# Masked Language Modeling (MLM) using TFBertForMaskedLM (Tensorflow)

**URL:** <https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528>\
**Category:** 🤗Transformers\
**Created:** [July 29, 2020, 8:22pm UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528 "2020-07-29T20:22:51Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![ikarthikng](https://avatars.discourse-cdn.com/v4/letter/i/6de8d8/32.png) [@ikarthikng](https://discuss.huggingface.co/u/ikarthikng)\
**Post date:** [July 29, 2020, 8:22pm UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528/1 "2020-07-29T20:22:51Z")

</div>

Where can I find a complete example on how to fine tune a model using Tensorflow for TFBertForMaskedLM for custom text dataset using transformers and Tensorflow instead of PyTorch. I have an working example using PyTorch but I need an example with Tensorflow. Can someone guide me here?

---

<div class="post-metadata">

**Author:** ![timellemeet](https://avatars.discourse-cdn.com/v4/letter/t/4bbf92/32.png) [@timellemeet](https://discuss.huggingface.co/u/timellemeet)\
**Post date:** [November 12, 2020, 9:48am UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528/2 "2020-11-12T09:48:21Z")

</div>

Looking for the same thing! Have you found a good example by now?

---

<div class="post-metadata">

**Author:** ![ayalaall](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@ayalaall](https://discuss.huggingface.co/u/ayalaall)\
**Post date:** [January 19, 2021, 10:39am UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528/3 "2021-01-19T10:39:24Z")

</div>

Hi,

I am also looking for the same thing. Any luck finding more information about this?  
Thanks,  
Ayala

---

<div class="post-metadata">

**Author:** ![s4sarath](https://avatars.discourse-cdn.com/v4/letter/s/bc79bd/32.png) [@s4sarath](https://discuss.huggingface.co/u/s4sarath)\
**Post date:** [January 19, 2021, 3:34pm UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528/4 "2021-01-19T15:34:59Z")

</div>

You can create tf records using any data. Have a look at Bert official repo. Then pass tf records to TFBert. But yes it’s not straight forward as PyTorch.

---

<div class="post-metadata">

**Author:** ![ayalaall](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@ayalaall](https://discuss.huggingface.co/u/ayalaall)\
**Post date:** [January 21, 2021, 7:58am UTC](https://discuss.huggingface.co/t/masked-language-modeling-mlm-using-tfbertformaskedlm-tensorflow/528/5 "2021-01-21T07:58:24Z")

</div>

Thanks! I will take a look.