# Error when finetuning pretrained huggingface conv-ai chatbot model

**URL:** <https://discuss.huggingface.co/t/error-when-finetuning-pretrained-huggingface-conv-ai-chatbot-model/5490>\
**Category:** 🤗Transformers\
**Created:** [April 14, 2021, 9:18am UTC](https://discuss.huggingface.co/t/error-when-finetuning-pretrained-huggingface-conv-ai-chatbot-model/5490 "2021-04-14T09:18:06Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mattmatura](https://avatars.discourse-cdn.com/v4/letter/m/ecd19e/32.png) [@mattmatura](https://discuss.huggingface.co/u/mattmatura)\
**Post date:** [April 14, 2021, 9:18am UTC](https://discuss.huggingface.co/t/error-when-finetuning-pretrained-huggingface-conv-ai-chatbot-model/5490/1 "2021-04-14T09:18:06Z")

</div>

I’ve been trying to train the model using my own custom dataset, but the kernel terminates the process just before running the first epoch. The same thing happens on both my local machine, and on Google colab.  
The code I run is: _ **! python train.py --dataset\_path counsel\_chat\_250-tokens\_full.json --gradient\_accumulation\_steps=4 --lm\_coef=2.0 --max\_history=1 --n\_epochs=3 --num\_candidates=4 --train\_batch\_size=2** _

 ![kilt](https://us1.discourse-cdn.com/hellohellohello/original/2X/9/922f75d9ac189ecb678935b6f5ec21911e1a11c0.png)

---

<div class="post-metadata">

**Author:** ![mattmatura](https://avatars.discourse-cdn.com/v4/letter/m/ecd19e/32.png) [@mattmatura](https://discuss.huggingface.co/u/mattmatura)\
**Post date:** [April 14, 2021, 9:57am UTC](https://discuss.huggingface.co/t/error-when-finetuning-pretrained-huggingface-conv-ai-chatbot-model/5490/2 "2021-04-14T09:57:19Z")

</div>

@julien-c any thoughts?

---

<div class="post-metadata">

**Author:** ![julien-c](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/julien-c/32/41937_2.png) [@julien-c](https://discuss.huggingface.co/u/julien-c)\
**Post date:** [April 19, 2021, 11:24pm UTC](https://discuss.huggingface.co/t/error-when-finetuning-pretrained-huggingface-conv-ai-chatbot-model/5490/3 "2021-04-19T23:24:44Z")

</div>

No sorry 😕

To be honest that code is pretty ancient now.
