# Recommended models for sequence classification on toy synthetic datasets

**URL:** <https://discuss.huggingface.co/t/recommended-models-for-sequence-classification-on-toy-synthetic-datasets/92002>\
**Category:** 🤗Transformers\
**Created:** [June 13, 2024, 1:44pm UTC](https://discuss.huggingface.co/t/recommended-models-for-sequence-classification-on-toy-synthetic-datasets/92002 "2024-06-13T13:44:45Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![rotentomato](https://avatars.discourse-cdn.com/v4/letter/r/cdc98d/32.png) [@rotentomato](https://discuss.huggingface.co/u/rotentomato)\
**Post date:** [June 13, 2024, 1:44pm UTC](https://discuss.huggingface.co/t/recommended-models-for-sequence-classification-on-toy-synthetic-datasets/92002/1 "2024-06-13T13:44:45Z")

</div>

I have a couple of synthetically generated tasks e.g., addition, subtraction etc.  
I have tried different models so far but nothing seems to work, meaning solving the actual task.

Can you suggest what would be the bests model for these kind of tasks?  
I have tried pretty much everything I could think of but most of of the models seem to not work (apart from one or two)

Can I use models for sequence classification for these tasks and if so could you provide a simple minimal working example?

---

<div class="post-metadata">

**Author:** ![MattiLinnanvuori](https://avatars.discourse-cdn.com/v4/letter/m/ec9cab/32.png) [@MattiLinnanvuori](https://discuss.huggingface.co/u/MattiLinnanvuori)\
**Post date:** [June 15, 2024, 10:13am UTC](https://discuss.huggingface.co/t/recommended-models-for-sequence-classification-on-toy-synthetic-datasets/92002/2 "2024-06-15T10:13:26Z")

</div>

Can you describe your task and language more precisely? Sequence classification can work to some extent to classify something. For a working example of sequence classification, see the following link. [Text classification](https://huggingface.co/docs/transformers/tasks/sequence_classification)
