# LoadDataSet pyarrow.lib.ArrowCapacityError

**URL:** <https://discuss.huggingface.co/t/loaddataset-pyarrow-lib-arrowcapacityerror/135328>\
**Category:** 🤗Datasets\
**Created:** [January 12, 2025, 4:14am UTC](https://discuss.huggingface.co/t/loaddataset-pyarrow-lib-arrowcapacityerror/135328 "2025-01-12T04:14:59Z")\
**Posts on this page:** 1\
**Showing post:** 3

<div class="post-metadata">

**Author:** ![Dammond](https://avatars.discourse-cdn.com/v4/letter/d/c37758/32.png) [@Dammond](https://discuss.huggingface.co/u/Dammond)\
**Post date:** [January 12, 2025, 4:59am UTC](https://discuss.huggingface.co/t/loaddataset-pyarrow-lib-arrowcapacityerror/135328/3 "2025-01-12T04:59:33Z")

</div>

Yes, I have seen similar posts with the same issue:

> [Minhash Deduplication - #11 by conceptofmind](https://discuss.huggingface.co/t/minhash-deduplication/19992/11)

But I tried this method and it didn’t solve the error.  
May I ask if there is any way you can help me solve this problem?  
Thank you!

---

_[View the full topic](https://discuss.huggingface.co/t/loaddataset-pyarrow-lib-arrowcapacityerror/135328)._