# Position Embedding error in HuggingFace

**URL:** <https://discuss.huggingface.co/t/position-embedding-error-in-huggingface/55833>\
**Category:** Intermediate\
**Created:** [September 21, 2023, 7:35am UTC](https://discuss.huggingface.co/t/position-embedding-error-in-huggingface/55833 "2023-09-21T07:35:30Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![tensorgirl](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/tensorgirl/32/19678_2.png) [@tensorgirl](https://discuss.huggingface.co/u/tensorgirl)\
**Post date:** [September 21, 2023, 7:35am UTC](https://discuss.huggingface.co/t/position-embedding-error-in-huggingface/55833/1 "2023-09-21T07:35:30Z")

</div>

![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/9/d/9d71d71b2abb90fb37996c952ab83bc9594e51c3.jpeg)

this variable is position embedding which is getting initialised as 1,50,128 but is reading the weights of cls\_token which is 1,1,128

---

<div class="post-metadata">

**Author:** ![tensorgirl](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/tensorgirl/32/19678_2.png) [@tensorgirl](https://discuss.huggingface.co/u/tensorgirl)\
**Post date:** [September 21, 2023, 7:36am UTC](https://discuss.huggingface.co/t/position-embedding-error-in-huggingface/55833/2 "2023-09-21T07:36:13Z")

</div>

![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/a/b/ab7236bd4528b10cebcd41b549fe0fd05ee74f9b.png)