# ViT Model increasing CPU RAM when moving to GPU

**URL:** <https://discuss.huggingface.co/t/vit-model-increasing-cpu-ram-when-moving-to-gpu/21579>\
**Category:** 🤗Transformers\
**Created:** [August 12, 2022, 8:01pm UTC](https://discuss.huggingface.co/t/vit-model-increasing-cpu-ram-when-moving-to-gpu/21579 "2022-08-12T20:01:00Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![benalex](https://avatars.discourse-cdn.com/v4/letter/b/e47774/32.png) [@benalex](https://discuss.huggingface.co/u/benalex)\
**Post date:** [August 12, 2022, 8:01pm UTC](https://discuss.huggingface.co/t/vit-model-increasing-cpu-ram-when-moving-to-gpu/21579/1 "2022-08-12T20:01:00Z")

</div>

Hi,

Unlike with a classical torch.nn.Module, moving a freshly initialized ViTModel to GPU increases CPU RAM by the same amount.  
Anyone know a fix?