Hugging Face's logo

turboderp
/
Laguna-XS-2.1-exl3

exl3
Model card Files
xet
 Community
1

EXL3 quants of poolside/Laguna-XS-2.1

⚠️ Requires ExLlamaV3 v1.2.0 (or dev branch)

2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

qb_kld_vram qb_kld_spread_vram qb_kld_hist_combined

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Laguna-XS-2.1-exl3

Base model

poolside/Laguna-XS-2.1
Quantized
(34)
this model

Collection including turboderp/Laguna-XS-2.1-exl3