unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 121k • 153
Gemma 4 QAT
Gemma 4 QAT (Quantization-Aware Training) for 3x less memory use and near original accuracy.
Note GGUFs to run:
-
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 87.5k • 107 -
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 45.6k • 55 -
unsloth/gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 35.5k • 40 -
unsloth/gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 20.1k • 30 -
unsloth/gemma-4-E2B-it-qat-mobile-GGUF
Any-to-Any • 5B • Updated • 9.01k • 11 -
unsloth/gemma-4-E4B-it-qat-mobile-GGUF
Any-to-Any • 7B • Updated • 12.6k • 12 -
unsloth/gemma-4-26B-A4B-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 324 • 2
unsloth/gemma-4-E2B-it-qat-q4_0-unquantized
Any-to-Any • 5B • Updated • 128 • 2Note BF16 Safetensor:
-
unsloth/gemma-4-E4B-it-qat-q4_0-unquantized
Any-to-Any • 8B • Updated • 325 • 2 -
unsloth/gemma-4-12B-it-qat-q4_0-unquantized
Any-to-Any • 12B • Updated • 1.62k • 4 -
unsloth/gemma-4-31B-it-qat-q4_0-unquantized
Image-Text-to-Text • 33B • Updated • 236 • 2 -
unsloth/gemma-4-E2B-it-qat-mobile
Any-to-Any • 2B • Updated • 155 • 2 -
unsloth/gemma-4-E4B-it-qat-mobile
Any-to-Any • 3B • Updated • 91 • 2 -
unsloth/gemma-4-E4B-it-qat-w4a16
Any-to-Any • 9B • Updated • 803 • 2 -
unsloth/gemma-4-E2B-it-qat-w4a16
Any-to-Any • 6B • Updated • 788 • 2