Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

gemma4_unified_assistant

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: gemma4_unified_assistant

google/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated 22 days ago • 106k • 104

mlx-community/gemma-4-12B-it-assistant-bf16

Any-to-Any • 0.4B • Updated Jun 3 • 710 • 5

mlx-community/gemma-4-12B-it-assistant-4bit

Any-to-Any • 66.1M • Updated Jun 3 • 392 • 2

mlx-community/gemma-4-12B-it-assistant-5bit

Any-to-Any • 79.3M • Updated Jun 3 • 28

mlx-community/gemma-4-12B-it-assistant-6bit

Any-to-Any • 92.5M • Updated Jun 3 • 87 • 1

mlx-community/gemma-4-12B-it-assistant-8bit

Any-to-Any • 0.1B • Updated Jun 3 • 181 • 1

mlx-community/gemma-4-12B-it-assistant-nvfp4

Any-to-Any • 0.1B • Updated Jun 3 • 71 • 1

mlx-community/gemma-4-12B-it-assistant-mxfp4

Any-to-Any • 79.3M • Updated Jun 3 • 81 • 1

mlx-community/gemma-4-12B-it-assistant-mxfp8

Any-to-Any • 0.1B • Updated Jun 3 • 56 • 1

agentmish/gemma-4-12B-it-assistant-mlx-bf16

0.4B • Updated Jun 3 • 40

ekryski/gemma-4-12B-it-assistant-mlx-4bit

0.3B • Updated Jun 3 • 18

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated Jun 3 • 84 • 2

YuCollection/gemma-4-12B-it-assistant-bf16

Any-to-Any • 0.4B • Updated Jun 4 • 4

google/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated 17 days ago • 101k • 22

senapati484/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated Jun 5 • 6

mlx-community/gemma-4-12B-it-qat-assistant-4bit

Text Generation • 66.1M • Updated Jun 5 • 1.41k • 3

mlx-community/gemma-4-12B-it-qat-assistant-5bit

Text Generation • 79.3M • Updated Jun 5 • 72

mlx-community/gemma-4-12B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 152

mlx-community/gemma-4-12B-it-qat-assistant-6bit

Text Generation • 92.5M • Updated Jun 5 • 72

mlx-community/gemma-4-12B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated Jun 5 • 159

mlx-community/gemma-4-12B-it-qat-assistant-mxfp4

Text Generation • 79.3M • Updated Jun 5 • 110

mlx-community/gemma-4-12B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated Jun 5 • 92

mlx-community/gemma-4-12B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 102

Frniez/gemma-4-12B-it-assistant

Any-to-Any • 0.4B • Updated Jun 6 • 4 • 1

brainworkup/gemma-4-12B-it-assistant-oQ8

0.1B • Updated Jun 6 • 78 • 2

cwfgpt/gemma-4-12B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 0.4B • Updated Jun 7 • 5

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 866 • 1

skilledu/gemma-4-12B-it-assistant-base

Any-to-Any • 0.4B • Updated Jun 8 • 5

tepirale/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-assistant-safetensors-yuxinlu1

Image-Text-to-Text • 0.4B • Updated Jun 23 • 37 • 3

tepirale/gemma-4-12B-coder-fable5-composer2.5-v1-assistant-safetensors-yuxinlu1

Image-Text-to-Text • 0.4B • Updated Jun 23 • 7