Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,900

Base only

Active filters: 2-bit

PocketAiHub/Qwen3.8-27B-Abliterated-MLX

Image-Text-to-Text • Updated 4 days ago • 109

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 537k • • 1.22k

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 16 days ago • 337k • 156

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 4 days ago • 1.58M • 455

mlx-community/DeepSeek-V4-Flash-0731-2.4bit-mixed

Text Generation • 26B • Updated 14 days ago • 6.94k • 24

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated Jul 14 • 1.7M • 179

PocketAiHub/Qwen3.8-27B-MLX

Image-Text-to-Text • Updated 4 days ago • 4 • 6

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 15 days ago • 21.2k • 29

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated 4 days ago • 2.49k • 5

Intel/Qwen3.8-27B-bpw2.8-AutoRound

5B • Updated about 4 hours ago • 4

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 322k • 128

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated 10 days ago • 7.52k • 253

mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit

Text Generation • 26B • Updated 4 days ago • 4.01k • 6

stamsam/maple-preview-gguf

Text Generation • 20B • Updated 13 days ago • 14.8k • 13

Vontra/Ling-3.0-flash-oQ2

Text Generation • 12B • Updated 8 days ago • 491 • 2

Vontra/Qwen3.8-27B-oQ2

Image-Text-to-Text • 3B • Updated 5 days ago • 880 • 2

lukaskremla/Qwen3.8-27B-2bit-MLX-TextOnly

Text Generation • 3B • Updated 5 days ago • 1.92k • 2

MaziyarPanahi/mamba-gpt-7b-v2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 27, 2024 • 390 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • 1B • Updated Sep 4, 2024 • 180k • 20

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • 9B • Updated Sep 4, 2024 • 179k • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-abliterated-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 2.88k • 3

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 187k • 20

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 306k • 14

MaziyarPanahi/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 301k • 11

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 346k • 8

pipenetwork/Hy3-2bit

Text Generation • 295B • Updated Jul 7 • 160 • 3

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated about 1 month ago • 17

mlx-works/Ornith-1.0-35B-oQ2

4B • Updated 24 days ago • 781 • 2

mlx-community/Laguna-S-2.1-oQ2e-fast

Text Generation • 10B • Updated 27 days ago • 4.35k • 11

apetersson/DeepSeek-V4-Flash-0731-Abliterated-MLX-Mixed-2bit-3bit-g64

Text Generation • 32B • Updated 19 days ago • 2.44k • 1