Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

156

Base only

Active filters: ik_llama.cpp

ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

Text Generation • 672B • Updated Jul 11, 2025 • 28 • 6

NexesQuants/gghfez_Writer-Large-2411-iMat-IKL-CQ-GGUF

123B • Updated Jul 31, 2025 • 59

ubergarm/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated Jul 22, 2025 • 449 • 22

tachyphylaxis/DeepSeek-R1-0528-IK_GGUF

671B • Updated Jul 17, 2025 • 2

tachyphylaxis/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 18, 2025 • 17

ubergarm/Qwen3-235B-A22B-Instruct-2507-GGUF

Text Generation • 235B • Updated Jul 27, 2025 • 83 • 17

ubergarm/Qwen3-Coder-480B-A35B-Instruct-GGUF

Text Generation • 480B • Updated Aug 28, 2025 • 130 • 17

ubergarm/Qwen3-235B-A22B-Thinking-2507-GGUF

Text Generation • 235B • Updated Jul 27, 2025 • 55 • 10

gghfez/DeepSeek-V3-0324-IQ3_KS

Text Generation • 672B • Updated Jul 26, 2025 • 18 • 2

gghfez/DeepSeek-R1-Zero-IQ2_KS

Text Generation • 672B • Updated Oct 19, 2025 • 16

gghfez/DeepSeek-R1-Zero-IQ3_KS

Text Generation • 672B • Updated Oct 19, 2025 • 14

sokann/Qwen3-Coder-480B-A35B-Instruct-GGUF

480B • Updated Jul 29, 2025 • 18

gghfez/DeepSeek-V3-0324-IQ2_KS

Text Generation • 672B • Updated Oct 18, 2025 • 39

ubergarm/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Jul 30, 2025 • 45 • 14

ubergarm/Qwen3-30B-A3B-Thinking-2507-GGUF

Text Generation • 31B • Updated Jul 30, 2025 • 95 • 11

sokann/DeepSeek-V3-0324-GGUF

672B • Updated Jul 31, 2025 • 4

ubergarm/Qwen3-Coder-30B-A3B-Instruct-GGUF

Text Generation • 31B • Updated Aug 28, 2025 • 197 • 11

ubergarm/GLM-4.5-GGUF

Text Generation • 358B • Updated Aug 28, 2025 • 22 • 21

ubergarm/GLM-4.5-Air-GGUF

Text Generation • 110B • Updated Aug 8, 2025 • 157 • 33

Mawdistical/Anthrobomination-70B-IK-GGUF

Text Generation • 71B • Updated Aug 4, 2025 • 28 • 2

lmganon123/DeepSeek-V3-0324_IK_GGUF_Q2

672B • Updated Aug 17, 2025 • 3

lmganon123/DeepSeek-R1_IK_GGUF_Q2

672B • Updated Aug 24, 2025 • 36

gghfez/DeepSeek-V3.1-Base-IQ2_KS

672B • Updated Aug 21, 2025 • 21

gghfez/DeepSeek-V3.1-IQ2_KS

Text Generation • 672B • Updated Aug 22, 2025 • 17

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • 671B • Updated Aug 24, 2025 • 241 • 15

lmganon123/DeepSeek-V3.1-Base_IK_GGUF_Q2

672B • Updated Aug 25, 2025 • 5 • 1

anikifoss/DeepSeek-V3.1-HQ4_K

Text Generation • 671B • Updated Nov 27, 2025 • 12 • 2

ubergarm/Kimi-K2-Instruct-0905-GGUF

Text Generation • 1T • Updated Sep 8, 2025 • 105 • 16

Downtown-Case/GLM-4.5-Base-128GB-RAM-IQ2_KL-GGUF

Text Generation • 358B • Updated Sep 12, 2025 • 27 • 2

ubergarm/DeepSeek-V3.1-Terminus-GGUF

Text Generation • 671B • Updated Sep 26, 2025 • 43 • 9