-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit
Text Generation
•
353B
•
Updated
•
883
•
16
Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32
Text-to-Image
•
Updated
•
21.4k
•
45
mlx-community/GLM-4.6V-Flash-4bit
Image-Text-to-Text
•
Updated
•
825
•
5
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
531k
•
41
QuantTrio/DeepSeek-V3.2-Speciale-AWQ
Text Generation
•
685B
•
Updated
•
149
•
5
huihui-ai/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-4bit
Text Generation
•
80B
•
Updated
•
1.74k
•
3
mlx-community/GLM-4.6V-4bit
Image-Text-to-Text
•
Updated
•
533
•
3
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
2B
•
Updated
•
171k
•
80
unsloth/Qwen2.5-Coder-7B-bnb-4bit
Text Generation
•
4B
•
Updated
•
14.4k
•
13
Qwen/Qwen2.5-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
8B
•
Updated
•
181k
•
95
gaunernst/gemma-3-12b-it-int4-awq
Image-Text-to-Text
•
12B
•
Updated
•
3.84k
•
22
IDEA-Research/Rex-Omni-AWQ
4B
•
Updated
•
1.95k
•
3
nightmedia/gpt-oss-120b-heretic-v2-mxfp4-q8-hi-mlx
Text Generation
•
117B
•
Updated
•
897
•
6
avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation
•
271B
•
Updated
•
241
•
2
MaziyarPanahi/Hermes-4.3-36B-GGUF
Text Generation
•
36B
•
Updated
•
17.4k
•
2
steampunque/Ministral-3-3B-Instruct-2512-Hybrid-GGUF
3B
•
Updated
•
146
•
2
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
•
9B
•
Updated
•
12.7k
•
2
TheBloke/Falcon-7B-Instruct-GPTQ
Text Generation
•
7B
•
Updated
•
135
•
68
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
33B
•
Updated
•
54.2k
•
591
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
7B
•
Updated
•
10.4k
•
267
TheBloke/Octocoder-GPTQ
Text Generation
•
16B
•
Updated
•
25
•
8
jxy/Tongyi-Finance-14B-Chat-Int4
Text Generation
•
Updated
•
12
•
2
TheBloke/saiga_mistral_7b-AWQ
Text Generation
•
7B
•
Updated
•
154
•
4
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
47B
•
Updated
•
345k
•
140
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
7B
•
Updated
•
31k
•
55
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
4B
•
Updated
•
10.9k
•
34
unsloth/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation
•
4B
•
Updated
•
534
•
7
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
5B
•
Updated
•
295k
•
89
MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
115k
•
40
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation
•
37B
•
Updated
•
6.08k
•
32