Inference Providers
Active filters: 2-bit
Text Generation
• Updated • 305
• 4
kgrabko/JiRackTernary_70b
Text Generation
• Updated • 279
• 3
kgrabko/JiRackTernary_405b
Text Generation
• 108B • Updated • 270
• 3
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 108k
• 7
Text Generation
• 15B • Updated • 109k
• 7
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
• 24B • Updated • 111k
• 10
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
• 2B • Updated • 167k
• 7
BitDistiller/Qwen-8B-w2g64-gptq
8B • Updated • 55
• 1
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 113k
• 2
MaziyarPanahi/LFM2-24B-A2B-GGUF
Text Generation
• 24B • Updated • 506
• 2
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 8
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 7
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 3
Text Generation
• 0.1B • Updated • 11
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 4
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 2
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 783
Text Generation
• 3B • Updated • 201
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 206
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 87
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 219
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 176
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 65
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 121
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 115
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 110
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 131
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 63
• 1