Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

457

Base only

Active filters: quark

deep-principle/Hydrogen-1.0-MXFP4

Text Generation • 384B • Updated 9 days ago • 9.56k • 16

amd/Qwen3.8-27B-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated 7 days ago • 39.5k • 43

flechin/Qwen3.8-27B-Randean-MXFP4

Image-Text-to-Text • 16B • Updated about 21 hours ago • 44 • 3

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 476 • 9

amd/Qwen3.8-Flash-Next-Quark-MXFP4

Image-Text-to-Text • 119B • Updated about 16 hours ago • 13.7k • 6

amd/GLM-5.3-Flash-Quark-MXFP4

169B • Updated Sep 2 • 17.2k • 2

amd/GLM-5.3-Quark-MXFP4-AttnFP8

Text Generation • 384B • Updated 4 days ago • 8.13k • 5

amd/Muse-Spark-Open-816B-A42B-Quark-MXFP4

435B • Updated 4 days ago • 7.2k • 3

legion666/Huihui-Qwen3.8-27B-abliterated-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated Sep 27 • 317 • 2

AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-MXFP4-MXFP6-ROCm

Text Generation • 18B • Updated about 17 hours ago • 2

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 10

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 8

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 12

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 14

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 16

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 8

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 11

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 16

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 8

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 23

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 19

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 25

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 28

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 18

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 18

amd-quark/quark-legacy-int8

1.03M • Updated Dec 18, 2024 • 5

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jun 18 • 527

amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jun 18 • 218

EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym

Text Generation • 8B • Updated Jan 22, 2025 • 21

amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead

Text Generation • 2B • Updated Jan 30, 2025 • 34