Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
KAT-V1-40B-GPTQ-Int4-Int8Mix
like
0
Follow
QuantTrio
161
Text Generation
Transformers
Safetensors
qwen2
AWQ
量化修复
vLLM
conversational
text-generation-inference
4-bit precision
gptq
arxiv:
2507.08297
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
KAT-V1-40B-GPTQ-Int4-Int8Mix
/
README.md
Commit History
Upload folder using huggingface_hub
12b36ba
verified
JunHowie
commited on
Jul 31, 2025