Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

EXL2 quants for Aqueducts 18B - https://huggingface.co/MarsupialAI/Aqueducts-18B

Downloads last month
12
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Clevyby/Aqueducts4.5

Quantized
(21)
this model