YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Flux Klein 9B in INT8 for 2x inference gains on 30-Series GPUs.
To be used with https://github.com/BobJohnson24/ComfyUI-Flux2-INT8
Comparison against FP8:
| FP8 | INT8 Prequantized (this repo) | INT8 dynamically loaded from bf16 |
|---|---|---|
 |
 |
 |
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support