ostris
/

Flex.1-alpha

Model card Files Files and versions

Add fp8 and GGUF if possible for us poor hw guys

#1

by ryg81 - opened Jan 19, 2025

Add fp8 and GGUF if possible for us poor hw guys

https://huggingface.co/Clybius/Flex.1-alpha-Q4_K_M-GGUF

I tested this and it works quite well - am positively surprised actually :)

Adding other quants: https://huggingface.co/hum-ma/Flex.1-alpha-GGUF

adding Fp8 in safetensors format https://huggingface.co/gmonsoon/Flex.1-alpha-Fp8

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment