How to use numind/NuExtract3-mlx-4bits with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download numind/NuExtract3-mlx-4bits --local-dir NuExtract3-mlx-4bits
MLX quantized version of numind/NuExtract3.
numind/NuExtract3
affine
64
4
source/default
none
pip install -U mlx-vlm mlx_vlm.generate --model numind/NuExtract3-mlx-4bits --prompt "your prompt"
Chat template
Files info
4-bit
Base model