This model was converted to MLX format from Qwen/Qwen3.5-2B using mlx-vlm version 0.3.12.

Conversion Command

$ uv run mlx_vlm.convert --hf-path Qwen/Qwen3.5-2B --mlx-path Qwen3.5-2B-mlx-vlm-nvfp4 -q --q-mode nvfp4 --q-group-size 16

uv dependencies

dependencies = ["mlx-lm==0.30.7", "mlx-vlm==0.3.12", "torchvision>=0.25.0"]

Downloads last month
78
Safetensors
Model size
0.8B params
Tensor type
U8
·
U32
·
BF16
·
F32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for RepublicOfKorokke/Qwen3.5-2B-mlx-vlm-nvfp4

Finetuned
Qwen/Qwen3.5-2B
Quantized
(76)
this model

Collection including RepublicOfKorokke/Qwen3.5-2B-mlx-vlm-nvfp4