jabbatheduck
/

ninfer-ext-models

Image-Text-to-Text

Mixture of Experts

text-generation

speculative-decoding

Model card Files Files and versions

ninfer-ext-models

414 GB

Ctrl+K

Ctrl+K

1 contributor

History: 51 commits

jabbatheduck's picture

Upload nemotron-h-74b-nvfp4-draft/nemotron_h_74b_nvfp4_draft.ninfer.conversion.json with huggingface_hub

8008464 verified 2 days ago

gemma4-26b-a4b-qat
Refresh measured numbers: repo-protocol perplexity and the same-session MTP sweep 6 days ago
gemma4-31b-it-m1
Upload gemma4-31b-it-m1/gemma4_31b_it_m1.ninfer.conversion.json with huggingface_hub 9 days ago
nemotron-h-74b-nvfp4-draft
Upload nemotron-h-74b-nvfp4-draft/nemotron_h_74b_nvfp4_draft.ninfer.conversion.json with huggingface_hub 2 days ago
qwen3.6-35b-a3b-nvfp4
Upload folder using huggingface_hub 12 days ago
qwen3.8-flash-next-exl3-3p5bpw
Add qwen3.8-flash-next-exl3-3p5bpw (EXL3 routed experts, Text + MTP) 14 days ago
qwen3.8-flash-next-exl3-4bpw
Add qwen3.8-flash-next-exl3-4bpw (EXL3 routed experts, Text + MTP) 14 days ago
qwen3.8-flash-next
Qwen3.8-Flash-Next: label prefill with ngram residency; note mapped is ~1.7x faster 17 days ago
.gitattributes

3.06 kB
Upload nemotron-h-74b-nvfp4-draft/nemotron_h_74b_nvfp4_draft.ninfer with huggingface_hub 2 days ago
README.md

11.6 kB
Upload README.md with huggingface_hub 2 days ago
qwen3_8_27b_exl3_3p5bpw.ninfer

15.3 GB
xet

Rebuild with the indexed draft head and the fork chat template 20 days ago
qwen3_8_27b_exl3_3p5bpw.ninfer.conversion.json

491 kB
Rebuild with the indexed draft head and the fork chat template 20 days ago
qwen3_8_27b_exl3_4bpw.ninfer
16.8 GB
xet

Rebuild with the indexed draft head and the fork chat template 20 days ago
qwen3_8_27b_exl3_4bpw.ninfer.conversion.json

491 kB
Rebuild with the indexed draft head and the fork chat template 20 days ago