Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29

Base only

Active filters: magicquant

magiccodingman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated Aug 21 • 2.1k • 14

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 87 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 401 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 218 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 317 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 228 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 741 • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 126 • 2

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-v2-GGUF

Text Generation • 4B • Updated May 26 • 249 • 1

magiccodingman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 537 • 6

magiccodingman/Qwen3.6-35B-A3B-Uncensored-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 747 • 5

magiccodingman/Qwen3.6-27B-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 821 • 4

magiccodingman/Qwen3.6-27B-Uncensored-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 887 • 4

lmcoleman/ThinkingCap-Qwen3.6-27B-MagicQuant-GGUF

Text Generation • 27B • Updated Aug 20 • 777 • 6

lmcoleman/ThinkingCap-Qwen3.6-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated Aug 3 • 131 • 7

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-MagicQuant-GGUF

Text Generation • 0.5B • Updated Aug 20 • 1.04k • 1

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-ROCmFPX-GGUF

Text Generation • 0.5B • Updated Aug 7 • 311 • 5

lmcoleman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 36B • Updated Aug 20 • 314

lmcoleman/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated Aug 1 • 35

lmcoleman/Qwen3.6-35B-A3B-BUDGET-GGUF

Text Generation • 36B • Updated Aug 20 • 170 • 1

spotapovadm/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated Aug 11 • 40 • 1

lmcoleman/Muse-Glimmer-30B-MagicQuant-GGUF

Text Generation • 28B • Updated Aug 20 • 280

lmcoleman/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MagicQuant-GGUF

33B • Updated Aug 20 • 333

lmcoleman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated Aug 20 • 649 • 3

lmcoleman/Qwen3.8-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated Aug 16 • 563 • 7

lmcoleman/Ornith-1.5-35B-A3B-MagicQuant-GGUF

Image-Text-to-Text • 36B • Updated 14 days ago • 950

lmcoleman/Ornith-1.5-35B-A3B-ROCmFPX-GGUF

Image-Text-to-Text • 36B • Updated Aug 22 • 147

magiccodingman/Qwen3.8-27B-MXFP4-MagicQuant-GGUF

Image-Text-to-Text • 27B • Updated Aug 26 • 7.46k • 5

gearwave00001/Huihui-Qwen3.8-27B-Quark-MXFP4-MagicQuant-GGUF

Text Generation • 27B • Updated 3 days ago • 835