Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

154

Base only

Active filters: lm-studio

ermiaazarkhalili/Llama-3.1-8B-Instruct_Function_Calling_xLAM-GGUF

8B • Updated Apr 18 • 16

ermiaazarkhalili/Llama-3-8B-Instruct_Function_Calling_xLAM-GGUF

8B • Updated Apr 18 • 15

ermiaazarkhalili/Qwen2.5-7B-SFT-Capybara-GGUF

8B • Updated Apr 18 • 7

ermiaazarkhalili/qwen2.5-7b-instruct-trl-sft-ChartQA-GGUF

8B • Updated Apr 18 • 36

continuum-ai/mixtral-8x7b-instruct-compacted-conservative

Text Generation • 35B • Updated Apr 11 • 660

vanch007/Huihui-gemma-4-26B-A4B-it-abliterated-mlx-8bit

Image-Text-to-Text • 8B • Updated Apr 12 • 317

vanch007/Huihui-gemma-4-26B-A4B-it-abliterated-mlx-bf16

Image-Text-to-Text • 26B • Updated Apr 12 • 342 • 1

vanch007/Huihui-gemma-4-26B-A4B-it-abliterated-mlx-4bit

Image-Text-to-Text • 5B • Updated Apr 12 • 1.56k • 3

JimmyBhoy/karpathy-qwen3-0.6b-hq-gguf

0.6B • Updated Apr 11 • 33

ermiaazarkhalili/granite-4.0-micro-GRPO-NuminaMath-100K-GGUF

Text Generation • Updated Apr 18

ermiaazarkhalili/Qwen2.5-3B-GRPO-NuminaMath-100K-GGUF

Text Generation • Updated Apr 18

Freenixi/AxionML-Qwen3.5-27B-NVFP4-GGUF

27B • Updated Apr 13 • 138 • 1

Auroraventures/cipher-sft-merged-Q4_K_M-GGUF

Text Generation • 31B • Updated Apr 18 • 5

Freenixi/AxionML-Qwen3.5-9B-NVFP4-GGUF

9B • Updated Apr 16 • 1.31k • 1

Outlier-Ai/Outlier-Lite-7B-GGUF

Text Generation • 8B • Updated 25 days ago • 278

Outlier-Ai/Outlier-Compact-14B-GGUF

Text Generation • 15B • Updated 25 days ago • 288 • 1

Outlier-Ai/Outlier-Max-32B-GGUF

Text Generation • 33B • Updated 25 days ago • 286 • 1

vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16

Image-Text-to-Text • 35B • Updated Apr 20 • 272

vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-8bit

Image-Text-to-Text • 10B • Updated Apr 20 • 235

vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-4bit

Image-Text-to-Text • 6B • Updated Apr 20 • 580 • 1

PCS1626/gemma4-legal-model-gguf

Text Generation • 5B • Updated Apr 21 • 166 • 1

PCS1626/gemma4-legalmind-model-GGUF

Text Generation • 5B • Updated Apr 21 • 41

thanhhoangnvbg/empathAI-llama3.1-8b

Text Generation • 8B • Updated 2 days ago • 1.85k • • 2

jodagreyhame/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-nvfp4

Image-Text-to-Text • 9B • Updated Apr 22 • 401

hitonet/hito-2b-GGUF

Text Generation • 2B • Updated Apr 22 • 92

steve-nguyen/aai-accountant-tt133-v1.1-GGUF

4B • Updated Apr 24 • 36

Freenixi/Abiray-Qwen3.6-27B-NVFP4-GGUF

Image-Text-to-Text • 27B • Updated Apr 24 • 8.81k • 17

henrique-simoes/gemma-4-e2b-it-istara-ux-research-GGUF

Text Generation • 5B • Updated Apr 25 • 101

henrique-simoes/gemma-4-e2b-it-istara-ux-research-MLX-F16

Text Generation • 5B • Updated Apr 25 • 95 • 1

henrique-simoes/gemma-4-e2b-it-istara-ux-research-MLX-4bit

Text Generation • 0.7B • Updated Apr 25 • 40