Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,820

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 9 days ago • 649k • • 1.06k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 10 days ago • 2.26M • 654

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 13 days ago • 39.7k • 184

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 1 day ago • 7.47k • 48

Cactus-Compute/needle

30.4M • Updated 14 days ago • 1.33k • 313

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 13 days ago • 31.6k • 152

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 595k • 1.01k

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 1 day ago • 875 • 32

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 1 day ago • 1.49k • 29

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 37.2k • 894

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated 1 day ago • 1.22k • 24

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated 1 day ago • 473 • 24

FINAL-Bench/POCKET-Image-Zimage

Text-to-Image • Updated 1 day ago • 24

runanywhere/silero-vad-v5

Voice Activity Detection • Updated Feb 13 • 6

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 21.9k • 231

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 6.86k • 39

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 101k • 127

mihuai/turkish-stt

Automatic Speech Recognition • Updated 5 days ago • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 54.8k • 759

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 22.3k • 120

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 387 • 4

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated Jun 26 • 399 • 13

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 32.1k • 82

prism-ml/Ternary-Bonsai-1.7B-mlx-2bit

Text Generation • 0.1B • Updated Apr 18 • 1.76k • 18

DuoNeural/Gemma-4-Abliterated-LiteRT

Text Generation • Updated May 1 • 10

PeppX/gemma-4-e2b-uncensored-litertlm

Updated 10 days ago • 2.71k • 12

openbmb/MiniCPM5-1B-SFT

Text Generation • 1B • Updated May 25 • 12.7k • 38

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 2.91k • 87

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 96k • 213

Aatricks/bonsai-image-ternary-4B-FLUX2-klein-GGUF

Text-to-Image • 4B • Updated Jun 3 • 607 • 7