Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

840

Base only

Active filters: ggml

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 4 days ago • 1.22k • 68

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 277k • 532

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 97.6k • 286

remixerdec/Inflect-Micro-v2-GGUF

Text-to-Speech • 9.34M • Updated 1 day ago • 140 • 4

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 16.2k • 79

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 40.7k • 82

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 46.7k • 42

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 86.6k • 29

remixerdec/Inflect-Nano-v2-GGUF

Text-to-Speech • 3.96M • Updated 1 day ago • 142 • 3

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 12.5k • 61

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 157k • 186

cstr/qwen3-tts-0.6b-customvoice-GGUF

Text-to-Speech • 0.9B • Updated May 1 • 1.3k • 3

cstr/m2m100-418m-GGUF

Translation • 0.5B • Updated 25 days ago • 701 • 2

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 5.54k • 11

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.3k • 10

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated about 14 hours ago • 17.4k • 5

sujithatz/ggml-whisper-medium-ml

Updated Oct 3, 2025 • 2

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 48.5k • 238

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 10.8k • 186

richiejp/deepvqe-aec-gguf

Audio-to-Audio • 7.97M • Updated Apr 27 • 195 • 3

cstr/canary-ctc-aligner-GGUF

Automatic Speech Recognition • 0.6B • Updated 16 days ago • 2.84k • 2

cstr/qwen3-forced-aligner-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Apr 11 • 2.05k • 4

cstr/pyannote-v3-segmentation-GGUF

Voice Activity Detection • 1.49M • Updated Apr 12 • 160 • 1

LocalAI-io/LocalVQE

Audio-to-Audio • 578k • Updated Jun 22 • 6.38k • 63

cstr/vibevoice-asr-GGUF

Automatic Speech Recognition • 8B • Updated 26 days ago • 5.93k • 6

cstr/omniASR-CTC-300M-v2-GGUF

Automatic Speech Recognition • 0.3B • Updated Apr 26 • 147 • 1

cstr/qwen3-tts-tokenizer-12hz-GGUF

Audio-to-Audio • 0.2B • Updated Apr 29 • 3.32k • 3

cstr/kokoro-voices-GGUF

Text-to-Speech • 131k • Updated May 1 • 3.21k • 2

cstr/kokoro-82m-GGUF

Text-to-Speech • 81.7M • Updated May 1 • 2.55k • 1

cstr/qwen3-tts-1.7b-voicedesign-GGUF

Text-to-Speech • 2B • Updated May 1 • 2.67k • 2