Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

text-generation-webui

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12

Base only

Active filters: text-generation-webui

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

NoirZangetsu/gemma-finetune-flutter-gguf-2

4B • Updated Apr 10, 2025 • 5

daniloreddy/gemma-3-1b-it_GGUF

Text Generation • 1.0B • Updated Mar 14 • 335

daniloreddy/gemma-3-270m-it_GGUF

Text Generation • 1.0B • Updated Mar 14 • 60 • 1

daniloreddy/gemma-3-4b-it_GGUF

Text Generation • 4B • Updated Mar 14 • 73

daniloreddy/Qwen3.5-0.8B_GGUF

Text Generation • 0.8B • Updated Mar 14 • 83

daniloreddy/Qwen3.5-2B_GGUF

Text Generation • 2B • Updated Mar 14 • 151 • 1

daniloreddy/Qwen3.5-4B_GGUF

Text Generation • 4B • Updated Mar 14 • 116

daniloreddy/Qwen3.5-9B_GGUF

Text Generation • 9B • Updated Mar 14 • 249 • 3

daniloreddy/DeepSeek-Coder-V2-Lite-Instruct_GGUF

Text Generation • 16B • Updated Mar 16 • 275 • 1

daniloreddy/gemma-4-E2B-it_GGUF

Text Generation • 5B • Updated Apr 5 • 1.11k

daniloreddy/gemma-4-E4B-it_GGUF

Text Generation • 8B • Updated Apr 5 • 157