Models

Intel/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound

Text Generation • Updated Sep 18 • 592 • 31

OPEA/DeepSeek-R1-int2-mixed-sym-inc

59B • Updated Jul 11 • 32 • 11

Intel/Qwen3-30B-A3B-Instruct-2507-int4-AutoRound

0.6B • Updated Sep 17 • 412 • 7

Intel/Qwen3-Coder-30B-A3B-Instruct-int4-AutoRound

0.6B • Updated Aug 4 • 904 • 4

Intel/Qwen3-30B-A3B-Thinking-2507-int4-AutoRound

0.6B • Updated Sep 19 • 109 • 11

TomoroAI/tomoro-ai-colqwen3-embed-4b-awq

Visual Document Retrieval • 1B • Updated 2 days ago • 22 • 1

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.3B • Updated Jan 4 • 15

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-asym

Text Generation • 0.3B • Updated Jan 4 • 12

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 2B • Updated Jan 4 • 7

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 2B • Updated Jan 4 • 6

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30 • 21 • 1

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

6B • Updated Apr 30 • 16 • 1

OPEA/Qwen2.5-14B-Instruct-int4-sym-inc

3B • Updated Apr 30 • 11

OPEA/Meta-Llama-3.1-8B-Instruct-int4-sym-inc

2B • Updated Jun 5 • 105

OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc

3B • Updated Jun 5 • 20 • 1

OPEA/Phi-3.5-vision-instruct-int4-sym-inc

Updated Apr 30 • 15

OPEA/Qwen2.5-7B-Instruct-int4-sym-inc

2B • Updated Apr 30 • 17 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

3B • Updated Jun 5 • 1.77k • 2

OPEA/llava-v1.5-7b-int4-sym-inc

1B • Updated Jul 18 • 26 • 1

OPEA/Qwen2.5-72B-Instruct-int4-sym-inc

12B • Updated Apr 30 • 12 • 1

OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc

14B • Updated Jul 18 • 29

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated Sep 11 • 6.17k

OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc

0.4B • Updated Sep 23 • 523

OPEA/Qwen2.5-3B-Instruct-int4-sym-inc

0.7B • Updated Apr 30 • 10

OPEA/QwQ-32B-Preview-int4-sym-mixed-inc

6B • Updated Apr 30 • 16 • 8

OPEA/glm-4-9b-chat-int4-sym-inc

2B • Updated Apr 30 • 24

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 11 • 1

OPEA/glm-4-9b-chat-int4-sym-lm-head-inc

2B • Updated Apr 30 • 8

OPEA/internlm2_5-7b-chat-int4-sym-inc

2B • Updated Apr 30 • 10

OPEA/Marco-o1-int4-sym-inc

2B • Updated Apr 30 • 14