wenhua cheng

wenhuach's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q2ks-mixed-AutoRound 3 days ago

Thinking version has been deleted?

1

#2 opened 3 days ago by

reswewr

New activity in Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound 10 days ago

Improve model card: Add pipeline tag, library name, and update paper/citation

🔥 1

#1 opened 12 days ago by

nielsr

New activity in Intel/Qwen3-30B-A3B-Instruct-2507-gguf-q2ks-mixed-AutoRound 16 days ago

2507 Thinking model release

9

#4 opened 2 months ago by

anjeysapkovski

New activity in Intel/Magistral-Small-2509-int4-AutoRound about 1 month ago

Could we get more w2a16 w3a16 and w4a16 Autoround

👍 1

1

#1 opened about 1 month ago by

twhitworth

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound about 1 month ago

Practical performance feedback

1

#2 opened about 2 months ago by

maigonis

New activity in Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound about 2 months ago

Works good with vLLM, just no tool calling

1

#1 opened 4 months ago by

Ununnilium

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound about 2 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened about 2 months ago by

whoisjeremylam

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound 3 months ago

Adding `transformers` as the library tag

#3 opened 3 months ago by

ariG23498

CPU only?

4

#2 opened 3 months ago by

jujutechnology

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound 3 months ago

Error loading in vLLm 10.1+

👍 1

2

#2 opened 4 months ago by

freegheist

New activity in Intel/Qwen3-235B-A22B-q2ks-mixed-AutoRound 4 months ago

Could you please consider release a 2-bit GPTQ or AWQ model for vllm

3

#1 opened 4 months ago by

kq

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-gguf-q2ks-mixed-AutoRound 4 months ago

Bits for embedding / lm-head / non expert layers

1

#1 opened 4 months ago by

sokann

New activity in Intel/Qwen3-Coder-480B-A35B-Instruct-int4-mixed-AutoRound 4 months ago

Awesome Any Chance for this for GLM-4.5

2

#1 opened 4 months ago by

Fernanda24

New activity in Intel/Qwen3-235B-A22B-Thinking-2507-int4-AutoRound 5 months ago

Whats the difference between this and autoround_v0?

7

#1 opened 5 months ago by

pty819

New activity in huggingface/documentation-images 8 months ago

auto-round

#482 opened 8 months ago by

wenhuach

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 9 months ago

how to run this model

4

#1 opened 9 months ago by

cicdatopea

New activity in OPEA/glm-4-9b-chat-int4-sym-inc about 1 year ago

Update README.md

#1 opened about 1 year ago by

wenhuach

New activity in Intel/low_bit_open_llm_leaderboard over 1 year ago

Add support for AQLM

❤️ 2

3

#1 opened over 1 year ago by

BlackSamorez

New activity in 01-ai/Yi-6B-Chat over 1 year ago

Introducing AutoRound INT4 algorithm

4

#4 opened over 1 year ago by

wenhuach

commented a paper over 1 year ago

How Good Are Low-bit Quantized LLaMA3 Models? An Empirical Study

Paper • 2404.14047 • Published Apr 22, 2024 • 45 •

12