@KingNish on Hugging Face: "I tested Muon vs MuonClip vs Muon+AdamW for fine-tuning LLMs Just published a…"

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

KingNish

posted an update 29 days ago

Post

2489

I tested Muon vs MuonClip vs Muon+AdamW for fine-tuning LLMs
Just published a blog on that, Read here 👉 https://huggingface.co/blog/KingNish/optimizer-part1

Xetro

29 days ago

Superb 🔥

In this post