NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
NuMuon adds a nuclear-norm constraint to Muon updates, boosting weight compressibility and post-compression quality in billion-parameter LLMs while preserving convergence.
Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 1 on Hugging Face
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.