83%Must read
?Must readVote to see the score
The Hidden Power of Scaling Factor in LoRA Optimization
LoRA's scaling factor dominates optimization by amplifying task signals without increasing drift, outperforming learning rate adjustments. The optimal alpha follows a sublinear square-root law with rank, revealing insufficient scaling in existing heuristics. Proposed LoRA-alpha restores principled s
Paris Poster Session 5, Fri, Dec 11, 11:30 AM–1:30 PM, Paris Poster Hall · Published 2026 · ▲ 12 on Hugging Face
– ReadersNo votes yet
13/20 AI panelreviewers recommend it
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
AI panel: 13 of 20 reviewers recommend it
lenient 3/5
medium 8/10
strict 2/5