
RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
RotMoLE adds a rotation gate to MoE-LoRA experts that rotates rather than merely scaling selected experts, improving specialization and performance on multi-task and multilingual benchmarks.
Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
