STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability
STARE analyzes token-level entropy dynamics under GRPO, identifies a credit assignment mismatch, and uses surprisal-guided advantage reweighting to stabilize policy entropy, improving AIME accuracy by 4-8%.
Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 12 on Hugging Face · Code ★ 24
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
