89%Must read
?Must readVote to see the score
Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers
LLM scorers with equal ranking quality make unstable threshold and preference decisions under candidate reordering, and order-consistency fine-tuning fixes it without harming quality.
Published Aug 27, 2026 · 0 citations · ▲ 17 on Hugging Face · Code ★ 2
– ReadersNo votes yet
16/20 AI panelreviewers recommend it
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
AI panel: 16 of 20 reviewers recommend it
lenient 5/5
medium 9/10
strict 2/5