Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers
LLM scorers with equal ranking quality make unstable threshold and preference decisions under candidate reordering, and order-consistency fine-tuning fixes it without harming quality.
Published Aug 27, 2026 · 0 citations · ▲ 17 on Hugging Face · Code ★ 2
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.

