83%Must read
?Must readVote to see the score
AI Evaluation Should Require Standardized Item-Level Data Releases
Standardized item-level benchmark releases should become AI evaluation infrastructure because aggregate scores obscure validity failures; OpenEval archives 10M responses to enable auditability and recover benchmark validity evidence.
Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026
– ReadersNo votes yet
13/20 AI panelreviewers recommend it
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.
AI panel: 13 of 20 reviewers recommend it
lenient 5/5
medium 8/10
strict 0/5