Good Papers: read the good ones

Showing LLM evaluation & benchmarks Show all papers

89%Must read

?Must readVote to see the score

Multilingual GSM-Symbolic: What determines capability transfer across languages?

Multilingual GSM-Symbolic introduces matched math problems across 15 languages to show model size, resource level, reasoning, and typology determine cross-lingual transfer, with size and reasoning closing low-resource gaps but not typological ones.

Kenneth Enevoldsen, Riley Herchert, Sofie Mosegaard, Dan Saattrup Smart and 21 more

Published Oct 2, 2026 · 0 citations · ▲ 47 on Hugging Face · Code ★ 4

– ReadersNo votes yet

16/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

69%Highly rated

arXivQuisqueya Quincy LLM evaluation & benchmarks

RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations

RealCompanion benchmarks AI companions on longitudinal real-world chats, finding needed past messages are usually recent, memory detectors fail on real messages, and persona reconstruction costs vary 31-fold at equal F1.

Arman Behnam, Sunglyoung Kim, Liangwei Yang

Published Oct 1, 2026 · 0 citations · ▲ 268 on Hugging Face

0% Readers0 of 1 upvoted

13/20 AI panelreviewers recommend it

Only vote on papers you've read. Sign in with GitHub to vote.

78%Highly rated

?Highly ratedVote to see the score

arXivLLM evaluation & benchmarks

Sentence Specificity Scores for Collaborative Technical Documentation: A Domain-Transfer Study

Sentence-specificity predictors disagree across technical corpora, and ranking LLM revisions improves selection only for certain models and predictors.

Rocker D’Antonio, Thomas Benton Townsend, Dimitrios Michael Manias

Published Oct 1, 2026 · 0 citations

– ReadersNo votes yet

11/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

75%Highly rated

?Highly ratedVote to see the score

arXivLLM evaluation & benchmarks

Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Papers

A benchmark of 390 AI papers measures scientific slop across structure, argument, and artifacts; a harness reduces the AI-human gap by 63% via evidence-grounded revision.

Yerim Oh, Young-Jun Lee, Jaewoo Ahn, Gunhee Kim and 1 more

Published Sep 30, 2026 · 0 citations · ▲ 55 on Hugging Face · Code ★ 13

0% Readers0 of 1 upvoted

17/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

88%Must read

?Must readVote to see the score

arXivJilin LLM evaluation & benchmarks

More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models

Direct-decision JEV models show ordinal scale-utilization bias, compressing decisions to 26, 76% of gold support despite high accuracy, but BA-LoRA post-training improves utilization to 86%.

Tianxiang Gao, Jinzhe Li, Zhiyuan Li, Yi Chang and 1 more

Published Sep 30, 2026 · 0 citations · ▲ 60 on Hugging Face · Code ★ 3

– ReadersNo votes yet

15/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

89%Must read

?Must readVote to see the score

arXivVirginia Tech U Maryland, College Park Mohamed bin Zayed University of LLM evaluation & benchmarks

A Missing Piece for Trustworthy AI Reviewers: From Benchmarking Rhetorical Robustness to SciCore Review

Rhetorical robustness requires stable judgments across content-preserving rewrites and discrimination across papers; SciCore improves both via dual-branch science-core review.

Chenguang Wang, Ming Li, Chengrui Fan, Jianpeng Chen and 3 more

Published Sep 30, 2026 · 0 citations · ▲ 76 on Hugging Face

– ReadersNo votes yet

16/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

78%Highly rated

?Highly ratedVote to see the score

arXivLLM evaluation & benchmarks

Source Identification Is Not Fitness Testing: Measuring the Limits of Synthetic-Data Attribution

Generator attribution falls sharply after rewriting, and provenance-based selection does not clearly outperform quality-score selection for recursive model training.

Joss Armstrong

Published Sep 30, 2026 · 0 citations

– ReadersNo votes yet

11/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

71%Highly rated

?Highly ratedVote to see the score

arXivLLM evaluation & benchmarks

Predictive Credit: Measuring What Scientific Explanations Add to Experimental Forecasts

Predictive credit for scientific explanations is measured via paired forecasts, but gains over descriptions remain unconfirmed across Tox21, OpenML, and controlled settings.

Jingjie Ning, Xueqi Li, Yibo Kong, Dongting Li

Published Sep 29, 2026 · 0 citations · ▲ 101 on Hugging Face

– ReadersNo votes yet

7/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

83%Must read

?Must readVote to see the score

arXivU Washington Texas A&M U Notre Dame U Virginia New York LLM evaluation & benchmarks

MoCo: A One-Stop Shop for Model Collaboration Research

MoCo unifies 26 model collaboration methods and 25 benchmarks to show collaboration outperforms single models in 61% of settings by up to 25.8%.

Shangbin Feng, Yuyang Bai, Ziyuan Yang, Yike Wang and 16 more

Published Jan 29, 2026 · 0 citations · Code ★ 63

– ReadersNo votes yet

13/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

86%Must read

?Must readVote to see the score

arXivFudan Washington University in St. Lou Xiaohongshu LLM evaluation & benchmarks

Benchmark^2: Systematic Evaluation of LLM Benchmarks

Benchmark² evaluates LLM benchmarks via ranking consistency, discriminability, and capability alignment deviation, revealing quality variations and enabling smaller effective test sets.

Qi Qian, Chengsong Huang, Jingwen Xu, Changze Lv and 12 more

Published Jan 7, 2026 · 0 citations · ▲ 34 on Hugging Face

– ReadersNo votes yet

14/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

74%Highly rated

?Highly ratedVote to see the score

arXivLLM evaluation & benchmarks

Efficient MAP Estimation of LLM Judgment Performance with Prior Transfer

BetaConform uses a Beta-Binomial MAP framework with adaptive conformal stopping and prior transfer to estimate LLM judge accuracy using minimal labeled samples. It achieves under 3.37% error on TruthfulQA with only ten annotations.

Hui Yan Qu, In-Young Choi, Tan, Zhen, Song Wang and 5 more

Published Apr 17, 2025 · 0 citations

– ReadersNo votes yet

9/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

67%Highly rated

?Highly ratedVote to see the score

NAACL 2025U Notre Dame Amazon Worcester Polytechnic Institute LLM evaluation & benchmarks

IHEval: Evaluating Language Models on Following the Instruction Hierarchy

IHEval evaluates language models on instruction hierarchy compliance, finding they frequently disregard system-level priority instructions.

Zhihan Zhang, Shiyang Li, Zixuan Zhang, Xin Liu and 10 more

Published 2025 · 4 citations

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

74%Highly rated

?Highly ratedVote to see the score

ACM Transactions on Knowledge Discovery from Data 2024Amazon Texas A&M Rice LLM evaluation & benchmarks

Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond

This survey guides practitioners in deploying LLMs across NLP tasks, covering model selection, data effects, use cases, biases, efficiency, and practical limitations.

Jingfeng Yang, Hongye Jin, Ruixiang Tang, Xiaotian Han and 5 more

Published Feb 28, 2024 · 503 citations

– ReadersNo votes yet. 1 from authors or colleagues not counted

9/21 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Penn State Pennsylvania State LLM evaluation & benchmarks

Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs

Sree Bhattacharyya, Samarth Khanna, Leona Chen, Lucas Craig and 2 more

Atlanta Poster Session 5, Fri, Dec 11, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026U Cambridge Flatiron Institute Computer Vision Center, Universi LLM evaluation & benchmarks

Auditing AI peer reviewers: a dose-response and false-positive benchmark on real scientific papers

Íñigo Zubeldia, Boris Bolliet, Francisco Villaescusa, Pablo Villanueva-Domingo and 1 more

Paris Poster Session 1, Wed, Dec 9, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Beijing University of Aeronautic Alibaba Group Shanghai Jiao Tong Huawei Technologies Ltd.Beihang University, Tsinghua LLM evaluation & benchmarks

VeriScope: Measuring Verification-Ready Verilog Artifacts

Wei Zhang, Jian Yang, jiajun wu, Junhang Cheng and 3 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026OralSharif University of Technology Penn State Pennsylvania State U Washington LLM evaluation & benchmarks

HearSayBench: Can LLMs Navigate from Abstract Human Rights to Lived Lives?

Sobhan Lotfi, Ava Iranmanesh, Ali Iranmanesh, Liwei Jiang

Atlanta Poster Session 2, Wed, Dec 9, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026U Massachusetts Amherst Department of Computer Science, Google DeepMind U Massachusetts, Amherst LLM evaluation & benchmarks

Evaluating Compositional Generalization in Transformers: The Role of Composition Equivalence and Module Coverage

Purva Pruthi, Andrew Yuan, Alexander D&#x27;Amour, David Jensen

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Qualified Health U California, San Francisco Waymo LLM evaluation & benchmarks

Efficient evaluation and error pattern discovery for blackbox AI systems

Maxim Rabinovich, Harvineet Singh, Aman Sinha

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026ETH Zurich Google DeepMind Anthropic OpenAI U Haifa LLM evaluation & benchmarks

CryptanalysisBench: Can LLMs do cryptanalysis?

Lukas Fluri, Avital Shafran, Nicholas Carlini, Matthew Jagielski and 4 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Vector Institute U Toronto ETH Zurich Department of Computer Science, Max Planck Institute for Intelli LLM evaluation & benchmarks

SuperSycophantic: Stress-Testing Frontier LLMs from Single- to Multi-Turn Sycophancy

Terry J Zhang, Oscar S Yasunaga, Wenyuan Jiang, Jessica Bo and 7 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Ludwig-Maximilians-Universität M Kings College London LMU Munich, MCML LMU King's College London LLM evaluation & benchmarks

S-EDL: Eliciting Self-Evidence from Sequence Likelihoods for Semantic Calibration of LLMs

Yawei Li, Jiazheng Li, David Rügamer, Bernd Bischl and 2 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Microsoft Research / UIUC MPI for Intelligent Systems, Tüb Max Planck Institute for Intelli Stanford MIT LLM evaluation & benchmarks

AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation

Olawale Salaudeen, Florian E. Dorner, Tom Sühr, Sang Truong and 12 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Institute of Software, Chinese A LLM evaluation & benchmarks

DIS-Bench: Evaluating LLMs on System Testing via Directed Input Synthesis

Siwei Wei, Yuqi Guo, Yan Cai

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Renmin University of China Huawei Noah's Ark Lab Huawei Technologies Ltd.LLM evaluation & benchmarks

How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistants

Xueyang Feng, Weinan Gan, Xu Chen, Quanyu Dai and 1 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Oulu College of William and Mary Tongji Peking LLM evaluation & benchmarks

SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?

Yueyi Yang, Haotian Liu, Fang Kang, Mengqi Zhang and 3 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026Zhejiang Harbin Institute of Technology U Illinois at Urbana-Champaign Ant Group College of Computer Science LLM evaluation & benchmarks

ClinMAS: A Knowledge-Grounded Multi-Agent Simulation Framework for Evaluating Clinical Reasoning in LLMs

Yuqi Tang, Jing Yu, Zichang Su, Kehua Feng and 6 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 2 of 20 reviewers recommend it

lenient 2/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Stanford U British Columbia, Google Stanford University / Virtue AI LLM evaluation & benchmarks

Strategic Evaluation: Incentivizing AI Capability Coverage with Private Benchmarks

Sang Truong, Serena Wang, Nick Haber, Sanmi Koyejo

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026Harbin Institute of Technology Tsinghua University, Tsinghua Eindhoven University of Technolo ByteDance LLM evaluation & benchmarks

SWE-GPU-Bench: Can Language Models Solve Real-World GPU Software Engineering Tasks?

Feng Chen, binbin liu, Wenhan Han, Yin Zheng

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Google DeepMind Imperial College London Forward College Google HeriotWatt LLM evaluation & benchmarks

Beyond Ground Truth: Evaluating Non-Verifiable Reasoning in LLMs through Moral Robustness

Elizaveta Tennant, Benjamin Henke, Anita Keshmirian, Murray Shanahan and 4 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026South China Normal Amazon Fudan East China Normal LLM evaluation & benchmarks

BayesJudge: Uncertainty-Aware Bayesian Meta-Evaluation of Human and LLM Judgments

Jiahao Zhang, Pengbin Feng, Chunlei Meng, Hang He and 1 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Institute of automation, Chinese Nankai Zhejiang U the Chinese Academy of Science Institute of automation, Chinese LLM evaluation & benchmarks

SoDeArena: A Socially-Situated Reasoning Benchmark for Large Language Models

Senhao Yang, Ziling Yuan, Xiaoran Yang, Yaqing Wang and 6 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026U Science and Technology of Chin Tencent Tencent AI Lab Tencent hunyuan team The Chinese University of Hong K LLM evaluation & benchmarks

AppCIF-Bench: An Application-Level Complex Instruction Following Benchmark for Large Language Models

Jiahao Xu, Xuefang Zhao, Xinhua Feng, Hongrui Yang and 3 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026Rensselaer Polytechnic Institute IBM Research IBM JPMorgan Chase & Co.LLM evaluation & benchmarks

Black-Box Uncertainty Quantification for Large Language Models via Ensemble-of-Ensembles

Wang Ma, Debarun Bhattacharjya, Junkyu Lee, Nhan H Pham and 2 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 2 of 20 reviewers recommend it

lenient 1/5

medium 1/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Johns Hopkins U Washington U California, Los Angeles U Illinois Urbana-Champaign LLM evaluation & benchmarks

Can We Trust Item Response Theory for AI Evaluation?

Han Jiang, Sunbeom Kwon, Jinwen Luo, Ziang Xiao and 1 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026U California, Berkeley UCSD UC Santa Cruz/ByteDance Research LLM evaluation & benchmarks

Forced Orders: What LLM Leaderboards Hide About Model Comparisons

Zonglin Di, Berk Ustun, Yang Liu

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 1/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026Rensselaer Polytechnic Institute LLM evaluation & benchmarks

What Claims Do LLM Benchmark Scores Support?

Srihari Sridharan

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 2 of 20 reviewers recommend it

lenient 1/5

medium 1/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026OralNanjing nanjing university LLM evaluation & benchmarks

ALTER: An Allen's Algebra-Based Evaluation Framework for Temporal Reasoning of LLMs

Zhou Hongkai, Yanhui Li

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

69%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026Technische Universität München Technical University of Munich U Sheffield U Oxford Sun Yat-sen University Cancer Ce LLM evaluation & benchmarks

RealICU: Do LLM Agents Understand Long-Context ICU Data? A Benchmark Beyond Behavior Imitation

Chengzhi Shen, Weixiang Shen, Tobias Susetzky, Chen Chen and 6 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

3/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 3 of 20 reviewers recommend it

lenient 2/5

medium 1/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U New South Wales UNSW University Of New South Wales LLM evaluation & benchmarks

ChronosAlign: A Large-Scale, Updatable Benchmark for Decomposing Temporal Alignment in LLMs

Sanjay Govindan, Maurice Pagnucco, Yang Song

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Peking LLM evaluation & benchmarks

VDE: Verifiable Dynamic Evaluation of Mathematical Reasoning via Typed Bipartite Graphs

Yihan Lu, Junzhe Zhang, Xiaojun Wan

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026VinUniversity Nanyang Technological Griffith Vietnam National University Hano Hanoi University of Science and LLM evaluation & benchmarks

Benchmarking Vietnamese Legal Knowledge of Large Language Models

Dong N Tien, Nguyen Minh-Anh, Thanh D Hoang, Nguyen T Ngoc and 5 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026UC Berkeley Jaypee University of Information New York IIT roorkee U Oxford LLM evaluation & benchmarks

IntegrityBench: Can LLMs Be Trusted as Co-Scientists? A Research Integrity Benchmark

Sai Sidhanth Manoharan Jayanthi, Yash Tripathi, Silu Sharma, Shivank Garg and 1 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Tsinghua Institute for AI Industry Resear Institute of AI Industry Researc U the Chinese Academy of Science Dell Technology LLM evaluation & benchmarks

CSBench: A Comprehensive Benchmark for Evaluating Project-Level System Construction in Computer Science

Hongli Yu, Huan-ang Gao, Botian Wang, Hanlin Wu and 11 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Tel Aviv Ben-Gurion University of the Neg LLM evaluation & benchmarks

When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice

Dean Ariel, Guy Laban

Paris Poster Session 3, Thu, Dec 10, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Jagiellonian LLM evaluation & benchmarks

FACBench: A Benchmark for Formal-Anchor Collisions in Multilingual Mathematical Grounding

Piotr Kuterba, Józef Spałek

Paris Poster Session 2, Wed, Dec 9, 5:00 PM–7:00 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026East China Normal LLM evaluation & benchmarks

NarrativeBench: Benchmarking Multi-trait Automated Scoring and Feedback Efficacy of Large Language Models for Chinese Narrative Essays

Jin Wu

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Adelaide Adelaide LLM evaluation & benchmarks

When Are Predictions Enough? An Evaluation Protocol for Frozen Expert Composition

Alessandro Pereira, Keith J Ransom, Lewis Mitchell

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Sorbonne Université - Faculté de Jozef Stefan Institute Jožef Stefan Institute CNRS & Sorbonne LLM evaluation & benchmarks

Routeability Before Routing: Routeability Audit Protocol (RAP) and RouteabilityBench for Audited LLM Model Selection

Yihang Lu, Denica Kjorvezir, Ana Gjorgjevikj, Carola Doerr and 1 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Johns Hopkins Cohere George Mason LLM evaluation & benchmarks

The Narrative Gap: Can LLMs help us Navigate Diverse Narratives Across Languages?

Nikhil Sharma, Kelly Marchisio, Kenton Murray, Ziang Xiao

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Universidad Nacional de Educació Universidad Nacional de Educació Universidad Nacional de Educació LLM evaluation & benchmarks

The Ruler and the Judge: Benchmark-Conditional Evaluation of LLM-as-a-Judge

Adrián Ghajari, Alejandro Benito-Santos, Víctor Fresno

Paris Poster Session 2, Wed, Dec 9, 5:00 PM–7:00 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Florida Northeastern LLM evaluation & benchmarks

Benchmarking Risk Attitudes of LLMs

Bowen Sun, Rui Min, Xianyao Li, Yuxi Wang and 3 more

Atlanta Poster Session 6, Fri, Dec 11, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Lossfunk LLM evaluation & benchmarks

EsoLang-Bench: Evaluating Large Language Models via Esoteric Programming Languages

Aman Sharma, Paras Chopra

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Lica World / Gamma HoYoverse Lica Lica World Gamma LLM evaluation & benchmarks

A Diagnostic Benchmark for Layered Layout and Template-Variant Reasoning

Jaejung Seol, Haonan Zhu, Elad Hirsch, Adrienne Deganutti and 1 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Boston University, Boston Hong Kong University of Science LLM evaluation & benchmarks

Online Evaluation of LLMs via Dyadic Designs

Jinglong Zhao, Zijie Zhou

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Proximal Microsoft Research Microsoft LLM evaluation & benchmarks

fxBench: Evaluating and Understanding Formula Suggestions in Spreadsheets

Sanket Mhatre, Sumit Gulwani, Vu Le, Yasharth Bajpai and 1 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Yandex School of Data Analysis GigaCode Research Center LLM evaluation & benchmarks

Hidden Positives: Why Code Retrieval Benchmarks Underestimate Model Quality

Maria Ivanova, Vitaly Kadulin, Dmitrii Babaev

Paris Poster Session 6, Fri, Dec 11, 2:30 PM–4:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 1/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026East China Normal Xiamen Shanghai Artificial Intelligence Shanghai Jiao Tong LLM evaluation & benchmarks

Penalize to Verify: A Multi-Domain Benchmark for Trustworthy LLM Evaluation

Jia-chen Zhang, Zheng Zhou, Zhuo Wang, Qi Jia and 6 more

Paris Poster Session 1, Wed, Dec 9, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Department of Computer Science, U Cambridge California Institute of Technolo Caltech MIT LLM evaluation & benchmarks

We Need to Improve Benchmarks in AI for Mathematics

Simon Frieder, Jonas Bayer, Shi Zhuo Looi, Jacob Loader and 14 more

Paris Poster Session 4, Thu, Dec 10, 5:30 PM–7:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026The University of New South Wale The Hong Kong University of Scie Changsha University of Science a Xiamen Beijing University of Civil Engi LLM evaluation & benchmarks

MINEGRID: A Multi-Modal Benchmark for LLMs Evaluation on Dynamic Modeling of Power Systems

Duange Guo, Yujian Yuan, Shanyu Li, Xinhua Wu and 1 more

Paris Poster Session 6, Fri, Dec 11, 2:30 PM–4:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Harbin Institute of Technology LLM evaluation & benchmarks

BraveATA: Benchmarking Broad and Verifiable End-to-End Automated Theoretical Analysis of Large Language Models

Dingzirui Wang, Xuanliang Zhang, Keyan Xu, Qingfu Zhu and 1 more

Paris Poster Session 3, Thu, Dec 10, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026ETH Zurich U Central Florida LLM evaluation & benchmarks

Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators

Heejin Do, Shashank Sonkar, Mrinmaya Sachan

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026EPFL U Sheffield U Manchester LLM evaluation & benchmarks

SciReason: A Controllable Benchmark for Scientific Reasoning in LLMs

Pierre Beckmann, Marco Valentino, Andre Freitas

Paris Poster Session 2, Wed, Dec 9, 5:00 PM–7:00 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

69%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026MPI-SWS Max Planck Institute for Behavio Max Planck Institute for Softwar LLM evaluation & benchmarks

Can an LLM Reason Like a Lawyer? Benchmarking the ability of LLMs to map the facts of a case to the elements of the applicable legal rule

Shounak Paul, Seungeon Lee, Christoph Engel, Krishna Gummadi

Paris Poster Session 1, Wed, Dec 9, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

3/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 3 of 20 reviewers recommend it

lenient 2/5

medium 1/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Vanderbilt LLM evaluation & benchmarks

Cognitive bias benchmarks should incorporate insights from ecological rationality

David Thorstad

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026McGill University, Mila, Paris-S ILLS and MILA | CNRS Paris-Sacl McGill University / Mila LLM evaluation & benchmarks

Auditing is not Evaluating: LLM Audit Requires Dynamic, Contextual, Budget-aware and Reliable Evidence

Cléa Chataigner, Pablo Piantanida, Golnoosh Farnadi

Paris Poster Session 5, Fri, Dec 11, 11:30 AM–1:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Illinois at Urbana-Champaign U California, San Diego U Illinois Urbana-Champaign New York UIUC LLM evaluation & benchmarks

Your Benchmark Is an Empirical Measure Over Difficulty

Yifan Sun, Naicheng Yu, Jiawen Gong, Jingyan Shen and 1 more

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Google DeepMind EleutherAI Universita della Svizzera Italia King Abdullah University of Scie U Waterloo LLM evaluation & benchmarks

Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures

Tyler Chang, Catherine Arnett, Abdelrahman Sadallah, Abdelrahman Eldesokey and 36 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Toronto U Toronto, University of Toronto Department of Computer Science, LLM evaluation & benchmarks

VerifyThisBench: Joint Evaluation of Code, Specifications, and Proof

Xun Deng, Barış Bayazıt, Si Cheng Zhong, Andreas Veneris and 2 more

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

67%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026U Pennsylvania, University of Pe Center for AI Safety Scale AI U Pennsylvania Aethra Labs LLM evaluation & benchmarks

Beyond Truthfulness: Evaluating Honesty in Large Language Models

Richard Ren, Arunim Agarwal, Mantas Mazeika, Cristina Menghini and 11 more

Atlanta Poster Session 1, Wed, Dec 9, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

2/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 2 of 20 reviewers recommend it

lenient 1/5

medium 1/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Chicago U Southern California U California Riverside NVIDIA U Toronto LLM evaluation & benchmarks

Precise Debugging Benchmark: Is Your Model Debugging or Regenerating?

Miaosen Chai, Wang Bill Zhu, Shangshang Wang, Yejia Liu and 4 more

Atlanta Poster Session 2, Wed, Dec 9, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Columbia Columbia University, Department LLM evaluation & benchmarks

Be CARE-ful with Text-to-SQL Benchmarks

Haonan Wang, Jiaxiang Liu, Elaine Ang, Tiancheng Ge and 7 more

Atlanta Poster Session 5, Fri, Dec 11, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 1/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Queen Mary University of London Huawei Technologies Ltd.UCL U Bedfordshire Queen Mary University of London LLM evaluation & benchmarks

CADMA: Capacity-Aware Recall Decomposition for Generative Model Assessment

Debin Meng, Zheng Gao, Ziquan Liu, Yanran Li and 2 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026U California, San Diego U California San Diego and Gense LLM evaluation & benchmarks

SourceBench: Can AI Answers Reference Quality Web Sources?

Hexi Jin, Xurui Liu, Yuheng Li, Simran Malik and 1 more

Atlanta Poster Session 5, Fri, Dec 11, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Illinois at Urbana - Champaign Meta, UIUC U Illinois at Urbana-Champaign UIUC, Co-Founder, CTO of Medicas LLM evaluation & benchmarks

Do Semantic Distance Tests Actually Predict Creativity in Large Language Models?

Samuel Schapiro, Alexi Gladstone, Jonah Black, Heng Ji

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026Tianjin Montreal Institute for Learning Shanxi Zhejiang LLM evaluation & benchmarks

Does Your Large Language Model Have An Intuitive Sense of The Difficulty of A Question?

Ruitao Wang, Jinyi Liu, Hongyao Tang, Rong Cheng and 8 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026Carnegie Mellon U Notre Dame CMU, Carnegie Mellon U Pittsburgh U North Carolina at Chapel Hill LLM evaluation & benchmarks

Can Agents Price a Reaction? Evaluating LLMs on Chemical Cost Reasoning

Yuyang Wu, Yue Huang, Shuaike Shen, Xujian Wang and 7 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 1 of 20 reviewers recommend it

lenient 1/5

medium 0/10

strict 0/5

69%Highly rated

?Highly ratedVote to see the score

NeurIPS 2026U California, Los Angeles U California, Los Angeles UCLA Shanghai Jiaotong U California, Berkeley LLM evaluation & benchmarks

Demystifying Numerical Errors in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL

Zhenting Zhu, Lucas Thai, Shan Yu, Yicheng Liu and 4 more

Atlanta Poster Session 6, Fri, Dec 11, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

3/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 3 of 20 reviewers recommend it

lenient 2/5

medium 1/10

strict 0/5

45%Niche pick

?Niche pickVote to see the score

NeurIPS 2026U Texas at Austin Theseus AI Labs, Inc.Theseus AI Labs McGill The University of Texas, Austin LLM evaluation & benchmarks

TensorCommitments: A Lightweight Verifiable Inference for Large Language Models

Oguzhan Baser, Elahe Sadeghi, Eric Wang, Nico Vergauwen and 4 more

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026

– ReadersNo votes yet

0/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 0 of 20 reviewers recommend it

lenient 0/5

medium 0/10

strict 0/5

57%Worth a look

?Worth a lookVote to see the score

NeurIPS 2026MBZUAI Georgia Institute of Technology KAUST U Electronic Science and Technol LLM evaluation & benchmarks

Hearing is Believing? Evaluating and Analyzing Audio Language Model Sycophancy with SYAUDIO

Junchi Yao, Lokranjan Lakshmikanthan, Annie Zhao, Danielle Zhao and 4 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet

1/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

Show 20 more papers