NAACL 2025Vision-language modelsFindings

LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models

Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono, Kairui Hu, Shuai Liu, Yuanhan Zhang, Jingkang Yang, Chunyuan Li, Ziwei Liu

Published 202545 citationsPaper ↗

76%

OverallHighly rated

OverallHighly ratedVote to see the score

Readers

–

Only vote on papers you've read. Sign in to vote.

AI panel10/21reviewers recommend it

lenient 3/5

medium 5/11

strict 2/5

AI panel?Vote to see what the 20 AI reviewers said

Abstract

Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono, Kairui Hu, Shuai Liu, Yuanhan Zhang, Jingkang Yang, Chunyuan Li, Ziwei Liu. Findings of the Association for Computational Linguistics: NAACL 2025. 2025.