Good Papers
NAACL 2025Privacy

Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench

MLLMU-Bench evaluates privacy risks in multimodal large language models via standardized leakage and inference benchmarks.

Zheyuan Liu, Guangyao Dou, Mengzhao Jia, Zhaoxuan Tan, Qingkai Zeng, Yongle Yuan, Meng Jiang

Published 20255 citationsPaper ↗

70%
OverallHighly rated
?
OverallHighly ratedVote to see the scoreThe exact score shows once you've voted, so every vote is your own call. The first half of each home page shelf shows its scores.
Readers
–

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel5/20reviewers recommend it
lenient 3/5
medium 2/10
strict 0/5
AI panel?Vote to see what the 20 AI reviewers said
Panel consensus
MLLMU-Bench delivers a valuable multimodal privacy audit for real-world image leaks, though its vision-specific exposure patterns remain unclear and its defense-agnostic design risks reducing the multimodal gap to a data artifact.

Abstract

Zheyuan Liu, Guangyao Dou, Mengzhao Jia, Zhaoxuan Tan, Qingkai Zeng, Yongle Yuan, Meng Jiang. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.