CANOPY: Adaptive-Granularity Evidence Compression for Multimodal RAG

CANOPY adaptively compresses multimodal evidence via hierarchical region scoring and targeted retrieval, improving QA accuracy while reducing input tokens by up to 27.7%.

Hyojeong Yun, Jueun Kim, Wook-Shin Han

Published Oct 1, 2026 · 0 citations · ▲ 16 on Hugging Face

AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models

AURAL uses adaptive latent reasoning with joint chunk prediction to match chain-of-thought performance while cutting first-token latency 11.8x versus explicit reasoning.

Yuxiang Wang, Kunyu Feng, Yuancheng Wang, Zihang Liu and 11 more

Published Oct 1, 2026 · 0 citations

EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

EgoTools introduces a dataset and benchmark for egocentric tool-use reasoning, showing current models struggle with visual grounding while training improves performance.

Shulin Tian, Junsu Kim, Shuai Liu, Hao Li and 16 more

Published Sep 30, 2026 · 0 citations · ▲ 67 on Hugging Face · Code ★ 9

OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning

OmniReasoning introduces a benchmark, data engine, and self-distillation method to improve audio-visual joint reasoning, boosting Qwen3-Omni-30B-A3B-Thinking by up to 12.8 points.

Junming Lin, Yuxuan Wang, Zhenxin Lei, Yuxin Liu and 10 more

Published Sep 30, 2026 · 0 citations · ▲ 17 on Hugging Face · Code ★ 1

Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering

Imagine3D-LLM learns compact scene representations via learnable summary tokens decoded into 3D Gaussian splatting with photometric loss, improving multi-view spatial reasoning benchmarks.

Jaewoo Jung, Hyeonseo Yu, Honggyu An, Jisang Han and 9 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published Sep 29, 2026 · ▲ 72 on Hugging Face · Code ★ 37

WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning

WM-VLM adds a world-model branch to vision-language models to generate intermediate visual states for spatial reasoning, outperforming baselines by up to 39.25 points on mental rotation tasks.

Yuheng Zha, Yilei Wang, Qiyue Gao, Junrong Chen and 4 more

Published Sep 28, 2026 · 0 citations · ▲ 11 on Hugging Face · Code ★ 1

Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence

ReaLVR fixes latent reasoning's weak visual grounding by supervising latent tokens with visual evidence, improving reasoning across scales up to 235B.

Xi Xiao, Tianchen Zhao, Youngeun Kim, Zhuowei Li and 9 more

Published Sep 28, 2026 · 0 citations · ▲ 217 on Hugging Face · Code ★ 40

BabyVision: Visual Reasoning Beyond Language

BabyVision benchmarks core visual reasoning without language and finds top MLLMs score far below human children.

Liang Chen, Weichu Xie, Yiyan Liang, Hongfeng He and 26 more

Published Jan 10, 2026 · 1 citation · ▲ 201 on Hugging Face · Code ★ 257

ACM SIGMM Multimodal Reasoning Workshop

The ACM SIGMM Multimodal Reasoning Workshop at IIT Patna gathered 108 participants to discuss multimodal reasoning, generative intelligence, and trustworthy AI through talks, tutorials, and hands-on sessions.

Sriparna Saha

Published 2026 · 0 citations

Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm

Video generation enables unified multimodal reasoning via Sora-2, which matches vision-language models and exceeds GPT-5 on spatial tasks while scoring 92% on MATH.

Jingqi Tong, Yurong Mou, Hangcheng Li, Mingzhe Li and 10 more

Published Nov 6, 2025 · 0 citations · ▲ 242 on Hugging Face · Code ★ 319

CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models

CollabVR pairs vision-language models with video generation models in closed-loop step-level planning and verification, reducing drift and simulation errors for major video reasoning gains.

Joowon Kim, Seungho Shin, Joonhyung Park, Eunho Yang

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 71 on Hugging Face · Code ★ 10

Single-Pass Evidence Measurement for Interpretable and Uncertainty-Aware Multimodal Face Anti-Spoofing

Yingjie Ma, Haonan Wang, Xun Lin, Ruixin Zhang and 7 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Learning to Learn from Multimodal Experience

Xingyu Sui, Weixiang Zhao, Yongxin Tang, Yanyan Zhao and 3 more

Paris Poster Session 5, Fri, Dec 11, 11:30 AM–1:30 PM, Paris Poster Hall · Published 2026

GRASP: Learning to Ground Social Reasoning in Multi-Person Non-Verbal Interactions

Junho Kim, Xu Cao, Houze Yang, Bikram Boote and 5 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

CMI-Trans: Cross Modal Inconsistency-aware Transport for HSI-LiDAR Classification

Yanli Li, Xuan Tan, Ding Qi, XINYANG JIANG

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

EDMA: Entropy-Driven Multimodal Answering

Emanuele Mezzi, Gertjan Burghouts, Fabio Massacci, Mengyuan Zhang

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

AeroMosaic:Transport-Aware Multimodal Evidence Fusion for Atmospheric Pollution Risk Inference

Muyang Zheng, Jiaming Ma, Zongyu Zhang, Qingsong Wen

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness

Songyuan Sui, Zhen Tan, Mohan Zhang, Rana M Khan and 2 more

Atlanta Poster Session 1, Wed, Dec 9, 10:00 AM–1:00 PM, Hall C1 · Published 2026

Intervene3D: Intervention-Based Controlled Inference for Multimodal Perception under Partial Observability

Constantino Msigwa, Denis Bernard, Jaeseok Yun

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?

Ziyi Wang, Li Li, Aolin Zhou, Yankun Shen and 3 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

GeLVR: Geometry-Consistent Latent Visual Reasoning in Multimodal LLMs

Jiaqi Wang, Yi Feng, Xian Wu

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

IntentLens: Grounding Underspecified Multimodal Queries for Recommendation via Tool-Augmented Reasoning

xiao chen, Dong Fang, Haitao Li, Qing Li

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

AVID: A 5T fMRI Dataset for Benchmarking Auditory-induced Visual Mental Imagery Decoding

Shiqi Shen, Shurui Li, Yuanning Li, Xilin Zhang

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

On Length Bias in EEG-to-Text Decoding

Iakovos Tenedios, Yashar Moshfeghi

Paris Poster Session 2, Wed, Dec 9, 5:00 PM–7:00 PM, Paris Poster Hall · Published 2026

TIGER: Bridging the Multimodal Reasoning-Access Gap via Modality Counterfactuals

Gregory Kang Ruey Lau, Huynh Minh Nguyen, Bryan Kian Hsiang Low

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation

Zhihan Yin, Jianxin Liang, Yifeng Yao, Nonghai Zhang and 4 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Thinking with Images as Continuous Policy: Numerical Visual Chain-of-Thought

Kesen Zhao, Beier Zhu, Junbao Zhou, Xingyu Zhu and 2 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generation

Zhenlong Yuan, Yue Wang, Jing Tang, Rui Chen and 8 more

Atlanta Poster Session 6, Fri, Dec 11, 4:30 PM–7:30 PM, Hall C1 · Published 2026

Diving-R1: Empowering Multimodal LLMs with Traceable Progressive Reasoning for Interpretable Diving Action Quality Assessment

Kaishen Yuan, Yuting Zhang, Bohao Xing, Wenshuo Chen and 4 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Forgery Evidence Peaks Mid-Stack: Forensic Evidence Relay for Multimodal Forgery Detection

Yingxin Lai, xinyuan Wang, Yufei Liu, Jialin Guo and 3 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark

Joel Julin, Souraja Kundu, Liza Dahiya, George Z Wei and 5 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Verifier Choice is a Benchmark Design Variable: Auditing Structural Counting Evaluation in Text-to-Image Models

Shurun Li, Michael H Wang, Haibo Zeng, Long Wang

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

TopoGraphRAG-Bench: Evaluating Multimodal GraphRAG on Layout-Grounded Evidence Reasoning

Ruochi Li, peter lin, Haoxuan Zhang, Haihua Chen and 3 more

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark

Taeyoung Yu, Seonbin Jo, Jiwon Kim, Junyoung Byun

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Who Called? V33DA: A Physically Verified Multimodal Benchmark for Vocal Attribution in Zebra Finch Groups

Maris Basha, Yuhang Wang, Xiaoran Chen, Longbiao Cheng and 4 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Look Before You Reason: Implicit Visual Thinking for Efficient Multimodal Reasoning

Zerui Chen, Changrui Chen, Fei Ni, Jiankang Deng

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

MUST: Stage-Adaptive Stability Control for Test-Time Scaling in Multimodal Reasoning

YunFeng Deng

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Visual Reinforcement Fine-Tuning via Bootstrapped Medical Reasoning

Yequan Bie, Peng Xie, Zhixuan CHEN, Yihui Wang and 7 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Prior Text-Informed Gate Attention Framework for Multimodal Psychiatric Disorder Diagnosis

Wensheng Zhai, Kaizhong Zheng, Difei Mei, Badong Chen and 1 more

Paris Poster Session 3, Thu, Dec 10, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026

Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning

jiayi lei, Yuandong Pu, Xingyu Han, Rongpeng Zhu and 7 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Semantic Freedom Bottleneck for Domain-Generalized Multimodal Face Anti-Spoofing

Yingjie Ma, Haonan Wang, Xun Lin, Hui Ma and 8 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Learning Actionable Information Landscapes for Multimodal Active Sensing in Hawkmoths

Abdelrahman Sharafeldin, Yaqing Wang, Simon Sponberg, Hannah Choi

Atlanta Poster Session 1, Wed, Dec 9, 10:00 AM–1:00 PM, Hall C1 · Published 2026

Fusion or Confusion? Multimodal Complexity Is Not All You Need

Tillmann Rheude, Roland Eils, Benjamin Wild

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Reasoning Gestures: LLM-Inferred Communicative Functions for Co-Speech Gesture Generation

Pinxin Liu, Haiyang Liu, Yunlong Tang, Luchuan Song

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

When Are Multimodal Predictions Biologically Supported? A Diagnostic Evaluation Framework

Dylan Steiner, Gustavo Arango, Gerald J Sun, Etai Jacob

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

CRISP: Compositional Reasoning over Images via Stackable Programs for VLMs

Arnas Uselis, Yujin Jeong, Yanpeng Zhao, Alexander Rubinstein and 3 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

AIM: Adaptive Interaction in Multi-Agent Debate for Multimodal LLM Inference

Wei Fan, JinYi Yoon, Bo Ji

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

MotorSense: A Video-EMG Dataset of Motoric Representations for Action Understanding

Eadom T Dessalene, Michael Maynord, Amir Hossein Shahidzadeh, Botao He and 5 more

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation

Jinghui Lu, Jiayi Guan, Zhijian Huang, Jinlong Li and 36 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

SynGeo: Synergizing Seeing and Proving through Revisable Geometric States

Tianyi Xu, Liu Yang, Wenjun GAO, Junyu Ou and 4 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

CausalConflictBench: Can Multimodal Models Follow Local Mechanisms That Conflict with Commonsense?

Bo Tian, Jianfeng Qu, Peng-Fei Zhang, Siyu Li and 2 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA

Hyemin Yang, Wooseong Jeong, Giwon Lee, Kuk-Jin Yoon

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

GeoDial: A Multimodal Dialog Tutoring Dataset for Geometry Problem-Solving with Visual Tutor Turns

Sankalan Pal Chowdhury, Junling Wang, Donya Rooein, April Wang and 1 more

Paris Poster Session 4, Thu, Dec 10, 5:30 PM–7:30 PM, Paris Poster Hall · Published 2026

Learning Where to Look: Observation Policy Optimization for Thinking with Images

Junfeng Wang, Jiawei Liu, Yongchao Xu, Tao Jiang and 4 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Unveiling Fine-Grained Visual Traces: Evaluating MultiModal Interleaved Reasoning Chains in Multimodal STEM Tasks

StepSTEM introduces 283 graduate-level STEM problems with strictly complementary visual-textual inputs to evaluate cross-modal reasoning via step-level alignment, revealing current MLLMs achieve only 38.29% accuracy due to heavy reliance on text.

Jing Jin, Hao Liu, Yan Bai, Yihang Lou and 8 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 1 on Hugging Face

MAEB: Massive Audio Embedding Benchmark

MAEB benchmarks 30 audio tasks across 100+ languages, finding no single model dominates and acoustic and linguistic skills trade off.

Adnan E Assadi, Isaac Chung, Chenghao Xiao, Roman Solomatin and 14 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 25 on Hugging Face

Reinforcing Multimodal Reasoning Against Visual Degradation

ROMA improves multimodal reasoning robustness to visual corruption via dual-pass RL optimization that avoids reward poisoning while preserving clean accuracy.

Rui Liu, Dian Yu, Haolin Liu, Yucheng Shi and 4 more

Atlanta Poster Session 2, Wed, Dec 9, 4:30 PM–7:30 PM, Hall C1 · Published 2026 · ▲ 5 on Hugging Face

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

CAVE uses structured process rewards to improve vision-language models' integration of nonlocal visual evidence, boosting fragmented reasoning benchmarks.

Tengda Guo, Jie Leng, Hanlei Li, Yaoyuan Liang and 5 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Touch-R1: Reinforcing Touch Reasoning in MLLMs

Touch-R1 trains a tactile reasoning MLLM via GRPO with tactile-grounded rewards, outperforming Octopi-13B and GPT-4o by 18.4% and 24.7% on TouchReason-Bench.

Yingxin Lai, Yafei Zhou, Fucai Zhu, Siyu Zhu and 1 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning

CausalSpatial benchmarks object-centric causal spatial reasoning, revealing MLLMs score 54% versus human 84% due to ungrounded textual reasoning, fixed by video-simulation framework COW.

Wenxin (Wendy) Ma, Chenlong Wang, Ruisheng Yuan, Hao Chen and 9 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026