AutoGUIWorld: Image Generators as Visual World Models for GUI Agent

AutoGUIWorld uses image generators to synthesize GUI interaction trajectories without running software, improving OSWorld scores to 40.8% and ScienceBoard success to 32.2%.

Cheng Yang, Yifan Wu, Yutao Huang, Zhaohua Zhang and 17 more

Published Oct 1, 2026 · 0 citations · ▲ 61 on Hugging Face · Code ★ 9

GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution

GUI-HARVEST optimizes executable harnesses for frozen GUI agents by aligning visual effects, comparing task runs, and consolidating failure patterns into reusable source edits, improving OSWorld-Verified by up to 12.33 points.

Geyi Yang, Zikun Qu, Xiang Li, Zhiyong Wang and 3 more

Published Oct 1, 2026 · 0 citations · ▲ 5 on Hugging Face · Code ★ 2

DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents

DeskForge generates dense desktop supervision via controllable real-app environments, yielding 1.2M observations that improve GUI grounding and long-horizon computer-use task completion.

A. Said Gurbuz, Ahmed Nassar, Sunghwan Hong, Marc Pollefeys and 1 more

Published Oct 1, 2026 · 0 citations · ▲ 10 on Hugging Face · Code ★ 4

A Subgoal-driven RL Framework for Improving Long-Horizon Web Agents

Taiyi Wang, Sian Gooding, Florian Hartmann, Oriana Riva and 1 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

From Click Imitation to Transition Equivalence: Rethinking Supervision for GUI Agents

Zhiming Lin, Tianxiang Xu, zizhao zhang, Yixue Liu and 5 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling

Yifan Zhang, Yutong Dai, Viraj Prabhu, Zhiyuan Hu and 2 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

From Local Skills to Long-Horizon Tasks: Progressive Skill Exploration for LLM Web Agents

Xueyang Feng, Xiaohe Bo, Xu Chen, Quanyu Dai and 1 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Proactive Instance Navigation with Comparative Judgment for Ambiguous User Queries

Junhyuk Kwon, Seungjoon Lee, Hyejin Park, Kyle Min and 1 more

Sydney Poster Session 5, Thu, Dec 10, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Beyond Task Success: Probing Cognitive Primitives in Web Agents

Xunjian Yin, Tianchen Guan, Jinao Wang, Weili Cao and 7 more

Atlanta Poster Session 3, Thu, Dec 10, 10:00 AM–1:00 PM, Hall C1 · Published 2026

PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control

PAGER closes the semantic-execution gap for point-precise geometric GUI control via dependency-structured planning and pixel-level execution, achieving 4.1x higher task success than general baselines.

Jingxuan Wei, Xi Bai, Shan Liu, caijun jia and 7 more

Sydney Poster Session 3, Wed, Dec 9, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 15 on Hugging Face · Code ★ 3

EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

EvoCUA evolves computer-use agents via synthetic experience loops, achieving 56.7% success on OSWorld to set a new open-source state-of-the-art.

Taofeng Xue, Chong Peng, Mianqiu Huang, Linsen Guo and 11 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026 · ▲ 92 on Hugging Face · Code ★ 352

OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents

OpenWebRL enables open online RL for visual web agents, with a 4B model reaching 67% Online-Mind2Web and 64% DeepShop success using minimal initialization data.

Rui Yang, Qianhui Wu, Yuxi Chen, Hao Bai and 6 more

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026 · ▲ 19 on Hugging Face · Code ★ 52

VSearcher: Long-Horizon Multimodal Search Agent via Reinforcement Learning

VSearcher uses reinforcement learning to turn static multimodal models into long-horizon web search agents that surpass proprietary models on multimodal search benchmarks.

RUIYANG ZHANG, Qianguo Sun, Chao Song, Yiyan Qi and 1 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026

Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization

SMTL replaces sequential reasoning with parallel evidence acquisition for efficient long-horizon agentic search, achieving state-of-the-art results on multiple benchmarks with far fewer reasoning steps.

Chengjun Yu, Shu XU, Jiaqi Wu, Qianben Chen and 20 more

Sydney Poster Session 1, Tue, Dec 8, 10:00 AM–1:00 PM, Hall 1-4 · Published 2026 · ▲ 23 on Hugging Face · Code ★ 3

OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents

OpenSearch-VL introduces an open-source recipe training multimodal deep search agents via curated data, diverse tools, and multi-turn fatal-aware GRPO, achieving over 10-point benchmark gains comparable to proprietary models.

Shuang Chen, Kaituo Feng, Hangting Chen, Wenxuan Huang and 6 more

Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026 · ▲ 57 on Hugging Face · Code ★ 289

ScreenSearch: Uncertainty-Aware OS Exploration

ScreenSearch combines structural screen retrieval with ambiguity-aware PUCT search to explore desktop OS states, collecting over 1M screenshots across 11 apps and showing ambiguity reduction alone is insufficient for exploration.

Michael Solodko, Justin Wagle

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026

Beyond Domains: Reusing Web Skills via Transferable Interaction Patterns

SkillMigrator learns reusable web skills via transferable interaction patterns matched by layout similarity to reduce LLM actions 8-10% across WebArena and Mind2Web.

Shiqi He, Yue Cui, Feijie Wu, Xinyu Ma and 4 more

Atlanta Poster Session 1, Wed, Dec 9, 10:00 AM–1:00 PM, Hall C1 · Published 2026

ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use Agents

ToolCUA learns optimal GUI-tool switching via scaled synthetic interleaved trajectories, tool-bootstrapped reinforcement learning, and online agentic rewards, achieving 46.85% accuracy on OSWorld-MCP.

XuHao Hu, Xi Zhang, Haiyang Xu, Kyle Qiao and 5 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026 · ▲ 26 on Hugging Face · Code ★ 62

Mecha-nudges for Machines

Mecha-nudging changes online choice environments to systematically influence AI agents without harming human usability, and Etsy listings show a 0.143-bit rise in machine-usable information after ChatGPT's release.

Giulio Frey, Kawin Ethayarajh

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026 · ▲ 1 on Hugging Face

Code2World: A GUI World Model via Renderable Code Generation

Code2World uses renderable code generation for GUI world modeling, achieving top next-UI prediction and boosting Android navigation success by up to 9.5%.

Yuhao Zheng, Li'an Zhong, Yi Wang, Rui Dai and 5 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026 · ▲ 186 on Hugging Face · Code ★ 312