conftrace_

screen understanding

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

graphical user interface (4) gui agent (3) multimodal learning (3) task automation (2) spatial structure modeling (1) modality perception (1) help prediction (1) gui understanding (1) behavior state detection (1) benchmark (1)

Papers

GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Tasks CVPR 2026 MP-GUI: Modality Perception with MLLMs for GUI Understanding CVPR 2025 UI-Hawk: Unleashing the Screen Stream Understanding for Mobile GUI Agents EMNLP 2025 Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ICML 2025 Android in the Zoo: Chain-of-Action-Thought for GUI Agents EMNLP 2024 CogAgent: A Visual Language Model for GUI Agents CVPR 2024 SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents ACL 2024