conftrace_

user interface

33 papers

Explore in graph

Also known as

UI

Co-occurring keywords · papers mentioning both

multimodal learning (9) vision-language model (6) human-ai interaction (5) dialogue system (3) multimodal large language model (3) visual grounding (3) representation learning (3) task completion (2) gui grounding (2) large language model (2)

Papers

Do GUI Grounders Truly Understand UI Elements? EACL 2026 UI-Lens: Assessing General MLLMs' Potential to Automate UI Display Quality Assurance CVPR 2026 AutoGUI: Scaling GUI Grounding with Automatic Functionality Annotations from LLMs ACL 2025 AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents ACL 2025 Hidden Forms: A Dataset to Fill Masked Interfaces from Language Commands ACL 2025 Lessons from a User Experience Evaluation of NLP Interfaces NAACL 2025 Lightweight Neural App Control ICLR 2025 MagicQuill: An Intelligent Interactive Image Editing System CVPR 2025 SPA-BENCH: A COMPREHENSIVE BENCHMARK FOR SMARTPHONE AGENT EVALUATION ICLR 2025 UICOMPASS: UI Map Guided Mobile Task Automation via Adaptive Action Generation EMNLP 2025 UIOrchestra: Generating High-Fidelity Code from UI Designs with a Multi-agent System EMNLP 2025 Will Gen Z users look for evidence to verify QA System-generated answers? NAACL 2025 MUG: Interactive Multimodal Grounding on User Interfaces EACL 2024 ScreenAI: A Vision-Language Model for UI and Infographics Understanding IJCAI 2024 Tell Me What’s Next: Textual Foresight for Generic UI Representations ACL 2024 Thesis Summary: Operationalizing User-Inclusive Transparency in Artificial Intelligence Systems AAAI 2024 UGIF-DataSet: A New Dataset for Cross-lingual, Cross-modal Sequential actions on the UI NAACL 2024 Visual Grounding for User Interfaces NAACL 2024 Designing, Evaluating, and Learning from Humans Interacting with NLP Models EMNLP 2023 Reconciling Adaptivity and Task Orientation in the Student Dashboard of an Intelligent Language Tutoring System ACL 2023 Referring to Screen Texts with Voice Assistants ACL 2023 Explaining Why: How Instructions and User Interfaces Impact Annotator Rationales When Labeling Text Data NAACL 2022 Lexi: Self-Supervised Learning of the UI Language EMNLP 2022 StoryQ—an Online Environment for Machine Learning of Text Classification AAAI 2022 ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces AAAI 2021