conftrace_

action prediction

74 papers

Explore in graph

Co-occurring keywords

video understanding (1658) multimodal learning (4645) representation learning (6206) large language model (13587) video prediction (140) autonomous agent (168) world model (189) diffusion model (3751) instructional video (58) graphical user interface (42)

Papers

You Only Look at Screens: Multimodal Chain-of-Action Agents ACL 2024
Dual-View Visual Contextualization for Web Navigation CVPR 2024
CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation ACL 2024
Nebula: A discourse aware Minecraft Builder EMNLP 2024
PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulation CORL 2023
Skip-Plan: Procedure Planning in Instructional Videos via Condensed Action Space Learning ICCV 2023
GliTr: Glimpse Transformers With Spatiotemporal Consistency for Online Action Prediction WACV 2023
Hierarchical Prompting Assists Large Language Model on Web Navigation EMNLP 2023
Improving Vision-and-Language Navigation by Generating Future-View Image Semantics CVPR 2023
KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigation CVPR 2023
Relax, it doesn’t matter how you get there: A new self-supervised approach for multi-timescale behavior analysis NIPS 2023
PDPP:Projected Diffusion for Procedure Planning in Instructional Videos CVPR 2023
Event-Guided Procedure Planning from Instructional Videos with Text Supervision ICCV 2023
Multitask Multimodal Prompted Training for Interactive Embodied Task Completion EMNLP 2023
Homomorphism AutoEncoder -- Learning Group Structured Representations from Observed Transitions ICML 2023
Multi-Agent Intention Progression with Reward Machines IJCAI 2022
HOP: History-and-Order Aware Pre-Training for Vision-and-Language Navigation CVPR 2022
Sequence-to-Action: Grammatical Error Correction with Action Guided Sequence Generation AAAI 2022
PLM-based World Models for Text-based Games EMNLP 2022
Forecasting Characteristic 3D Poses of Human Actions CVPR 2022
Egocentric Prediction of Action Target in 3D CVPR 2022
META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI EMNLP 2022
Look Wide and Interpret Twice: Improving Performance on Interactive Instruction-following Tasks IJCAI 2021
Coupling Intent and Action for Pedestrian Crossing Behavior Prediction IJCAI 2021
Benchmark for Evaluating Pedestrian Action Prediction WACV 2021