Agent Systems

Vision-Language Foundation Models as Effective Robot Imitators ICLR 2024 Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning ICLR 2024 Vision-Language Navigation with Energy-Based Policy NeurIPS 2024 VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks ACL 2024 VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought NeurIPS 2024 VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions NeurIPS 2024 Wasserstein distributionally robust regret-optimal control over infinite-horizon L4DC 2024 Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement EMNLP 2024 Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents NeurIPS 2024 WebArena: A Realistic Web Environment for Building Autonomous Agents ICLR 2024 WebLINX: Real-World Website Navigation with Multi-Turn Dialogue ICML 2024 WebOlympus: An Open Platform for Web Agents on Live Websites EMNLP 2024 WebVLN: Vision-and-Language Navigation on Websites AAAI 2024 WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models ACL 2024 WebWISE: Unlocking Web Interface Control for LLMs via Sequential Exploration NAACL 2024 WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control NeurIPS 2024 When is Tree Search Useful for LLM Planning? It Depends on the Discriminator ACL 2024 When Your AIs Deceive You: Challenges of Partial Observability in Reinforcement Learning from Human Feedback NeurIPS 2024 Which One? Leveraging Context Between Objects and Multiple Views for Language Grounding NAACL 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 ‘Why Didn’t You Allocate This Task to Them?’ Negotiation-Aware Task Allocation and Contrastive Explanation Generation AAAI 2024 Will LLMs Sink or Swim? Exploring Decision-Making Under Pressure EMNLP 2024 WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks? ICML 2024 WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks NeurIPS 2024 WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment NeurIPS 2024