Marco Pavone

Scaling Vision Pre-Training to 4K Resolution CVPR 2025 Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models CVPR 2025 LOTUS: A Leaderboard for Detailed Image Captioning from Quality to Societal Bias and User Preferences ACL 2025 Pseudo-Simulation for Autonomous Driving CORL 2025 RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models CORL 2025 STORM: Spatio-TempOral Reconstruction Model For Large-Scale Outdoor Scenes ICLR 2025 OmniRe: Omni Urban Scene Reconstruction ICLR 2025 Language-Image Models with 3D Understanding ICLR 2025 Offline Hierarchical Reinforcement Learning via Inverse Optimization ICLR 2025 Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning CORL 2025 Leveraging Correlation Across Test Platforms for Variance-Reduced Metric Estimation CORL 2025 CUPID: Curating Data your Robot Loves with Influence Functions CORL 2025 LoRA3D: Low-Rank Self-Calibration of 3D Geometric Foundation models ICLR 2025 LLaMA-Berry: Pairwise Optimization for Olympiad-level Mathematical Reasoning via O1-like Monte Carlo Tree Search NAACL 2025 Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusion ICLR 2025 Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluation ICCV 2025 Describe Anything: Detailed Localized Image and Video Captioning ICCV 2025 Extrapolated Urban View Synthesis Benchmark ICCV 2025 Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress CORL 2024 Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate NIPS 2024 NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking NIPS 2024 Large Spatial Model: End-to-end Unposed Images to Semantic 3D NIPS 2024 DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Features NIPS 2024 Training an Open-Vocabulary Monocular 3D Detection Model without 3D Data NIPS 2024 DiffuBox: Refining 3D Object Detection with Point Diffusion NIPS 2024 Memorize What Matters: Emergent Scene Decomposition from Multitraverse NIPS 2024 Text2Interaction: Establishing Safe and Preferable Human-Robot Interaction CORL 2024 Q-SLAM: Quadric Representations for Monocular SLAM CORL 2024 Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving CORL 2024 Promptable Closed-loop Traffic Simulation CORL 2024 Driving Everywhere with Large Language Model Policy Adaptation CVPR 2024 Producing and Leveraging Online Map Uncertainty in Trajectory Prediction CVPR 2024 PARA-Drive: Parallelized Architecture for Real-time Autonomous Driving CVPR 2024 Dolphins: Multimodal Language Model for Driving ECCV 2024 RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios ECCV 2024 Accelerating Online Mapping and Behavior Prediction via Direct BEV Feature Attention ECCV 2024 EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision ICLR 2024 Parallelized Spatiotemporal Slot Binding for Videos ICML 2024 Learning for CasADi: Data-driven Models in Numerical Optimization L4DC 2024 Real-Time Anomaly Detection and Reactive Planning with Large Language Models RSS 2024 Language Conditioned Traffic Generation CORL 2023 PAC-Bayes Generalization Certificates for Learned Inductive Conformal Prediction NIPS 2023 Robust and Controllable Object-Centric Learning through Energy-based Models ICLR 2023 Task-Aware Risk Estimation of Perception Failures for Autonomous Vehicles RSS 2023 Multi-Predictor Fusion: Combining Learning-based and Rule-based Trajectory Predictors CORL 2023 Language-Guided Traffic Simulation via Scene-Level Diffusion CORL 2023 Object Pose Estimation With Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation CVPR 2023 Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems L4DC 2023 FreeNeRF: Improving Few-Shot Neural Rendering With Free Frequency Regularization CVPR 2023 Learning Control-Oriented Dynamical Structure from Data ICML 2023 Graph Reinforcement Learning for Network Control via Bi-Level Optimization ICML 2023 Bayesian Reparameterization of Reward-Conditioned Reinforcement Learning with Energy-based Models ICML 2023 trajdata: A Unified Interface to Multiple Human Trajectory Datasets NIPS 2023 Online Learning for Traffic Routing under Unknown Preferences AISTATS 2023 DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles CORL 2022 AdvDO: Realistic Adversarial Attacks for Trajectory Prediction ECCV 2022 Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles CORL 2022 Robust Trajectory Prediction against Adversarial Attacks CORL 2022 Local calibration: metrics and recalibration UAI 2022 Data-Driven Chance Constrained Control using Kernel Distribution Embeddings L4DC 2022 A Simple and Efficient Sampling-based Algorithm for General Reachability Analysis L4DC 2022 Second-Order Sensitivity Analysis for Bilevel Optimization AISTATS 2022 A Unified View of SDP-based Neural Network Verification through Completely Positive Programming AISTATS 2022 Whose Track Is It Anyway? Improving Robustness to Tracking Errors With Affinity-Based Trajectory Prediction CVPR 2022 Motron: Multimodal Probabilistic Human Motion Forecasting CVPR 2022 ScePT: Scene-Consistent, Policy-Based Trajectory Predictions for Planning CVPR 2022 Co-Design of Communication and Machine Inference for Cloud Robotics RSS 2021 SEAGuL: Sample Efficient Adversarially Guided Learning of Value Functions L4DC 2021 Sketching curvature for efficient out-of-distribution detection for deep neural networks UAI 2021 Data Sharing and Compression for Cooperative Networked Control NIPS 2021 Lyapunov-stable neural-network control RSS 2021 Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems RSS 2021 MATS: An Interpretable Trajectory Forecasting Representation for Planning and Control CORL 2020 Sampling-based Reachability Analysis: A Random Set Theory Approach with Adversarial Sampling CORL 2020 Continuous Meta-Learning without Tasks NIPS 2020 Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Data ECCV 2020 Evidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders NIPS 2020 Network Offloading Policies for Cloud Robotics: A Learning-Based Approach RSS 2019 High-Dimensional Optimization in Adaptive Random Subspaces NIPS 2019 A Differentiable Augmented Lagrangian Method for Bilevel Nonlinear Optimization RSS 2019 Trajectory Optimization on Manifolds: A Theoretically-Guaranteed Embedded Sequential Convex Programming Approach RSS 2019 The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs ICCV 2019 Scalable and Congestion-Aware Routing for Autonomous Mobility-On-Demand Via Frank-Wolfe Optimization RSS 2019 Risk-Sensitive Generative Adversarial Imitation Learning AISTATS 2019 On the interaction between Autonomous Mobility-on-Demand systems and the power network: models and coordination algorithms RSS 2018 Risk-Constrained Reinforcement Learning with Percentile Risk Criteria JMLR 2018 Safe Motion Planning in Unknown Environments: Optimality Benchmarks and Tractable Policies RSS 2018 Risk-sensitive Inverse Reinforcement Learning via Coherent Risk Models RSS 2017 Evaluating Trajectory Collision Probability through Adaptive Importance Sampling for Safe Motion Planning RSS 2017 Routing Autonomous Vehicles in Congested Transportation Networks: Structural Properties and Coordination Algorithms RSS 2016 Risk-Sensitive and Robust Decision-Making: a CVaR Optimization Approach NIPS 2015 Control of Robotic Mobility-On-Demand Systems: a Queueing-Theoretical Perspective RSS 2014 Load Balancing for Mobility-on-Demand Systems RSS 2011