Vladlen Koltun

Depth Pro: Sharp Monocular Metric Depth in Less Than a Second ICLR 2025 Cut Your Losses in Large-Vocabulary Language Models ICLR 2025 Robust Autonomy Emerges from Self-Play ICML 2025 CoMotion: Concurrent Multi-person 3D Motion ICLR 2025 Does Spatial Cognition Emerge in Frontier Models? ICLR 2025 Shape From Polarization for Complex Scenes in the Wild CVPR 2022 Dancing Under the Stars: Video Denoising in Starlight CVPR 2022 Global Tracking Transformers CVPR 2022 Scale-invariant Learning by Physics Inversion NIPS 2022 Guaranteed Conservation of Momentum for Learning Particle-based Fluid Dynamics NIPS 2022 Non-deep Networks NIPS 2022 Domain Generalization without Excess Empirical Risk NIPS 2022 Simple Multi-Dataset Detection CVPR 2022 Neural Deep Equilibrium Solvers ICLR 2022 Language-driven Semantic Segmentation ICLR 2022 Habitat 2.0: Training Home Assistants to Rearrange their Habitat NIPS 2021 Self-Supervised Geometric Perception CVPR 2021 Stable View Synthesis CVPR 2021 Differentiable Simulation of Soft Multi-body Systems NIPS 2021 Geometry Processing with Neural Fields NIPS 2021 Stabilizing Equilibrium Models by Jacobian Regularization ICML 2021 Large Batch Simulation for Deep Reinforcement Learning ICLR 2021 Adaptive Surface Reconstruction With Multiscale Convolutional Kernels ICCV 2021 Point Transformer ICCV 2021 Vision Transformers for Dense Prediction ICCV 2021 Learning To Drive From a World on Rails ICCV 2021 Online Continual Learning With Natural Distribution Shifts: An Empirical Study With Visual Data ICCV 2021 Efficient Differentiable Simulation of Articulated Bodies ICML 2021 Megaverse: Simulating Embodied Agents at One Million Experiences per Second ICML 2021 Training Graph Neural Networks with 1000 Layers ICML 2021 Deep Drone Acrobatics (Extended Abstract) IJCAI 2021 MSeg: A Composite Dataset for Multi-Domain Semantic Segmentation CVPR 2020 High-Dimensional Convolutional Networks for Geometric Pattern Recognition CVPR 2020 Deep Drone Acrobatics RSS 2020 Exploring Self-Attention for Image Recognition CVPR 2020 On Joint Estimation of Pose, Geometry and svBRDF From a Handheld Scanner CVPR 2020 Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learning ICML 2020 Scalable Differentiable Physics for Learning and Control ICML 2020 Multiscale Deep Equilibrium Models NIPS 2020 Tracking Objects as Points ECCV 2020 Free View Synthesis ECCV 2020 Dynamic Low-light Imaging with Quanta Image Sensors ECCV 2020 Deep Global Registration CVPR 2020 Learning to Control PDEs with Differentiable Physics ICLR 2020 Learning to Guide Random Search ICLR 2020 Lagrangian Fluid Simulation with Continuous Convolutions ICLR 2020 Deep Layers as Stochastic Solvers ICLR 2019 Deep Equilibrium Models NIPS 2019 Differentiable Cloth Simulation for Inverse Problems NIPS 2019 Learning by Cheating CORL 2019 What Do Single-View 3D Reconstruction Networks Learn? CVPR 2019 Zoom to Learn, Learn to Zoom CVPR 2019 Events-To-Video: Bringing Modern Computer Vision to Event Cameras CVPR 2019 Acoustic Non-Line-Of-Sight Imaging CVPR 2019 Connecting the Dots: Learning Representations for Active Monocular Depth Estimation CVPR 2019 Hiding Video in Audio via Reversible Generative Models ICCV 2019 Consensus Maximization Tree Search Revisited ICCV 2019 Seeing Motion in the Dark ICCV 2019 Fully Convolutional Geometric Features ICCV 2019 Habitat: A Platform for Embodied AI Research ICCV 2019 Trellis Networks for Sequence Modeling ICLR 2019 Speech Denoising with Deep Feature Losses INTERSPEECH 2019 TD or not TD: Analyzing the Role of Temporal Differencing in Deep Reinforcement Learning ICLR 2018 Semi-parametric topological memory for navigation ICLR 2018 Driving Policy Transfer via Modularity and Abstraction CORL 2018 Deep Drone Racing: Learning Agile Flight in Dynamic Environments CORL 2018 Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search NIPS 2018 Motion Perception in Reinforcement Learning with Dynamic Objects CORL 2018 On Offline Evaluation of Vision-based Driving Models ECCV 2018 Deep Fundamental Matrix Estimation ECCV 2018 Semi-Parametric Image Synthesis CVPR 2018 Tangent Convolutions for Dense Prediction in 3D CVPR 2018 Learning to See in the Dark CVPR 2018 Interactive Image Segmentation With Latent Diversity CVPR 2018 Multi-Task Learning as Multi-Objective Optimization NIPS 2018 Photographic Image Synthesis With Cascaded Refinement Networks ICCV 2017 Playing for Benchmarks ICCV 2017 Fast Image Processing With Fully-Convolutional Networks ICCV 2017 Learning to Inpaint for Image Compression NIPS 2017 Accurate Optical Flow via Direct Cost Volume Processing CVPR 2017 Dilated Residual Networks CVPR 2017 CARLA: An Open Urban Driving Simulator CORL 2017 Colored Point Cloud Registration Revisited ICCV 2017 Learning Compact Geometric Features ICCV 2017 Dense Monocular Depth Estimation in Complex Dynamic Scenes CVPR 2016 Full Flow: Optical Flow Estimation By Global Optimization Over Regular Grids CVPR 2016 Feature Space Optimization for Semantic Video Segmentation CVPR 2016 Learning to Propose Objects CVPR 2015 Depth Camera Tracking With Contour Cues CVPR 2015 Robust Nonrigid Registration by Convex Optimization ICCV 2015 Robust Reconstruction of Indoor Scenes CVPR 2015 Fast MRF Optimization with Application to Depth Reconstruction CVPR 2014 Learning Complex Neural Network Policies with Trajectory Optimization ICML 2014 Simultaneous Localization and Calibration: Self-Calibration of Consumer Depth Cameras CVPR 2014 Parameter Learning and Convergent Inference for Dense Random Fields ICML 2013 A Simple Model for Intrinsic Image Decomposition with Depth Cues ICCV 2013 Elastic Fragments for Dense Scene Reconstruction ICCV 2013 Guided Policy Search ICML 2013 Variational Policy Search via Trajectory Optimization NIPS 2013 Nonlinear Inverse Reinforcement Learning with Gaussian Processes NIPS 2011 Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials NIPS 2011 Feature Construction for Inverse Reinforcement Learning NIPS 2010