Joshua B. Tenenbaum

GenMatter: Perceiving Physical Objects with Generative Matter Models CVPR 2026 Can Large Language Models Understand Symbolic Graphics Programs? ICLR 2025 Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-the-fly EMNLP 2025 LLM-Guided Probabilistic Program Induction for POMDP Model Estimation CoRL 2025 Multiagent Finetuning: Self Improvement with Diverse Reasoning Chains ICLR 2025 On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts EMNLP 2025 Testing the Limits of Fine-Tuning for Improving Visual Cognition in Vision Language Models ICML 2025 Vision CNNs trained to estimate spatial latents learned similar ventral-stream-aligned representations ICLR 2025 VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning ICLR 2025 What Makes a Maze Look Like a Maze? ICLR 2025 Building Cooperative Embodied Agents Modularly with Large Language Models ICLR 2024 Compositional Image Decomposition with Diffusion Models ICML 2024 ContPhy: Continuum Physical Concept Learning and Reasoning from Videos ICML 2024 Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads NeurIPS 2024 Evaluating Multiview Object Consistency in Humans and Image Models NeurIPS 2024 Generalized Planning in PDDL Domains with Pretrained Large Language Models AAAI 2024 HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments ICLR 2024 Improving Factuality and Reasoning in Language Models through Multiagent Debate ICML 2024 Learning Grounded Action Abstractions from Language ICLR 2024 Learning Iterative Reasoning through Energy Diffusion ICML 2024 Learning to Act from Actionless Videos through Dense Correspondences ICLR 2024 Learning to Jointly Understand Visual and Tactile Signals ICLR 2024 LILO: Learning Interpretable Libraries by Compressing and Documenting Code ICLR 2024 LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery ICML 2024 Neural Amortized Inference for Nested Multi-Agent Reasoning AAAI 2024 Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness RSS 2024 Physically Compatible 3D Object Modeling from a Single Image NeurIPS 2024 Potential Based Diffusion Motion Planning ICML 2024 Probabilistic Adaptation of Black-Box Text-to-Video Models ICLR 2024 Video Language Planning ICLR 2024 3D Concept Learning and Reasoning From Multi-View Images CVPR 2023 3D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation ICCV 2023 Are Deep Neural Networks SMARTer Than Second Graders? CVPR 2023 Composing Ensembles of Pre-trained Models via Iterative Consensus ICLR 2023 Compositional Diffusion-Based Continuous Constraint Solvers CoRL 2023 DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics ICLR 2023 Inferring Relational Potentials in Interacting Systems ICML 2023 Is Conditional Generative Modeling all you need for Decision Making? ICLR 2023 Learning Neural Constitutive Laws from Motion Observations for Generalizable PDE Dynamics ICML 2023 Learning Rational Subgoals from Demonstrations and Instructions AAAI 2023 Learning Reusable Manipulation Strategies CoRL 2023 Neural Groundplans: Persistent Neural Scene Representations from a Single Image ICLR 2023 On the Complexity of Bayesian Generalization ICML 2023 Planning with Large Language Models for Code Generation ICLR 2023 Planning with Sequence Models through Iterative Energy Minimization ICLR 2023 Predicate Invention for Bilevel Planning AAAI 2023 Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC ICML 2023 SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments ICLR 2023 Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models ICCV 2023 Visual Dependency Transformers: Dependency Tree Emerges From Reversed Attention CVPR 2023 Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs AAAI 2023 ComPhy: Compositional Physical Reasoning of Objects and Events from Videos ICLR 2022 Compositional Visual Generation with Composable Diffusion Models ECCV 2022 Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics ICLR 2022 DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools ICLR 2022 Discovering State and Action Abstractions for Generalized Task and Motion Planning AAAI 2022 Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following CoRL 2022 FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations ICLR 2022 Finding Fallen Objects via Asynchronous Audio-Visual Integration CVPR 2022 Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction CVPR 2022 Hybrid Memoised Wake-Sleep: Approximate Inference at the Discrete-Continuous Interface ICLR 2022 Learning Neuro-Symbolic Skills for Bilevel Planning CoRL 2022 Linking Emergent and Natural Languages via Corpus Transfer ICLR 2022 Map Induction: Compositional spatial submap learning for efficient exploration in novel environments ICLR 2022 MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation AAAI 2022 RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation ICLR 2022 Unsupervised Segmentation in Real-World Images via Spelke Object Inference ECCV 2022 Augmenting Policy Learning with Routines Discovered from a Single Demonstration AAAI 2021 GLIB: Efficient Exploration for Relational Model-Based Reinforcement Learning via Goal-Literal Babbling AAAI 2021 Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning ICLR 2021 Learning Task Decomposition with Ordered Memory Policy Network ICLR 2021 Learning with AMIGo: Adversarially Motivated Intrinsic Goals ICLR 2021 Neural Radiance Flow for 4D View Synthesis and Video Processing ICCV 2021 PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception AAAI 2021 Planning with Learned Object Importance in Large Problem Instances using Graph Neural Networks AAAI 2021 PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics ICLR 2021 Representing Partial Programs with Blended Abstract Semantics ICLR 2021 Single-Shot Scene Reconstruction CoRL 2021 Temporal and Object Quantification Networks IJCAI 2021 Unsupervised Discovery of 3D Physical Objects from Video ICLR 2021 Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration ICLR 2021 A Morphable Face Albedo Model CVPR 2020 CLEVRER: Collision Events for Video Representation and Reasoning ICLR 2020 Deep Audio Priors Emerge From Harmonic Convolutional Networks ICLR 2020 DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs IJCAI 2020 End-to-End Optimization of Scene Layout CVPR 2020 Foley Music: Learning to Generate Music from Videos ECCV 2020 Music Gesture for Visual Sound Separation CVPR 2020 Perspective Plane Program Induction From a Single Image CVPR 2020 Probabilistic Video Prediction From Noisy Data With a Posterior Confidence CVPR 2020 Rethinking Few-shot Image Classification: A Good Embedding is All You Need? ECCV 2020 Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning - Extended Abtract IJCAI 2019 GAN Dissection: Visualizing and Understanding Generative Adversarial Networks ICLR 2019 Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids ICLR 2019 Learning to Describe Scenes with Programs ICLR 2019 Learning to Infer and Execute 3D Shape Programs ICLR 2019 Program-Guided Image Manipulators ICCV 2019 Reasoning About Physical Interactions with Object-Oriented Prediction and Planning ICLR 2019 The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision ICLR 2019 Theory of Minds: Understanding Behavior in Groups through Inverse Planning AAAI 2019 Unsupervised Discovery of Parts, Structure, and Dynamics ICLR 2019 Learning Shape Priors for Single-View 3D Completion and Reconstruction ECCV 2018 Meta-Learning for Semi-Supervised Few-Shot Classification ICLR 2018 Physical Primitive Decomposition ECCV 2018 Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling CVPR 2018 Seeing Tree Structure from Vibration ECCV 2018 Generative Modeling of Audible Shapes for Object Perception ICCV 2017 Neural Scene De-Rendering CVPR 2017 Synthesizing 3D Shapes via Modeling Multi-View Depth Maps and Silhouettes With Deep Generative Networks CVPR 2017 CrossCat: A Fully Bayesian Nonparametric Method for Analyzing Heterogeneous, High Dimensional Data JMLR 2016 Picture: A Probabilistic Programming Language for Scene Perception CVPR 2015 Learning to Learn with Compound HD Models NeurIPS 2011 Dynamic Infinite Relational Model for Time-varying Relational Data Analysis NeurIPS 2010 Nonparametric Bayesian Policy Priors for Reinforcement Learning NeurIPS 2010 Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model NeurIPS 2009 Help or Hinder: Bayesian Models of Social Goal Inference NeurIPS 2009 Modelling Relational Data using Bayesian Clustered Tensor Factorization NeurIPS 2009 Perceptual Multistability as Markov Chain Monte Carlo Inference NeurIPS 2009 A Bayesian Framework for Cross-Situational Word-Learning NeurIPS 2007 Learning and using relational theories NeurIPS 2007 Causal inference in sensorimotor integration NeurIPS 2006 Combining causal and similarity-based reasoning NeurIPS 2006 Learning annotated hierarchies from relational data NeurIPS 2006 Multiple timescales and uncertainty in motor adaptation NeurIPS 2006 Unsupervised Topic Modelling for Multi-Party Spoken Discourse ACL 2006