Joshua B. Tenenbaum

Testing the Limits of Fine-Tuning for Improving Visual Cognition in Vision Language Models ICML 2025 LLM-Guided Probabilistic Program Induction for POMDP Model Estimation CORL 2025 What Makes a Maze Look Like a Maze? ICLR 2025 Multiagent Finetuning: Self Improvement with Diverse Reasoning Chains ICLR 2025 VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning ICLR 2025 Vision CNNs trained to estimate spatial latents learned similar ventral-stream-aligned representations ICLR 2025 Can Large Language Models Understand Symbolic Graphics Programs? ICLR 2025 On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts EMNLP 2025 Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-the-fly EMNLP 2025 ContPhy: Continuum Physical Concept Learning and Reasoning from Videos ICML 2024 Physically Compatible 3D Object Modeling from a Single Image NIPS 2024 Learning to Act from Actionless Videos through Dense Correspondences ICLR 2024 Learning to Jointly Understand Visual and Tactile Signals ICLR 2024 Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness RSS 2024 LILO: Learning Interpretable Libraries by Compressing and Documenting Code ICLR 2024 Probabilistic Adaptation of Black-Box Text-to-Video Models ICLR 2024 HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments ICLR 2024 Video Language Planning ICLR 2024 Building Cooperative Embodied Agents Modularly with Large Language Models ICLR 2024 Learning Grounded Action Abstractions from Language ICLR 2024 Evaluating Multiview Object Consistency in Humans and Image Models NIPS 2024 Compositional Image Decomposition with Diffusion Models ICML 2024 LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery ICML 2024 Neural Amortized Inference for Nested Multi-Agent Reasoning AAAI 2024 Generalized Planning in PDDL Domains with Pretrained Large Language Models AAAI 2024 Potential Based Diffusion Motion Planning ICML 2024 Learning Iterative Reasoning through Energy Diffusion ICML 2024 Improving Factuality and Reasoning in Language Models through Multiagent Debate ICML 2024 Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads NIPS 2024 Inferring Relational Potentials in Interacting Systems ICML 2023 Learning Reusable Manipulation Strategies CORL 2023 Compositional Diffusion-Based Continuous Constraint Solvers CORL 2023 Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs AAAI 2023 Learning Rational Subgoals from Demonstrations and Instructions AAAI 2023 Predicate Invention for Bilevel Planning AAAI 2023 Visual Dependency Transformers: Dependency Tree Emerges From Reversed Attention CVPR 2023 3D Concept Learning and Reasoning From Multi-View Images CVPR 2023 Are Deep Neural Networks SMARTer Than Second Graders? CVPR 2023 Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models ICCV 2023 3D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation ICCV 2023 Planning with Sequence Models through Iterative Energy Minimization ICLR 2023 DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics ICLR 2023 Planning with Large Language Models for Code Generation ICLR 2023 SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments ICLR 2023 Composing Ensembles of Pre-trained Models via Iterative Consensus ICLR 2023 Neural Groundplans: Persistent Neural Scene Representations from a Single Image ICLR 2023 Is Conditional Generative Modeling all you need for Decision Making? ICLR 2023 Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC ICML 2023 Learning Neural Constitutive Laws from Motion Observations for Generalizable PDE Dynamics ICML 2023 On the Complexity of Bayesian Generalization ICML 2023 ComPhy: Compositional Physical Reasoning of Objects and Events from Videos ICLR 2022 Hybrid Memoised Wake-Sleep: Approximate Inference at the Discrete-Continuous Interface ICLR 2022 Map Induction: Compositional spatial submap learning for efficient exploration in novel environments ICLR 2022 Learning Neuro-Symbolic Skills for Bilevel Planning CORL 2022 Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics ICLR 2022 Compositional Visual Generation with Composable Diffusion Models ECCV 2022 Unsupervised Segmentation in Real-World Images via Spelke Object Inference ECCV 2022 MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation AAAI 2022 Discovering State and Action Abstractions for Generalized Task and Motion Planning AAAI 2022 Finding Fallen Objects via Asynchronous Audio-Visual Integration CVPR 2022 Linking Emergent and Natural Languages via Corpus Transfer ICLR 2022 Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following CORL 2022 Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction CVPR 2022 RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation ICLR 2022 FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations ICLR 2022 DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools ICLR 2022 Augmenting Policy Learning with Routines Discovered from a Single Demonstration AAAI 2021 Temporal and Object Quantification Networks IJCAI 2021 Neural Radiance Flow for 4D View Synthesis and Video Processing ICCV 2021 Learning Task Decomposition with Ordered Memory Policy Network ICLR 2021 Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning ICLR 2021 Representing Partial Programs with Blended Abstract Semantics ICLR 2021 Unsupervised Discovery of 3D Physical Objects from Video ICLR 2021 Learning with AMIGo: Adversarially Motivated Intrinsic Goals ICLR 2021 Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration ICLR 2021 PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics ICLR 2021 Single-Shot Scene Reconstruction CORL 2021 Planning with Learned Object Importance in Large Problem Instances using Graph Neural Networks AAAI 2021 GLIB: Efficient Exploration for Relational Model-Based Reinforcement Learning via Goal-Literal Babbling AAAI 2021 PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception AAAI 2021 Foley Music: Learning to Generate Music from Videos ECCV 2020 Rethinking Few-shot Image Classification: A Good Embedding is All You Need? ECCV 2020 Deep Audio Priors Emerge From Harmonic Convolutional Networks ICLR 2020 CLEVRER: Collision Events for Video Representation and Reasoning ICLR 2020 Probabilistic Video Prediction From Noisy Data With a Posterior Confidence CVPR 2020 A Morphable Face Albedo Model CVPR 2020 End-to-End Optimization of Scene Layout CVPR 2020 Perspective Plane Program Induction From a Single Image CVPR 2020 Music Gesture for Visual Sound Separation CVPR 2020 DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs IJCAI 2020 Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning - Extended Abtract IJCAI 2019 GAN Dissection: Visualizing and Understanding Generative Adversarial Networks ICLR 2019 Reasoning About Physical Interactions with Object-Oriented Prediction and Planning ICLR 2019 Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids ICLR 2019 Learning to Infer and Execute 3D Shape Programs ICLR 2019 Program-Guided Image Manipulators ICCV 2019 The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision ICLR 2019 Learning to Describe Scenes with Programs ICLR 2019 Unsupervised Discovery of Parts, Structure, and Dynamics ICLR 2019 Theory of Minds: Understanding Behavior in Groups through Inverse Planning AAAI 2019 Physical Primitive Decomposition ECCV 2018 Seeing Tree Structure from Vibration ECCV 2018 Learning Shape Priors for Single-View 3D Completion and Reconstruction ECCV 2018 Meta-Learning for Semi-Supervised Few-Shot Classification ICLR 2018 Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling CVPR 2018 Synthesizing 3D Shapes via Modeling Multi-View Depth Maps and Silhouettes With Deep Generative Networks CVPR 2017 Generative Modeling of Audible Shapes for Object Perception ICCV 2017 Neural Scene De-Rendering CVPR 2017 CrossCat: A Fully Bayesian Nonparametric Method for Analyzing Heterogeneous, High Dimensional Data JMLR 2016 Picture: A Probabilistic Programming Language for Scene Perception CVPR 2015 Learning to Learn with Compound HD Models NIPS 2011 Dynamic Infinite Relational Model for Time-varying Relational Data Analysis NIPS 2010 Nonparametric Bayesian Policy Priors for Reinforcement Learning NIPS 2010 Help or Hinder: Bayesian Models of Social Goal Inference NIPS 2009 Perceptual Multistability as Markov Chain Monte Carlo Inference NIPS 2009 Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model NIPS 2009 Modelling Relational Data using Bayesian Clustered Tensor Factorization NIPS 2009 A Bayesian Framework for Cross-Situational Word-Learning NIPS 2007 Learning and using relational theories NIPS 2007 Learning annotated hierarchies from relational data NIPS 2006 Multiple timescales and uncertainty in motor adaptation NIPS 2006 Unsupervised Topic Modelling for Multi-Party Spoken Discourse COLING 2006 Combining causal and similarity-based reasoning NIPS 2006 Causal inference in sensorimotor integration NIPS 2006 Unsupervised Topic Modelling for Multi-Party Spoken Discourse ACL 2006