Stuart Russell

AssistanceZero: Scalably Solving Assistance Games ICML 2025 Avoiding Catastrophe in Online Learning by Asking for Help ICML 2025 BAMDP Shaping: a Unified Framework for Intrinsic Motivation and Reward Shaping ICLR 2025 Diffusion On Syntax Trees For Program Synthesis ICLR 2025 Extractive Structures Learned in Pretraining Enable Generalization on Finetuned Facts ICML 2025 Monitoring Latent World States in Language Models with Propositional Probes ICLR 2025 Observation Interference in Partially Observable Assistance Games ICML 2025 RL, but don’t do anything I wouldn’t do UAI 2025 The Partially Observable Off-Switch Game AAAI 2025 AI Alignment with Changing and Influenceable Reward Functions ICML 2024 Evidence of Learned Look-Ahead in a Chess-Playing Neural Network NeurIPS 2024 Image Hijacks: Adversarial Images can Control Generative Models at Runtime ICML 2024 On Representation Complexity of Model-based and Model-free Reinforcement Learning ICLR 2024 Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback ICML 2024 Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game ICLR 2024 The Effective Horizon Explains Deep RL Performance in Stochastic Environments ICLR 2024 Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics NeurIPS 2024 Trajectory Improvement and Reward Learning from Comparative Language Feedback CoRL 2024 When Your AIs Deceive You: Challenges of Partial Observability in Reinforcement Learning from Human Feedback NeurIPS 2024 Adversarial Policies Beat Superhuman Go AIs ICML 2023 Invariance in Policy Optimisation and Partial Identifiability in Reward Learning ICML 2023 Optimal Conservative Offline RL with General Function Approximation via Augmented Lagrangian ICLR 2023 SMCP3: Sequential Monte Carlo with Probabilistic Program Proposals AISTATS 2023 Who Needs to Know? Minimal Knowledge for Optimal Coordination ICML 2023 Cross-Domain Imitation Learning via Optimal Transport ICLR 2022 Estimating and Penalizing Induced Preference Shifts in Recommender Systems ICML 2022 For Learning in Symmetric Teams, Local Optima are Global Nash Equilibria ICML 2022 Quantifying Differences in Reward Functions ICLR 2021 Adversarial Policies: Attacking Deep Reinforcement Learning ICLR 2020 Bayesian Relational Memory for Semantic Visual Navigation ICCV 2019 Robust Multi-Agent Reinforcement Learning via Minimax Deep Deterministic Policy Gradient AAAI 2019 An Efficient, Generalized Bellman Update For Cooperative Inverse Reinforcement Learning ICML 2018 Discrete-Continuous Mixtures in Probabilistic Programming: Generalized Semantics and Inference Algorithms ICML 2018 Learning Plannable Representations with Causal InfoGAN NeurIPS 2018 Meta-Learning MCMC Proposals NeurIPS 2018 Negotiable Reinforcement Learning for Pareto Optimal Sequential Decision-Making NeurIPS 2018 Adversarial Training for Relation Extraction EMNLP 2017 Efficient Reinforcement Learning with Hierarchies of Machines by Leveraging Internal Transitions IJCAI 2017 Inverse Reward Design NeurIPS 2017 Should Robots be Obedient? IJCAI 2017 Signal-based Bayesian Seismic Monitoring AISTATS 2017 The Off-Switch Game IJCAI 2017 Cooperative Inverse Reinforcement Learning NeurIPS 2016 Markovian State and Action Abstractions for MDPs via Hierarchical MCTS IJCAI 2016 Swift: Compiled Inference for Probabilistic Programming Languages IJCAI 2016 Gaussian Process Random Fields NeurIPS 2015 Algorithm selection by rational metareasoning as a model of human strategy selection NeurIPS 2014 Dynamic Scaled Sampling for Deterministic Constraints AISTATS 2013 Multilinear Dynamical Systems for Tensor Time Series NeurIPS 2013 Global seismic monitoring as probabilistic inference NeurIPS 2010 Why are DBNs sparse? AISTATS 2010 Probabilistic detection of short events, with application to critical care monitoring NeurIPS 2008