Matthijs T. J. Spaan

17 papers · 2005–2026 · 8 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

+4 more ↓

🌉 Interdisciplinary Bridge · Silver 🗺️ Taxonomy Completionist (29) 🌍 Conference Polyglot · Silver 🐣 Hot Topic Early Bird 🏃 Academic Marathon · Ultra

🚀 Conference Pioneer 🔥 Unstoppable · Bronze 💎 Century Club · Bronze 🗃️ Keyword Collector (76)

Venues

ICML (4) AAAI (3) ICLR (2) IJCAI (2) RSS (2) UAI (2) ACL (1) JMLR (1)

Top co-authors

Thiago D. Simão (5) Pascal R. van der Vaart (3) Moritz Akiya Zanger (3) Alberto Castellini (2) Alessandro Farinelli (2) Wendelin Boehmer (2) Yaniv Oren (2) Federico Bianchi (2) Yijun Wu (2) Edoardo Zorzi (2)

Research topics

Artificial Intelligence (12) Core AI (12) Reinforcement Learning (10) Methods (9) Machine Learning (8) Learning Types (5) Optimization & Theory (5) Applications · Reinforcement Learning (3) Deep Learning (2) Bayesian & Probabilistic (2) Robotics (1) Application Areas (1) Applications · Robotics (1) Core Methods (1) Learning Paradigms (1)

Keywords

reinforcement learning (5) monte carlo tree search (4) safe policy improvement (3) epistemic uncertainty (2) sample complexity (2) neural tangent kernel (2) uncertainty quantification (2) baseline bootstrapping (2) distributional reinforcement learning (2) policy improvement (2) offline reinforcement learning (1) sequential decision making (1) temporal difference learning (1) policy learning (1) reinforcement learning theory (1) sample efficiency (1) partially observable markov decision process (1) sequential monte carlo (1) policy iteration (1) structure learning (1)

Papers

An NTK Theory Approach to UCB Estimation in Semi-gradient TD Learning UAI 2026 On the Equivalence of Random Network Distillation, Deep Ensembles, and Bayesian Inference UAI 2026 Epistemic Bellman Operators AAAI 2025 Epistemic Monte Carlo Tree Search ICLR 2025 Positive Experience Reflection for Agents in Interactive Text Environments ACL 2025 Trust-Region Twisted Policy Improvement ICML 2025 Diverse Projection Ensembles for Distributional Reinforcement Learning ICLR 2024 Scalable Safe Policy Improvement for Factored Multi-Agent MDPs ICML 2024 Scalable Safe Policy Improvement via Monte Carlo Tree Search ICML 2023 Influence-Augmented Local Simulators: a Scalable Solution for Fast Deep RL in Large Networked Systems ICML 2022 Safe Policies for Factored Partially Observable Stochastic Games RSS 2021 WCSAC: Worst-Case Soft Actor Critic for Safety-Constrained Reinforcement Learning AAAI 2021 Safe Policy Improvement with Baseline Bootstrapping in Factored Environments AAAI 2019 Structure Learning for Safe Policy Improvement IJCAI 2019 The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems JMLR 2017 Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions IJCAI 2015 Robot Planning in Partially Observable Continuous Domains RSS 2005