Richard S. Sutton
17 papers · 2006–2025 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+11 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (29) π Academic Marathon Β· Full π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Gold π£ Hot Topic Early Bird
π±
Topic Pioneer
π¬
Deep Specialist
(12)
π
Keyword Trendsetter Combo
(6)
π§¬
Topic Evolution
π
Keyword Champion
(2)
π§
Keyword Pioneer
π
Century Club Β· Bronze
π
Conference Pioneer
ποΈ
Keyword Collector
(78)
π
Trend Setter
π
Renaissance Researcher
(6)
Venues
Top co-authors
Research topics
Reinforcement Learning
(16)
Methods
(15)
Machine Learning
(14)
Learning Types Β· Machine Learning
(11)
Optimization & Theory
(10)
Artificial Intelligence
(6)
Applications
(6)
Core AI
(6)
Deep Learning
(4)
Learning Types Β· Deep Learning
(3)
Mathematics & Optimization
(2)
Optimization
(2)
Data Science & Analytics
(1)
Interdisciplinary
(1)
Knowledge & Reasoning
(1)
Keywords
reinforcement learning
(11)
temporal difference learning
(9)
value function
(7)
function approximation
(6)
off-policy learning
(5)
policy evaluation
(5)
linear function approximation
(4)
eligibility trace
(3)
stochastic gradient descent
(3)
model-based reinforcement learning
(3)
markov decision process
(3)
convergence analysis
(2)
bellman error
(2)
least-squares temporal difference
(2)
temporal abstraction
(2)
linear function approximator
(1)
natural gradient
(1)
computational neuroscience
(1)
deep learning
(1)
online learning
(1)
Papers
MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters
ICML 2025
Reward-Respecting Subtasks for Model-Based Reinforcement Learning (Abstract Reprint)
AAAI 2024
Scalable Real-Time Recurrent Learning Using Columnar-Constructive Networks
JMLR 2023
Toward Efficient Gradient-Based Value Estimation
ICML 2023
Doubly-Asynchronous Value Iteration: Making Value Iteration Asynchronous in Actions
NeurIPS 2022
Planning with Expectation Models
IJCAI 2019
On Generalized Bellman Equations and Temporal-Difference Learning
JMLR 2018
An Emphatic Approach to the Problem of Off-policy Temporal-Difference Learning
JMLR 2016
True Online Temporal-Difference Learning
JMLR 2016
Universal Option Models
NeurIPS 2014
Weighted importance sampling for off-policy learning with linear function approximation
NeurIPS 2014
Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation
NeurIPS 2009
Multi-Step Dyna Planning for Policy Evaluation and Control
NeurIPS 2009
A computational model of hippocampal function in trace conditioning
NeurIPS 2008
A Convergent $O(n)$ Temporal-difference Algorithm for Off-policy Learning with Linear Function Approximation
NeurIPS 2008
Incremental Natural Actor-Critic Algorithms
NeurIPS 2007
iLSTD: Eligibility Traces and Convergence Analysis
NeurIPS 2006