Co-occurring keywords · papers mentioning both
stochastic approximation
(5)
temporal difference learning
(4)
two-timescale stochastic approximation
(2)
finite-time analysis
(2)
linear function approximation
(2)
gradient-based temporal difference
(1)
nonlinear function approximation
(1)
finite-time bound
(1)
exponential stability
(1)
multilevel monte carlo
(1)
Papers
Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise
AAAI 2026
High-Order Error Bounds for Markovian LSA with Richardson–Romberg Extrapolation
AAAI 2026
Linear Q-Learning Does Not Diverge in L^2: Convergence Rates to a Bounded Set
ICML 2025
The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise
JMLR 2025
Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way
AISTATS 2025
Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications
AISTATS 2024
First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities
NeurIPS 2023
On the Stability of Random Matrix Product with Markovian Noise: Application to Linear Stochastic Approximation and TD Learning
COLT 2021
Finite Time Analysis of Linear Two-timescale Stochastic Approximation with Markovian Noise
COLT 2020
Finite-Time Error Bounds For Linear Stochastic Approximation andTD Learning
COLT 2019