stochastic approximation

Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise AAAI 2026 A Two-Timescale Primal-Dual Framework for Reinforcement Learning via Online Dual Variable Guidance JMLR 2026 Central Limit Theorems for Asynchronous Averaged Q-Learning L4DC 2026 Finite-Time Decoupled Convergence in Nonlinear Two-Time-Scale Stochastic Approximation JMLR 2026 Gaussian Approximation and Multiplier Bootstrap for Federated Linear Stochastic Approximation UAI 2026 GINO-Q: Learning an Asymptotically Optimal Index Policy for Restless Multi-armed Bandits AAAI 2026 Convergence Rate in a Nonlinear Two-Time-Scale Stochastic Approximation with State (Time)-Dependence AAAI 2025 EF21 with Bells & Whistles: Six Algorithmic Extensions of Modern Error Feedback JMLR 2025 Global Optimization with a Power-Transformed Objective and Gaussian Smoothing ICML 2025 Learning in Herding Mean Field Games: Single-Loop Algorithm with Finite-Time Convergence Analysis AISTATS 2025 Online Covariance Estimation in Nonsmooth Stochastic Approximation COLT 2025 Recursive Learning of Asymptotic Variational Objectives AISTATS 2025 Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem AISTATS 2025 The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise JMLR 2025 Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way AISTATS 2025 An Analysis of Quantile Temporal-Difference Learning JMLR 2024 Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise NeurIPS 2024 Efficient Stochastic Approximation of Minimax Excess Risk Optimization ICML 2024 FastMAC: Stochastic Spectral Sampling of Correspondence Graph CVPR 2024 Finite-Time Convergence Rates of Decentralized Local Markovian Stochastic Approximation IJCAI 2024 Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability COLT 2024 Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization NeurIPS 2024 Oja's Algorithm for Streaming Sparse PCA NeurIPS 2024 Online Variational Sequential Monte Carlo ICML 2024 Periodic agent-state based Q-learning for POMDPs NeurIPS 2024