step size

Finite-Time Decoupled Convergence in Nonlinear Two-Time-Scale Stochastic Approximation JMLR 2026 Suspicious Alignment of SGD:A Fine-Grained Step Size Condition Analysis ALT 2026 AutoStep: Locally adaptive involutive MCMC ICML 2025 Constant Stepsize Local GD for Logistic Regression: Acceleration by Instability ICML 2025 Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VI AISTATS 2025 Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression ALT 2025 Gradient Descent Converges Arbitrarily Fast for Logistic Regression via Large and Adaptive Stepsizes ICML 2025 Learning to Steer Learners in Games ICML 2025 MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters ICML 2025 Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churn ICML 2025 On the Convergence of Min-Max Langevin Dynamics and Algorithm COLT 2025 On the Convergence of Projected Policy Gradient for Any Constant Step Sizes JMLR 2025 Rapid Overfitting of Multi-Pass SGD in Stochastic Convex Optimization ICML 2025 Toward a Unified Theory of Gradient Descent under Generalized Smoothness ICML 2025 Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares ICML 2024 Stability-Informed Initialization of Neural Ordinary Differential Equations ICML 2024 Understanding Forgetting in Continual Learning with Linear Regression ICML 2024 BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization NeurIPS 2023 DoG is SGD’s Best Friend: A Parameter-Free Dynamic Step Size Schedule ICML 2023 Reducing Discretization Error in the Frank-Wolfe Method AISTATS 2023 SGD with Large Step Sizes Learns Sparse Features ICML 2023 ASAP.SGD: Instance-based Adaptiveness to Staleness in Asynchronous SGD ICML 2022 Delay-Adaptive Step-sizes for Asynchronous Learning ICML 2022 Gradient Descent: The Ultimate Optimizer NeurIPS 2022 Revisit last-iterate convergence of mSGD under milder requirement on step size NeurIPS 2022