conftrace_

adaptive stepsize

8 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) non-convex optimization (547) adaptive optimization (52) convergence rate (607) convergence analysis (395) convex optimization (1321) stochastic optimization (1060) momentum method (75) gradient method (29) exponential moving average (37)

Papers

Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes NIPS 2024
SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance ICML 2023
On the Last Iterate Convergence of Momentum Methods ALT 2022
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NIPS 2022
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients NIPS 2020
Adaptive Proximal Average Based Variance Reducing Stochastic Methods for Optimization with Composite Regularization AAAI 2019
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes AISTATS 2019
Adaptive Primal-Dual Splitting Methods for Statistical Learning and Image Processing NIPS 2015