conftrace_

adaptive step size

18 papers

Explore in graph

Co-occurring keywords

convergence rate (607) convex optimization (1321) stochastic gradient descent (1091) stochastic optimization (1060) step size (26) learning rate (192) gradient descent (1144) adaptive optimization (52) non-convex optimization (547) optimistic method (4)

Papers

Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization NIPS 2024
On the Convergence of Loss and Uncertainty-based Active Learning Algorithms NIPS 2024
Beyond the Golden Ratio for Variational Inequality Algorithms JMLR 2023
Generalized Polyak Step Size for First Order Optimization with Momentum ICML 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization NIPS 2023
Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD COLT 2023
Randomized Primal-Dual Methods with Adaptive Step Sizes AISTATS 2023
Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022
Making SGD Parameter-Free COLT 2022
Adaptive Stochastic Variance Reduction for Non-convex Finite-Sum Minimization NIPS 2022
Adaptive Random Walk Gradient Descent for Decentralized Optimization ICML 2022
"Hey, that’s not an ODE": Faster ODE Adjoints via Seminorms ICML 2021
Convergence Rates of a Momentum Algorithm with Bounded Adaptive Step Size for Nonconvex Optimization ACML 2020
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search ICML 2019
Adaptive Three Operator Splitting ICML 2018
Stochastic Adaptive Quasi-Newton Methods for Minimizing Expected Values ICML 2017
Follow the Moving Leader in Deep Learning ICML 2017
Global Convergence of a Grassmannian Gradient Descent Algorithm for Subspace Estimation AISTATS 2016