conftrace_

momentum method

75 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) convergence rate (607) gradient descent (1144) stochastic optimization (1060) non-convex optimization (547) nonconvex optimization (316) convergence analysis (395) variance reduction (523) convex optimization (1321) nesterov acceleration (54)

Papers

Heavy Ball Neural Ordinary Differential Equations NIPS 2021
Asynchronous Optimization Methods for Efficient Training of Deep Neural Networks with Guarantees AAAI 2021
Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball COLT 2021
Variance Reduced Coordinate Descent with Acceleration: New Method With a Surprising Application to Finite-Sum Problems ICML 2020
pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization IJCAI 2020
Conformal Symplectic and Relativistic Optimization NIPS 2020
Acceleration through spectral density estimation ICML 2020
Proximal Gradient Algorithm with Momentum and Flexible Parameter Restart for Nonconvex Optimization IJCAI 2020
Momentum Improves Normalized SGD ICML 2020
An Improved Analysis of Stochastic Gradient Descent with Momentum NIPS 2020
SpiderBoost and Momentum: Faster Variance Reduction Algorithms NIPS 2019
Understanding the Role of Momentum in Stochastic Gradient Methods NIPS 2019
On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization ICML 2019
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations JMLR 2019
Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances ICML 2019
The Role of Memory in Stochastic Optimization UAI 2019
IHT dies hard: Provable accelerated Iterative Hard Thresholding AISTATS 2018
Katyusha X: Simple Momentum Method for Stochastic Sum-of-Nonconvex Optimization ICML 2018
Katyusha: The First Direct Acceleration of Stochastic Gradient Methods JMLR 2018
Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Nonconvex Stochastic Optimization NIPS 2018
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent COLT 2018
Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization ICML 2017
Accelerated Doubly Stochastic Gradient Algorithm for Large-scale Empirical Risk Minimization IJCAI 2017
Breaking Locality Accelerates Block Gauss-Seidel ICML 2017
On the Influence of Momentum Acceleration on Online Learning JMLR 2016