momentum method

On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization ICLR 2019 On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization ICML 2019 Quasi-hyperbolic momentum and Adam for deep learning ICLR 2019 SpiderBoost and Momentum: Faster Variance Reduction Algorithms NeurIPS 2019 Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations JMLR 2019 The Role of Memory in Stochastic Optimization UAI 2019 Understanding the Role of Momentum in Stochastic Gradient Methods NeurIPS 2019 Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent COLT 2018 IHT dies hard: Provable accelerated Iterative Hard Thresholding AISTATS 2018 Katyusha: The First Direct Acceleration of Stochastic Gradient Methods JMLR 2018 Katyusha X: Simple Momentum Method for Stochastic Sum-of-Nonconvex Optimization ICML 2018 On the insufficiency of existing momentum schemes for Stochastic Optimization ICLR 2018 Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Nonconvex Stochastic Optimization NeurIPS 2018 Accelerated Doubly Stochastic Gradient Algorithm for Large-scale Empirical Risk Minimization IJCAI 2017 Breaking Locality Accelerates Block Gauss-Seidel ICML 2017 Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization ICML 2017 On the Influence of Momentum Acceleration on Online Learning JMLR 2016