momentum method

Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions NeurIPS 2022 Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball COLT 2021 Analytical Study of Momentum-Based Acceleration Methods in Paradigmatic High-Dimensional Non-Convex Problems NeurIPS 2021 Asynchronous Optimization Methods for Efficient Training of Deep Neural Networks with Guarantees AAAI 2021 CANITA: Faster Rates for Distributed Convex Optimization with Communication Compression NeurIPS 2021 Continuous Time Analysis of Momentum Methods JMLR 2021 Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models NeurIPS 2021 Heavy Ball Neural Ordinary Differential Equations NeurIPS 2021 Minibatch and Momentum Model-based Methods for Stochastic Weakly Convex Optimization NeurIPS 2021 On the Faster Alternating Least-Squares for CCA AISTATS 2021 Riemannian Stochastic Recursive Momentum Method for non-Convex Optimization IJCAI 2021 Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021 STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning NeurIPS 2021 Stochastic Sign Descent Methods: New Algorithms and Better Theory ICML 2021 SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients NeurIPS 2021 The Power of Factorial Powers: New Parameter settings for (Stochastic) Optimization ACML 2021 Acceleration through spectral density estimation ICML 2020 An Improved Analysis of Stochastic Gradient Descent with Momentum NeurIPS 2020 Conformal Symplectic and Relativistic Optimization NeurIPS 2020 Momentum Improves Normalized SGD ICML 2020 pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization IJCAI 2020 Proximal Gradient Algorithm with Momentum and Flexible Parameter Restart for Nonconvex Optimization IJCAI 2020 Variance Reduced Coordinate Descent with Acceleration: New Method With a Surprising Application to Finite-Sum Problems ICML 2020 Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances ICML 2019 AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods ICLR 2019