heavy ball method

Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization ICLR 2025 Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise ICLR 2024 Almost Sure Convergence Rates Analysis and Saddle Avoidance of Stochastic Gradient Methods JMLR 2024 Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024 Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions JMLR 2024 Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the in the O(epsilon^(-7/4)) Complexity JMLR 2023 Zeroth-order Optimization with Weak Dimension Dependency COLT 2023 Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022 Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball COLT 2021 Continuous Time Analysis of Momentum Methods JMLR 2021 Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models NeurIPS 2021 A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020 Automatic Differentiation of Some First-Order Methods in Parametric Optimization AISTATS 2020 Universal Average-Case Optimality of Polyak Momentum ICML 2020 Acceleration via Symplectic Discretization of High-Resolution Differential Equations NeurIPS 2019 Implicit Regularization of Accelerated Methods in Hilbert Spaces NeurIPS 2019 Non-Ergodic Convergence Analysis of Heavy-Ball Algorithms AAAI 2019 Shadowing Properties of Optimization Algorithms NeurIPS 2019 From Averaging to Acceleration, There is Only a Step-size COLT 2015