conftrace_

heavy ball

8 papers

Explore in graph

Also known as

HB

Co-occurring keywords · papers mentioning both

momentum method (6) stochastic gradient descent (4) accelerated gradient (3) stochastic optimization (3) variational calculus (1) geometric integration (1) symplectic integration (1) implicit gradient transport (1) relativistic system (1) mini-batch noise (1)

Papers

SGD with memory: fundamental properties and stochastic acceleration ICLR 2025 Discrete Variational Calculus for Accelerated Optimization JMLR 2023 Does Momentum Help in Stochastic Optimization? A Sample Complexity Analysis. UAI 2023 Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022 Conformal Symplectic and Relativistic Optimization NeurIPS 2020 Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances ICML 2019 Reducing the variance in online optimization by transporting past gradients NeurIPS 2019 On the insufficiency of existing momentum schemes for Stochastic Optimization ICLR 2018