conftrace_

stochastic heavy ball

3 papers

Explore in graph

Also known as

SHB

Co-occurring keywords · papers mentioning both

stochastic gradient descent (3) almost sure convergence (2) momentum method (2) convergence rate (2) non-convex objective (1) polyak stepsize (1) heavy ball method (1) nesterov accelerated gradient (1) adaptive step size (1) strongly convex function (1)

Papers

Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance ICLR 2025 On Almost Sure Convergence Rates of Stochastic Gradient Methods COLT 2022 Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball COLT 2021