conftrace_

polyak's momentum

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

polyak momentum (1) relu network (1) linear network (1) convergence rate (1) gradient descent (1) neural network optimization (1)

Papers

A Modular Analysis of Provable Acceleration via Polyak’s Momentum: Training a Wide ReLU Network and a Deep Linear Network ICML 2021