conftrace_

lookahead optimizer

5 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) convergence analysis (395) nonconvex optimization (316) smooth game (5) gan training (21) gradient method (29) gradient descent ascent (31) local sgd (17) linear interpolation (11) lipschitz smoothness (4)

Papers

Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization ICML 2023
Stable Nonconvex-Nonconcave Training via Linear Interpolation NIPS 2023
On Convergence of Lookahead in Smooth Games AISTATS 2022
Towards Understanding Why Lookahead Generalizes Better Than SGD and Beyond NIPS 2021
Lookahead Optimizer: k steps forward, 1 step back NIPS 2019