conftrace_

nesterov momentum

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

convergence rate (4) learning rate (2) gradient descent (2) accelerated optimization (2) convex optimization (2) stochastic gradient descent (2) accelerated gradient descent (1) exponential stability (1) calculus of variation (1) large batch training (1)

Papers

Accelerated Policy Gradient: On the Convergence Rates of the Nesterov Momentum for Reinforcement Learning ICML 2024 Acceleration and Implicit Regularization in Gaussian Phase Retrieval AISTATS 2024 On the Hyperparameters in Stochastic Gradient Descent with Momentum JMLR 2024 Provable Accelerated Convergence of Nesterov’s Momentum for Deep ReLU Neural Networks ALT 2024 Algorithmic Instabilities of Accelerated Gradient Descent NeurIPS 2021 Finite-time theory for momentum Q-learning UAI 2021 Rethinking the Variational Interpretation of Accelerated Optimization Methods NeurIPS 2021 Amortized Nesterov’s Momentum: A Robust Momentum and Its Application to Deep Learning UAI 2020 Don't Decay the Learning Rate, Increase the Batch Size ICLR 2018