conftrace_

adaptive gradient method

28 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) adaptive gradient (24) neural network optimization (1293) stochastic optimization (1060) nonconvex optimization (316) adam optimizer (54) convergence guarantee (169) learning rate (192) gradient descent (1144) convergence analysis (395)

Papers

Variants of RMSProp and Adagrad with Logarithmic Regret Bounds ICML 2017
The Marginal Value of Adaptive Gradient Methods in Machine Learning NIPS 2017
Delay-Tolerant Algorithms for Asynchronous Distributed Online Learning NIPS 2014