conftrace_

adam optimizer

54 papers

Explore in graph

Also known as

ADAM

Co-occurring keywords

stochastic gradient descent (1091) neural network optimization (1293) adaptive optimization (52) gradient descent (1144) stochastic optimization (1060) learning rate (192) convergence guarantee (169) adaptive learning rate (58) convergence rate (607) hyperparameter tuning (215)

Papers

A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019

Nostalgic Adam: Weighting More of the Past Gradients When Designing the Adaptive Learning Rate IJCAI 2019

Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients ICML 2018

L4: Practical loss-based stepsize adaptation for deep learning NIPS 2018