conftrace_

adaptive learning rate

58 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) non-convex optimization (547) stochastic optimization (1060) regret bound (1926) learning rate (192) variance reduction (523) gradient descent (1144) adam optimizer (54) online learning (1777) convergence guarantee (169)

Papers

SADAGRAD: Strongly Adaptive Stochastic Gradient Methods ICML 2018
Automated Inference with Adaptive Batches AISTATS 2017
Adaptive Learning Rate via Covariance Matrix Based Preconditioning for Deep Neural Networks IJCAI 2017
A survey of Algorithms and Analysis for Adaptive Online Learning JMLR 2017
Scalable Adaptive Stochastic Optimization Using Random Projections NIPS 2016
Equilibrated adaptive learning rates for non-convex optimization NIPS 2015
Adaptive Hedge NIPS 2011
Spatially-Adaptive Learning Rates for Online Incremental SLAM RSS 2007