conftrace_

learning rate adaptation

10 papers

Explore in graph

Co-occurring keywords

learning rate (192) stochastic gradient descent (1091) adaptive algorithm (114) adaptive optimization (52) gradient descent (1144) online learning (1777) reward volatility (2) decision-theoretic online learning (2) strategy adaptation (2) hyperparameter tuning (215)

Papers

QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning AAAI 2024
Accelerated Training via Incrementally Growing Neural Networks using Variance Transfer and Learning Rate Adaptation NIPS 2023
Domain-Independent Dominance of Adaptive Methods CVPR 2021
Reverse engineering learned optimizers reveals known and novel mechanisms NIPS 2021
A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020
Learning Rate Adaptation for Differentially Private Learning AISTATS 2020
Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization AISTATS 2019
Why ADAGRAD Fails for Online Topic Modeling EMNLP 2017
Adaptive Hedge NIPS 2011
Environmental statistics and the trade-off between model-based and TD learning in humans NIPS 2011