conftrace_

learning rate

192 papers

Explore in graph

Also known as

LR

Co-occurring keywords

stochastic gradient descent (1091) neural network optimization (1293) gradient descent (1144) convergence rate (607) convergence analysis (395) stochastic optimization (1060) online learning (1777) kernel methods (1097) neural network (6616) regret bound (1926)

Papers

Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent ICML 2021
Safe-Bayesian Generalized Linear Regression AISTATS 2020
Sharp Thresholds of the Information Cascade Fragility Under a Mismatched Model AISTATS 2020
Understanding the Role of Training Regimes in Continual Learning NIPS 2020
Towards Problem-dependent Optimal Learning Rates NIPS 2020
A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020
Online mirror descent and dual averaging: keeping pace in the dynamic case ICML 2020
Semi-Supervised Learning: the Case When Unlabeled Data is Equally Useful UAI 2020
Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function NIPS 2020
Distributed Kernel Ridge Regression with Communications JMLR 2020
Sobolev Norm Learning Rates for Regularized Least-Squares Algorithms JMLR 2020
Overcoming Catastrophic Forgetting by Neuron-Level Plasticity Control AAAI 2020
Adaptive multi-fidelity optimization with fast learning rates AISTATS 2020
Online Convex Optimization with Perturbed Constraints: Optimal Rates against Stronger Benchmarks AISTATS 2020
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate NIPS 2020
Better Full-Matrix Regret via Parameter-Free Online Learning NIPS 2020
Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020
Continuous-time Models for Stochastic Optimization Algorithms NIPS 2019
On the optimality of the Hedge algorithm in the stochastic regime JMLR 2019
Convergence Analysis of Gradient-Based Learning in Continuous Games UAI 2019
Understanding the Impact of Entropy on Policy Optimization ICML 2019
The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Study ICML 2019
Cogra: Concept-Drift-Aware Stochastic Gradient Descent for Time-Series Forecasting AAAI 2019
A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019
Learning rates for Gaussian mixtures under group action COLT 2019