learning rate

At Stability's Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks? ICLR 2020 Better Full-Matrix Regret via Parameter-Free Online Learning NeurIPS 2020 Distributed Kernel Ridge Regression with Communications JMLR 2020 Online Convex Optimization with Perturbed Constraints: Optimal Rates against Stronger Benchmarks AISTATS 2020 Online mirror descent and dual averaging: keeping pace in the dynamic case ICML 2020 Overcoming Catastrophic Forgetting by Neuron-Level Plasticity Control AAAI 2020 Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate NeurIPS 2020 Safe-Bayesian Generalized Linear Regression AISTATS 2020 Semi-Supervised Learning: the Case When Unlabeled Data is Equally Useful UAI 2020 Sharp Thresholds of the Information Cascade Fragility Under a Mismatched Model AISTATS 2020 Sobolev Norm Learning Rates for Regularized Least-Squares Algorithms JMLR 2020 Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function NeurIPS 2020 The Break-Even Point on Optimization Trajectories of Deep Neural Networks ICLR 2020 Towards Problem-dependent Optimal Learning Rates NeurIPS 2020 Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020 Understanding the Role of Training Regimes in Continual Learning NeurIPS 2020 Adaptive Gradient Methods with Dynamic Bound of Learning Rate ICLR 2019 Adaptivity and Optimality: A Universal Algorithm for Online Convex Optimization UAI 2019 A Sufficient Condition for Convergences of Adam and RMSProp CVPR 2019 Cogra: Concept-Drift-Aware Stochastic Gradient Descent for Time-Series Forecasting AAAI 2019 Continuous-time Models for Stochastic Optimization Algorithms NeurIPS 2019 Control Batch Size and Learning Rate to Generalize Well: Theoretical and Empirical Evidence NeurIPS 2019 Convergence Analysis of Gradient-Based Learning in Continuous Games UAI 2019 Deep Frank-Wolfe For Neural Network Optimization ICLR 2019 Fast Rates for a kNN Classifier Robust to Unknown Asymmetric Label Noise ICML 2019