stochastic gradient descent

The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects ICML 2019 The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Study ICML 2019 Theoretical Analysis of Auto Rate-Tuning by Batch Normalization ICLR 2019 The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares NeurIPS 2019 Tight analyses for non-smooth stochastic gradient descent COLT 2019 Tight Dimension Independent Lower Bound on the Expected Convergence Rate for Diminishing Step Sizes in SGD NeurIPS 2019 Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks NeurIPS 2019 Toward Understanding the Impact of Staleness in Distributed Machine Learning ICLR 2019 Trading Redundancy for Communication: Speeding up Distributed SGD for Non-convex Optimization ICML 2019 Two Tiered Distributed Training Algorithm for Acoustic Modeling Interspeech 2019 Understanding and correcting pathologies in the training of learned optimizers ICML 2019 Understanding the Role of Momentum in Stochastic Gradient Methods NeurIPS 2019 Universal Adversarial Perturbation via Prior Driven Uncertainty Approximation ICCV 2019 Universal Stagewise Learning for Non-Convex Problems with Convergence on Averaged Solutions ICLR 2019 User-Specified Local Differential Privacy in Unconstrained Adaptive Online Learning NeurIPS 2019 Using Statistics to Automate Stochastic Optimization NeurIPS 2019 What is the Effect of Importance Weighting in Deep Learning? ICML 2019 Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model NeurIPS 2019 Zeno: Distributed Stochastic Gradient Descent with Suspicion-based Fault-tolerance ICML 2019 D^2: Decentralized Training over Decentralized Data ICML 2018 ℓ_1 Regression using Lewis Weights Preconditioning and Stochastic Gradient Descent COLT 2018 A Bayesian Perspective on Generalization and Stochastic Gradient Descent ICLR 2018 Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP 2018 Accelerating Convolutional Networks via Global & Dynamic Filter Pruning IJCAI 2018 Accelerating Stochastic Gradient Descent for Least Squares Regression COLT 2018