stochastic gradient descent

The Effect of Network Width on the Performance of Large-batch Training NeurIPS 2018 The Hidden Vulnerability of Distributed Learning in Byzantium ICML 2018 The Hierarchical Adaptive Forgetting Variational Filter ICML 2018 The Lingering of Gradients: How to Reuse Gradients Over Time NeurIPS 2018 The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning ICML 2018 The Spectrum of the Fisher Information Matrix of a Single-Hidden-Layer Neural Network NeurIPS 2018 Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Nonconvex Stochastic Optimization NeurIPS 2018 Training Deep Models Faster with Robust, Approximate Importance Sampling NeurIPS 2018 Unbiased Online Recurrent Optimization ICLR 2018 Uncertainty Sampling is Preconditioned Stochastic Gradient Descent on Zero-One Loss NeurIPS 2018 Variance-Reduced Stochastic Gradient Descent on Streaming Data NeurIPS 2018 Weighted SGD for ℓ_p Regression with Randomized Preconditioning JMLR 2018 When is a Convolutional Filter Easy to Learn? ICLR 2018 Accelerated Doubly Stochastic Gradient Algorithm for Large-scale Empirical Risk Minimization IJCAI 2017 Active Bias: Training More Accurate Neural Networks by Emphasizing High Variance Samples NeurIPS 2017 Adaptive Sampling Probabilities for Non-Smooth Optimization ICML 2017 Algorithmic Stability and Hypothesis Complexity ICML 2017 A PAC-Bayesian Analysis of Randomized Learning with Application to Stochastic Gradient Descent NeurIPS 2017 A Structural Representation Learning for Multi-relational Networks IJCAI 2017 A Unified Variance Reduction-Based Framework for Nonconvex Low-Rank Matrix Recovery ICML 2017 Automated Inference with Adaptive Batches AISTATS 2017 Backstitch: Counteracting Finite-Sample Bias via Negative Steps Interspeech 2017 Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Optimization NeurIPS 2017 Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent NeurIPS 2017 Collaborative Deep Learning in Fixed Topology Networks NeurIPS 2017