stochastic gradient descent

How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? NeurIPS 2018 How SGD Selects the Global Minima in Over-parameterized Learning: A Dynamical Stability Perspective NeurIPS 2018 How To Make the Gradients Small Stochastically: Even Faster Convex and Nonconvex SGD NeurIPS 2018 Improved Asynchronous Parallel Optimization Analysis for Stochastic Incremental Methods JMLR 2018 Iterate Averaging as Regularization for Stochastic Gradient Descent COLT 2018 Katyusha: The First Direct Acceleration of Stochastic Gradient Methods JMLR 2018 L4: Practical loss-based stepsize adaptation for deep learning NeurIPS 2018 Large scale distributed neural network training through online distillation ICLR 2018 Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations ICML 2018 Learning One-hidden-layer Neural Networks with Landscape Design ICLR 2018 Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data NeurIPS 2018 Learning Sparse Neural Networks through L_0 Regularization ICLR 2018 Learning with SGD and Random Features NeurIPS 2018 Lightweight Label Propagation for Large-Scale Network Data IJCAI 2018 MISSION: Ultra Large-Scale Feature Selection using Count-Sketches ICML 2018 Natasha 2: Faster Non-Convex Optimization Than SGD NeurIPS 2018 NEON2: Finding Local Minima via First-Order Oracles NeurIPS 2018 New Insight into Hybrid Stochastic Gradient Descent: Beyond With-Replacement Sampling and Convexity NeurIPS 2018 Not All Samples Are Created Equal: Deep Learning with Importance Sampling ICML 2018 Online Bootstrap Confidence Intervals for the Stochastic Gradient Descent Estimator JMLR 2018 Online Learning Rate Adaptation with Hypergradient Descent ICLR 2018 On Markov Chain Gradient Descent NeurIPS 2018 On the Convergence Properties of a K-step Averaging Stochastic Gradient Descent Algorithm for Nonconvex Optimization IJCAI 2018 On the Information Bottleneck Theory of Deep Learning ICLR 2018 On the insufficiency of existing momentum schemes for Stochastic Optimization ICLR 2018