← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

On the Local Minima of the Empirical Risk NIPS 2018
Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Nonconvex Stochastic Optimization NIPS 2018
Natasha 2: Faster Non-Convex Optimization Than SGD NIPS 2018
Curriculum Learning by Transfer Learning: Theory and Experiments with Deep Networks ICML 2018
$D^2$: Decentralized Training over Decentralized Data ICML 2018
Batch IS NOT Heavy: Learning Word Representations From All Samples ACL 2018
Efficient Learning with a Family of Nonconvex Regularizers by Redistributing Nonconvexity JMLR 2018
On the Convergence Properties of a K-step Averaging Stochastic Gradient Descent Algorithm for Nonconvex Optimization IJCAI 2018
Accelerating Stochastic Gradient Descent for Least Squares Regression COLT 2018
Finding Global Optima in Nonconvex Stochastic Semidefinite Optimization with Variance Reduction AISTATS 2018
An Investigation of Non-linear i-vectors for Speaker Verification INTERSPEECH 2018
Stochastic Composite Mirror Descent: Optimal Bounds with High Probabilities NIPS 2018
Statistical Sparse Online Regression: A Diffusion Approximation Perspective AISTATS 2018
Escaping Saddles with Stochastic Gradients ICML 2018
SGDLibrary: A MATLAB library for stochastic optimization algorithms JMLR 2018
Distributed Asynchronous Optimization with Unbounded Delays: How Slow Can You Go? ICML 2018
Convergence diagnostics for stochastic gradient descent with constant learning rate AISTATS 2018
AdaGeo: Adaptive Geometric Learning for Optimization and Sampling AISTATS 2018
Online Bootstrap Confidence Intervals for the Stochastic Gradient Descent Estimator JMLR 2018
Iterate Averaging as Regularization for Stochastic Gradient Descent COLT 2018
$\ell_1$ Regression using Lewis Weights Preconditioning and Stochastic Gradient Descent COLT 2018
Averaging Stochastic Gradient Descent on Riemannian Manifolds COLT 2018
Exponential Convergence of Testing Error for Stochastic Gradient Methods COLT 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD AISTATS 2018
Asynchronous Decentralized Parallel Stochastic Gradient Descent ICML 2018