← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances ICML 2019
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication ICML 2019
Exponentially convergent stochastic k-PCA without variance reduction NIPS 2019
Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron AISTATS 2019
SAGA with Arbitrary Sampling ICML 2019
SGD: General Analysis and Improved Rates ICML 2019
Calibrated Stochastic Gradient Descent for Convolutional Neural Networks AAAI 2019
Parsimonious Online Learning with Kernels via Sparse Projections in Function Space JMLR 2019
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations JMLR 2019
Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation UAI 2019
Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers NIPS 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers NIPS 2019
Can SGD Learn Recurrent Neural Networks with Provable Generalization? NIPS 2019
Communication-efficient Distributed SGD with Sketching NIPS 2019
On the Ineffectiveness of Variance Reduced Optimization for Deep Learning NIPS 2019
Lookahead Optimizer: k steps forward, 1 step back NIPS 2019
Fast and Accurate Stochastic Gradient Estimation NIPS 2019
First Exit Time Analysis of Stochastic Gradient Descent Under Heavy-Tailed Gradient Noise NIPS 2019
SGD on Neural Networks Learns Functions of Increasing Complexity NIPS 2019
Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks NIPS 2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup NIPS 2019
Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks NIPS 2019
Lightweight Label Propagation for Large-Scale Network Data IJCAI 2018
Stochastic Nested Variance Reduction for Nonconvex Optimization NIPS 2018
Uncertainty Sampling is Preconditioned Stochastic Gradient Descent on Zero-One Loss NIPS 2018