← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Towards understanding how momentum improves generalization in deep learning ICML 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks ICML 2022
SGD with Coordinate Sampling: Theory and Practice JMLR 2022
Distributed Stochastic Gradient Descent: Nonconvexity, Nonsmoothness, and Convergence to Local Minima JMLR 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape AISTATS 2022
A Momentumized, Adaptive, Dual Averaged Gradient Method JMLR 2022
Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks JMLR 2022
On Almost Sure Convergence Rates of Stochastic Gradient Methods COLT 2022
Exploiting Explainable Metrics for Augmented SGD CVPR 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NIPS 2022
Learning-based Moving Horizon Estimation through Differentiable Convex Optimization Layers L4DC 2022
Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum ICML 2022
Stochastic Variance Reduced Ensemble Adversarial Attack for Boosting the Adversarial Transferability CVPR 2022
Better SGD using Second-order Momentum NIPS 2022
Learning Mixture of Neural Temporal Point Processes for Multi-dimensional Event Sequence Clustering IJCAI 2022
Ridgeless Regression with Random Features IJCAI 2022
On the Double Descent of Random Features Models Trained with SGD NIPS 2022
Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions NIPS 2022
Privacy Amplification by Decentralization AISTATS 2022
Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021
THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021
L-SVRG and L-Katyusha with Arbitrary Sampling JMLR 2021
PAGE: A Simple and Optimal Probabilistic Gradient Estimator for Nonconvex Optimization ICML 2021
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization ICML 2021
Stochastic Sign Descent Methods: New Algorithms and Better Theory ICML 2021