← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Markov Chain Score Ascent: A Unifying Framework of Variational Inference with Markovian Gradients NIPS 2022
From Gradient Flow on Population Loss to Learning with Stochastic Gradient Descent NIPS 2022
Efficiency Ordering of Stochastic Gradient Descent NIPS 2022
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NIPS 2022
Chaotic Dynamics are Intrinsic to Neural Network Training with SGD NIPS 2022
The alignment property of SGD noise and how it helps select flat minima: A stability analysis NIPS 2022
Data sampling affects the complexity of online SGD over dependent data UAI 2022
Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams NIPS 2022
Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold JMLR 2022
Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks NIPS 2022
Hierarchical Lattice Layer for Partially Monotone Neural Networks NIPS 2022
A Statistical Online Inference Approach in Averaged Stochastic Approximation NIPS 2022
Masked Training of Neural Networks with Partial Gradients AISTATS 2022
On the non-universality of deep learning: quantifying the cost of symmetry NIPS 2022
Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$-Covers NIPS 2022
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent AISTATS 2022
AdaBlock: SGD with Practical Block Diagonal Matrix Adaptation for Deep Learning AISTATS 2022
Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays NIPS 2022
Shifted compression framework: generalizations and improvements UAI 2022
Better SGD using Second-order Momentum NIPS 2022
Fast Mixing of Stochastic Gradient Descent with Normalization and Weight Decay NIPS 2022
Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks NIPS 2022
Learning-based Moving Horizon Estimation through Differentiable Convex Optimization Layers L4DC 2022
Multi-agent Performative Prediction with Greedy Deployment and Consensus Seeking Agents NIPS 2022
Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022