← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

User-level Private Stochastic Convex Optimization with Optimal Rates ICML 2023
Variational Sparse Inverse Cholesky Approximation for Latent Gaussian Processes via Double Kullback-Leibler Minimization ICML 2023
Recursive Quantile Estimation: Non-Asymptotic Confidence Bounds JMLR 2023
Stochastic Gradient Descent under Markovian Sampling Schemes ICML 2023
Tighter Analysis for ProxSkip ICML 2023
DoG is SGD’s Best Friend: A Parameter-Free Dynamic Step Size Schedule ICML 2023
Implicit Stochastic Gradient Descent for Training Physics-Informed Neural Networks AAAI 2023
How much does Initialization Affect Generalization? ICML 2023
Semi Bandit dynamics in Congestion Games: Convergence to Nash Equilibrium and No-Regret Guarantees. ICML 2023
Network Effects in Performative Prediction Games ICML 2023
Dropout Reduces Underfitting ICML 2023
Data Banzhaf: A Robust Data Valuation Framework for Machine Learning AISTATS 2023
Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks NIPS 2023
Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width NIPS 2023
An SDE for Modeling SAM: Theory and Insights ICML 2023
TiDAL: Learning Training Dynamics for Active Learning ICCV 2023
Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023
Implicit Bias of (Stochastic) Gradient Descent for Rank-1 Linear Neural Network NIPS 2023
A Theoretical Analysis of the Learning Dynamics under Class Imbalance ICML 2023
Special Properties of Gradient Descent with Large Learning Rates ICML 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods NIPS 2023
On the Convergence of Black-Box Variational Inference NIPS 2023
Decentralized Riemannian Algorithm for Nonconvex Minimax Problems AAAI 2023
AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023
spred: Solving L1 Penalty with SGD ICML 2023