stochastic gradient descent

Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer NeurIPS 2023 Semi Bandit dynamics in Congestion Games: Convergence to Nash Equilibrium and No-Regret Guarantees. ICML 2023 SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics COLT 2023 (S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability NeurIPS 2023 SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance ICML 2023 SGD with Large Step Sizes Learns Sparse Features ICML 2023 Sharper Bounds for Uniformly Stable Algorithms with Stationary Mixing Process ICLR 2023 Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NeurIPS 2023 Special Properties of Gradient Descent with Large Learning Rates ICML 2023 Spectral Evolution and Invariance in Linear-width Neural Networks NeurIPS 2023 spred: Solving L1 Penalty with SGD ICML 2023 Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems COLT 2023 Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm NeurIPS 2023 Stability-Based Generalization Analysis for Mixtures of Pointwise and Pairwise Learning AAAI 2023 Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD AAAI 2023 Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks NeurIPS 2023 Stochastic Gradient Descent-Ascent: Unified Theory and New Efficient Methods AISTATS 2023 Stochastic Gradient Descent-Induced Drift of Representation in a Two-Layer Neural Network ICML 2023 Stochastic Gradient Descent under Markovian Sampling Schemes ICML 2023 The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks ICLR 2023 The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent ICML 2023 TiDAL: Learning Training Dynamics for Active Learning ICCV 2023 Tighter Analysis for ProxSkip ICML 2023 Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond ICML 2023 Toward Better PAC-Bayes Bounds for Uniformly Stable Algorithms NeurIPS 2023