stochastic gradient descent

Private Geometric Median NeurIPS 2024 Proving Linear Mode Connectivity of Neural Networks via Optimal Transport AISTATS 2024 Revisiting Convergence of AdaGrad with Relaxed Assumptions UAI 2024 Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods ICLR 2024 Revisiting the Noise Model of Stochastic Gradient Descent AISTATS 2024 SAMPa: Sharpness-aware Minimization Parallelized NeurIPS 2024 Scalable DP-SGD: Shuffling vs. Poisson Subsampling NeurIPS 2024 Scaling Laws in Linear Regression: Compute, Parameters, and Data NeurIPS 2024 SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem ICLR 2024 SGD vs GD: Rank Deficiency in Linear Networks NeurIPS 2024 Shuffling Gradient-Based Methods for Nonconvex-Concave Minimax Optimization NeurIPS 2024 Sliding Down the Stairs: How Correlated Latent Variables Accelerate Learning with Neural Networks ICML 2024 SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization NeurIPS 2024 Small steps no more: Global convergence of stochastic gradient bandits for arbitrary learning rates NeurIPS 2024 Sparse Variational Student-t Processes AAAI 2024 Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness NeurIPS 2024 Stochastic Fine-Tuning of Language Models Using Masked Gradients EMNLP 2024 Stochastic Gradient Descent for Gaussian Processes Done Right ICLR 2024 Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent JMLR 2024 Stochastic Optimization Schemes for Performative Prediction with Nonconvex Loss NeurIPS 2024 Structured Dynamic Pricing: Optimal Regret in a Global Shrinkage Model JMLR 2024 Symmetries in Overparametrized Neural Networks: A Mean Field View NeurIPS 2024 The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank AAAI 2024 The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms NeurIPS 2024 The Implicit Bias of Adam on Separable Data NeurIPS 2024