stochastic gradient descent

Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning JMLR 2025 Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping ICLR 2025 Online Quantile Regression JMLR 2025 On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks ICML 2025 On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm JMLR 2025 On the Performance Analysis of Momentum Method: A Frequency Domain Perspective ICLR 2025 On the Utility of Equal Batch Sizes for Inference in Stochastic Gradient Descent JMLR 2025 Optimal Decentralized Composite Optimization for Strongly Convex Functions JMLR 2025 Rapid Overfitting of Multi-Pass SGD in Stochastic Convex Optimization ICML 2025 Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration JMLR 2025 Revisiting Large-Scale Non-convex Distributionally Robust Optimization ICLR 2025 Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis AISTATS 2025 Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations ICLR 2025 Right Time to Learn: Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation ICML 2025 Robustness of Quantum Algorithms for Nonconvex Optimization ICLR 2025 SGD with memory: fundamental properties and stochastic acceleration ICLR 2025 Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training ICLR 2025 Sharpness-Aware Minimization: General Analysis and Improved Rates ICLR 2025 Stability and Generalization of Zeroth-Order Decentralized Stochastic Gradient Descent with Changing Topology AAAI 2025 Stabilizing Sharpness-Aware Minimization Through A Simple Renormalization Strategy JMLR 2025 Statistical Inference of Random Graphs With a Surrogate Likelihood Function JMLR 2025 Stochastic Gradient Descent for Bézier Simplex Representation of Pareto Set in Multi-Objective Optimization AISTATS 2025 Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance ICLR 2025 Stochastic Semi-Gradient Descent for Learning Mean Field Games with Population-Aware Function Approximation ICLR 2025 Taking a Big Step: Large Learning Rates in Denoising Score Matching Prevent Memorization COLT 2025