stochastic gradient descent

Dropout Reduces Underfitting ICML 2023 Efficient preconditioned stochastic gradient descent for estimation in latent variable models ICML 2023 Efficient Privacy-Preserving Stochastic Nonconvex Optimization UAI 2023 Enhance Robustness of Machine Learning with Improved Efficiency AAAI 2023 Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation ICLR 2023 Faster Differentially Private Convex Optimization via Second-Order Methods NeurIPS 2023 Feature selection and low test error in shallow low-rotation ReLU networks ICLR 2023 FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy ICLR 2023 Finding Generalization Measures by Contrasting Signal and Noise ICML 2023 Finding Local Minima Efficiently in Decentralized Optimization NeurIPS 2023 Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneity AISTATS 2023 From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks COLT 2023 Gaussian Membership Inference Privacy NeurIPS 2023 Generalization Guarantees via Algorithm-dependent Rademacher Complexity COLT 2023 Generalized Polyak Step Size for First Order Optimization with Momentum ICML 2023 Global Convergence Analysis of Local SGD for Two-layer Neural Network without Overparameterization NeurIPS 2023 Have it your way: Individualized Privacy Assignment for DP-SGD NeurIPS 2023 HeteRSGD: Tackling Heterogeneous Sampling Costs via Optimal Reweighted Stochastic Gradient Descent AISTATS 2023 High Probability Convergence of Stochastic Gradient Methods ICML 2023 HiGrad: Uncertainty Quantification for Online Learning and Stochastic Approximation JMLR 2023 How gradient estimator variance and bias impact learning in neural networks ICLR 2023 How much does Initialization Affect Generalization? ICML 2023 Implicit Bias of (Stochastic) Gradient Descent for Rank-1 Linear Neural Network NeurIPS 2023 Implicit Jacobian regularization weighted with impurity of probability output ICML 2023 Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent ICLR 2023