conftrace_

iterate averaging

14 papers

Explore in graph

Also known as

IA

Co-occurring keywords

stochastic gradient descent (1091) convex function (24) linear regression (282) excess risk (66) stochastic optimization (1060) concept drift (73) momentum optimizer (3) proximal stochastic gradient (3) power iteration (23) bias-variance decomposition (17)

Papers

The Road Less Scheduled NIPS 2024
Iterate Averaging in the Quest for Best Test Error JMLR 2024
Stochastic Optimization under Distributional Drift JMLR 2023
Benign Overfitting of Constant-Stepsize SGD for Linear Regression JMLR 2023
Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees NIPS 2021
Convergence rates and approximation results for SGD and its continuous-time counterpart COLT 2021
Benign Overfitting of Constant-Stepsize SGD for Linear Regression COLT 2021
Increasing Iterate Averaging for Solving Saddle-Point Problems AAAI 2021
Obtaining Adjustable Regularization for Free via Iterate Averaging ICML 2020
Open Problem: Do Good Algorithms Necessarily Query Bad Points? COLT 2019
Stochastic Approximation of Smooth and Strongly Convex Functions: Beyond the $O(1/T)$ Convergence Rate COLT 2019
Averaging Stochastic Gradient Descent on Riemannian Manifolds COLT 2018
Iterate Averaging as Regularization for Stochastic Gradient Descent COLT 2018
Linear Stochastic Approximation: How Far Does Constant Step-Size and Iterate Averaging Go? AISTATS 2018