conftrace_

gradient smoothing

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

regularization effect (1) heavy-tailed data (1) excess population risk (1) decentralized stochastic gradient descent (1) stochastic convex optimization (1) sharpness-aware minimization (1) distributed learning (1) non-convex optimization (1) differential privacy (1)

Papers

Decentralized SGD and Average-direction SAM are Asymptotically Equivalent ICML 2023 On Differentially Private Stochastic Convex Optimization with Heavy-tailed Data ICML 2020