Zhenxun Zhuang
4 papers · 2019–2022 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
🌍
Conference Polyglot
(2)
🌉
Interdisciplinary Bridge
🧭
Keyword Pioneer
🐣
Hot Topic Early Bird
🐝
Cross-Pollinator
(15)
Conferences
ICML (2)
NIPS (2)
Top co-authors
Keywords
non-convex optimization
(4)
stochastic gradient descent
(3)
gradient clipping
(2)
neural network optimization
(1)
online convex optimization
(1)
distributed training
(1)
communication efficiency
(1)
adaptive learning rate
(1)
communication complexity
(1)
polyak-lojasiewicz condition
(1)
adaptive gradient
(1)
exponential step size
(1)
cosine step size
(1)
unbounded smoothness
(1)
stepsize tuning
(1)
self-tuned stepsize
(1)
adam algorithm
(1)
Papers
Robustness to Unbounded Smoothness of Generalized SignSGD
NIPS 2022
A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks
NIPS 2022
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance
ICML 2021
Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization
ICML 2019