conftrace_

sign stochastic gradient descent

2 papers

Explore in graph

Also known as

SIGNSGD

Co-occurring keywords · papers mentioning both

convergence rate (2) neural network (1) sign gradient descent (1) error feedback (1) batch size (1) momentum optimization (1) optimization theory (1) variance reduction (1) distributed optimization (1) distributed learning (1)

Papers

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction NeurIPS 2024 Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023