Skip to content
conftrace_

sign gradient descent

4 papers

Explore in graph

Also known as

SIGNGD

Co-occurring keywords · papers mentioning both

election coding (1) two-layer transformer (1) nonlinearities (1) convnext (1) low time-steps (1) neural network (1) coding theory (1) sign stochastic gradient descent (1) integrate-and-fire model (1) byzantine attack (1)

Papers

On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent ICLR 2025 Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network ICML 2024 Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023 Election Coding for Distributed Learning: Protecting SignSGD against Byzantine Attacks NeurIPS 2020