conftrace_

decentralized stochastic gradient descent

8 papers

Explore in graph

Also known as

DSGD DECENTRALIZED SGD D-SGD

Co-occurring keywords

distributed learning (563) stochastic gradient descent (1091) decentralized learning (103) generalization bound (652) communication topology (17) stochastic method (95) communication efficiency (297) distributed optimization (275) decentralized optimization (113) neighborhood heterogeneity (1)

Papers

Stability and Generalization of Zeroth-Order Decentralized Stochastic Gradient Descent with Changing Topology AAAI 2025
Towards Stability and Generalization Bounds in Decentralized Minibatch Stochastic Gradient Descent AAAI 2024
Refined Convergence and Topology Learning for Decentralized SGD with Heterogeneous Data AISTATS 2023
DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm ICML 2023
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent ICML 2023
Topology-aware Generalization of Decentralized SGD ICML 2022
Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021
Moniqua: Modulo Quantized Communication in Decentralized SGD ICML 2020