conftrace_

distributed stochastic gradient descent

15 papers

Explore in graph

Also known as

DISTRIBUTED SGD DSGD

Co-occurring keywords

communication efficiency (297) stochastic gradient descent (1091) distributed learning (563) gradient sparsification (16) gradient compression (78) distributed optimization (275) non-convex optimization (547) gradient quantization (27) neural network (6616) communication compression (55)

Papers

Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGD NIPS 2024
Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity NIPS 2024
Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate NIPS 2022
Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022
Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021
Distributed Stochastic Gradient Descent with Event-Triggered Communication AAAI 2020
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NIPS 2019
Trading Redundancy for Communication: Speeding up Distributed SGD for Non-convex Optimization ICML 2019
A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification IJCAI 2019
cpSGD: Communication-efficient and differentially-private distributed SGD NIPS 2018
A Linear Speedup Analysis of Distributed Deep Learning with Sparse and Quantized Communication NIPS 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD AISTATS 2018
Bayesian Distributed Stochastic Gradient Descent NIPS 2018
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent NIPS 2017
Collaborative Deep Learning in Fixed Topology Networks NIPS 2017