distributed stochastic gradient descent

Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGD NeurIPS 2024 Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity NeurIPS 2024 Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate NeurIPS 2022 Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022 Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021 Distributed Stochastic Gradient Descent with Event-Triggered Communication AAAI 2020 A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification IJCAI 2019 Optimal Sparsity-Sensitive Bounds for Distributed Mean Estimation NeurIPS 2019 Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations NeurIPS 2019 Trading Redundancy for Communication: Speeding up Distributed SGD for Non-convex Optimization ICML 2019 A Linear Speedup Analysis of Distributed Deep Learning with Sparse and Quantized Communication NeurIPS 2018 Bayesian Distributed Stochastic Gradient Descent NeurIPS 2018 cpSGD: Communication-efficient and differentially-private distributed SGD NeurIPS 2018 Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD AISTATS 2018 Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent NeurIPS 2017 Collaborative Deep Learning in Fixed Topology Networks NeurIPS 2017