Distributed Learning

Cooperative SGD: A Unified Framework for the Design and Analysis of Local-Update SGD Algorithms JMLR 2021 Cooperative Stochastic Bandits with Asynchronous Agents and Constrained Feedback NeurIPS 2021 Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates AISTATS 2021 Cross-Gradient Aggregation for Decentralized Learning from Non-IID Data ICML 2021 DecentLaM: Decentralized Momentum SGD for Large-Batch Deep Training ICCV 2021 Decentralised Learning from Independent Multi-Domain Labels for Person Re-Identification AAAI 2021 Decentralized Riemannian Gradient Descent on the Stiefel Manifold ICML 2021 DeepReduce: A Sparse-tensor Communication Framework for Federated Deep Learning NeurIPS 2021 Delayed Gradient Averaging: Tolerate the Communication Latency for Federated Learning NeurIPS 2021 DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs ICML 2021 Differentially Private Aggregation in the Shuffle Model: Almost Central Accuracy in Almost a Single Message ICML 2021 Distributed Covariance Steering with Consensus ADMM for Stochastic Multi-Agent Systems RSS 2021 Distributed Deep Learning In Open Collaborations NeurIPS 2021 Distributed Estimation with Multiple Samples per User: Sharp Rates and Phase Transition NeurIPS 2021 Distributed Machine Learning with Sparse Heterogeneous Data NeurIPS 2021 Distributed Nyström Kernel Learning with Communications ICML 2021 Distributed Principal Component Analysis with Limited Communication NeurIPS 2021 Distributed Ranking with Communications: Approximation Analysis and Applications AAAI 2021 Distributed Saddle-Point Problems Under Data Similarity NeurIPS 2021 Distributed Zero-Order Optimization under Adversarial Noise NeurIPS 2021 Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads OSDI 2021 DRIVE: One-bit Distributed Mean Estimation NeurIPS 2021 EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition AAAI 2021 EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback NeurIPS 2021 Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021