Distributed Learning

Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms JMLR 2020 Pegasus: Tolerating Skewed Workloads in Distributed Storage with In-Network Coherence Directories OSDI 2020 Practical Low-Rank Communication Compression in Decentralized Deep Learning NeurIPS 2020 Projection-free Distributed Online Convex Optimization with O(√T) Communication Complexity ICML 2020 Quantized Compressive Sampling of Stochastic Gradients for Efficient Communication in Distributed Deep Learning AAAI 2020 Quantized Decentralized Stochastic Learning over Directed Graphs ICML 2020 Randomized Block-Diagonal Preconditioning for Parallel Learning ICML 2020 Resilient Distributed Diffusion for Multi-Robot Systems Using Centerpoint RSS 2020 Robust Asynchronous Stochastic Gradient-Push: Asymptotically Optimal and Network-Independent Performance for Strongly Convex Functions JMLR 2020 Robust Federated Learning: The Case of Affine Distribution Shifts NeurIPS 2020 Scalable and Flexible Clustering of Grouped Data via Parallel and Distributed Sampling in Versatile Hierarchical Dirichlet Processes UAI 2020 Scalable Belief Propagation via Relaxed Scheduling NeurIPS 2020 ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training NeurIPS 2020 Second Order Optimality in Decentralized Non-Convex Optimization via Perturbed Gradient Tracking NeurIPS 2020 SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference ICLR 2020 Simultaneous Inference for Massive Data: Distributed Bootstrap ICML 2020 Sparse Parallel Training of Hierarchical Dirichlet Process Topic Models EMNLP 2020 Statistical Guarantees of Distributed Nearest Neighbor Classification NeurIPS 2020 Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization ICML 2020 Stochastic Optimization with Laggard Data Pipelines NeurIPS 2020 Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Data CVPR 2020 The Gossiping Insert-Eliminate Algorithm for Multi-Agent Bandits AISTATS 2020 The Non-IID Data Quagmire of Decentralized Machine Learning ICML 2020 Throughput-Optimal Topology Design for Cross-Silo Federated Learning NeurIPS 2020 Tighter Theory for Local SGD on Identical and Heterogeneous Data AISTATS 2020