Distributed Learning

Elastic Resource Sharing for Distributed Deep Learning NSDI 2021 Error Compensated Distributed SGD Can Be Accelerated NeurIPS 2021 Exponential Graph is Provably Efficient for Decentralized Deep Training NeurIPS 2021 Extreme k-Center Clustering AAAI 2021 Fault-Tolerant Replication with Pull-Based Consensus in MongoDB NSDI 2021 Federated Block Coordinate Descent Scheme for Learning Global and Personalized Models AAAI 2021 Federated-EM with heterogeneity mitigation and variance reduction NeurIPS 2021 Federated Learning Based on Dynamic Regularization ICLR 2021 FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Analysis ICML 2021 From Local to Global Norm Emergence: Dissolving Self-reinforcing Substructures with Incremental Social Instruments ICML 2021 Gradient Forward-Propagation for Large-Scale Temporal Video Modelling CVPR 2021 Graph reparameterizations for enabling 1000+ Monte Carlo iterations in Bayesian deep neural networks UAI 2021 HetSeq: Distributed GPU Training on Heterogeneous Infrastructure AAAI 2021 Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes AISTATS 2021 LENA: Communication-Efficient Distributed Learning with Self-Triggered Gradient Uploads AISTATS 2021 Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation NeurIPS 2021 LocalNewton: Reducing communication rounds for distributed learning UAI 2021 Local SGD: Unified Theory and New Efficient Methods AISTATS 2021 Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency AISTATS 2021 Lower Bounds and Optimal Algorithms for Smooth and Strongly Convex Decentralized Optimization Over Time-Varying Networks NeurIPS 2021 MARINA: Faster Non-Convex Distributed Learning with Compression ICML 2021 Memory-Efficient Pipeline-Parallel DNN Training ICML 2021 Mini-Batch Consistent Slot Set Encoder for Scalable Set Encoding NeurIPS 2021 Model-Contrastive Federated Learning CVPR 2021 Model-sharing Games: Analyzing Federated Learning Under Voluntary Participation AAAI 2021