Distributed Learning

Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating AAAI 2021 Spectral vertex sparsifiers and pair-wise spanners over distributed graphs ICML 2021 Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021 Step-Ahead Error Feedback for Distributed Training with Compressed Gradient AAAI 2021 STL-SGD: Speeding Up Local SGD with Stagewise Communication Period AAAI 2021 Stochastic Sign Descent Methods: New Algorithms and Better Theory ICML 2021 Taming Communication and Sample Complexities in Decentralized Policy Evaluation for Cooperative Multi-Agent Reinforcement Learning NeurIPS 2021 TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models ICML 2021 Test-time Collective Prediction NeurIPS 2021 The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication COLT 2021 Towards Tight Communication Lower Bounds for Distributed Optimisation NeurIPS 2021 Toward Understanding the Influence of Individual Clients in Federated Learning AAAI 2021 Uni-FedRec: A Unified Privacy-Preserving News Recommendation Framework for Model Training and Online Serving EMNLP 2021 Unifying Timestamp with Transaction Ordering for MVCC with Decentralized Scalar Timestamp NSDI 2021 Variance Reduced Median-of-Means Estimator for Byzantine-Robust Distributed Inference JMLR 2021 Wyner-Ziv Estimators: Efficient Distributed Mean Estimation with Side-Information AISTATS 2021 Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization ICML 2020 A Decentralized Parallel Algorithm for Training Generative Adversarial Nets NeurIPS 2020 A Distributed Multi-Sensor Machine Learning Approach to Earthquake Early Warning AAAI 2020 A Double Residual Compression Algorithm for Efficient Distributed Learning AISTATS 2020 A High-Speed Load-Balancer Design with Guaranteed Per-Connection-Consistency NSDI 2020 AntMan: Dynamic Scaling on GPU Clusters for Deep Learning OSDI 2020 Apache Mahout: Machine Learning on Distributed Dataflow Systems JMLR 2020 A Scalable Approach for Privacy-Preserving Collaborative Machine Learning NeurIPS 2020 Assise: Performance and Availability via Client-local NVM in a Distributed File System OSDI 2020