Distributed Learning

Unbiased Compression Saves Communication in Distributed Optimization: When and How Much? NeurIPS 2023 Unbiased Multilevel Monte Carlo Methods for Intractable Distributions: MLMC Meets MCMC JMLR 2023 Unlocking the Heterogeneous Landscape of Big Data NLP with DUUI EMNLP 2023 zPROBE: Zero Peek Robustness Checks for Federated Learning ICCV 2023 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation ICML 2022 Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks NSDI 2022 Acceleration in Distributed Optimization under Similarity AISTATS 2022 Acceleration in Distributed Sparse Regression NeurIPS 2022 A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks NeurIPS 2022 A Deep Learning Dataloader with Shared Data Preparation NeurIPS 2022 Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning OSDI 2022 Anarchic Federated Learning ICML 2022 An Equivalence Between Data Poisoning and Byzantine Gradient Attacks ICML 2022 ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems AAAI 2022 A Resilient Distributed Boosting Algorithm ICML 2022 ASAP.SGD: Instance-based Adaptiveness to Staleness in Asynchronous SGD ICML 2022 A Stochastic Linearized Augmented Lagrangian Method for Decentralized Bilevel Optimization NeurIPS 2022 Asymptotic Behaviors of Projected Stochastic Approximation: A Jump Diffusion Perspective NeurIPS 2022 AsyncFL: Asynchronous Federated Learning Using Majority Voting with Quantized Model Updates (Student Abstract) AAAI 2022 Asynchronous Personalized Federated Learning with Irregular Clients ACML 2022 Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays NeurIPS 2022 A Unified Analysis of Federated Learning with Arbitrary Client Participation NeurIPS 2022 BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression NeurIPS 2022 Beyond spectral gap: the role of the topology in decentralized learning NeurIPS 2022 BigDL 2.0: Seamless Scaling of AI Pipelines From Laptops to Distributed Cluster CVPR 2022