Distributed Learning

Statistical Estimation and Online Inference via Local SGD COLT 2022 Syne Tune: A Library for Large Scale Hyperparameter Tuning and Reproducible Research AutoML 2022 Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology ICML 2022 TA-MoE: Topology-Aware Large Scale Mixture-of-Expert Training NeurIPS 2022 TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels NeurIPS 2022 Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques NeurIPS 2022 Topology-aware Generalization of Decentralized SGD ICML 2022 Towards Optimal Communication Complexity in Distributed Non-Convex Optimization NeurIPS 2022 Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs NeurIPS 2022 Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization OSDI 2022 Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization JMLR 2022 Variance Reduced ProxSkip: Algorithm, Theory and Application to Federated Learning NeurIPS 2022 Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning OSDI 2022 Zeta: A Scalable and Robust East-West Communication Framework in Large-Scale Clouds NSDI 2022 1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021 Accelerating Gossip SGD with Periodic Global Averaging ICML 2021 Accumulated Decoupled Learning with Gradient Staleness Mitigation for Convolutional Neural Networks ICML 2021 Adaptive Federated Optimization ICLR 2021 A Distributed Method for Fitting Laplacian Regularized Stratified Models JMLR 2021 ADOM: Accelerated Decentralized Optimization Method for Time-Varying Networks ICML 2021 A Faster Decentralized Algorithm for Nonconvex Minimax Problems NeurIPS 2021 A Flexible Framework for Communication-Efficient Machine Learning AAAI 2021 A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! AISTATS 2021 An Improved Analysis of Gradient Tracking for Decentralized Machine Learning NeurIPS 2021 A Serverless Approach to Federated Learning Infrastructure Oriented for IoT/Edge Data Sources (Student Abstract) AAAI 2021