Distributed Learning

Distributed Algorithms for U-statistics-based Empirical Risk Minimization JMLR 2023 Distributed Sparse Regression via Penalization JMLR 2023 Fast Algorithms for Distributed k-Clustering with Outliers ICML 2023 Is Consensus Acceleration Possible in Decentralized Optimization over Slowly Time-Varying Networks? ICML 2023 On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network AISTATS 2023 Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023 Reducing Training Time in Cross-Silo Federated Learning Using Multigraph Topology ICCV 2023 Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD JMLR 2023 Single Point-Based Distributed Zeroth-Order Optimization with a Non-Convex Stochastic Objective Function ICML 2023 SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023 Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning OSDI 2022 A Polynomial-time Decentralised Algorithm for Coordinated Management of Multiple Intersections IJCAI 2022 A Stochastic Multi-Rate Control Framework For Modeling Distributed Optimization Algorithms ICML 2022 Decentralized Training of Foundation Models in Heterogeneous Environments NeurIPS 2022 Distributed Bayesian Varying Coefficient Modeling Using a Gaussian Process Prior JMLR 2022 Federated Learning with Partial Model Personalization ICML 2022 Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022 One Gradient Frank-Wolfe for Decentralized Online Convex and Submodular Optimization ACML 2022 Projection-free Distributed Online Learning with Sublinear Communication Complexity JMLR 2022 Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks JMLR 2022 Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization JMLR 2022 Accelerating Distributed SGD for Linear Regression using Iterative Pre-Conditioning L4DC 2021 ADOM: Accelerated Decentralized Optimization Method for Time-Varying Networks ICML 2021 A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization ICML 2021 Byzantine-Resilient High-Dimensional SGD with Local Iterations on Heterogeneous Data ICML 2021