distributed learning

Weight for Robustness: A Comprehensive Approach towards Optimal Fault-Tolerant Asynchronous ML NeurIPS 2024 ZeRO++: Extremely Efficient Collective Communication for Large Model Training ICLR 2024 z-SignFedAvg: A Unified Stochastic Sign-Based Compression for Federated Learning AAAI 2024 ℓ_p-Regression in the Arbitrary Partition Model of Communication COLT 2023 A General Theory for Federated Optimization with Asynchronous and Heterogeneous Clients Updates JMLR 2023 Algorithmic Collective Action in Machine Learning ICML 2023 A principled framework for the design and analysis of token algorithms AISTATS 2023 Attacks against Federated Learning Defense Systems and their Mitigation JMLR 2023 Better Together: Jointly Optimizing ML Collective Scheduling and Execution Planning using SYNDICATE NSDI 2023 Buffered Asynchronous SGD for Byzantine Learning JMLR 2023 Byzantine-Robust Federated Learning with Optimal Statistical Rates AISTATS 2023 Catalyst Acceleration of Error Compensated Methods Leads to Better Communication Complexity AISTATS 2023 CocktailSGD: Fine-tuning Foundation Models over 500Mbps Networks ICML 2023 ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning ACL 2023 Collaboratively Learning Linear Models with Structured Missing Data NeurIPS 2023 Communication-Efficient Stochastic Gradient Descent Ascent with Momentum Algorithms IJCAI 2023 Complement Sparsification: Low-Overhead Model Pruning for Federated Learning AAAI 2023 DADAO: Decoupled Accelerated Decentralized Asynchronous Optimization ICML 2023 Decentralized Riemannian Algorithm for Nonconvex Minimax Problems AAAI 2023 Decentralized SGD and Average-direction SAM are Asymptotically Equivalent ICML 2023 DIFF2: Differential Private Optimization via Gradient Differences for Nonconvex Distributed Learning ICML 2023 Differentially Private Distributed Bayesian Linear Regression with MCMC ICML 2023 DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training CVPR 2023 Distributed Algorithms for U-statistics-based Empirical Risk Minimization JMLR 2023 Distributed Extra-gradient with Optimal Complexity and Communication Guarantees ICLR 2023