Distributed Learning

Least Squares Model Averaging for Distributed Data JMLR 2023 Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit ICML 2023 MALib: A Parallel Framework for Population-based Multi-agent Reinforcement Learning JMLR 2023 MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates NeurIPS 2023 Modeling with Homophily Driven Heterogeneous Data in Gossip Learning IJCAI 2023 Momentum Provably Improves Error Feedback! NeurIPS 2023 Multi-Consensus Decentralized Accelerated Gradient Descent JMLR 2023 No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation ICML 2023 On Biased Compression for Distributed Learning JMLR 2023 On-Demand Communication for Asynchronous Multi-Agent Bandits AISTATS 2023 On Generalization of Decentralized Learning with Separable Data AISTATS 2023 On the Benefits of Learning to Route in Mixture-of-Experts Models EMNLP 2023 On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network AISTATS 2023 On the Convergence of Federated Averaging with Cyclic Client Participation ICML 2023 On the Privacy-Robustness-Utility Trilemma in Distributed Learning ICML 2023 Optimal Convergence Rates for Distributed Nystroem Approximation JMLR 2023 Optimal Resource Allocation for Early Stopping-based Neural Architecture Search Methods AutoML 2023 Optimal Shrinkage for Distributed Second-Order Optimization ICML 2023 OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning IJCAI 2023 Parallel Q-Learning: Scaling Off-policy Reinforcement Learning under Massively Parallel Simulation ICML 2023 Patch-Based Privacy Preserving Neural Network for Vision Tasks WACV 2023 Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023 Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization AAAI 2023 Quantized Distributed Training of Large Models with Convergence Guarantees ICML 2023 Refined Convergence and Topology Learning for Decentralized SGD with Heterogeneous Data AISTATS 2023