Distributed Learning

One-shot Federated Learning via Synthetic Distiller-Distillate Communication NeurIPS 2024 One Year of Continuous and Automatic Data Gathering from Parliaments of European Union Member States COLING 2024 On Sampling Strategies for Spectral Model Sharding NeurIPS 2024 On the Convergence of Hierarchical Federated Learning with Partial Worker Participation UAI 2024 On the Necessity of Collaboration for Online Model Selection with Decentralized Data NeurIPS 2024 On the Optimal Time Complexities in Decentralized Stochastic Asynchronous Optimization NeurIPS 2024 Optimal Private and Communication Constraint Distributed Goodness-of-Fit Testing for Discrete Distributions in the Large Sample Regime NeurIPS 2024 Ordered Momentum for Asynchronous SGD NeurIPS 2024 Parallel Empirical Evaluations: Resilience despite Concurrency AAAI 2024 pFedClub: Controllable Heterogeneous Model Aggregation for Personalized Federated Learning NeurIPS 2024 Pipeline Parallelism with Controllable Memory NeurIPS 2024 PrivSGP-VR: Differentially Private Variance-Reduced Stochastic Gradient Push with Tight Utility Bounds IJCAI 2024 Queuing dynamics of asynchronous Federated Learning AISTATS 2024 Recovery Guarantees for Distributed-OMP AISTATS 2024 RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs NAACL 2024 Resiliency at Scale: Managing Google’s TPUv4 Machine Learning Supercomputer NSDI 2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models NeurIPS 2024 Robust Distribution Learning with Local and Global Adversarial Corruptions (extended abstract) COLT 2024 SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning NeurIPS 2024 Scalable Federated Unlearning via Isolated and Coded Sharding IJCAI 2024 Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data JMLR 2024 SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training NeurIPS 2024 Secure Distributed Sparse Gaussian Process Models Using Multi-Key Homomorphic Encryption AAAI 2024 SENIT at AraFinNLP2024: trust your model or combine two ACL 2024 Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity NeurIPS 2024