Distributed Learning

LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation ACL 2025 LongVILA: Scaling Long-Context Visual Language Models for Long Videos ICLR 2025 Low End-to-End Latency atop a Speculative Shared Log with Fix-Ante Ordering OSDI 2025 Mean Aggregator is More Robust than Robust Aggregators under Label Poisoning Attacks on Distributed Heterogeneous Data JMLR 2025 Mixture of Languages: Improved Multilingual Encoders Through Language Grouping EMNLP 2025 MultiSFL: Towards Accurate Split Federated Learning via Multi-Model Aggregation and Knowledge Replay AAAI 2025 One-shot Federated Learning Methods: A Practical Guide IJCAI 2025 On Scaling Up 3D Gaussian Splatting Training ICLR 2025 OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework EMNLP 2025 Optimal and Efficient Algorithms for Decentralized Online Convex Optimization JMLR 2025 Optimal Complexity in Byzantine-Robust Distributed Stochastic Optimization with Data Heterogeneity JMLR 2025 Optimal Decentralized Composite Optimization for Strongly Convex Functions JMLR 2025 OptiReduce: Resilient and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud NSDI 2025 Order-Optimal Regret in Distributed Kernel Bandits using Uniform Sampling with Shared Randomness AISTATS 2025 PA3Fed: Period-Aware Adaptive Aggregation for Improved Federated Learning AAAI 2025 PAPAYA Federated Analytics Stack: Engineering Privacy, Scalability and Practicality NSDI 2025 PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmark JMLR 2025 Picsou: Enabling Replicated State Machines to Communicate Efficiently OSDI 2025 Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters AAAI 2025 Population Normalization for Federated Learning CVPR 2025 Preble: Efficient Distributed Prompt Scheduling for LLM Serving ICLR 2025 RADIOv2.5: Improved Baselines for Agglomerative Vision Foundation Models CVPR 2025 RAMEN: Real-time Asynchronous Multi-agent Neural Implicit Mapping RSS 2025 RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs EMNLP 2025 SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data WACV 2025