Distributed Learning

Incorporating Serverless Computing into P2P Networks for ML Training: In-Database Tasks and Their Scalability Implications (Student Abstract) AAAI 2024 Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated Learning ICLR 2024 JaxMARL: Multi-Agent RL Environments and Algorithms in JAX NeurIPS 2024 Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax Optimization AAAI 2024 JointSQ: Joint Sparsification-Quantization for Distributed Learning CVPR 2024 JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning ACL 2024 Klonet: an Easy-to-Use and Scalable Platform for Computer Networks Education NSDI 2024 KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server EMNLP 2024 Language Models as Zero-shot Lossless Gradient Compressors: Towards General Neural Parameter Prior Models NeurIPS 2024 Leveraging partial stragglers within gradient coding NeurIPS 2024 LG-FGAD: An Effective Federated Graph Anomaly Detection Framework IJCAI 2024 LinguaLinked: Distributed Large Language Model Inference on Mobile Devices ACL 2024 LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024 LocMoE: A Low-overhead MoE for Large Language Model Training IJCAI 2024 Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks NeurIPS 2024 Low Precision Local Training is Enough for Federated Learning NeurIPS 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 MAST: Global Scheduling of ML Training across Geo-Distributed Datacenters at Hyperscale OSDI 2024 MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs NSDI 2024 Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization NeurIPS 2024 Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices CVPR 2024 Momentum Benefits Non-iid Federated Learning Simply and Provably ICLR 2024 Nearly Optimal Regret for Decentralized Online Convex Optimization COLT 2024 Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity NeurIPS 2024 Near-Optimal Resilient Aggregation Rules for Distributed Learning Using 1-Center and 1-Mean Clustering with Outliers AAAI 2024