Distributed Learning

Scalable and Trustworthy Learning in Heterogeneous Networks AAAI 2025 Scalable Decentralized Algorithms for Online Personalized Mean Estimation AAAI 2025 Scalable Decentralized Learning with Teleportation ICLR 2025 Scaling Species Diversity Analysis in Carbon Credit Projects with Large-Context LLMs ACL 2025 Selective Aggregation for Low-Rank Adaptation in Federated Learning ICLR 2025 SemiDFL: A Semi-Supervised Paradigm for Decentralized Federated Learning AAAI 2025 SEPARATE: A Simple Low-rank Projection for Gradient Compression in Modern Large-scale Model Training Process ICLR 2025 Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025 Sharp Bounds for Sequential Federated Learning on Heterogeneous Data JMLR 2025 Skybridge: Bounded Staleness for Distributed Caches OSDI 2025 Stability and Generalization of Zeroth-Order Decentralized Stochastic Gradient Descent with Changing Topology AAAI 2025 Tackling Intertwined Data and Device Heterogeneities in Federated Learning with Unlimited Staleness AAAI 2025 Tigon: A Distributed Database for a CXL Pod OSDI 2025 Toolscaler: Scalable Generative Tool Calling via Structure-Aware Semantic Tokenization EMNLP 2025 TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining ICLR 2025 Towards Efficient Object Re-Identification with a Novel Cloud-Edge Collaborative Framework AAAI 2025 Towards Explaining the Power of Constant-depth Graph Neural Networks for Structured Linear Programming ICLR 2025 Towards Privacy-Preserving Split Learning for ControlNet WACV 2025 Understanding Stragglers in Large Model Training Using What-if Analysis OSDI 2025 UniAP: Unifying Inter- and Intra-Layer Automatic Parallelism by Mixed Integer Quadratic Programming CVPR 2025 Vegeta: Enabling Parallel Smart Contract Execution in Leaderless Blockchains NSDI 2025 WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling AAAI 2025 ZEN: Empowering Distributed Training with Sparsity-driven Data Synchronization OSDI 2025 Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization JMLR 2024 Accelerating Distributed Stochastic Optimization via Self-Repellent Random Walks ICLR 2024