Distributed Systems

Optimizing Resource Allocation in Hyperscale Datacenters: Scalability, Usability, and Experiences OSDI 2024 Parallel Beam Search Algorithms for Domain-Independent Dynamic Programming AAAI 2024 Parallel Empirical Evaluations: Resilience despite Concurrency AAAI 2024 Position: Exploring the Robustness of Pipeline-Parallelism-Based Decentralized Training ICML 2024 Resiliency at Scale: Managing Google’s TPUv4 Machine Learning Supercomputer NSDI 2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models NeurIPS 2024 SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NeurIPS 2024 SRL: Scaling Distributed Reinforcement Learning to Over Ten Thousand Cores ICLR 2024 SwiftPaxos: Fast Geo-Replicated State Machines NSDI 2024 Swing: Short-cutting Rings for Higher Bandwidth Allreduce NSDI 2024 Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve OSDI 2024 The Promise of Serverless Computing within Peer-to-Peer Architectures for Distributed ML Training AAAI 2024 USHER: Holistic Interference Avoidance for Resource Optimized ML Inference OSDI 2024 Xinference: Making Large Model Serving Easy EMNLP 2024 S^3: Increasing GPU Utilization during Generative Inference for Higher Throughput NeurIPS 2023 A Combinatorial Algorithm for Approximating the Optimal Transport in the Parallel and MPC Settings NeurIPS 2023 Applied Online Algorithms with Heterogeneous Predictors ICML 2023 AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution AAAI 2023 Better Together: Jointly Optimizing ML Collective Scheduling and Execution Planning using SYNDICATE NSDI 2023 Block Subsampled Randomized Hadamard Transform for Nyström Approximation on Distributed Architectures ICML 2023 Building Flexible, Low-Cost Wireless Access Networks With Magma NSDI 2023 Canvas: Isolated and Adaptive Swapping for Multi-Applications on Remote Memory NSDI 2023 Characterizing Off-path SmartNIC for Accelerating Distributed Systems OSDI 2023 Chardonnay: Fast and General Datacenter Transactions for On-Disk Databases OSDI 2023 DASH: A Distributed and Parallelizable Algorithm for Size-Constrained Submodular Maximization AAAI 2023