conftrace_

collective communication

14 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) distributed training (3) bandwidth optimization (2) gpu communication (2) network topology (2) data-parallel training (2) model training (2) communication efficiency (2) rdma transport (1) latency optimization (1)

Papers

ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics NSDI 2026 HeteCCL: Synthesizing Near-Optimal Collective Communication Schedules for Heterogeneous GPU Clusters NSDI 2026 UCCL-Tran: An Extensible Software Transport Layer for GPU Networking OSDI 2026 AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training NSDI 2025 Efficient Direct-Connect Topologies for Collective Communications NSDI 2025 Enabling Efficient GPU Communication over Multiple NICs with FuseLink OSDI 2025 Evolution of Aegis: Fault Diagnosis for AI Model Training Service in Production NSDI 2025 ACCL+: an FPGA-Based Collective Engine for Distributed Applications OSDI 2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models NeurIPS 2024 Swing: Short-cutting Rings for Higher Bandwidth Allreduce NSDI 2024 ZeRO++: Extremely Efficient Collective Communication for Large Model Training ICLR 2024 ARK: GPU-driven Code Execution for Distributed Deep Learning NSDI 2023 TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches NSDI 2023 Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks NSDI 2022