pipeline parallelism

Accelerating Diffusion via Hybrid Data-Pipeline Parallelism Based on Conditional Guidance Scheduling CVPR 2026 Attack of the Bubbles: Straggler-Resilient Pipeline Parallelism for Large Model Training NSDI 2026 Revisiting Pipeline Parallelism for LLM Serving OSDI 2026 SMIDT: High-Performance Inference Framework for MoE Models with Dynamic Top-K Routing AAAI 2026 Sparse Checkpointing for Fast and Reliable MoE Training NSDI 2026 Tessera: A Holistic Pipeline Parallelism Framework for Trillion-Parameter Heterogeneous MoE Training (Operational Systems) OSDI 2026 DICE: Staleness-Centric Optimizations for Parallel Diffusion MoE Inference ICCV 2025 Efficient Long Context Fine-tuning with Chunk Flow ICML 2025 Ferret: An Efficient Online Continual Learning Framework under Varying Memory Constraints CVPR 2025 Nesterov Method for Asynchronous Pipeline Parallel Optimization ICML 2025 PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization ICML 2025 PipeSpec: Breaking Stage Dependencies in Hierarchical LLM Decoding ACL 2025 Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025 Sequence Accumulation and Beyond: Infinite Context Length on Single GPU and Large Clusters AAAI 2025 WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training OSDI 2025 BBQ: A Fast and Scalable Integer Priority Queue for Hardware Packet Scheduling NSDI 2024 DISTMM: Accelerating Distributed Multimodal Model Training NSDI 2024 EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism ICML 2024 HexGen: Generative Inference of Large Language Model over Heterogeneous Environment ICML 2024 HPipe: Large Language Model Pipeline Parallelism for Long Context on Heterogeneous Cost-effective Devices NAACL 2024 Pipeline Parallelism with Controllable Memory NeurIPS 2024 Position: Exploring the Robustness of Pipeline-Parallelism-Based Decentralized Training ICML 2024 Practical Performance Guarantees for Pipelined DNN Inference ICML 2024 Zero Bubble (Almost) Pipeline Parallelism ICLR 2024 Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs NSDI 2023