conftrace_

training throughput

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

distributed training (3) large language model (2) model sharding (1) elastic pipelining (1) dataflow abstraction (1) signal propagation theory (1) heterogeneous computing (1) model offloading (1) context switching (1) transformer block (1)

Papers

Making Every Head Count: Sparse Attention Without the Speed-Performance Trade-off AAAI 2026 RLinf: Flexible and Efficient Large-Scale Reinforcement Learning via Macro-to-Micro Flow Transformation OSDI 2026 Optimizing RLHF Training for Large Language Models with Stage Fusion NSDI 2025 Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025 ZEN: Empowering Distributed Training with Sparsity-driven Data Synchronization OSDI 2025 Simplifying Transformer Blocks ICLR 2024 SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NeurIPS 2024 SRL: Scaling Distributed Reinforcement Learning to Over Ten Thousand Cores ICLR 2024