conftrace_

tensor parallelism

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

distributed training (3) model parallelism (3) large language model (2) pipeline parallelism (2) ml pipeline (1) llm inference (1) parallel transformer (1) time to first token (1) tensor parallelization (1) multi-device inference (1)

Papers

ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs ACL 2026 Revisiting Pipeline Parallelism for LLM Serving OSDI 2026 SPD: Sync-Point Drop for Efficient Tensor Parallelism of Large Language Models ICML 2025 DISTMM: Accelerating Distributed Multimodal Model Training NSDI 2024 JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning ACL 2024 Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference NeurIPS 2024 RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs NAACL 2024 Piper: Multidimensional Planner for DNN Parallelization NeurIPS 2021