Skip to content
conftrace_

3d parallelism

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) distributed training (2) omni-modal learning (1) megatron-lm (1) kv caching (1) model scaling (1) pipeline parallelism (1) mixture of expert (1) parameter-efficient fine-tuning (1) early exit (1)

Papers

OmniScale: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo AAAI 2026 EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism ICML 2024 CoLLiE: Collaborative Training of Large Language Models in an Efficient Way EMNLP 2023