conftrace_

model parallelization

6 papers

Explore in graph

Co-occurring keywords

parallelization planning (1) constraint-guided optimization (1) streaming rollout (1) scheduling strategies (1) recurrent neural network (1790) deep neural network (1803) parameter update (36) end-to-end training (170) inference efficiency (248) task scheduling (19)

Papers

SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters ACL 2026
MLAAN: Scaling Supervised Local Learning with Multilaminar Leap Augmented Auxiliary Network AAAI 2025
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training OSDI 2024
The streaming rollout of deep networks - towards fully model-parallel execution NIPS 2018
SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization ICML 2017
On Model Parallelization and Scheduling Strategies for Distributed Machine Learning NIPS 2014