conftrace_

distributed training

188 papers

Explore in graph

Co-occurring keywords

distributed learning (563) communication efficiency (297) model parallelism (43) stochastic gradient descent (1091) gradient compression (78) neural network optimization (1293) federated learning (1333) large language model (13587) model compression (3302) neural network (6616)

Papers

TawPipe: Topology-Aware Weight Pipeline Parallelism for Accelerating Long-Context Large Models Training AAAI 2026
DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes AAAI 2026
OmniScale: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo AAAI 2026
FusedRec: Fused Embedding Communication for Distributed Recommendation Training on GPUs AAAI 2026
OptiCo: Adaptive Distributed Training Optimization via Collaborative Agent Reasoning ACL 2026
BitDP: Ultra-low-bit Communication for Data Parallelism in LLM Training AAAI 2026
SimAI: Unifying Architecture Design and Performance Tuning for Large-Scale Large Language Model Training with Scalability and Precision NSDI 2025
Beyond A Single AI Cluster: A Survey of Decentralized LLM Training EMNLP 2025
OptiReduce: Resilient and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud NSDI 2025
ZEN: Empowering Distributed Training with Sparsity-driven Data Synchronization OSDI 2025
Decentralized Diffusion Models CVPR 2025
ActionStudio: A Lightweight Framework for Data and Training of Large Action Models EMNLP 2025
ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development NSDI 2025
AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training NSDI 2025
A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework EMNLP 2025
Highly Parallelized Reinforcement Learning Training with Relaxed Assignment Dependencies AAAI 2025
Breaking the Memory Barrier of Contrastive Loss via Tile-Based Strategy CVPR 2025
Minder: Faulty Machine Detection for Large-scale Distributed Model Training NSDI 2025
LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation ACL 2025
Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters AAAI 2025
Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025
FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data EMNLP 2025
FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulation ICCV 2025
An Efficient Subgraph-Inferring Framework for Large-Scale Heterogeneous Graphs AAAI 2024