Skip to content
conftrace_

distributed training

228 papers

Papers

Distributed Parallel Gradient Stacking(DPGS): Solving Whole Slide Image Stacking Challenge in Multi-Instance Learning ICML 2025 FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data EMNLP 2025 FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulation ICCV 2025 Highly Parallelized Reinforcement Learning Training with Relaxed Assignment Dependencies AAAI 2025 LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation ACL 2025 Minder: Faulty Machine Detection for Large-scale Distributed Model Training NSDI 2025 NetMoE: Accelerating MoE Training through Dynamic Sample Placement ICLR 2025 On Scaling Up 3D Gaussian Splatting Training ICLR 2025 OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework EMNLP 2025 Optimal Distributed Training With Co-Adaptive Data Parallelism in Heterogeneous Environments IJCAI 2025 OptiReduce: Resilient and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud NSDI 2025 PETRA: Parallel End-to-end Training with Reversible Architectures ICLR 2025 Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters AAAI 2025 Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training NAACL 2025 SimAI: Unifying Architecture Design and Performance Tuning for Large-Scale Large Language Model Training with Scalability and Precision NSDI 2025 Stochastic Rounding for LLM Training: Theory and Practice AISTATS 2025 TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining ICLR 2025 ZEN: Empowering Distributed Training with Sparsity-driven Data Synchronization OSDI 2025 Accelerating Neural Recommendation Training with Embedding Scheduling NSDI 2024 An Efficient Subgraph-Inferring Framework for Large-Scale Heterogeneous Graphs AAAI 2024 CASSINI: Network-Aware Job Scheduling in Machine Learning Clusters NSDI 2024 Cheaper and Faster: Distributed Deep Reinforcement Learning with Serverless Computing AAAI 2024 Cleanba: A Reproducible and Efficient Distributed Reinforcement Learning Platform ICLR 2024 CO2: Efficient Distributed Training with Full Communication-Computation Overlap ICLR 2024 Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baseline CVPR 2024