conftrace_

large language model training

10 papers

Explore in graph

Also known as

LLM TRAINING

Co-occurring keywords · papers mentioning both

large language model (2) memory efficiency (2) distributed training (2) training optimization (2) neural network optimization (2) memory balancing (1) activation balancing (1) machine learning training (1) performance analysis (1) online pca (1)

Papers

ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics NSDI 2026 Phantora: Maximizing Code Reuse in Simulation-based Machine Learning System Performance Estimation NSDI 2026 SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters ACL 2026 SimAI: Unifying Architecture Design and Performance Tuning for Large-Scale Large Language Model Training with Scalability and Precision NSDI 2025 Understanding Stragglers in Large Model Training Using What-if Analysis OSDI 2025 MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs NSDI 2024 Memory-Efficient LLM Training with Online Subspace Descent NeurIPS 2024 The Fine-Grained Complexity of Gradient Computation for Training Large Language Models NeurIPS 2024 BPipe: Memory-Balanced Pipeline Parallelism for Training Large Language Models ICML 2023 CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023