Haibin Lin
11 papers · 2019–2025 · 7 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+4 more ↓ Show less ↑
π Cross-Pollinator (15) π Conference Polyglot (7) π Academic Marathon (6) πΊοΈ Taxonomy Completionist (11) π§ Keyword Pioneer
π
Renaissance Researcher
(5)
π
Interdisciplinary Bridge
π₯
Mega-Team
(32)
π
Century Club
(11)
Conferences
NIPS (3)
NSDI (3)
EMNLP (1)
ICLR (1)
IJCNLP (1)
JMLR (1)
OSDI (1)
Top co-authors
Keywords
distributed training
(4)
gradient compression
(2)
large language model training
(2)
large language model
(2)
computer vision
(1)
natural language processing
(1)
distributed learning
(1)
deep learning
(1)
model parallelism
(1)
distributed computing
(1)
fault detection
(1)
fault tolerance
(1)
communication efficiency
(1)
weight prediction
(1)
straggler mitigation
(1)
model deployment
(1)
data parallelism
(1)
pretrained model
(1)
cluster scheduling
(1)
distributed deep learning
(1)
Papers
Understanding Stragglers in Large Model Training Using What-if Analysis
OSDI 2025
Minder: Faulty Machine Detection for Large-scale Distributed Model Training
NSDI 2025
ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development
NSDI 2025
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
NSDI 2024
LEMON: Lossless model expansion
ICLR 2024
SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
NIPS 2024
SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training
NIPS 2022
CSER: Communication-efficient SGD with Error Reset
NIPS 2020
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing
JMLR 2020
Dive into Deep Learning for Natural Language Processing
IJCNLP 2019
Dive into Deep Learning for Natural Language Processing
EMNLP 2019