Connor Holmes
3 papers · 2021–2024 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
🌍
Conference Polyglot
(3)
🌉
Interdisciplinary Bridge
🐝
Cross-Pollinator
(15)
Conferences
AAAI (1)
ICLR (1)
NIPS (1)
Top co-authors
Keywords
model compression
(1)
efficient training
(1)
curriculum learning
(1)
knowledge distillation
(1)
model pretraining
(1)
natural language understanding
(1)
deep learning
(1)
training efficiency
(1)
alternating direction method of multiplier
(1)
downstream task
(1)
transformer network
(1)
data efficiency
(1)
model sparsification
(1)
language model pretraining
(1)
token dropping
(1)
Papers
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing
AAAI 2024
ZeRO++: Extremely Efficient Collective Communication for Large Model Training
ICLR 2024
NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM
NIPS 2021