Conglong Li
7 papers · 2021–2024 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(20)
🐣
Hot Topic Early Bird
🏆
Grand Slam
Venues
Top co-authors
Research topics
Machine Learning
(7)
Deep Learning
(5)
Application Areas
(5)
Optimization & Theory · Deep Learning
(4)
Optimization & Theory · Machine Learning
(4)
Techniques
(3)
Models
(2)
Artificial Intelligence
(1)
Natural Language Processing
(1)
Architectures
(1)
Learning Paradigms · Machine Learning
(1)
Learning Paradigms · Artificial Intelligence
(1)
Learning Types
(1)
Resources & Methods
(1)
Keywords
model compression
(4)
large language model
(3)
knowledge distillation
(2)
distributed training
(2)
adam optimizer
(2)
training efficiency
(2)
model pretraining
(2)
efficient computing
(1)
communication efficiency
(1)
model inference
(1)
sparse model
(1)
adaptive optimization
(1)
gradient compression
(1)
communication compression
(1)
mixture of expert
(1)
training stability
(1)
data efficiency
(1)
inference optimization
(1)
weight quantization
(1)
gradient variance
(1)
Papers
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing
AAAI 2024
Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam
ICLR 2023
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
ICML 2022
The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models
NeurIPS 2022
XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient
NeurIPS 2022
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
NeurIPS 2022
1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed
ICML 2021