conftrace_

Connor Holmes

3 papers · 2021–2024 · 3 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze

Venues

AAAI (1) ICLR (1) NeurIPS (1)

Top co-authors

Yuxiong He (3) Minjia Zhang (2) Zhewei Yao (2) Xiaoxia Wu (2) Feng Yan (1) Guanhua Wang (1) Lei Yang (1) Bo Wu (1) Olatunji Ruwase (1) Sam Ade Jacobs (1)

Research topics

Machine Learning (3) Application Areas (3) Optimization & Theory · Machine Learning (3) Deep Learning (1) Learning Paradigms (1) Learning Types (1) Optimization & Theory · Deep Learning (1) Techniques (1)

Keywords

model compression (1) model quantization (1) efficient training (1) curriculum learning (1) knowledge distillation (1) distributed learning (1) model pretraining (1) natural language understanding (1) deep learning (1) training efficiency (1) alternating direction method of multiplier (1) model training (1) downstream task (1) transformer network (1) data efficiency (1) collective communication (1) model sparsification (1) language model pretraining (1) token dropping (1)

Papers

DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing AAAI 2024 ZeRO++: Extremely Efficient Collective Communication for Large Model Training ICLR 2024 NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM NeurIPS 2021