Skip to content
conftrace_

Ammar Ahmad Awan

2 papers · 2021–2022 · 1 venue · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓
🗺️ Taxonomy Completionist (10) 🐣 Hot Topic Early Bird

Venues

ICML (2)

Top co-authors

Yuxiong He (2) Samyam Rajbhandari (2) Conglong Li (2) Shaoduo Gan (1) Ce Zhang (1) Jeff Rasley (1) Minjia Zhang (1) Hanlin Tang (1) Zhewei Yao (1) Xiangru Lian (1)

Research topics

Deep Learning (2) Machine Learning (2) Application Areas (2) Optimization & Theory · Deep Learning (2) Architectures (1) Models (1) Optimization & Theory · Machine Learning (1) Techniques (1)

Keywords

model compression (2) large language model (2) distributed training (1) model inference (1) training efficiency (1) sparse model (1) adaptive optimization (1) adam optimizer (1) communication compression (1) mixture of expert (1) inference optimization (1) error compensation (1) transformer architecture (1)

Papers

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022 1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021