HyoukJoong Lee

3 papers · 2018–2021 · 2 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🐣 Hot Topic Early Bird 🧭 Keyword Pioneer

Venues

NeurIPS (2) ICLR (1)

Top co-authors

Youlong Cheng (2) Dehao Chen (2) Orhan Firat (2) zhifeng Chen (2) Noam Shazeer (2) Yanping Huang (2) Ankur Bapna (1) Mingsheng Hong (1) Mia Chen (1) Yuanzhong Xu (1)

Research topics

Deep Learning (3) Architectures (3) Optimization & Theory · Deep Learning (3) Machine Learning (2) Optimization & Theory · Machine Learning (2) Natural Language Processing (1) Application Areas (1) Applications (1) Learning Types (1)

Keywords

distributed training (2) model parallelism (2) distributed computing (1) multilingual machine translation (1) parallel computing (1) mixture of expert (1) pipeline parallelism (1) model scaling (1) data parallelism (1) tensor computation (1) large-scale neural network (1) large-scale training (1) transformer model (1) conditional computation (1) automatic sharding (1) deep learning (1)

Papers

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ICLR 2021 GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism NeurIPS 2019 Mesh-TensorFlow: Deep Learning for Supercomputers NeurIPS 2018