Xiao Shi Huang

4 papers · 2020–2024 · 3 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🐣 Hot Topic Early Bird

Venues

ICLR (2) ICML (1) MLHC (1)

Top co-authors

Maksims Volkovs (4) Felipe Perez (2) Xiaochen Zhang (1) Aslesha Pokhrel (1) Alex Labach (1) Yi Sui (1) Jimmy Ba (1) Ga Wu (1) Tongzi Wu (1) George Stein (1)

Research topics

Deep Learning (3) Machine Learning (3) Architectures (3) Core Methods (2) Learning Types · Machine Learning (2) Natural Language Processing (1) Application Areas (1) Applications (1) Learning Types · Deep Learning (1) Optimization & Theory (1)

Keywords

transformer architecture (1) representation learning (1) self-supervised learning (1) knowledge distillation (1) machine translation (1) data augmentation (1) masked language model (1) clinical prediction (1) gradient optimization (1) multivariate time series (1) random projection (1) weight initialization (1) learning rate warmup (1) electronic health record (1) transformer optimization (1) layer normalization (1) non-autoregressive translation (1) self-supervised representation learning (1) data modality (1)

Papers

Self-supervised Representation Learning from Random Data Projectors ICLR 2024 DuETT: Dual Event Time Transformer for Electronic Health Records MLHC 2023 Improving Non-Autoregressive Translation Models Without Distillation ICLR 2022 Improving Transformer Optimization Through Better Initialization ICML 2020