conftrace_

Guoqing Jiang

3 papers · 2020–2024 · 2 conferences · across top CS/AI conferences

Achievements

Jump to papers ↓

🌍 Conference Polyglot (2) 🌉 Interdisciplinary Bridge 🐝 Cross-Pollinator (15)

Conferences

AAAI (2) ICLR (1)

Top co-authors

Wei LIN (2) Zixiang Ding (2) SHUAI ZHANG (2) Lin Guo (2) Jinlong Liu (1) Huayan Wang (1) Ting Chen (1) Yunzhi Bai (1)

Keywords

knowledge distillation (2) model compression (2) bert compression (1) student model (1) teacher ensemble (1) teacher model (1) categorical distribution (1) image classification (1)

Papers

How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation AAAI 2024 SKDBERT: Compressing BERT via Stochastic Knowledge Distillation AAAI 2023 Understanding Why Neural Networks Generalize Well Through GSNR of Parameters ICLR 2020