Knowledge Distillation

Students Who Study Together Learn Better: On the Importance of Collective Knowledge Distillation for Domain Transfer in Fact Verification EMNLP 2021 Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021 SuperMix: Supervising the Mixing Data Augmentation CVPR 2021 Teacher Guided Neural Architecture Search for Face Recognition AAAI 2021 Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021 TenTrans Large-Scale Multilingual Machine Translation System for WMT21 EMNLP 2021 Text Is Text, No Matter What: Unifying Text Recognition Using Knowledge Distillation ICCV 2021 The Curious Case of Hallucinations in Neural Machine Translation NAACL 2021 The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task EMNLP 2021 The NiuTrans System for the WMT 2021 Efficiency Task EMNLP 2021 Towards Compact Single Image Super-Resolution via Contrastive Self-distillation IJCAI 2021 Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation EMNLP 2021 Towards Enabling Meta-Learning from Target Models NeurIPS 2021 Towards Faster Deep Collaborative Filtering via Hierarchical Decision Networks AAAI 2021 Towards Learning Spatially Discriminative Feature Representations ICCV 2021 Towards Quantifiable Dialogue Coherence Evaluation ACL 2021 Towards Zero-Shot Knowledge Distillation for Natural Language Processing EMNLP 2021 Training Binary Neural Network without Batch Normalization for Image Super-Resolution AAAI 2021 Training data-efficient image transformers & distillation through attention ICML 2021 Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation Interspeech 2021 Tree-Like Decision Distillation CVPR 2021 Trigger is Not Sufficient: Exploiting Frame-aware Knowledge for Implicit Event Argument Extraction ACL 2021 Ultra Fast Speech Separation Model with Teacher Student Learning Interspeech 2021 Unanswerable Question Correction in Question Answering over Personal Knowledge Base AAAI 2021 Understanding and Improving Lexical Choice in Non-Autoregressive Translation ICLR 2021