Knowledge Distillation

MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding EMNLP 2021 Multi-Domain Knowledge Distillation via Uncertainty-Matching for End-to-End ASR Models Interspeech 2021 Multi-Grained Knowledge Distillation for Named Entity Recognition NAACL 2021 Multilingual AMR Parsing with Noisy Knowledge Distillation EMNLP 2021 Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021 Multimodal Knowledge Expansion ICCV 2021 Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021 Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021 Multi-stage Pre-training over Simplified Multimodal Pre-training Models ACL 2021 Multi-Task Knowledge Distillation for Eye Disease Prediction WACV 2021 Multi-Task Self-Training for Learning General Representations ICCV 2021 Multi-Vector Attention Models for Deep Re-ranking EMNLP 2021 Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation AAAI 2021 NASTransfer: Analyzing Architecture Transferability in Large Scale Neural Architecture Search AAAI 2021 NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases EMNLP 2021 NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021 N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021 Noise as a Resource for Learning in Knowledge Distillation WACV 2021 Noisy Self-Knowledge Distillation for Text Summarization NAACL 2021 Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation NeurIPS 2021 NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021 On Knowledge Distillation for Translating Erroneous Speech Transcriptions ACL 2021 On Learning the Geodesic Path for Incremental Learning CVPR 2021 Online Knowledge Distillation for Efficient Pose Estimation ICCV 2021 Online Multi-Granularity Distillation for GAN Compression ICCV 2021