knowledge distillation

Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains ACL 2021 Meta Pseudo Labels CVPR 2021 Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner CVPR 2021 MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Maps NeurIPS 2021 MixKD: Towards Efficient Distillation of Large-scale Language Models ICLR 2021 MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing ICCV 2021 Modality-specific Distillation NAACL 2021 More Photos Are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrieval CVPR 2021 Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data NeurIPS 2021 Motion-Augmented Self-Training for Video Recognition at Smaller Scale ICCV 2021 MRD-Net: Multi-Modal Residual Knowledge Distillation for Spoken Question Answering IJCAI 2021 MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding EMNLP 2021 Multi-Domain Knowledge Distillation via Uncertainty-Matching for End-to-End ASR Models Interspeech 2021 Multi-Domain Multi-Task Rehearsal for Lifelong Learning AAAI 2021 Multi-Grained Knowledge Distillation for Named Entity Recognition NAACL 2021 Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification Interspeech 2021 Multilingual AMR Parsing with Noisy Knowledge Distillation EMNLP 2021 Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task EMNLP 2021 Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021 Multimodal Knowledge Expansion ICCV 2021 Multi-Path Neural Networks for On-Device Multi-Domain Visual Classification WACV 2021 Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021 Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021 Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation ICCV 2021 Multi-Task Knowledge Distillation for Eye Disease Prediction WACV 2021