Knowledge Distillation

Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning AAAI 2021 Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation CVPR 2021 In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ACL 2021 Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021 Instance-Conditional Knowledge Distillation for Object Detection NeurIPS 2021 Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network AAAI 2021 Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study ICLR 2021 Joint-DetNAS: Upgrade Your Detector With NAS, Pruning and Dynamic Distillation CVPR 2021 KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation IJCAI 2021 Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021 Knowledge Evolution in Neural Networks CVPR 2021 Knowledge Refinery: Learning from Decoupled Label AAAI 2021 Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021 Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution CVPR 2021 Learning Student-Friendly Teacher Networks for Knowledge Distillation NeurIPS 2021 Learning Student Networks in the Wild CVPR 2021 Learning to Augment for Data-scarce Domain BERT Knowledge Distillation AAAI 2021 Learning to Explain: Generating Stable Explanations Fast ACL 2021 Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021 Lipschitz Continuity Guided Knowledge Distillation ICCV 2021 Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021 Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains ACL 2021 Meta Pseudo Labels CVPR 2021 Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner CVPR 2021