Knowledge Distillation

CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks NeurIPS 2021 Claim Matching Beyond English to Scale Global Fact-Checking ACL 2021 CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition Interspeech 2021 Collaborative Group Learning AAAI 2021 Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021 Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021 Complementary Relation Contrastive Distillation CVPR 2021 Content-Aware GAN Compression CVPR 2021 Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias EMNLP 2021 Cross-Layer Distillation with Semantic Calibration AAAI 2021 Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis AAAI 2021 Data-Free Model Extraction CVPR 2021 deepQuest-py: Large and Distilled Models for Quality Estimation EMNLP 2021 Deep Structured Instance Graph for Distilling Object Detectors ICCV 2021 Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021 Distilling Audio-Visual Knowledge by Compositional Contrastive Learning CVPR 2021 Distilling Knowledge for Empathy Detection EMNLP 2021 Distilling Knowledge via Knowledge Review CVPR 2021 Distilling Linguistic Context for Language Model Compression EMNLP 2021 Distilling Meta Knowledge on Heterogeneous Graph for Illicit Drug Trafficker Detection on Social Media NeurIPS 2021 Distilling Object Detectors via Decoupled Features CVPR 2021 Distilling Relation Embeddings from Pretrained Language Models EMNLP 2021 Diverse Knowledge Distillation for End-to-End Person Search AAAI 2021 DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learning EMNLP 2021 Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling ICLR 2021