Knowledge Distillation

Conditional Response Augmentation for Dialogue Using Knowledge Distillation Interspeech 2020 Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020 Contrastive Representation Distillation ICLR 2020 CORAL-DMOEA: Correlation Alignment-Based Information Transfer for Dynamic Multi-Objective Optimization (Student Abstract) AAAI 2020 Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NeurIPS 2020 Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation COLING 2020 D3D: Distilled 3D Networks for Video Action Recognition WACV 2020 Dark Experience for General Continual Learning: a Strong, Simple Baseline NeurIPS 2020 DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020 DFQF: Data Free Quantization-aware Fine-tuning ACML 2020 DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling EMNLP 2020 Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation ACL 2020 Distill and Replay for Continual Language Learning COLING 2020 Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020 Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020 Distilling Effective Supervision From Severe Label Noise CVPR 2020 Distilling Image Dehazing With Heterogeneous Task Imitation CVPR 2020 Distilling Knowledge From Graph Convolutional Networks CVPR 2020 Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction AAAI 2020 Distilling Knowledge Learned in BERT for Text Generation ACL 2020 Distilling Multiple Domains for Neural Machine Translation EMNLP 2020 Distilling Neural Networks for Greener and Faster Dependency Parsing ACL 2020 Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020 Distilling the Knowledge of BERT for Sequence-to-Sequence ASR Interspeech 2020 Distributed Distillation for On-Device Learning NeurIPS 2020