knowledge distillation

Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020 Contrastive Representation Distillation ICLR 2020 Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NeurIPS 2020 Creating Something From Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing CVPR 2020 Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation COLING 2020 D3D: Distilled 3D Networks for Video Action Recognition WACV 2020 Dark Experience for General Continual Learning: a Strong, Simple Baseline NeurIPS 2020 Data Diversification: A Simple Strategy For Neural Machine Translation NeurIPS 2020 Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN CVPR 2020 Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation EMNLP 2020 DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference ACL 2020 DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs NeurIPS 2020 Deep Streaming Label Learning ICML 2020 DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering ACL 2020 DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020 DFQF: Data Free Quantization-aware Fine-tuning ACML 2020 Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data EMNLP 2020 DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling EMNLP 2020 Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation ACL 2020 Distill and Replay for Continual Language Learning COLING 2020 Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020 Distilled Semantics for Comprehensive Scene Understanding from Videos CVPR 2020 Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020 Distilling Effective Supervision From Severe Label Noise CVPR 2020 Distilling Image Dehazing With Heterogeneous Task Imitation CVPR 2020