Knowledge Distillation

Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020 Distilling Image Dehazing With Heterogeneous Task Imitation CVPR 2020 Distilling Knowledge From Graph Convolutional Networks CVPR 2020 Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction AAAI 2020 Distilling Multiple Domains for Neural Machine Translation EMNLP 2020 Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020 Distilling Structured Knowledge for Text-Based Relational Reasoning EMNLP 2020 Distilling the Knowledge of BERT for Sequence-to-Sequence ASR Interspeech 2020 Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness ACL 2020 Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion CVPR 2020 Dual Policy Distillation IJCAI 2020 Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives CVPR 2020 E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT EMNLP 2020 Efficient and High-Quality Neural Machine Translation with OpenNMT ACL 2020 End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020 ACL 2020 Ensemble Approaches for Uncertainty in Spoken Language Assessment Interspeech 2020 Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast—Choose Three EMNLP 2020 Explaining Knowledge Distillation by Quantifying the Knowledge CVPR 2020 Exploit and Replace: An Asymmetrical Two-Stream Architecture for Versatile Light Field Saliency Detection AAAI 2020 Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020 Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation NeurIPS 2020 FastBERT: a Self-distilling BERT with Adaptive Inference Time ACL 2020 Fast End-to-end Coreference Resolution for Korean EMNLP 2020 FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020 Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020