← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection CVPR 2020
Knowledge As Priors: Cross-Modal Knowledge Generalization for Datasets Without Superior Knowledge CVPR 2020
Modeling the Background for Incremental Learning in Semantic Segmentation CVPR 2020
Improving Neural Topic Models using Knowledge Distillation EMNLP 2020
Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation EMNLP 2020
IIE’s Neural Machine Translation Systems for WMT20 EMNLP 2020
Combining Sequence Distillation and Transfer Learning for Efficient Low-Resource Neural Machine Translation Models EMNLP 2020
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch UAI 2020
Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification AAAI 2020
Scalable Zero-shot Entity Linking with Dense Entity Retrieval EMNLP 2020
Autoregressive Knowledge Distillation through Imitation Learning EMNLP 2020
Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task EMNLP 2020
Incremental Event Detection via Knowledge Consolidation Networks EMNLP 2020
Efficient Meta Lifelong-Learning with Limited Memory EMNLP 2020
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue EMNLP 2020
Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast—Choose Three EMNLP 2020
Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data EMNLP 2020
Students Need More Attention: BERT-based Attention Model for Small Data with Application to Automatic Patient Message Triage MLHC 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline NIPS 2020
Self-Supervised Generative Adversarial Compression NIPS 2020
Task-Oriented Feature Distillation NIPS 2020
Big Self-Supervised Models are Strong Semi-Supervised Learners NIPS 2020
Self-Distillation as Instance-Specific Label Smoothing NIPS 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning NIPS 2020