← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

End-to-End Speech Translation with Knowledge Distillation INTERSPEECH 2019
MBS: Macroblock Scaling for CNN Model Reduction CVPR 2019
Weakly Supervised Open-Set Domain Adaptation by Dual-Domain Collaboration CVPR 2019
Knockoff Nets: Stealing Functionality of Black-Box Models CVPR 2019
Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition With Multimodal Training CVPR 2019
Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks AAAI 2019
DDFlow: Learning Optical Flow with Unlabeled Data Distillation AAAI 2019
Deeply-Supervised Knowledge Synergy CVPR 2019
Zero-Shot Cross-Lingual Abstractive Sentence Summarization through Teaching Generation and Attention ACL 2019
The NiuTrans Machine Translation Systems for WMT19 ACL 2019
GTCOM Neural Machine Translation Systems for WMT19 ACL 2019
BAM! Born-Again Multi-Task Networks for Natural Language Understanding ACL 2019
On Knowledge distillation from complex networks for response prediction NAACL 2019
Natural Language Generation for Effective Knowledge Distillation EMNLP 2019
Joint Student-Teacher Learning for Audio-Visual Scene-Aware Dialog INTERSPEECH 2019
Knowledge Distillation with Adversarial Samples Supporting Decision Boundary AAAI 2019
Structured Pruning of Neural Networks With Budget-Aware Regularization CVPR 2019
Acoustic Scene Classification Using Teacher-Student Learning with Soft-Labels INTERSPEECH 2019
Learning Without Memorizing CVPR 2019
Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimation CVPR 2019
Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-Grained Image Recognition CVPR 2019
When does label smoothing help? NIPS 2019
Positive-Unlabeled Compression on the Cloud NIPS 2019
Unsupervised Image Captioning CVPR 2019
Fast Human Pose Estimation CVPR 2019