← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Hierarchical Self-supervised Augmented Knowledge Distillation IJCAI 2021
Self-boosting for Feature Distillation IJCAI 2021
RankDistil: Knowledge Distillation for Ranking AISTATS 2021
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ACL 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation ACL 2021
Selective Knowledge Distillation for Neural Machine Translation ACL 2021
Distilling Image Classifiers in Object Detectors NIPS 2021
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data NIPS 2021
GhostBERT: Generate More Features with Cheap Operations for BERT ACL 2021
On Knowledge Distillation for Translating Erroneous Speech Transcriptions ACL 2021
KSM: Fast Multiple Task Adaption via Kernel-Wise Soft Mask Learning CVPR 2021
Faster Matchings via Learned Duals NIPS 2021
A Peek Into the Reasoning of Neural Networks: Interpreting With Structural Visual Concepts CVPR 2021
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation CVPR 2021
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation NIPS 2021
Does Knowledge Distillation Really Work? NIPS 2021
Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NIPS 2021
Learning to Augment for Data-scarce Domain BERT Knowledge Distillation AAAI 2021
Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis AAAI 2021
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval IJCNLP 2021
ESPnet-ST IWSLT 2021 Offline Speech Translation System IJCNLP 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 IJCNLP 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor IJCNLP 2021
Obtaining Better Static Word Embeddings Using Contextual Embedding Models IJCNLP 2021
Continual Learning for Named Entity Recognition AAAI 2021