← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Lightweight Adapter Tuning for Multilingual Speech Translation IJCNLP 2021
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation IJCNLP 2021
Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021
Effectiveness of Arbitrary Transfer Sets for Data-Free Knowledge Distillation WACV 2021
Learning to Distill Convolutional Features Into Compact Local Descriptors WACV 2021
Investigation of IMU&Elevoc Submission for the Short-Duration Speaker Verification Challenge 2021 INTERSPEECH 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021
Self-Adaptive Distillation for Multilingual Speech Recognition: Leveraging Student Independence INTERSPEECH 2021
Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation INTERSPEECH 2021
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression EMNLP 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021
Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation EMNLP 2021
RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation EMNLP 2021
Real-Time Uncertainty Estimation in Computer Vision via Uncertainty-Aware Distribution Distillation WACV 2021
Data-Free Knowledge Distillation for Object Detection WACV 2021
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding EMNLP 2021
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading CVPR 2021
Multi-Task Knowledge Distillation for Eye Disease Prediction WACV 2021
Distillation Multiple Choice Learning for Multimodal Action Recognition WACV 2021
IIRC: Incremental Implicitly-Refined Classification CVPR 2021
Wasserstein Contrastive Representation Distillation CVPR 2021
Complementary Relation Contrastive Distillation CVPR 2021
SuperMix: Supervising the Mixing Data Augmentation CVPR 2021