← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Enhancing Diversity in Teacher-Student Networks via Asymmetric Branches for Unsupervised Person Re-Identification WACV 2021
Adversarial Teacher-Student Representation Learning for Domain Generalization NIPS 2021
Self-Distillation for Few-Shot Image Captioning WACV 2021
Revisiting Pretraining with Adapters ACL 2021
IAPUCP at SemEval-2021 Task 1: Stacking Fine-Tuned Transformers is Almost All You Need for Lexical Complexity Prediction ACL 2021
THiFly_Queens at SemEval-2021 Task 9: Two-stage Statement Verification with Adaptive Ensembling and Slot-based Operation ACL 2021
G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-Guided Feature Imitation ICCV 2021
Text Is Text, No Matter What: Unifying Text Recognition Using Knowledge Distillation ICCV 2021
Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer ICCV 2021
Channel-Wise Knowledge Distillation for Dense Prediction ICCV 2021
Distillation-Guided Image Inpainting ICCV 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
Distilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation EMNLP 2021
GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation EMNLP 2021
Students Who Study Together Learn Better: On the Importance of Collective Knowledge Distillation for Domain Transfer in Fact Verification EMNLP 2021
Towards Zero-Shot Knowledge Distillation for Natural Language Processing EMNLP 2021
Tree-Like Decision Distillation CVPR 2021
HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression EMNLP 2021
Self-training Improves Pre-training for Natural Language Understanding NAACL 2021
EvDistill: Asynchronous Events To End-Task Learning via Bidirectional Reconstruction-Guided Cross-Modal Knowledge Distillation CVPR 2021
Probabilistic Model Distillation for Semantic Correspondence CVPR 2021
Distilling Linguistic Context for Language Model Compression EMNLP 2021
Revisiting Pretraining with Adapters IJCNLP 2021
An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation IJCNLP 2021
Towards Quantifiable Dialogue Coherence Evaluation IJCNLP 2021