← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Focal and Global Knowledge Distillation for Detectors CVPR 2022
Contextual Similarity Distillation for Asymmetric Image Retrieval CVPR 2022
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022
Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022
Knowledge Distillation via the Target-Aware Transformer CVPR 2022
Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022
X-Trans2Cap: Cross-Modal Knowledge Transfer Using Transformer for 3D Dense Captioning CVPR 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022
Slimmable Domain Adaptation CVPR 2022
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022
Co-Advise: Cross Inductive Bias Distillation CVPR 2022
Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022
Plug and Play Knowledge Distillation for kNN-LM with External Logits IJCNLP 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks AACL 2022
Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations AACL 2022
TRILLsson: Distilled Universal Paralinguistic Speech Representations INTERSPEECH 2022
Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis EMNLP 2022
Distill The Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation EMNLP 2022
Not to Overfit or Underfit the Source Domains? An Empirical Study of Domain Generalization in Question Answering EMNLP 2022
Sparse Teachers Can Be Dense with Knowledge EMNLP 2022
Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation EMNLP 2022
Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation EMNLP 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022