← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Learning from Students: Online Contrastive Distillation Network for General Continual Learning IJCAI 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022
Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification INTERSPEECH 2022
Low-resource Low-footprint Wake-word Detection using Knowledge Distillation INTERSPEECH 2022
Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer INTERSPEECH 2022
Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation INTERSPEECH 2022
Safe Distillation Box AAAI 2022
Boosting Contrastive Learning with Relation Knowledge Distillation AAAI 2022
Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation ACL 2022
Weighted self Distillation for Chinese word segmentation ACL 2022
The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 ACL 2022
VIRT: Improving Representation-based Text Matching via Virtual Interaction EMNLP 2022
Multilingual Machine Translation with Hyper-Adapters EMNLP 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022
Distilling Multilingual Transformers into CNNs for Scalable Intent Classification EMNLP 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text EMNLP 2022
DINE: Domain Adaptation From Single and Multiple Black-Box Predictors CVPR 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022
Focal and Global Knowledge Distillation for Detectors CVPR 2022
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022
Anomaly Detection via Reverse Distillation From One-Class Embedding CVPR 2022