← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Distilling Multilingual Transformers into CNNs for Scalable Intent Classification EMNLP 2022
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training EMNLP 2022
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation EMNLP 2022
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing EMNLP 2022
Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022
Distilling a Pretrained Language Model to a Multilingual ASR Model INTERSPEECH 2022
Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval EMNLP 2022
Predicting Prerequisite Relations for Unseen Concepts EMNLP 2022
Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022
TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition EMNLP 2022
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization EMNLP 2022
Class Incremental Learning for Intent Classification with Limited or No Old Data EMNLP 2022
Semantic Segmentation of Legal Documents via Rhetorical Roles EMNLP 2022
BJTU-WeChat’s Systems for the WMT22 Chat Translation Task EMNLP 2022
Label Hallucination for Few-Shot Classification AAAI 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022
Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer INTERSPEECH 2022
Improving ASR Robustness in Noisy Condition Through VAD Integration INTERSPEECH 2022
Low-resource Low-footprint Wake-word Detection using Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022
MobileFaceSwap: A Lightweight Framework for Video Face Swapping AAAI 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022
Multi-View Attention Transfer for Efficient Speech Enhancement INTERSPEECH 2022