← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Synthetic Pre-Training Tasks for Neural Machine Translation ACL 2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023
PIP: Parse-Instructed Prefix for Syntactically Controlled Paraphrase Generation ACL 2023
Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction ACL 2023
Better Language Models of Code through Self-Improvement ACL 2023
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023
Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages ACL 2023
Four Approaches to Low-Resource Multilingual NMT: The Helsinki Submission to the AmericasNLP 2023 Shared Task ACL 2023
An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023
Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization INTERSPEECH 2023
Compressed MoE ASR Model Based on Knowledge Distillation and Quantization INTERSPEECH 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition INTERSPEECH 2023
A Teacher-Student Approach for Extracting Informative Speaker Embeddings From Speech Mixtures INTERSPEECH 2023
Improving End-to-End SLU performance with Prosodic Attention and Distillation INTERSPEECH 2023
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation INTERSPEECH 2023
Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data INTERSPEECH 2023
Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation INTERSPEECH 2023
DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model INTERSPEECH 2023
Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization INTERSPEECH 2023
Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding INTERSPEECH 2023
Effective Training of Attention-based Contextual Biasing Adapters with Synthetic Audio for Personalised ASR INTERSPEECH 2023
Knowledge Distillation Approach for Efficient Internal Language Model Estimation INTERSPEECH 2023
Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR INTERSPEECH 2023
Towards Understanding Ensemble Distillation in Federated Learning ICML 2023
Discrete Continuous Optimization Framework for Simultaneous Clustering and Training in Mixture Models ICML 2023