conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding INTERSPEECH 2023
Multi-mode Neural Speech Coding Based on Deep Generative Networks INTERSPEECH 2023
Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation INTERSPEECH 2023
Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data INTERSPEECH 2023
Improving End-to-End SLU performance with Prosodic Attention and Distillation INTERSPEECH 2023
Effective Training of Attention-based Contextual Biasing Adapters with Synthetic Audio for Personalised ASR INTERSPEECH 2023
CLRL-Tuning: A Novel Continual Learning Approach for Automatic Speech Recognition INTERSPEECH 2023
Masked Modeling Duo for Speech: Specializing General-Purpose Audio Representation to Speech using Denoising Distillation INTERSPEECH 2023
Knowledge Distillation Approach for Efficient Internal Language Model Estimation INTERSPEECH 2023
Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation INTERSPEECH 2023
Knowledge Distillation on Joint Task End-to-End Speech Translation INTERSPEECH 2023
Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition INTERSPEECH 2023
An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023
On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation INTERSPEECH 2023
Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer INTERSPEECH 2023
Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions INTERSPEECH 2023
Nkululeko: Machine Learning Experiments on Speaker Characteristics Without Programming INTERSPEECH 2023
DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding INTERSPEECH 2023
DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model INTERSPEECH 2023
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023
A Multiple-Teacher Pruning Based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting INTERSPEECH 2023
Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR INTERSPEECH 2023
Application of Knowledge Distillation to Multi-Task Speech Representation Learning INTERSPEECH 2023
Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding INTERSPEECH 2023
Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization INTERSPEECH 2023