conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

Bridging Language Gaps in Audio-Text Retrieval INTERSPEECH 2024
tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models INTERSPEECH 2024
Enhanced Feature Learning with Normalized Knowledge Distillation for Audio Tagging INTERSPEECH 2024
RaD-Net 2: A causal two-stage repairing and denoising speech enhancement network with knowledge distillation and complex axial self-attention INTERSPEECH 2024
BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation INTERSPEECH 2024
Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models INTERSPEECH 2024
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation INTERSPEECH 2024
Prompting Large Language Models with Audio for General-Purpose Speech Summarization INTERSPEECH 2024
Frequency-mix Knowledge Distillation for Fake Speech Detection INTERSPEECH 2024
Shared-Adapters: A Novel Transformer-based Parameter Efficient Transfer Learning Approach For Children’s Automatic Speech Recognition INTERSPEECH 2024
Online Knowledge Distillation of Decoder-Only Large Language Models for Efficient Speech Recognition INTERSPEECH 2024
ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation INTERSPEECH 2024
Exploring compressibility of transformer based text-to-music (TTM) models INTERSPEECH 2024
GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model INTERSPEECH 2024
Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning INTERSPEECH 2024
Efficient Speaker Embedding Extraction Using a Twofold Sliding Window Algorithm for Speaker Diarization INTERSPEECH 2024
Knowledge boosting during low-latency inference INTERSPEECH 2024
PRVAE-VC2: Non-Parallel Voice Conversion by Distillation of Speech Representations INTERSPEECH 2024
Knowledge Distillation from Self-Supervised Representation Learning Model with Discrete Speech Units for Any-to-Any Streaming Voice Conversion INTERSPEECH 2024
A Small and Fast BERT for Chinese Medical Punctuation Restoration INTERSPEECH 2024
Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation INTERSPEECH 2024
Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models INTERSPEECH 2024
Self-Supervised Learning with Multi-Head Multi-Mode Knowledge Distillation for Speaker Verification INTERSPEECH 2024
FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation INTERSPEECH 2024
LungAdapter: Efficient Adapting Audio Spectrogram Transformer for Lung Sound Classification INTERSPEECH 2024