conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

Guiding CTC Posterior Spike Timings for Improved Posterior Fusion and Knowledge Distillation INTERSPEECH 2019
Joint Student-Teacher Learning for Audio-Visual Scene-Aware Dialog INTERSPEECH 2019
Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion INTERSPEECH 2019
Knowledge Distillation for End-to-End Monaural Multi-Talker ASR System INTERSPEECH 2019
Self-Teaching Networks INTERSPEECH 2019
Compression of CTC-Trained Acoustic Models by Dynamic Frame-Wise Distillation or Segment-Wise N-Best Hypotheses Imitation INTERSPEECH 2019
Neural Network Distillation on IoT Platforms for Sound Event Detection INTERSPEECH 2019
Compression of Acoustic Event Detection Models with Quantized Distillation INTERSPEECH 2019
Learn Spelling from Teachers: Transferring Knowledge from Language Models to Sequence-to-Sequence Speech Recognition INTERSPEECH 2019
Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition INTERSPEECH 2019
ReWE: Regressing Word Embeddings for Regularization of Neural Machine Translation Systems NAACL 2019
Online Distilling from Checkpoints for Neural Machine Translation NAACL 2019
On Knowledge distillation from complex networks for response prediction NAACL 2019
Probability Distillation: A Caveat and Alternatives UAI 2019
KDGAN: Knowledge Distillation with Generative Adversarial Networks NIPS 2018
Learning to Specialize with Knowledge Distillation for Visual Question Answering NIPS 2018
Collaborative Learning for Deep Neural Networks NIPS 2018
Moonshine: Distilling with Cheap Convolutions NIPS 2018
Neural Guided Constraint Logic Programming for Program Synthesis NIPS 2018
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis NIPS 2018
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions NIPS 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer NIPS 2018
MacNet: Transferring Knowledge from Machine Comprehension to Sequence-to-Sequence Models NIPS 2018
Knowledge Distillation by On-the-Fly Native Ensemble NIPS 2018
Improving Simple Models with Confidence Profiles NIPS 2018