conftrace_
← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

1,329 papers

Papers per year

1
3
10
12
47
120
155
197
206
255
290
33

Papers

Towards Architecture-Agnostic Neural Transfer: a Knowledge-Enhanced Approach IJCAI 2019
Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition INTERSPEECH 2019
Probability Distillation: A Caveat and Alternatives UAI 2019
KDGAN: Knowledge Distillation with Generative Adversarial Networks NIPS 2018
Knowledge Distillation by On-the-Fly Native Ensemble NIPS 2018
Distilling Knowledge for Search-based Structured Prediction ACL 2018
Neural Natural Language Inference Models Enhanced with External Knowledge ACL 2018
Marian: Cost-effective High-Quality Neural Machine Translation in C++ ACL 2018
NestedNet: Learning Nested Sparse Structures in Deep Neural Networks CVPR 2018
Boosting Self-Supervised Learning via Knowledge Transfer CVPR 2018
Revisiting the Importance of Encoding Logic Rules in Sentiment Classification EMNLP 2018
Analyzing Knowledge Distillation in Neural Machine Translation EMNLP 2018
Born Again Neural Networks ICML 2018
WSNet: Compact and Efficient Networks Through Weight Sampling ICML 2018
Knowledge Distillation for Sequence Model INTERSPEECH 2018
Sobolev Training for Neural Networks NIPS 2017
Learning Efficient Object Detection Models with Knowledge Distillation NIPS 2017
Cross-lingual Distillation for Text Classification ACL 2017
A Teacher-Student Framework for Zero-Resource Neural Machine Translation ACL 2017
A Gift From Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning CVPR 2017
Mimicking Very Efficient Network for Object Detection CVPR 2017
Knowledge Distillation for Bilingual Dictionary Induction EMNLP 2017
Student-Teacher Training with Diverse Decision Tree Ensembles INTERSPEECH 2017
Transfer Learning and Distillation Techniques to Improve the Acoustic Modeling of Low Resource Languages INTERSPEECH 2017
Efficient Knowledge Distillation from an Ensemble of Teachers INTERSPEECH 2017