conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

A Gift From Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning CVPR 2017
Mimicking Very Efficient Network for Object Detection CVPR 2017
Distilling Knowledge from an Ensemble of Models for Punctuation Prediction INTERSPEECH 2017
A Teacher-Student Framework for Zero-Resource Neural Machine Translation ACL 2017
Knowledge Distillation for Bilingual Dictionary Induction EMNLP 2017
Efficient Knowledge Distillation from an Ensemble of Teachers INTERSPEECH 2017
Generalized Distillation Framework for Speaker Normalization INTERSPEECH 2017
Modal Consistency based Pre-Trained Multi-Model Reuse IJCAI 2017
Student-Teacher Training with Diverse Decision Tree Ensembles INTERSPEECH 2017
Adaptively Unified Semi-supervised Learning for Cross-Modal Retrieval IJCAI 2017
How a General-Purpose Commonsense Ontology can Improve Performance of Learning-Based Image Retrieval IJCAI 2017
Transfer Learning and Distillation Techniques to Improve the Acoustic Modeling of Low Resource Languages INTERSPEECH 2017
DrMAD: Distilling Reverse-Mode Automatic Differentiation for Optimizing Hyperparameters of Deep Neural Networks IJCAI 2016
Network Morphism ICML 2016
Distilling Knowledge from Ensembles of Neural Networks for Speech Recognition INTERSPEECH 2016
Sequence Student-Teacher Training of Deep Neural Networks INTERSPEECH 2016
Model Compression Applied to Small-Footprint Keyword Spotting INTERSPEECH 2016
Dropout distillation ICML 2016
Robust Speech Recognition Using Generalized Distillation Framework INTERSPEECH 2016
Cross Modal Distillation for Supervision Transfer CVPR 2016
SoundNet: Learning Sound Representations from Unlabeled Video NIPS 2016
Bayesian dark knowledge NIPS 2015
Do Deep Nets Really Need to be Deep? NIPS 2014
Near-Maximum Entropy Models for Binary Neural Representations of Natural Images NIPS 2007
Distilling dialogues - A method using natural dialogue corpora for dialogue systems development NAACL 2000