Knowledge Distillation

Multi-Task Zipping via Layer-wise Neuron Sharing NeurIPS 2018 Neural Guided Constraint Logic Programming for Program Synthesis NeurIPS 2018 PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing CVPR 2018 Paraphrasing Complex Network: Network Compression via Factor Transfer NeurIPS 2018 Progressive Blockwise Knowledge Distillation for Neural Network Acceleration IJCAI 2018 Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control ICLR 2018 Teaching Semi-Supervised Classifier via Generalized Distillation IJCAI 2018 The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation COLING 2018 Towards Exploiting Background Knowledge for Building Conversation Systems EMNLP 2018 Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis NeurIPS 2018 XL-NBT: A Cross-lingual Neural Belief Tracking Framework EMNLP 2018 A Gift From Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning CVPR 2017 A Teacher-Student Framework for Zero-Resource Neural Machine Translation ACL 2017 Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model NeurIPS 2017 Cross-lingual Distillation for Text Classification ACL 2017 DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning EMNLP 2017 Distilling Knowledge from an Ensemble of Models for Punctuation Prediction Interspeech 2017 Distral: Robust multitask reinforcement learning NeurIPS 2017 Efficient Knowledge Distillation from an Ensemble of Teachers Interspeech 2017 Ensembles of Multi-Scale VGG Acoustic Models Interspeech 2017 Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization ACL 2017 Generalized Distillation Framework for Speaker Normalization Interspeech 2017 Knowledge Distillation for Bilingual Dictionary Induction EMNLP 2017 Large-Scale Domain Adaptation via Teacher-Student Learning Interspeech 2017 Learning Efficient Object Detection Models with Knowledge Distillation NeurIPS 2017