Knowledge Distillation

Neural Network Distillation on IoT Platforms for Sound Event Detection Interspeech 2019 NOTE-RCNN: NOise Tolerant Ensemble RCNN for Semi-Supervised Object Detection ICCV 2019 On Knowledge distillation from complex networks for response prediction NAACL 2019 Online Distilling from Checkpoints for Neural Machine Translation NAACL 2019 Online Model Distillation for Efficient Video Inference ICCV 2019 On the Efficacy of Knowledge Distillation ICCV 2019 PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation ACL 2019 Parameter-Efficient Transfer Learning for NLP ICML 2019 Patient Knowledge Distillation for BERT Model Compression EMNLP 2019 Pedestrian Attribute Recognition by Joint Visual-semantic Reasoning and Knowledge Distillation IJCAI 2019 Positive-Unlabeled Compression on the Cloud NeurIPS 2019 Private Model Compression via Knowledge Distillation AAAI 2019 Probability Density Distillation with Generative Adversarial Networks for High-Quality Parallel Waveform Generation Interspeech 2019 Probability Distillation: A Caveat and Alternatives UAI 2019 Progressive Teacher-Student Learning for Early Action Prediction CVPR 2019 RDPD: Rich Data Helps Poor Data via Imitation IJCAI 2019 Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs IJCAI 2019 Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimation CVPR 2019 Relational Knowledge Distillation CVPR 2019 ReWE: Regressing Word Embeddings for Regularization of Neural Machine Translation Systems NAACL 2019 Scalable Syntax-Aware Language Models Using Knowledge Distillation ACL 2019 Scaling Object Detection by Transferring Classification Weights ICCV 2019 SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models NeurIPS 2019 Self-Teaching Networks Interspeech 2019 Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition Interspeech 2019