Knowledge Distillation

Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020 Object Relational Graph With Teacher-Recommended Learning for Video Captioning CVPR 2020 Online Knowledge Distillation with Diverse Peers AAAI 2020 Understanding Knowledge Distillation in Non-autoregressive Machine Translation ICLR 2020 Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers EMNLP 2020 A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization NAACL 2019 Progressive Teacher-Student Learning for Early Action Prediction CVPR 2019 Fidelity-Weighted Learning ICLR 2018 Knowledge Distillation by On-the-Fly Native Ensemble NeurIPS 2018 Bayesian dark knowledge NeurIPS 2015