Knowledge Distillation

Incremental Event Detection via Knowledge Consolidation Networks EMNLP 2020 Inducing Relational Knowledge from BERT AAAI 2020 Integrating Relation Constraints with Neural Relation Extractors AAAI 2020 Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020 Intra-Utterance Similarity Preserving Knowledge Distillation for Audio Tagging Interspeech 2020 KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow MIDL 2020 Kernel Based Progressive Distillation for Adder Neural Networks NeurIPS 2020 Knowledge As Priors: Cross-Modal Knowledge Generalization for Datasets Without Superior Knowledge CVPR 2020 Knowledge-Based Regularization in Generative Modeling IJCAI 2020 Knowledge Base Embedding By Cooperative Knowledge Distillation COLING 2020 Knowledge Consistency between Neural Networks and Beyond ICLR 2020 Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation ACL 2020 Knowledge Distillation from Internal Representations AAAI 2020 Knowledge Distillation from Offline to Streaming RNN Transducer for End-to-End Speech Recognition Interspeech 2020 Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher NeurIPS 2020 Knowledge Integration Networks for Action Recognition AAAI 2020 Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control NeurIPS 2020 LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression COLING 2020 Language Model Prior for Low-Resource Neural Machine Translation EMNLP 2020 Learning Student Networks with Few Data AAAI 2020 Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion ICML 2020 Learning Voice Representation Using Knowledge Distillation for Automatic Voice Casting Interspeech 2020 Lifelong Language Knowledge Distillation EMNLP 2020 Light Multi-Segment Activation for Model Compression AAAI 2020 Load What You Need: Smaller Versions of Mutililingual BERT EMNLP 2020