Knowledge Distillation

Long Short-Term Sample Distillation AAAI 2020 Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition AAAI 2020 Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation EMNLP 2020 Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020 MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NeurIPS 2020 MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices ACL 2020 Model Watermarking for Image Processing Networks AAAI 2020 More Grounded Image Captioning by Distilling Image-Text Matching Model CVPR 2020 MTSS: Learn from Multiple Domain Teachers and Become a Multi-Domain Dialogue Expert AAAI 2020 Multi-Agent Mutual Learning at Sentence-Level and Token-Level for Neural Machine Translation EMNLP 2020 Multi-label Contrastive Predictive Coding NeurIPS 2020 Multi-Stage Influence Function NeurIPS 2020 Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch UAI 2020 Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation From a Blackbox Model CVPR 2020 NLP@JUST at SemEval-2020 Task 4: Ensemble Technique for BERT and Roberta to Evaluate Commonsense Validation SemEval 2020 Object Relational Graph With Teacher-Recommended Learning for Video Captioning CVPR 2020 Online Knowledge Distillation via Collaborative Learning CVPR 2020 Online Knowledge Distillation with Diverse Peers AAAI 2020 Open-Set Short Utterance Forensic Speaker Verification Using Teacher-Student Network with Explicit Inductive Bias Interspeech 2020 Pay Attention to Features, Transfer Learn Faster CNNs ICLR 2020 P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection IJCAI 2020 PublishInCovid19 at WNUT 2020 Shared Task-1: Entity Recognition in Wet Lab Protocols using Structured Learning Ensemble and Contextualised Embeddings EMNLP 2020 Query Distillation: BERT-based Distillation for Ensemble Ranking COLING 2020 Regularizing Class-Wise Predictions via Self-Knowledge Distillation CVPR 2020 Residual Distillation: Towards Portable Deep Neural Networks without Shortcuts NeurIPS 2020