knowledge distillation

Long Short-Term Sample Distillation AAAI 2020 Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition AAAI 2020 Maintaining Discrimination and Fairness in Class Incremental Learning CVPR 2020 Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation EMNLP 2020 Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020 MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NeurIPS 2020 MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices ACL 2020 Modeling the Background for Incremental Learning in Semantic Segmentation CVPR 2020 More Grounded Image Captioning by Distilling Image-Text Matching Model CVPR 2020 Movement Pruning: Adaptive Sparsity by Fine-Tuning NeurIPS 2020 MTSS: Learn from Multiple Domain Teachers and Become a Multi-Domain Dialogue Expert AAAI 2020 Multi-Agent Mutual Learning at Sentence-Level and Token-Level for Neural Machine Translation EMNLP 2020 Multi-label Contrastive Predictive Coding NeurIPS 2020 Multi-Source Distilling Domain Adaptation AAAI 2020 MultiSpeech: Multi-Speaker Text to Speech with Transformer Interspeech 2020 Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch UAI 2020 Neural Epitome Search for Architecture-Agnostic Network Compression ICLR 2020 Neural Network Pruning With Residual-Connections and Limited-Data CVPR 2020 Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation From a Blackbox Model CVPR 2020 Online Knowledge Distillation via Collaborative Learning CVPR 2020 Online Knowledge Distillation with Diverse Peers AAAI 2020 Open-Set Short Utterance Forensic Speaker Verification Using Teacher-Student Network with Explicit Inductive Bias Interspeech 2020 Pay Attention to Features, Transfer Learn Faster CNNs ICLR 2020 P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection IJCAI 2020 Private-kNN: Practical Differential Privacy for Computer Vision CVPR 2020