Knowledge Distillation

A "Network Pruning Network'' Approach to Deep Model Compression WACV 2020 An Iterative Multi-Source Mutual Knowledge Transfer Framework for Machine Reading Comprehension IJCAI 2020 Assessment of DistilBERT performance on Named Entity Recognition task for the detection of Protected Health Information and medical concepts EMNLP 2020 Audio-Visual Model Distillation Using Acoustic Images WACV 2020 AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks ICML 2020 Autoregressive Knowledge Distillation through Imitation Learning EMNLP 2020 Balancing Cost and Benefit with Tied-Multi Transformers ACL 2020 BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance EMNLP 2020 BERT-of-Theseus: Compressing BERT by Progressive Module Replacing EMNLP 2020 BhamNLP at SemEval-2020 Task 12: An Ensemble of Different Word Embeddings and Emotion Transfer Learning for Arabic Offensive Language Identification in Social Media SemEval 2020 Black-Box Ripper: Copying black-box models using generative evolutionary algorithms NeurIPS 2020 BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget ICLR 2020 Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation CVPR 2020 Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation EMNLP 2020 Can Automatic Post-Editing Improve NMT? EMNLP 2020 CASIA’s System for IWSLT 2020 Open Domain Translation ACL 2020 Class-incremental Learning via Deep Model Consolidation WACV 2020 Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction CoNLL 2020 Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020 Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation COLING 2020 Combining Sequence Distillation and Transfer Learning for Efficient Low-Resource Neural Machine Translation Models EMNLP 2020 Compact Speaker Embedding: lrx-Vector Interspeech 2020 Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings EMNLP 2020 CompRess: Self-Supervised Learning by Compressing Representations NeurIPS 2020 ConceptBert: Concept-Aware Representation for Visual Question Answering EMNLP 2020