knowledge distillation

A Unified Framework for Knowledge Intensive Gradient Boosting: Leveraging Human Experts for Noisy Sparse Domains AAAI 2020 AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks ICML 2020 Autoregressive Knowledge Distillation through Imitation Learning EMNLP 2020 Auxiliary Training: Towards Accurate and Robust Models CVPR 2020 Balancing Cost and Benefit with Tied-Multi Transformers ACL 2020 BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance EMNLP 2020 BERT-of-Theseus: Compressing BERT by Progressive Module Replacing EMNLP 2020 Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data COLING 2020 Beyond Network Pruning: a Joint Search-and-Training Approach IJCAI 2020 Big Self-Supervised Models are Strong Semi-Supervised Learners NeurIPS 2020 Black-Box Ripper: Copying black-box models using generative evolutionary algorithms NeurIPS 2020 BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget ICLR 2020 Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation CVPR 2020 Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation EMNLP 2020 CASIA’s System for IWSLT 2020 Open Domain Translation ACL 2020 Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Evolvability NeurIPS 2020 Class-incremental Learning via Deep Model Consolidation WACV 2020 Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction CoNLL 2020 Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020 Combining Sequence Distillation and Transfer Learning for Efficient Low-Resource Neural Machine Translation Models EMNLP 2020 Compact Speaker Embedding: lrx-Vector Interspeech 2020 Compressing Pre-trained Language Models by Matrix Decomposition AACL 2020 Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings EMNLP 2020 CompRess: Self-Supervised Learning by Compressing Representations NeurIPS 2020 Conditional Response Augmentation for Dialogue Using Knowledge Distillation Interspeech 2020