Knowledge Distillation

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression EMNLP 2021 BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021 BNS: Building Network Structures Dynamically for Continual Learning NeurIPS 2021 Boosting Weakly Supervised Object Detection via Learning Bounding Box Adjusters ICCV 2021 Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection NeurIPS 2021 Bridging the Gap Between Streaming and Non-Streaming ASR Systems by Distilling Ensembles of CTC and RNN-T Models Interspeech 2021 CapsuleRRT: Relationships-Aware Regression Tracking via Capsules CVPR 2021 Channel-Wise Knowledge Distillation for Dense Prediction ICCV 2021 Claim Matching Beyond English to Scale Global Fact-Checking ACL 2021 Class-Incremental Instance Segmentation via Multi-Teacher Networks AAAI 2021 Code Completion by Modeling Flattened Abstract Syntax Trees as Graphs AAAI 2021 CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition Interspeech 2021 Collaborative Group Learning AAAI 2021 Collaborative Learning of Bidirectional Decoders for Unsupervised Text Style Transfer EMNLP 2021 Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021 Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021 Competing Independent Modules for Knowledge Integration and Optimization EMNLP 2021 Complementary Relation Contrastive Distillation CVPR 2021 Comprehensive Knowledge Distillation with Causal Intervention NeurIPS 2021 Compressing Visual-Linguistic Model via Knowledge Distillation ICCV 2021 Content-Aware GAN Compression CVPR 2021 Context-Aware Image Inpainting with Learned Semantic Priors IJCAI 2021 Contextualized Attention-Based Knowledge Transfer for Spoken Conversational Question Answering Interspeech 2021 Continual Learning for Fake Audio Detection Interspeech 2021 Continual Learning for Named Entity Recognition AAAI 2021