Knowledge Distillation

Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022 Knowledge Distillation from A Stronger Teacher NeurIPS 2022 Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NeurIPS 2022 Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains ACL 2022 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022 Knowledge Distillation via Constrained Variational Inference AAAI 2022 Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer Interspeech 2022 Knowledge Distillation via the Target-Aware Transformer CVPR 2022 Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression COLING 2022 Knowledge Distillation With the Reused Teacher Classifier CVPR 2022 Knowledge Inheritance for Pre-trained Language Models NAACL 2022 Knowledge Sharing via Domain Adaptation in Customs Fraud Detection AAAI 2022 Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition Interspeech 2022 Knowledge Transfer with Visual Prompt in multi-modal Dialogue Understanding and Generation COLING 2022 KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022 Kronecker Decomposition for GPT Compression ACL 2022 Label Hallucination for Few-Shot Classification AAAI 2022 Language model compression with weighted low-rank factorization ICLR 2022 Language Modelling via Learning to Rank AAAI 2022 Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval NAACL 2022 Learning Augmented Binary Search Trees ICML 2022 Learning Cross-Lingual IR from an English Retriever NAACL 2022 Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NeurIPS 2022 Learning from Students: Online Contrastive Distillation Network for General Continual Learning IJCAI 2022 Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation NeurIPS 2022