Knowledge Distillation

Information-Theoretic GAN Compression with Variational Energy-based Model NeurIPS 2022 Injecting Domain Knowledge in Language Models for Task-oriented Dialogue Systems EMNLP 2022 Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022 Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022 Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022 Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning Interspeech 2022 Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022 Knowledge Distillation from A Stronger Teacher NeurIPS 2022 Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks NeurIPS 2022 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022 Knowledge Distillation via Constrained Variational Inference AAAI 2022 Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer Interspeech 2022 Knowledge Distillation via the Target-Aware Transformer CVPR 2022 Knowledge Distillation With the Reused Teacher Classifier CVPR 2022 Knowledge Inheritance for Pre-trained Language Models NAACL 2022 Knowledge Sharing via Domain Adaptation in Customs Fraud Detection AAAI 2022 Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition Interspeech 2022 Knowledge Transfer from Answer Ranking to Answer Generation EMNLP 2022 KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022 Label Hallucination for Few-Shot Classification AAAI 2022 Language Adapters for Large-Scale MT: The GMU System for the WMT 2022 Large-Scale Machine Translation Evaluation for African Languages Shared Task EMNLP 2022 Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic Samples ACL 2022 Learn From Others and Be Yourself in Heterogeneous Federated Learning CVPR 2022 Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NeurIPS 2022 Learning from Students: Online Contrastive Distillation Network for General Continual Learning IJCAI 2022