Knowledge Distillation

Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights NeurIPS 2022 Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022 Improved Feature Distillation via Projector Ensemble NeurIPS 2022 Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022 Improving ASR Robustness in Noisy Condition Through VAD Integration Interspeech 2022 Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022 Improving Neural Cross-Lingual Abstractive Summarization via Employing Optimal Transport Distance for Knowledge Distillation AAAI 2022 Improving Object Detection by Label Assignment Distillation WACV 2022 Improving Scene Graph Classification by Exploiting Knowledge from Texts AAAI 2022 Improving Video Model Transfer With Dynamic Representation Learning CVPR 2022 Incremental Cross-View Mutual Distillation for Self-Supervised Medical CT Synthesis CVPR 2022 Information-Theoretic GAN Compression with Variational Energy-based Model NeurIPS 2022 Infusing Knowledge from Wikipedia to Enhance Stance Detection ACL 2022 InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model NeurIPS 2022 It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022 KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation NAACL 2022 Keyword Spotting with Synthetic Data using Heterogeneous Knowledge Distillation Interspeech 2022 KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022 Knowledge-Augmented Language Models for Cause-Effect Relation Classification ACL 2022 Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022 Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022 Knowledge Distillation: Bad Models Can Be Good Role Models NeurIPS 2022 Knowledge Distillation based Contextual Relevance Matching for E-commerce Product Search EMNLP 2022 Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning Interspeech 2022 Knowledge distillation for In-memory keyword spotting model Interspeech 2022