Knowledge Distillation

Efficient Scheduling of Data Augmentation for Deep Reinforcement Learning NeurIPS 2022 Eliminating Backdoor Triggers for Deep Neural Networks Using Attention Relation Graph Distillation IJCAI 2022 Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval EMNLP 2022 Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation ACL 2022 En-Compactness: Self-Distillation Embedding & Contrastive Generation for Generalized Zero-Shot Learning CVPR 2022 Evaluation-Oriented Knowledge Distillation for Deep Face Recognition CVPR 2022 Extractive Knowledge Distillation WACV 2022 EyePAD++: A Distillation-Based Approach for Joint Eye Authentication and Presentation Attack Detection Using Periocular Images CVPR 2022 Fairness without Demographics through Knowledge Distillation NeurIPS 2022 Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation Interspeech 2022 Feature Kernel Distillation ICLR 2022 Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models NeurIPS 2022 Focal and Global Knowledge Distillation for Detectors CVPR 2022 From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022 FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022 Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks NeurIPS 2022 Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022 Hilbert Distillation for Cross-Dimensionality Networks NeurIPS 2022 How Can a Teacher Make Learning From Sparse Data Softer? Application to Business Relation Extraction EMNLP 2022 Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models NeurIPS 2022 HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022 Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data CVPR 2022 Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022 Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022 Improving Neural Cross-Lingual Abstractive Summarization via Employing Optimal Transport Distance for Knowledge Distillation AAAI 2022