Knowledge Distillation

Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023 Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models EMNLP 2023 Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023 Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023 H2O Open Ecosystem for State-of-the-art Large Language Models EMNLP 2023 HAPI Explorer: Comprehension, Discovery, and Explanation on History of ML APIs AAAI 2023 Harnessing Black-Box Control to Boost Commonsense in LM’s Generation EMNLP 2023 Heterogeneous-Branch Collaborative Learning for Dialogue Generation AAAI 2023 Heterogeneous Continual Learning CVPR 2023 Heterogeneous Forgetting Compensation for Class-Incremental Learning ICCV 2023 HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation ACL 2023 HOICLIP: Efficient Knowledge Transfer for HOI Detection With Vision-Language Models CVPR 2023 HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers ICLR 2023 How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives ACL 2023 HuatuoGPT, Towards Taming Language Model to Be a Doctor EMNLP 2023 Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval EMNLP 2023 HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks ACL 2023 I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation ACL 2023 I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task ACL 2023 ICD-Face: Intra-class Compactness Distillation for Face Recognition ICCV 2023 IDEAL: Query-Efficient Data-Free Learning from Black-Box Models ICLR 2023 IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023 Improving Adversarial Robustness via Information Bottleneck Distillation NeurIPS 2023 Improving CLIP Fine-tuning Performance ICCV 2023 Improving End-to-End SLU performance with Prosodic Attention and Distillation Interspeech 2023