Knowledge Distillation

Discrete Continuous Optimization Framework for Simultaneous Clustering and Training in Mixture Models ICML 2023 Discriminator-Cooperated Feature Map Distillation for GAN Compression CVPR 2023 Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from a Conditional Causal Perspective AAAI 2023 DisGUIDE: Disagreement-Guided Data-Free Model Extraction AAAI 2023 Distillation of encoder-decoder transformers for sequence labelling EACL 2023 Distillation Strategies for Discriminative Speech Recognition Rescoring Interspeech 2023 DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation ICCV 2023 DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023 Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning ICCV 2023 Distilling Calibrated Knowledge for Stance Detection ACL 2023 Distilling ChatGPT for Explainable Automated Student Answer Assessment EMNLP 2023 Distilling Cross-Temporal Contexts for Continuous Sign Language Recognition CVPR 2023 Distilling DETR with Visual-Linguistic Knowledge for Open-Vocabulary Object Detection ICCV 2023 Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023 Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection CVPR 2023 Distilling from Similar Tasks for Transfer Learning on a Budget ICCV 2023 Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks ACML 2023 Distilling knowledge from Gaussian process teacher to neural network student Interspeech 2023 Distilling Large Vision-Language Model with Out-of-Distribution Generalizability ICCV 2023 Distilling Neural Fields for Real-Time Articulated Shape Reconstruction CVPR 2023 Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models NeurIPS 2023 Distilling Reasoning Capabilities into Smaller Language Models ACL 2023 Distilling Script Knowledge from Large Language Models for Constrained Language Planning ACL 2023 Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023 Distilling Universal and Joint Knowledge for Cross-Domain Model Compression on Time Series Data IJCAI 2023