Knowledge Distillation

Distilling Vision-Language Pre-Training To Collaborate With Weakly-Supervised Temporal Action Localization CVPR 2023 Distill n’ Explain: explaining graph neural networks using simple surrogates AISTATS 2023 Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023 DistilPose: Tokenized Pose Regression With Heatmap Distillation CVPR 2023 DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model Interspeech 2023 Distribution Shift Matters for Knowledge Distillation with Webly Collected Images ICCV 2023 DisWOT: Student Architecture Search for Distillation WithOut Training CVPR 2023 DKT: Diverse Knowledge Transfer Transformer for Class Incremental Learning CVPR 2023 Does Graph Distillation See Like Vision Dataset Counterpart? NeurIPS 2023 Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023 Don’t Add, don’t Miss: Effective Content Preserving Generation from Pre-Selected Text Spans EMNLP 2023 DOT: A Distillation-Oriented Trainer ICCV 2023 Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL 2023 DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models Interspeech 2023 DreamTeacher: Pretraining Image Backbones with Deep Generative Models ICCV 2023 DROID: Learning from Offline Heterogeneous Demonstrations via Reward-Policy Distillation CoRL 2023 Dual Learning with Dynamic Knowledge Distillation for Partially Relevant Video Retrieval ICCV 2023 Dual Relation Knowledge Distillation for Object Detection IJCAI 2023 Dual Student Networks for Data-Free Model Stealing ICLR 2023 DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding Interspeech 2023 DyLiN: Making Light Field Networks Dynamic CVPR 2023 Effective Training of Attention-based Contextual Biasing Adapters with Synthetic Audio for Personalised ASR Interspeech 2023 Efficient Controllable Multi-Task Architectures ICCV 2023 Efficient Image Captioning for Edge Devices AAAI 2023 Efficiently Robustify Pre-Trained Models ICCV 2023