Knowledge Distillation

NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation EMNLP 2023 NTK-approximating MLP Fusion for Efficient Language Model Fine-tuning ICML 2023 Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection CVPR 2023 Omnidirectional Information Gathering for Knowledge Transfer-Based Audio-Visual Navigation ICCV 2023 On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation Interspeech 2023 On Distillation of Guided Diffusion Models CVPR 2023 One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NeurIPS 2023 One Is All: Bridging the Gap between Neural Radiance Fields Architectures with Progressive Volume Distillation AAAI 2023 One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garments RSS 2023 One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification Interspeech 2023 Online Knowledge Distillation for Multi-Task Learning WACV 2023 On student-teacher deviations in distillation: does it pay to disobey? NeurIPS 2023 On the Fairness Impacts of Private Ensembles Models IJCAI 2023 On the Impact of Knowledge Distillation for Model Interpretability ICML 2023 On the Size and Approximation Error of Distilled Datasets NeurIPS 2023 ORC: Network Group-based Knowledge Distillation using Online Role Change ICCV 2023 OvarNet: Towards Open-Vocabulary Object Attribute Recognition CVPR 2023 Parameter-Efficient Learning for Text-to-Speech Accent Adaptation Interspeech 2023 Parameter-Efficient Model Adaptation for Vision Transformers AAAI 2023 Partial Network Cloning CVPR 2023 PartManip: Learning Cross-Category Generalizable Part Manipulation Policy From Point Cloud Observations CVPR 2023 Periodically Exchange Teacher-Student for Source-Free Object Detection ICCV 2023 Personalized Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation EMNLP 2023 PIP: Parse-Instructed Prefix for Syntactically Controlled Paraphrase Generation ACL 2023 Pixel-Wise Contrastive Distillation ICCV 2023