Knowledge Distillation

Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection ICCV 2023 Representation Disparity-aware Distillation for 3D Object Detection ICCV 2023 Residual Prompt Tuning: improving prompt tuning with residual reparameterization ACL 2023 Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning AAAI 2023 Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from Backbone NeurIPS 2023 Rethinking Feature-Based Knowledge Distillation for Face Recognition CVPR 2023 Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation ICCV 2023 Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023 Retrieve and Copy: Scaling ASR Personalization to Large Catalogs EMNLP 2023 Reusing Pretrained Models by Multi-linear Operators for Efficient Training NeurIPS 2023 Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NeurIPS 2023 Revisiting Data-Free Knowledge Distillation with Poisoned Teachers ICML 2023 Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023 Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NeurIPS 2023 Robust Active Distillation ICLR 2023 Robust distillation for worst-class performance: on the interplay between teacher and student objectives UAI 2023 Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023 SALAD: Source-Free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection WACV 2023 Scalable Theory-Driven Regularization of Scene Graph Generation Models AAAI 2023 ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023 SCPNet: Semantic Scene Completion on Point Cloud CVPR 2023 SEFD: Learning to Distill Complex Pose and Occlusion ICCV 2023 Segment Any Point Cloud Sequences by Distilling Vision Foundation Models NeurIPS 2023 Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023 Select, Prompt, Filter: Distilling Large Language Models for Summarizing Conversations EMNLP 2023