Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

Random Teachers are Good Teachers ICML 2023 RD-Suite: A Benchmark for Ranking Distillation NeurIPS 2023 ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models ACL 2023 Recent Advances in Direct Speech-to-text Translation IJCAI 2023 Recyclable Tuning for Continual Pre-training ACL 2023 Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation Interspeech 2023 RefCLIP: A Universal Teacher for Weakly Supervised Referring Expression Comprehension CVPR 2023 Regularized Mask Tuning: Uncovering Hidden Knowledge in Pre-Trained Vision-Language Models ICCV 2023 Rehearsal-free Continual Language Learning via Efficient Parameter Isolation ACL 2023 Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement ICCV 2023 Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection ICCV 2023 Representation Disparity-aware Distillation for 3D Object Detection ICCV 2023 Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning AAAI 2023 Rethinking Data-Free Quantization as a Zero-Sum Game AAAI 2023 Rethinking Feature-Based Knowledge Distillation for Face Recognition CVPR 2023 Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation ICCV 2023 Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023 Reusing Pretrained Models by Multi-linear Operators for Efficient Training NeurIPS 2023 Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NeurIPS 2023 Revisiting Commonsense Reasoning in Machine Translation: Training, Evaluation and Challenge ACL 2023 Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023 Revisiting Prototypical Network for Cross Domain Few-Shot Learning CVPR 2023 Revisiting Reverse Distillation for Anomaly Detection CVPR 2023 Revisiting the Knowledge Injection Frameworks EMNLP 2023 Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NeurIPS 2023