Knowledge Distillation

AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023 Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NeurIPS 2023 Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillation ICLR 2023 A Unified Continual Learning Framework with General Parameter-Efficient Tuning ICCV 2023 A Unified Knowledge Distillation Framework for Deep Directed Graphical Models CVPR 2023 Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? ICLR 2023 Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023 Auxiliary Modality Learning with Generalized Curriculum Distillation ICML 2023 Backdoor Cleansing With Unlabeled Data CVPR 2023 Backprop Induced Feature Weighting for Adversarial Domain Adaptation With Iterative Label Distribution Alignment WACV 2023 Bayesian Optimization Meets Self-Distillation ICCV 2023 Better Language Models of Code through Self-Improvement ACL 2023 Better Simultaneous Translation with Monotonic Knowledge Distillation ACL 2023 Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation ICLR 2023 BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection ICLR 2023 Beyond Testers’ Biases: Guiding Model Testing with Knowledge Bases using LLMs EMNLP 2023 Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation ICCV 2023 Bilateral Memory Consolidation for Continual Learning CVPR 2023 Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation CVPR 2023 Boosting Graph Neural Networks via Adaptive Knowledge Distillation AAAI 2023 Boosting Summarization with Normalizing Flows and Aggressive Training EMNLP 2023 Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval EMNLP 2023 Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection ICCV 2023 Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023 Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023