student teacher

Dual Information Purification for Lightweight SAR Object Detection AAAI 2025 EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025 Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023 Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023 Amalgamating Knowledge From Heterogeneous Graph Neural Networks CVPR 2021 General Instance Distillation for Object Detection CVPR 2021 Progressive Network Grafting for Few-Shot Knowledge Distillation AAAI 2021 SEED: Self-supervised Distillation For Visual Representation ICLR 2021 Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021 Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020 MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NeurIPS 2020 On the Efficacy of Knowledge Distillation ICCV 2019