conftrace_

student network

45 papers

Explore in graph

Co-occurring keywords

knowledge distillation (3725) model compression (3302) teacher network (22) neural network (6616) knowledge transfer (648) feature distillation (106) data-free learning (54) transfer learning (5449) teacher model (53) network compression (53)

Papers

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration AAAI 2025
Adaptive Dual Guidance Knowledge Distillation AAAI 2025
Talking Head Anime 4: Distillation for Real-Time Performance WACV 2025
Reinforced Cross-Domain Knowledge Distillation on Time Series Data NIPS 2024
PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor CVPR 2024
Self-Regulated Data-Free Knowledge Amalgamation for Text Classification NAACL 2024
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study WACV 2023
Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay AAAI 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022
Model Compression Using Optimal Transport WACV 2022
Knowledge Distillation: Bad Models Can Be Good Role Models NIPS 2022
BERT Learns to Teach: Knowledge Distillation with Meta Learning ACL 2022
Collaborative Group Learning AAAI 2021
Lipschitz Continuity Guided Knowledge Distillation ICCV 2021
Self-boosting for Feature Distillation IJCAI 2021
Learning Student Networks in the Wild CVPR 2021
Distilling Knowledge via Knowledge Review CVPR 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021
Does Knowledge Distillation Really Work? NIPS 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network IJCNLP 2021
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model ICML 2021
Distilling Holistic Knowledge With Graph Neural Networks ICCV 2021
Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation ICCV 2021