← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

TinyHD: Efficient Video Saliency Prediction With Heterogeneous Decoders Using Hierarchical Maps Distillation WACV 2023
FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection WACV 2023
Online Knowledge Distillation for Multi-Task Learning WACV 2023
Revisiting Data-Free Knowledge Distillation with Poisoned Teachers ICML 2023
MetricGAN-OKD: Multi-Metric Optimization of MetricGAN via Online Knowledge Distillation for Speech Enhancement ICML 2023
EM-Network: Oracle Guided Self-distillation for Sequence Learning ICML 2023
SpotEM: Efficient Video Search for Episodic Memory ICML 2023
Teaching What You Should Teach: A Data-Based Distillation Method IJCAI 2023
Acoustic NLOS Imaging with Cross Modal Knowledge Distillation IJCAI 2023
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023
Towards Lossless Head Pruning through Automatic Peer Distillation for Language Models IJCAI 2023
Periodically Exchange Teacher-Student for Source-Free Object Detection ICCV 2023
Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxes ICCV 2023
Alleviating Catastrophic Forgetting of Incremental Object Detection via Within-Class and Between-Class Knowledge Distillation ICCV 2023
Exploring Open-Vocabulary Semantic Segmentation from CLIP Vision Encoder Distillation Only ICCV 2023
Taxonomy Adaptive Cross-Domain Adaptation in Medical Imaging via Optimization Trajectory Distillation ICCV 2023
Representation Disparity-aware Distillation for 3D Object Detection ICCV 2023
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models ICCV 2023
Distilling from Similar Tasks for Transfer Learning on a Budget ICCV 2023
Class-relation Knowledge Distillation for Novel Class Discovery ICCV 2023
Multi-Task Learning with Knowledge Distillation for Dense Prediction ICCV 2023
ICD-Face: Intra-class Compactness Distillation for Face Recognition ICCV 2023
DIME-FM : DIstilling Multimodal and Efficient Foundation Models ICCV 2023
MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation ICCV 2023
Masked Autoencoders Are Stronger Knowledge Distillers ICCV 2023