← Techniques
Deep Learning › Techniques ›

Knowledge Distillation

623 directly classified papers

Papers per year

Papers

Towards Practical Plug-and-Play Diffusion Models CVPR 2023
RefCLIP: A Universal Teacher for Weakly Supervised Referring Expression Comprehension CVPR 2023
Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation CVPR 2023
Class Attention Transfer Based Knowledge Distillation CVPR 2023
Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions CVPR 2023
Distilling a Pretrained Language Model to a Multilingual ASR Model INTERSPEECH 2022
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation NAACL 2022
Plug and Play Knowledge Distillation for kNN-LM with External Logits AACL 2022
Extractive Knowledge Distillation WACV 2022
Semi-Supervised Domain Adaptation via Sample-to-Sample Self-Distillation WACV 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
TAKE: Topic-shift Aware Knowledge sElection for Dialogue Generation COLING 2022
Attribute Injection for Pretrained Language Models: A New Benchmark and an Efficient Method COLING 2022
CILDA: Contrastive Data Augmentation Using Intermediate Layer Knowledge Distillation COLING 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022
Adaptable Adapters NAACL 2022
Nearest Neighbor Knowledge Distillation for Neural Machine Translation NAACL 2022
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training NAACL 2022
Spatial-Channel Token Distillation for Vision MLPs ICML 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022
Self-supervised Models are Good Teaching Assistants for Vision Transformers ICML 2022
MemSR: Training Memory-efficient Lightweight Model for Image Super-Resolution ICML 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022
Pseudo-spherical Knowledge Distillation IJCAI 2022