← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Densely Guided Knowledge Distillation Using Multiple Teacher Assistants ICCV 2021
Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Better ICCV 2021
AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-Directional Metric Learning ICCV 2021
Distilling Holistic Knowledge With Graph Neural Networks ICCV 2021
Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation ICCV 2021
Striking a Balance Between Stability and Plasticity for Class-Incremental Learning ICCV 2021
AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition ICCV 2021
PR-Net: Preference Reasoning for Personalized Video Highlight Detection ICCV 2021
Ensemble Attention Distillation for Privacy-Preserving Federated Learning ICCV 2021
Tokens-to-Token ViT: Training Vision Transformers From Scratch on ImageNet ICCV 2021
Knowledge Distillation from Multi-Modality to Single-Modality for Person Verification INTERSPEECH 2021
Contextualized Attention-Based Knowledge Transfer for Spoken Conversational Question Answering INTERSPEECH 2021
Knowledge Distillation for Streaming Transformer–Transducer INTERSPEECH 2021
Knowledge Distillation for Singing Voice Detection INTERSPEECH 2021
Lifelong Zero-Shot Learning IJCAI 2020
TopicKA: Generating Commonsense Knowledge-Aware Dialogue Responses Towards the Recommended Topic Fact IJCAI 2020
An Iterative Multi-Source Mutual Knowledge Transfer Framework for Machine Reading Comprehension IJCAI 2020
Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020
Teacher-Student Networks with Multiple Decoders for Solving Math Word Problem IJCAI 2020
End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020 ACL 2020
Temporally Distributed Networks for Fast Video Semantic Segmentation CVPR 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing ACL 2020
Stochastic Batch Augmentation with An Effective Distilled Dynamic Soft Label Regularizer IJCAI 2020
Beyond Network Pruning: a Joint Search-and-Training Approach IJCAI 2020