conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Striking a Balance Between Stability and Plasticity for Class-Incremental Learning ICCV 2021
AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition ICCV 2021
PR-Net: Preference Reasoning for Personalized Video Highlight Detection ICCV 2021
Ensemble Attention Distillation for Privacy-Preserving Federated Learning ICCV 2021
Tokens-to-Token ViT: Training Vision Transformers From Scratch on ImageNet ICCV 2021
Knowledge Distillation from Multi-Modality to Single-Modality for Person Verification INTERSPEECH 2021
Contextualized Attention-Based Knowledge Transfer for Spoken Conversational Question Answering INTERSPEECH 2021
Knowledge Distillation for Streaming Transformer–Transducer INTERSPEECH 2021
Knowledge Distillation for Singing Voice Detection INTERSPEECH 2021
Lifelong Zero-Shot Learning IJCAI 2020
TopicKA: Generating Commonsense Knowledge-Aware Dialogue Responses Towards the Recommended Topic Fact IJCAI 2020
An Iterative Multi-Source Mutual Knowledge Transfer Framework for Machine Reading Comprehension IJCAI 2020
Inter-Region Affinity Distillation for Road Marking Segmentation CVPR 2020
Teacher-Student Networks with Multiple Decoders for Solving Math Word Problem IJCAI 2020
End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020 ACL 2020
Temporally Distributed Networks for Fast Video Semantic Segmentation CVPR 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing ACL 2020
Stochastic Batch Augmentation with An Effective Distilled Dynamic Soft Label Regularizer IJCAI 2020
Beyond Network Pruning: a Joint Search-and-Training Approach IJCAI 2020
Distilling Knowledge Learned in BERT for Text Generation ACL 2020
Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN CVPR 2020
ZeroQ: A Novel Zero Shot Quantization Framework CVPR 2020
Maintaining Discrimination and Fairness in Class Incremental Learning CVPR 2020
Structured Multi-Hashing for Model Compression CVPR 2020