← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Spatial-Channel Token Distillation for Vision MLPs ICML 2022
Learning Unforgotten Domain-Invariant Representations for Online Unsupervised Domain Adaptation IJCAI 2022
Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs COLING 2022
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning IJCAI 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022
Self-supervised Models are Good Teaching Assistants for Vision Transformers ICML 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022
Multi-Modal Alignment Using Representation Codebook CVPR 2022
Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation CVPR 2022
Proto2Proto: Can You Recognize the Car, the Way I Do? CVPR 2022
Self-Supervised Models Are Continual Learners CVPR 2022
DINE: Domain Adaptation From Single and Multiple Black-Box Predictors CVPR 2022
SCMT: Self-Correction Mean Teacher for Semi-supervised Object Detection IJCAI 2022
Learning from Students: Online Contrastive Distillation Network for General Continual Learning IJCAI 2022
Dense Interspecies Face Embedding NIPS 2022
Respecting Transfer Gap in Knowledge Distillation NIPS 2022
Cycle class consistency with distributional optimal transport and knowledge distillation for unsupervised domain adaptation UAI 2022
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge ACL 2022
Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations ACL 2022
The RoyalFlush System for the WMT 2022 Efficiency Task EMNLP 2022
Edinburgh’s Submission to the WMT 2022 Efficiency Task EMNLP 2022
The NiuTrans Machine Translation Systems for WMT22 EMNLP 2022
Samsung R&D Institute Poland Participation in WMT 2022 EMNLP 2022
An Efficient Active Learning Pipeline for Legal Text Classification EMNLP 2022
How Can a Teacher Make Learning From Sparse Data Softer? Application to Business Relation Extraction EMNLP 2022