conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Self-supervised Models are Good Teaching Assistants for Vision Transformers ICML 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022
Multi-Modal Alignment Using Representation Codebook CVPR 2022
Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation CVPR 2022
Proto2Proto: Can You Recognize the Car, the Way I Do? CVPR 2022
Self-Supervised Models Are Continual Learners CVPR 2022
DINE: Domain Adaptation From Single and Multiple Black-Box Predictors CVPR 2022
SCMT: Self-Correction Mean Teacher for Semi-supervised Object Detection IJCAI 2022
Learning from Students: Online Contrastive Distillation Network for General Continual Learning IJCAI 2022
Dense Interspecies Face Embedding NIPS 2022
Respecting Transfer Gap in Knowledge Distillation NIPS 2022
Lost in Distillation: A Case Study in Toxicity Modeling NAACL 2022
X-Trans2Cap: Cross-Modal Knowledge Transfer Using Transformer for 3D Dense Captioning CVPR 2022
ASCM: An Answer Space Clustered Prompting Method without Answer Engineering ACL 2022
Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic Samples ACL 2022
Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022
An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition ACL 2022
Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation AAAI 2022
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation AAAI 2022
RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling AAAI 2022
Up to 100x Faster Data-Free Knowledge Distillation AAAI 2022
Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook EMNLP 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation EMNLP 2022
DKPLM: Decomposable Knowledge-Enhanced Pre-trained Language Model for Natural Language Understanding AAAI 2022