← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability CVPR 2022
MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022
Structured Sparse R-CNN for Direct Scene Graph Generation CVPR 2022
Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning CVPR 2022
Pre-Train, Self-Train, Distill: A Simple Recipe for Supersizing 3D Reconstruction CVPR 2022
Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation CVPR 2022
Decoupled Knowledge Distillation CVPR 2022
A Fast Post-Training Pruning Framework for Transformers NIPS 2022
Contextual Similarity Distillation for Asymmetric Image Retrieval CVPR 2022
Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning CVPR 2022
Cloth-Changing Person Re-Identification From a Single Image With Gait Prediction and Regularization CVPR 2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation EMNLP 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022
aiML at the FinNLP-2022 ERAI Task: Combining Classification and Regression Tasks for Financial Opinion Mining EMNLP 2022
Towards Data-Free Model Stealing in a Hard Label Setting CVPR 2022
Rethinking Resolution in the Context of Efficient Video Recognition NIPS 2022
Multi-Knowledge Aggregation and Transfer for Semantic Segmentation AAAI 2022
Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation CVPR 2022
IntraQ: Learning Synthetic Images With Intra-Class Heterogeneity for Zero-Shot Network Quantization CVPR 2022
It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022
Exploring the Benefits and Limitations of Multilinguality for Non-autoregressive Machine Translation EMNLP 2022
Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation EMNLP 2022
Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022