← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023
AIO-P: Expanding Neural Performance Predictors beyond Image Classification AAAI 2023
Auxiliary Modality Learning with Generalized Curriculum Distillation ICML 2023
Label-Guided Knowledge Distillation for Continual Semantic Segmentation on 2D Images and 3D Point Clouds ICCV 2023
Masked Autoencoders Are Stronger Knowledge Distillers ICCV 2023
Learn More for Food Recognition via Progressive Self-Distillation AAAI 2023
Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023
Prompting Neural Machine Translation with Translation Memories AAAI 2023
Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces AAAI 2023
BiT: Robustly Binarized Multi-distilled Transformer NIPS 2022
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer NIPS 2022
Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NIPS 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Continual Federated Learning Based on Knowledge Distillation IJCAI 2022
CS-CTCSCONV1D: Small footprint speaker verification with channel split time-channel-time separable 1-dimensional convolution INTERSPEECH 2022
Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting INTERSPEECH 2022
Shadow Knowledge Distillation: Bridging Offline and Online Knowledge Transfer NIPS 2022
KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022
CILDA: Contrastive Data Augmentation Using Intermediate Layer Knowledge Distillation COLING 2022
Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment Analysis EMNLP 2022
Structural Pruning via Latency-Saliency Knapsack NIPS 2022
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt IJCAI 2022
Learning Multiple Adverse Weather Removal via Two-Stage Knowledge Learning and Multi-Contrastive Regularization: Toward a Unified Model CVPR 2022
Knowledge Distillation With the Reused Teacher Classifier CVPR 2022