← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

MTGLS: Multi-Task Gaze Estimation With Limited Supervision WACV 2022
Improving Object Detection by Label Assignment Distillation WACV 2022
Distilling a Pretrained Language Model to a Multilingual ASR Model INTERSPEECH 2022
Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition INTERSPEECH 2022
C3PO: A Lightweight Copying Mechanism for Translating Pseudocode to Code IJCNLP 2022
Assist Non-native Viewers: Multimodal Cross-Lingual Summarization for How2 Videos EMNLP 2022
Cross-Task Knowledge Distillation in Multi-Task Recommendation AAAI 2022
TrustAL: Trustworthy Active Learning Using Knowledge Distillation AAAI 2022
Improving Neural Cross-Lingual Abstractive Summarization via Employing Optimal Transport Distance for Knowledge Distillation AAAI 2022
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data WACV 2022
PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression WACV 2022
Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation COLING 2022
Supervised Compression for Resource-Constrained Edge Computing Systems WACV 2022
Reweighting Strategy Based on Synthetic Data Identification for Sentence Similarity COLING 2022
Safe Distillation Box AAAI 2022
Self-Guidance: Improve Deep Neural Network Generalization via Knowledge Distillation WACV 2022
Boosting Contrastive Learning with Relation Knowledge Distillation AAAI 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision ICML 2022
MGAD: Learning Descriptional Representation Distilled from Distributional Semantics for Unseen Entities IJCAI 2022
Low-Cost Multispectral Scene Analysis With Modality Distillation WACV 2022
Boosting Multi-Label Image Classification with Complementary Parallel Self-Distillation IJCAI 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
CMU’s IWSLT 2022 Dialect Speech Translation System ACL 2022
Using time-series privileged information for provably efficient learning of prediction models AISTATS 2022