← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Distilling Representations from GAN Generator via Squeeze and Span NIPS 2022
Knowledge Distillation from A Stronger Teacher NIPS 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022
Low-resource Low-footprint Wake-word Detection using Knowledge Distillation INTERSPEECH 2022
Improving ASR Robustness in Noisy Condition Through VAD Integration INTERSPEECH 2022
Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer INTERSPEECH 2022
A Closer Look at Parameter Contributions When Training Neural Language and Translation Models COLING 2022
Compressing Models With Few Samples: Mimicking Then Replacing CVPR 2022
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation EMNLP 2022
Augmented Geometric Distillation for Data-Free Incremental Person ReID CVPR 2022
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection CVPR 2022
Anomaly Detection via Reverse Distillation From One-Class Embedding CVPR 2022
Not All Relations Are Equal: Mining Informative Labels for Scene Graph Generation CVPR 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022
PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022
Lifelong Unsupervised Domain Adaptive Person Re-Identification With Coordinated Anti-Forgetting and Adaptation CVPR 2022
Backdoor Attacks on Self-Supervised Learning CVPR 2022
Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection NIPS 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching NIPS 2022
BJTU-WeChat’s Systems for the WMT22 Chat Translation Task EMNLP 2022
Class Incremental Learning for Intent Classification with Limited or No Old Data EMNLP 2022