← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

A Lightweight Framework for Online Voice Activity Detection in the Wild INTERSPEECH 2021
Adjunct-Emeritus Distillation for Semi-Supervised Language Model Adaptation INTERSPEECH 2021
CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition INTERSPEECH 2021
Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification INTERSPEECH 2021
Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification INTERSPEECH 2021
Investigation of IMU&Elevoc Submission for the Short-Duration Speaker Verification Challenge 2021 INTERSPEECH 2021
Continual Learning for Fake Audio Detection INTERSPEECH 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence ICML 2021
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation INTERSPEECH 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation IJCNLP 2021
Bridging the Gap Between Streaming and Non-Streaming ASR Systems by Distilling Ensembles of CTC and RNN-T Models INTERSPEECH 2021
Collaborative Training of Acoustic Encoders for Speech Recognition INTERSPEECH 2021
Energy-Friendly Keyword Spotting System Using Add-Based Convolution INTERSPEECH 2021
Lipschitz Continuity Guided Knowledge Distillation ICCV 2021
Distilling Virtual Examples for Long-Tailed Recognition ICCV 2021
Self-Mutual Distillation Learning for Continuous Sign Language Recognition ICCV 2021
Multi-Task Self-Training for Learning General Representations ICCV 2021
Knowledge-Enriched Distributional Model Inversion Attacks ICCV 2021
Improving De-Raining Generalization via Neural Reorganization ICCV 2021
Temporal Knowledge Consistency for Unsupervised Visual Representation Learning ICCV 2021
Efficient Action Recognition via Dynamic Knowledge Propagation ICCV 2021
Compressing Visual-Linguistic Model via Knowledge Distillation ICCV 2021
SS-IL: Separated Softmax for Incremental Learning ICCV 2021
Self-Knowledge Distillation With Progressive Refinement of Targets ICCV 2021
Explainable Person Re-Identification With Attribute-Guided Metric Distillation ICCV 2021