conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Investigation of IMU&Elevoc Submission for the Short-Duration Speaker Verification Challenge 2021 INTERSPEECH 2021
Continual Learning for Fake Audio Detection INTERSPEECH 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence ICML 2021
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation INTERSPEECH 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation IJCNLP 2021
Bridging the Gap Between Streaming and Non-Streaming ASR Systems by Distilling Ensembles of CTC and RNN-T Models INTERSPEECH 2021
Collaborative Training of Acoustic Encoders for Speech Recognition INTERSPEECH 2021
Energy-Friendly Keyword Spotting System Using Add-Based Convolution INTERSPEECH 2021
Lipschitz Continuity Guided Knowledge Distillation ICCV 2021
Distilling Virtual Examples for Long-Tailed Recognition ICCV 2021
Self-Mutual Distillation Learning for Continuous Sign Language Recognition ICCV 2021
Multi-Task Self-Training for Learning General Representations ICCV 2021
Knowledge-Enriched Distributional Model Inversion Attacks ICCV 2021
Improving De-Raining Generalization via Neural Reorganization ICCV 2021
Temporal Knowledge Consistency for Unsupervised Visual Representation Learning ICCV 2021
Efficient Action Recognition via Dynamic Knowledge Propagation ICCV 2021
Compressing Visual-Linguistic Model via Knowledge Distillation ICCV 2021
SS-IL: Separated Softmax for Incremental Learning ICCV 2021
Self-Knowledge Distillation With Progressive Refinement of Targets ICCV 2021
Explainable Person Re-Identification With Attribute-Guided Metric Distillation ICCV 2021
TeachText: CrossModal Generalized Distillation for Text-Video Retrieval ICCV 2021
MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing ICCV 2021
Online Knowledge Distillation for Efficient Pose Estimation ICCV 2021
Distilling Global and Local Logits With Densely Connected Relations ICCV 2021
Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition ICCV 2021