← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Adversarially Robust Distillation AAAI 2020
Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020
Few Shot Network Compression via Cross Distillation AAAI 2020
DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020
Leveraging Filter Correlations for Deep Model Compression WACV 2020
D3D: Distilled 3D Networks for Video Action Recognition WACV 2020
Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning WACV 2020
Deep Streaming Label Learning ICML 2020
Self-supervised Label Augmentation via Input Transformations ICML 2020
EigenEmo: Spectral Utterance Representation Using Dynamic Mode Decomposition for Speech Emotion Classification INTERSPEECH 2020
MultiSpeech: Multi-Speaker Text to Speech with Transformer INTERSPEECH 2020
Conditional Response Augmentation for Dialogue Using Knowledge Distillation INTERSPEECH 2020
Ensemble of Students Taught by Probabilistic Teachers to Improve Speech Emotion Recognition INTERSPEECH 2020
Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription INTERSPEECH 2020
Improving Low Resource Code-Switched ASR Using Augmented Code-Switched TTS INTERSPEECH 2020
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR INTERSPEECH 2020
Knowledge Distillation from Offline to Streaming RNN Transducer for End-to-End Speech Recognition INTERSPEECH 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation INTERSPEECH 2020
Sub-Band Knowledge Distillation Framework for Speech Enhancement INTERSPEECH 2020
Large Scale Weakly and Semi-Supervised Learning for Low-Resource Video ASR INTERSPEECH 2020
Leveraging Unlabeled Speech for Sequence Discriminative Training of Acoustic Models INTERSPEECH 2020
Compact Speaker Embedding: lrx-Vector INTERSPEECH 2020
Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion ICML 2020
Self-PU: Self Boosted and Calibrated Positive-Unlabeled Training ICML 2020
Dual-Path Distillation: A Unified Framework to Improve Black-Box Attacks ICML 2020