← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Network Pruning via Transformable Architecture Search NIPS 2019
Compression of Acoustic Event Detection Models with Quantized Distillation INTERSPEECH 2019
Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs IJCAI 2019
RDPD: Rich Data Helps Poor Data via Imitation IJCAI 2019
Knowledge Amalgamation from Heterogeneous Networks by Common Feature Learning IJCAI 2019
Zero-Shot Knowledge Distillation in Deep Networks ICML 2019
Learn Spelling from Teachers: Transferring Knowledge from Language Models to Sequence-to-Sequence Speech Recognition INTERSPEECH 2019
Distilling Policy Distillation AISTATS 2019
Towards Architecture-Agnostic Neural Transfer: a Knowledge-Enhanced Approach IJCAI 2019
Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition INTERSPEECH 2019
Compression of CTC-Trained Acoustic Models by Dynamic Frame-Wise Distillation or Segment-Wise N-Best Hypotheses Imitation INTERSPEECH 2019
Small and Practical BERT Models for Sequence Labeling IJCNLP 2019
Neural Network Distillation on IoT Platforms for Sound Event Detection INTERSPEECH 2019
M2H-GAN: A GAN-Based Mapping from Machine to Human Transcripts for Speech Understanding INTERSPEECH 2019
Compact Trilinear Interaction for Visual Question Answering ICCV 2019
Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers IJCAI 2019
Characterizing and Avoiding Negative Transfer CVPR 2019
Distill Knowledge From NRSfM for Weakly Supervised 3D Pose Learning ICCV 2019
DistInit: Learning Video Representations Without a Single Labeled Video ICCV 2019
Distillation-Based Training for Multi-Exit Architectures ICCV 2019
On the Efficacy of Knowledge Distillation ICCV 2019
Dynamic Kernel Distillation for Efficient Pose Estimation in Videos ICCV 2019
MMAct: A Large-Scale Dataset for Cross Modal Human Action Understanding ICCV 2019
A Mobile Application for Sound Event Detection IJCAI 2019
Cousin Network Guided Sketch Recognition via Latent Attribute Warehouse AAAI 2019