conftrace_
← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

1,329 papers

Papers per year

1
3
10
12
47
120
155
197
206
255
290
33

Papers

Hierarchical Self-supervised Augmented Knowledge Distillation IJCAI 2021
Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation IJCAI 2021
KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation IJCAI 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor IJCNLP 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation IJCNLP 2021
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains IJCNLP 2021
Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation INTERSPEECH 2021
Speech Emotion Recognition via Multi-Level Cross-Modal Distillation INTERSPEECH 2021
CoDERT: Distilling Encoder Representations with Co-Learning for Transducer-Based Speech Recognition INTERSPEECH 2021
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation INTERSPEECH 2021
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation WACV 2021
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NIPS 2020
Multi-label Contrastive Predictive Coding NIPS 2020
Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation NIPS 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space NIPS 2020
CompRess: Self-Supervised Learning by Compressing Representations NIPS 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NIPS 2020
Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation AAAI 2020
DeGAN: Data-Enriching GAN for Retrieving Representative Samples from a Trained Classifier AAAI 2020
Few Shot Network Compression via Cross Distillation AAAI 2020
Scalable Attentive Sentence Pair Modeling via Distilled Sentence Embedding AAAI 2020
Online Knowledge Distillation with Diverse Peers AAAI 2020
Distilling Portable Generative Adversarial Networks for Image Translation AAAI 2020
Adversarially Robust Distillation AAAI 2020