← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Guiding CTC Posterior Spike Timings for Improved Posterior Fusion and Knowledge Distillation INTERSPEECH 2019
Distilling Discrimination and Generalization Knowledge for Event Detection via Delta-Representation Learning ACL 2019
Towards Understanding Knowledge Distillation ICML 2019
Network Recasting: A Universal Method for Network Architecture Transformation AAAI 2019
NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networks AAAI 2019
Data-Distortion Guided Self-Distillation for Deep Neural Networks AAAI 2019
MEAL: Multi-Model Ensemble via Adversarial Learning AAAI 2019
Exploiting the Ground-Truth: An Adversarial Imitation Based Knowledge Distillation Approach for Event Detection AAAI 2019
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons AAAI 2019
Private Model Compression via Knowledge Distillation AAAI 2019
White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks NAACL 2019
Training Deep Neural Networks in Generations: A More Tolerant Teacher Educates Better Students AAAI 2019
Amalgamating Knowledge towards Comprehensive Classification AAAI 2019
LIT: Learned Intermediate Representation Training for Model Compression ICML 2019
Overcoming Multi-model Forgetting ICML 2019
AWSD: Adaptive Weighted Spatiotemporal Distillation for Video Representation ICCV 2019
Weakly Supervised Cross-lingual Semantic Relation Classification via Knowledge Distillation IJCNLP 2019
A Comprehensive Overhaul of Feature Distillation ICCV 2019
Correlation Congruence for Knowledge Distillation ICCV 2019
Scaling Object Detection by Transferring Classification Weights ICCV 2019
WSOD2: Learning Bottom-Up and Top-Down Objectness Distillation for Weakly-Supervised Object Detection ICCV 2019
Pedestrian Attribute Recognition by Joint Visual-semantic Reasoning and Knowledge Distillation IJCAI 2019
Patient Knowledge Distillation for BERT Model Compression IJCNLP 2019
Iterative Dual Domain Adaptation for Neural Machine Translation IJCNLP 2019
Online Distilling from Checkpoints for Neural Machine Translation NAACL 2019