← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Fine-grained Knowledge Fusion for Sequence Labeling Domain Adaptation IJCNLP 2019
Distilling Knowledge From a Deep Pose Regressor Network ICCV 2019
Overcoming Catastrophic Forgetting With Unlabeled Data in the Wild ICCV 2019
Learning Lightweight Lane Detection CNNs by Self Attention Distillation ICCV 2019
Improved Techniques for Training Adaptive Deep Networks ICCV 2019
Lifelong GAN: Continual Learning for Conditional Image Generation ICCV 2019
Data-Free Learning of Student Networks ICCV 2019
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation ICCV 2019
Diversity With Cooperation: Ensemble Methods for Few-Shot Classification ICCV 2019
DSConv: Efficient Convolution Operator ICCV 2019
Teacher Guided Architecture Search ICCV 2019
Learning a Mixture of Granularity-Specific Experts for Fine-Grained Categorization ICCV 2019
A Bayesian Optimization Framework for Neural Network Compression ICCV 2019
Face Photo-Sketch Synthesis via Knowledge Transfer IJCAI 2019
Gazetteer-Enhanced Attentive Neural Networks for Named Entity Recognition IJCNLP 2019
Learning by Cheating CORL 2019
Binarized Collaborative Filtering with Distilling Graph Convolutional Network IJCAI 2019
Probability Distillation: A Caveat and Alternatives UAI 2019
Global Autoregressive Models for Data-Efficient Sequence Learning CONLL 2019
The Pupil Has Become the Master: Teacher-Student Model-Based Word Embedding Distillation with Ensemble Learning IJCAI 2019
Variational Information Distillation for Knowledge Transfer CVPR 2019
Knowledge Distillation via Instance Relationship Graph CVPR 2019
Unifying Heterogeneous Classifiers With Distillation CVPR 2019
Large Scale Incremental Learning CVPR 2019
Efficient Video Classification Using Fewer Frames CVPR 2019