← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Distilling Knowledge for Search-based Structured Prediction ACL 2018
Marian: Cost-effective High-Quality Neural Machine Translation in C++ ACL 2018
Moonshine: Distilling with Cheap Convolutions NIPS 2018
Collaborative Learning for Deep Neural Networks NIPS 2018
RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information EMNLP 2018
MacNet: Transferring Knowledge from Machine Comprehension to Sequence-to-Sequence Models NIPS 2018
KDGAN: Knowledge Distillation with Generative Adversarial Networks NIPS 2018
Good View Hunting: Learning Photo Composition From Dense View Pairs CVPR 2018
Analyzing Knowledge Distillation in Neural Machine Translation EMNLP 2018
Knowledge Aided Consistency for Weakly Supervised Phrase Grounding CVPR 2018
Coupled End-to-End Transfer Learning With Generalized Fisher Information CVPR 2018
A Teacher-Student Framework for Maintainable Dialog Manager EMNLP 2018
Learning to Specialize with Knowledge Distillation for Visual Question Answering NIPS 2018
ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenes CVPR 2018
NestedNet: Learning Nested Sparse Structures in Deep Neural Networks CVPR 2018
Towards Effective Low-Bitwidth Convolutional Neural Networks CVPR 2018
Improving Simple Models with Confidence Profiles NIPS 2018
Learning to Teach with Dynamic Loss Functions NIPS 2018
Knowledge Distillation by On-the-Fly Native Ensemble NIPS 2018
Generalizing GANs: A Turing Perspective NIPS 2017
Learning Efficient Object Detection Models with Knowledge Distillation NIPS 2017
Unfolding and Shrinking Neural Machine Translation Ensembles EMNLP 2017
Expert Gate: Lifelong Learning With a Network of Experts CVPR 2017
A Gift From Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning CVPR 2017
Mimicking Very Efficient Network for Object Detection CVPR 2017