← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Learning Metrics From Teachers: Compact Networks for Image Embedding CVPR 2019
From Research to Production and Back: Ludicrously Fast Neural Machine Translation EMNLP 2019
Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More CVPR 2019
Knowledge Adaptation for Efficient Semantic Segmentation CVPR 2019
Automatic Adaptation of Object Detectors to New Domains Using Self-Training CVPR 2019
Distilled Person Re-Identification: Towards a More Scalable System CVPR 2019
Structured Knowledge Distillation for Semantic Segmentation CVPR 2019
NetTailor: Tuning the Architecture, Not Just the Weights CVPR 2019
Distilling Object Detectors With Fine-Grained Feature Imitation CVPR 2019
PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation ACL 2019
Microsoft Research Asia’s Systems for WMT19 ACL 2019
Unified Semantic Parsing with Weak Supervision ACL 2019
Flambé: A Customizable Framework for Machine Learning Experiments ACL 2019
Random Path Selection for Continual Learning NIPS 2019
Iterative Dual Domain Adaptation for Neural Machine Translation EMNLP 2019
Small and Practical BERT Models for Sequence Labeling EMNLP 2019
Patient Knowledge Distillation for BERT Model Compression EMNLP 2019
Zero-shot Knowledge Transfer via Adversarial Belief Matching NIPS 2019
Knowledge Extraction with No Observable Data NIPS 2019
nocaps: novel object captioning at scale ICCV 2019
Progressive Teacher-Student Learning for Early Action Prediction CVPR 2019
Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion INTERSPEECH 2019
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation ICCV 2019
Explaining Neural Networks Semantically and Quantitatively ICCV 2019