← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

More Grounded Image Captioning by Distilling Image-Text Matching Model CVPR 2020
Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation From a Blackbox Model CVPR 2020
Heterogeneous Knowledge Distillation Using Information Flow Modeling CVPR 2020
Feature-map-level Online Adversarial Knowledge Distillation ICML 2020
Hierarchical Knowledge Squeezed Adversarial Network Compression AAAI 2020
Acquiring Knowledge from Pre-Trained Model to Neural Machine Translation AAAI 2020
Incorporating Stylistic Lexical Preferences in Generative Language Models EMNLP 2020
Adversarial Self-Supervised Data-Free Distillation for Text Classification EMNLP 2020
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks AAAI 2020
Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020
High Performance Natural Language Processing EMNLP 2020
ADINet: Attribute Driven Incremental Network for Retinal Image Classification CVPR 2020
Towards Learning Structure via Consensus for Face Segmentation and Parsing CVPR 2020
GAN Compression: Efficient Architectures for Interactive Conditional GANs CVPR 2020
TernaryBERT: Distillation-aware Ultra-low Bit BERT EMNLP 2020
Geometry-Aware Distillation for Indoor Semantic Segmentation CVPR 2019
SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models NIPS 2019
Channel Gating Neural Networks NIPS 2019
Relational Knowledge Distillation CVPR 2019
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells CVPR 2019
Similarity-Preserving Knowledge Distillation ICCV 2019
Knowledge Distillation via Route Constrained Optimization ICCV 2019
Fine-grained Knowledge Fusion for Sequence Labeling Domain Adaptation EMNLP 2019
Weakly Supervised Cross-lingual Semantic Relation Classification via Knowledge Distillation EMNLP 2019
Generation-Distillation for Efficient Natural Language Understanding in Low-Data Settings EMNLP 2019