knowledge distillation

Relational Knowledge Distillation CVPR 2019 Scalable Syntax-Aware Language Models Using Knowledge Distillation ACL 2019 Scaling Object Detection by Transferring Classification Weights ICCV 2019 SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models NeurIPS 2019 Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition Interspeech 2019 Similarity-Preserving Knowledge Distillation ICCV 2019 Small and Practical BERT Models for Sequence Labeling EMNLP 2019 Snapshot Distillation: Teacher-Student Optimization in One Generation CVPR 2019 Structured Knowledge Distillation for Semantic Segmentation CVPR 2019 Structured Pruning of Neural Networks With Budget-Aware Regularization CVPR 2019 Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More CVPR 2019 Teacher Guided Architecture Search ICCV 2019 The NiuTrans Machine Translation Systems for WMT19 ACL 2019 The Pupil Has Become the Master: Teacher-Student Model-Based Word Embedding Distillation with Ensemble Learning IJCAI 2019 Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion Interspeech 2019 Towards Architecture-Agnostic Neural Transfer: a Knowledge-Enhanced Approach IJCAI 2019 Towards Understanding Knowledge Distillation ICML 2019 Training Deep Neural Networks in Generations: A More Tolerant Teacher Educates Better Students AAAI 2019 Unified Semantic Parsing with Weak Supervision ACL 2019 Unifying Heterogeneous Classifiers With Distillation CVPR 2019 Unsupervised Image Captioning CVPR 2019 Variational Information Distillation for Knowledge Transfer CVPR 2019 Weakly Supervised Cross-lingual Semantic Relation Classification via Knowledge Distillation EMNLP 2019 Weakly Supervised Open-Set Domain Adaptation by Dual-Domain Collaboration CVPR 2019 When does label smoothing help? NeurIPS 2019