← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings EMNLP 2020
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference EMNLP 2020
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling EMNLP 2020
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers AAAI 2020
Assessment of DistilBERT performance on Named Entity Recognition task for the detection of Protected Health Information and medical concepts EMNLP 2020
Implicit Transfer of Privileged Acoustic Information in a Generalized Knowledge Distillation Framework INTERSPEECH 2020
Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020
Towards Making the Most of BERT in Neural Machine Translation AAAI 2020
Scalable Attentive Sentence Pair Modeling via Distilled Sentence Embedding AAAI 2020
Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation AAAI 2020
Towards Oracle Knowledge Distillation with Neural Architecture Search AAAI 2020
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition AAAI 2020
Weakly-Supervised Video Re-Localization with Multiscale Attention Model AAAI 2020
Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification AAAI 2020
Sub-Band Knowledge Distillation Framework for Speech Enhancement INTERSPEECH 2020
A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection CVPR 2020
Search to Distill: Pearls Are Everywhere but Not the Eyes CVPR 2020
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks ICML 2020
Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language ACL 2020
SimulSpeech: End-to-End Simultaneous Speech to Text Translation ACL 2020
Graph Convolutional Network for Recommendation with Low-pass Collaborative Filters ICML 2020
AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks ICML 2020
Learning Task-Agnostic Embedding of Multiple Black-Box Experts for Multi-Task Model Fusion ICML 2020
Object Relational Graph With Teacher-Recommended Learning for Video Captioning CVPR 2020
Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization AAAI 2020