Knowledge Distillation

Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020 Few Shot Network Compression via Cross Distillation AAAI 2020 Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization AAAI 2020 Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models SemEval 2020 Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks UAI 2020 General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference EMNLP 2020 Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks AAAI 2020 Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020 Graph Convolutional Network for Recommendation with Low-pass Collaborative Filters ICML 2020 Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge NeurIPS 2020 Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers AAAI 2020 Heterogeneous Knowledge Distillation Using Information Flow Modeling CVPR 2020 Hierarchical Knowledge Squeezed Adversarial Network Compression AAAI 2020 High Performance Natural Language Processing EMNLP 2020 HW-TSC’s Participation in the WMT 2020 News Translation Shared Task EMNLP 2020 Hybrid Models for Learning to Branch NeurIPS 2020 Implicit Transfer of Privileged Acoustic Information in a Generalized Knowledge Distillation Framework Interspeech 2020 Improved Knowledge Distillation via Teacher Assistant AAAI 2020 Improving Event Detection via Open-domain Trigger Knowledge ACL 2020 Improving Low Resource Code-Switched ASR Using Augmented Code-Switched TTS Interspeech 2020 Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention NeurIPS 2020 Improving Neural Topic Models using Knowledge Distillation EMNLP 2020 Improving Non-autoregressive Neural Machine Translation with Monolingual Data ACL 2020 Improving On-Device Speaker Verification Using Federated Learning with Privacy Interspeech 2020 Improving Word Embedding Factorization for Compression Using Distilled Nonlinear Neural Decomposition EMNLP 2020