knowledge distillation

Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation AACL 2020 Towards Oracle Knowledge Distillation with Neural Architecture Search AAAI 2020 Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers ICML 2020 Training binary neural networks with real-to-binary convolutions ICLR 2020 Training Keyword Spotting Models on Non-IID Data with Federated Learning Interspeech 2020 Ultrafast Video Attention Prediction with Coupled Knowledge Distillation AAAI 2020 Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification AAAI 2020 Understanding Knowledge Distillation in Non-autoregressive Machine Translation ICLR 2020 UniTrans : Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Data IJCAI 2020 Using the Past Knowledge to Improve Sentiment Classification EMNLP 2020 Variational Learning of Bayesian Neural Networks via Bayesian Dark Knowledge IJCAI 2020 Vec2Face: Unveil Human Faces From Their Blackbox Features in Face Recognition CVPR 2020 WeChat Neural Machine Translation Systems for WMT20 EMNLP 2020 What It Thinks Is Important Is Important: Robustness Transfers Through Input Gradients CVPR 2020 Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers EMNLP 2020 Xiaomi’s Submissions for IWSLT 2020 Open Domain Translation Task ACL 2020 XtremeDistil: Multi-stage Distillation for Massive Multilingual Models ACL 2020 ZeroQ: A Novel Zero Shot Quantization Framework CVPR 2020 A Bayesian Optimization Framework for Neural Network Compression ICCV 2019 A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation ICLR 2019 A Comprehensive Overhaul of Feature Distillation ICCV 2019 Acoustic Scene Classification Using Teacher-Student Learning with Soft-Labels Interspeech 2019 Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers IJCAI 2019 Amalgamating Knowledge towards Comprehensive Classification AAAI 2019 A Mobile Application for Sound Event Detection IJCAI 2019