knowledge distillation

Ensemble of Students Taught by Probabilistic Teachers to Improve Speech Emotion Recognition Interspeech 2020 ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks NeurIPS 2020 Explaining Knowledge Distillation by Quantifying the Knowledge CVPR 2020 Exploit and Replace: An Asymmetrical Two-Stream Architecture for Versatile Light Field Saliency Detection AAAI 2020 Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020 Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ACL 2020 Extreme Model Compression for On-device Natural Language Understanding COLING 2020 Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation NeurIPS 2020 FastBERT: a Self-distilling BERT with Adaptive Inference Time ACL 2020 Fast End-to-end Coreference Resolution for Korean EMNLP 2020 FasterSeg: Searching for Faster Real-time Semantic Segmentation ICLR 2020 FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020 Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training EMNLP 2020 Feature-map-level Online Adversarial Knowledge Distillation ICML 2020 FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction EMNLP 2020 Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020 Few Shot Network Compression via Cross Distillation AAAI 2020 Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization AAAI 2020 Finding trainable sparse networks through Neural Tangent Transfer ICML 2020 Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models SemEval 2020 GAN Compression: Efficient Architectures for Interactive Conditional GANs CVPR 2020 Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks UAI 2020 General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference EMNLP 2020 Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks AAAI 2020 Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020