Knowledge Distillation

Reinforced Multi-Teacher Selection for Knowledge Distillation AAAI 2021 Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation ACL 2021 Revisiting Knowledge Distillation: An Inheritance and Exploration Framework CVPR 2021 Robust Domain Randomised Reinforcement Learning through Peer-to-Peer Distillation ACML 2021 Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021 Robust Knowledge Transfer via Hybrid Forward on the Teacher-Student Model AAAI 2021 Robust Model Compression Using Deep Hypotheses AAAI 2021 RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking EMNLP 2021 Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task ACL 2021 Selective Knowledge Distillation for Neural Machine Translation ACL 2021 Self-boosting for Feature Distillation IJCAI 2021 Self-Mutual Distillation Learning for Continuous Sign Language Recognition ICCV 2021 Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding EMNLP 2021 Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021 SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud CVPR 2021 Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021 Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021 SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation AAAI 2021 Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NeurIPS 2021 Small Model and In-Domain Data Are All You Need EMNLP 2021 Space-Time Distillation for Video Super-Resolution CVPR 2021 Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework NeurIPS 2021 Speech Emotion Recognition via Multi-Level Cross-Modal Distillation Interspeech 2021 Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network AAAI 2021 Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021