Knowledge Distillation

Self-Distillation for Few-Shot Image Captioning WACV 2021 Self-Knowledge Distillation With Progressive Refinement of Targets ICCV 2021 Self Supervision to Distillation for Long-Tailed Visual Recognition ICCV 2021 Self-training Improves Pre-training for Natural Language Understanding NAACL 2021 Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021 Semantic Categorization of Social Knowledge for Commonsense Question Answering EMNLP 2021 Semi-Supervised Domain Adaptation Based on Dual-Level Domain Mixing for Semantic Segmentation CVPR 2021 Semi-Supervised Knowledge Amalgamation for Sequence Classification AAAI 2021 Sequence to General Tree: Knowledge-Guided Geometry Word Problem Solving ACL 2021 Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021 Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021 Simple and Efficient ways to Improve REALM EMNLP 2021 Simulating Unknown Target Models for Query-Efficient Black-Box Attacks CVPR 2021 Simultaneous Similarity-based Self-Distillation for Deep Metric Learning ICML 2021 Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NeurIPS 2021 Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation NAACL 2021 Space-Time Distillation for Video Super-Resolution CVPR 2021 Speech Emotion Recognition via Multi-Level Cross-Modal Distillation Interspeech 2021 Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network AAAI 2021 SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning NeurIPS 2021 Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021 Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021 Striking a Balance Between Stability and Plasticity for Class-Incremental Learning ICCV 2021 Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor ACL 2021 Student Customized Knowledge Distillation: Bridging the Gap Between Student and Teacher ICCV 2021