knowledge distillation

Self-training Improves Pre-training for Natural Language Understanding NAACL 2021 Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding EMNLP 2021 Semantic-Aware Knowledge Distillation for Few-Shot Class-Incremental Learning CVPR 2021 Semi-Supervised Domain Adaptation Based on Dual-Level Domain Mixing for Semantic Segmentation CVPR 2021 Semi-Supervised Knowledge Amalgamation for Sequence Classification AAAI 2021 Sequential Graph Convolutional Network for Active Learning CVPR 2021 SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud CVPR 2021 Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching AAAI 2021 Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021 SIGN: Spatial-Information Incorporated Generative Network for Generalized Zero-Shot Semantic Segmentation ICCV 2021 SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation AAAI 2021 Simulating Unknown Target Models for Query-Efficient Black-Box Attacks CVPR 2021 Simultaneous Similarity-based Self-Distillation for Deep Metric Learning ICML 2021 Slimmable Generative Adversarial Networks AAAI 2021 Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NeurIPS 2021 Small Model and In-Domain Data Are All You Need EMNLP 2021 Space-Time Distillation for Video Super-Resolution CVPR 2021 Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework NeurIPS 2021 Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network AAAI 2021 SS-IL: Separated Softmax for Incremental Learning ICCV 2021 SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning NeurIPS 2021 Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021 Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021 Striking a Balance Between Stability and Plasticity for Class-Incremental Learning ICCV 2021 Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor ACL 2021