Knowledge Distillation

Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023 Self-Distillation for Further Pre-training of Transformers ICLR 2023 Self-Distillation into Self-Attention Heads for Improving Transformer-based End-to-End Neural Speaker Diarization Interspeech 2023 Self-distilled Transitive Instance Weighting for Denoised Distantly Supervised Relation Extraction EMNLP 2023 Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation EMNLP 2023 Self-Supervised Character-to-Character Distillation for Text Recognition ICCV 2023 Semantic Scene Completion With Cleaner Self CVPR 2023 Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR Interspeech 2023 Semi-attention Partition for Occluded Person Re-identification AAAI 2023 Semi-Supervised Learning via Weight-Aware Distillation under Class Distribution Mismatch ICCV 2023 Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding Interspeech 2023 Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding Interspeech 2023 Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction ACL 2023 SKD-NER: Continual Named Entity Recognition via Span-based Knowledge Distillation with Reinforcement Learning EMNLP 2023 Smart Word Suggestions for Writing Assistance ACL 2023 SMOC-Net: Leveraging Camera Pose for Self-Supervised Monocular Object Pose Estimation CVPR 2023 StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-Based 3D Object Detection AAAI 2023 Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023 StructVPR: Distill Structural Knowledge With Weighting Samples for Visual Place Recognition CVPR 2023 Students Parrot Their Teachers: Membership Inference on Model Distillation NeurIPS 2023 STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection NeurIPS 2023 Switchable Representation Learning Framework With Self-Compatibility CVPR 2023 Switching Temporary Teachers for Semi-Supervised Semantic Segmentation NeurIPS 2023 T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023 Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation ACL 2023