Knowledge Distillation

Spectral Co-Distillation for Personalized Federated Learning NeurIPS 2023 SpotEM: Efficient Video Search for Episodic Memory ICML 2023 SSSD: Self-Supervised Self Distillation WACV 2023 STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition ICML 2023 StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-Based 3D Object Detection AAAI 2023 Storyline-Centric Detection of Aphasia and Dysarthria in Stroke Patient Transcripts ACL 2023 Strategic Data Sharing between Competitors NeurIPS 2023 Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation EACL 2023 Structure Aware Incremental Learning with Personalized Imitation Weights for Recommender Systems AAAI 2023 StructVPR: Distill Structural Knowledge With Weighting Samples for Visual Place Recognition CVPR 2023 STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection NeurIPS 2023 Supervised Masked Knowledge Distillation for Few-Shot Transformers CVPR 2023 Supervision Complexity and its Role in Knowledge Distillation ICLR 2023 Switching Temporary Teachers for Semi-Supervised Semantic Segmentation NeurIPS 2023 Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step ACL 2023 Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings EACL 2023 Synthesize, if you do not have: Effective Synthetic Dataset Creation Strategies for Self-Supervised Opinion Summarization in E-commerce EMNLP 2023 Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model ACL 2023 Synthetic Pre-Training Tasks for Neural Machine Translation ACL 2023 T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillation AAAI 2023 TADA : Task Agnostic Dialect Adapters for English ACL 2023 Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation ACL 2023 TARGET: Federated Class-Continual Learning via Exemplar-Free Distillation ICCV 2023 Task-Specific Skill Localization in Fine-tuned Language Models ICML 2023 Taxonomy Adaptive Cross-Domain Adaptation in Medical Imaging via Optimization Trajectory Distillation ICCV 2023