Knowledge Distillation

Knowledge Distillation for High Dimensional Search Index NeurIPS 2023 Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data Interspeech 2023 Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer Interspeech 2023 Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023 Knowledge Distillation on Joint Task End-to-End Speech Translation Interspeech 2023 Knowledge Distillation Performs Partial Variance Reduction NeurIPS 2023 Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation Interspeech 2023 Know Where You’re Going: Meta-Learning for Parameter-Efficient Fine-Tuning ACL 2023 Label-Guided Knowledge Distillation for Continual Semantic Segmentation on 2D Images and 3D Point Clouds ICCV 2023 Large Language Models Are Reasoning Teachers ACL 2023 Large-to-Small Image Resolution Asymmetry in Deep Metric Learning WACV 2023 Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions NeurIPS 2023 LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023 Learn and Sample Together: Collaborative Generation for Graphic Design Layout IJCAI 2023 Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023 Learning Answer Generation using Supervision from Automatic Question Answering Evaluators ACL 2023 Learning From Biased Soft Labels NeurIPS 2023 Learning from the Wisdom of Crowds: Exploiting Similar Sessions for Session Search AAAI 2023 Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation ICML 2023 Learning MLPs on Graphs: A Unified View of Effectiveness, Robustness, and Efficiency ICLR 2023 Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement CVPR 2023 Learning to Distill Global Representation for Sparse-View CT ICCV 2023 Learning to Imagine: Distillation-Based Interactive Context Exploitation for Dialogue State Tracking AAAI 2023 Learning to Learn from APIs: Black-Box Data-Free Meta-Learning ICML 2023 Learning To Retain While Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation CVPR 2023