Knowledge Distillation

Instance-level Expert Knowledge and Aggregate Discriminative Attention for Radiology Report Generation CVPR 2024 Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data EMNLP 2024 Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024 Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation COLING 2024 Joint Input and Output Coordination for Class-Incremental Learning IJCAI 2024 KALM: Knowledgeable Agents by Offline Reinforcement Learning from Large Language Model Rollouts NeurIPS 2024 KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling CVPR 2024 KDMCSE: Knowledge Distillation Multimodal Sentence Embeddings with Adaptive Angular margin Contrastive Learning NAACL 2024 Keyword-Guided Adaptation of Automatic Speech Recognition Interspeech 2024 KNN-Instruct: Automatic Instruction Construction with K Nearest Neighbor Deduction EMNLP 2024 Knowledge boosting during low-latency inference Interspeech 2024 Knowledge Distillation Based on Transformed Teacher Matching ICLR 2024 Knowledge Distillation for Tiny Speech Enhancement with Latent Feature Augmentation Interspeech 2024 Knowledge Distillation from Monolingual to Multilingual Models for Intelligent and Interpretable Multilingual Emotion Detection ACL 2024 Knowledge Distillation from Self-Supervised Representation Learning Model with Discrete Speech Units for Any-to-Any Streaming Voice Conversion Interspeech 2024 Knowledge Distillation from Single-Task Teachers to Multi-Task Student for End-to-End Autonomous Driving AAAI 2024 Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels NAACL 2024 Knowledge Distillation in Federated Learning: A Practical Guide IJCAI 2024 Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget NAACL 2024 Knowledge Editing in Language Models via Adapted Direct Preference Optimization EMNLP 2024 Knowledge-Enhanced Historical Document Segmentation and Recognition AAAI 2024 Knowledge-Preserving Pluggable Modules for Multilingual Speech Translation Tasks Interspeech 2024 KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server EMNLP 2024 Knowledge Transfer via Compact Model in Federated Learning (Student Abstract) AAAI 2024 KTCN: Enhancing Open-World Object Detection with Knowledge Transfer and Class-Awareness Neutralization IJCAI 2024