knowledge distillation

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning EMNLP 2024 PromptKD: Unsupervised Prompt Distillation for Vision-Language Models CVPR 2024 Prophecy Distillation for Boosting Abstractive Summarization COLING 2024 Provable Partially Observable Reinforcement Learning with Privileged Information NeurIPS 2024 Pruning before Fine-tuning: A Retraining-free Compression Framework for Pre-trained Language Models COLING 2024 PRVAE-VC2: Non-Parallel Voice Conversion by Distillation of Speech Representations Interspeech 2024 PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning IJCAI 2024 PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024 QBB: Quantization with Binary Bases for LLMs NeurIPS 2024 RA2FD: Distilling Faithfulness into Efficient Dialogue Systems EMNLP 2024 RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features CVPR 2024 RADCoT: Retrieval-Augmented Distillation to Specialization Models for Generating Chain-of-Thoughts in Query Expansion COLING 2024 RaD-Net 2: A causal two-stage repairing and denoising speech enhancement network with knowledge distillation and complex axial self-attention Interspeech 2024 RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation AAAI 2024 Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024 Ranking Entities along Conceptual Space Dimensions with LLMs: An Analysis of Fine-Tuning Strategies ACL 2024 RAPPER: Reinforced Rationale-Prompted Paradigm for Natural Language Explanation in Visual Question Answering ICLR 2024 RDRec: Rationale Distillation for LLM-based Recommendation ACL 2024 RECOST: External Knowledge Guided Data-efficient Instruction Tuning ACL 2024 Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models AAAI 2024 Reinforced Cross-Domain Knowledge Distillation on Time Series Data NeurIPS 2024 Resource-Aware Federated Self-Supervised Learning with Global Class Representations NeurIPS 2024 Resource-Efficient Transformer Pruning for Finetuning of Large Models CVPR 2024 Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract) AAAI 2024 Rethinking Branching on Exact Combinatorial Optimization Solver: The First Deep Symbolic Discovery Framework ICLR 2024