Knowledge Distillation

Should We Really Edit Language Models? On the Evaluation of Edited Language Models NeurIPS 2024 SimDistill: Simulated Multi-Modal Distillation for BEV 3D Object Detection AAAI 2024 SimVG: A Simple Framework for Visual Grounding with Decoupled Multi-modal Fusion NeurIPS 2024 Sinkhorn Distance Minimization for Knowledge Distillation COLING 2024 SlimSAM: 0.1% Data Makes Segment Anything Slim NeurIPS 2024 Small But Funny: A Feedback-Driven Approach to Humor Distillation ACL 2024 Small Scale Data-Free Knowledge Distillation CVPR 2024 Some Like It Small: Czech Semantic Embedding Models for Industry Applications AAAI 2024 Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases NeurIPS 2024 Sparse High Rank Adapters NeurIPS 2024 Speaker Change Detection with Weighted-sum Knowledge Distillation based on Self-supervised Pre-trained Models Interspeech 2024 Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NeurIPS 2024 Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024 SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams NeurIPS 2024 STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models ACL 2024 Stronger, Lighter, Better: Towards Life-Long Attribute Value Extraction for E-Commerce Products ACL 2024 Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning NeurIPS 2024 Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification Interspeech 2024 StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements EMNLP 2024 Suitable is the Best: Task-Oriented Knowledge Fusion in Vulnerability Detection NeurIPS 2024 Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection AAAI 2024 SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NeurIPS 2024 Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale NeurIPS 2024 SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation EMNLP 2024 TAeKD: Teacher Assistant Enhanced Knowledge Distillation for Closed-Source Multilingual Neural Machine Translation COLING 2024