knowledge distillation

Spatial-Temporal Knowledge Distillation for Takeaway Recommendation AAAI 2025 Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling ICLR 2025 Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting ICLR 2025 Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025 SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking ICLR 2025 Split-Merge: Scalable and Memory-Efficient Merging of Expert LLMs EMNLP 2025 SSHNet: Unsupervised Cross-modal Homography Estimation via Problem Reformulation and Split Optimization CVPR 2025 SSR: Alignment-Aware Modality Connector for Speech Language Models ACL 2025 Staged Knowledge Distillation Through Least-to-Most Prompting: Optimizing Teacher Guidance via Difficulty-Aware Training EMNLP 2025 Static Word Embeddings for Sentence Semantic Representation EMNLP 2025 STEP-DETR: Advancing DETR-based Semi-Supervised Object Detection with Super Teacher and Pseudo-Label Guided Text Queries ICCV 2025 StepER: Step-wise Knowledge Distillation for Enhancing Reasoning Ability in Multi-Step Retrieval-Augmented Language Models EMNLP 2025 STINR: Deciphering Spatial Transcriptomics via Implicit Neural Representation CVPR 2025 StitchLLM: Serving LLMs, One Block at a Time ACL 2025 Streamlining LLMs: Adaptive Knowledge Distillation for Tailored Language Models NAACL 2025 Streamlining Redundant Layers to Compress Large Language Models ICLR 2025 Stronger Models are Not Always Stronger Teachers for Instruction Tuning NAACL 2025 Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework EMNLP 2025 Suit the Node Pair to the Case: A Multi-Scale Node Pair Grouping Strategy for Graph-MLP Distillation IJCAI 2025 SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation EMNLP 2025 Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task Learning ICLR 2025 SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025 SynQ: Accurate Zero-shot Quantization by Synthesis-aware Fine-tuning ICLR 2025 Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025 Syntriever: How to Train Your Retriever with Synthetic Data from LLMs NAACL 2025