knowledge distillation

Plug-in and Fine-tuning: Bridging the Gap between Small Language Models and Large Language Models ACL 2025 PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning COLING 2025 PointGAC: Geometric-Aware Codebook for Masked Point Modeling ICCV 2025 Point-SAM: Promptable 3D Segmentation Model for Point Clouds ICLR 2025 PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches ICLR 2025 POSITION BIAS MITIGATES POSITION BIAS: Mitigate Position Bias Through Inter-Position Knowledge Distillation EMNLP 2025 Post-pre-training for Modality Alignment in Vision-Language Foundation Models CVPR 2025 Powerformer: Efficient and High-Accuracy Privacy-Preserving Language Model with Homomorphic Encryption ACL 2025 PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation EMNLP 2025 Presto! Distilling Steps and Layers for Accelerating Music Generation ICLR 2025 Pre-training Distillation for Large Language Models: A Design Space Exploration ACL 2025 Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG ICML 2025 Prevalence of Negative Transfer in Continual Reinforcement Learning: Analyses and a Simple Baseline ICLR 2025 Proactive Guidance of Multi-Turn Conversation in Industrial Search ACL 2025 Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos AAAI 2025 Progressive distillation induces an implicit curriculum ICLR 2025 Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data CVPR 2025 Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation ACL 2025 PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts AAAI 2025 PromptOptMe: Error-Aware Prompt Compression for LLM-based MT Evaluation Metrics NAACL 2025 ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom EMNLP 2025 Prototypical Replay with Old-class Focusing Knowledge Distillation for Incremental Named Entity Recognition AAAI 2025 Proxy Denoising for Source-Free Domain Adaptation ICLR 2025 PruneSLU: Efficient On-device Spoken Language Understanding through Vocabulary and Structural Pruning Interspeech 2025 Pruning General Large Language Models into Customized Expert Models ACL 2025