knowledge distillation

LOIRE: LifelOng learning on Incremental data via pre-trained language model gRowth Efficiently ICLR 2025 LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025 LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learning CVPR 2025 LoRA Unlearns More and Retains More (Student Abstract) AAAI 2025 LoSiA: Efficient High-Rank Fine-Tuning via Subnet Localization and Optimization EMNLP 2025 LRA-QViT: Integrating Low-Rank Approximation and Quantization for Robust and Efficient Vision Transformers ICML 2025 LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tables ICCV 2025 LVPTrack: High Performance Domain Adaptive UAV Tracking with Label Aligned Visual Prompt Tuning AAAI 2025 Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translation ACL 2025 Maintaining Fairness in Logit-based Knowledge Distillation for Class-Incremental Learning AAAI 2025 Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models ACL 2025 Masking meets Supervision: A Strong Learning Alliance CVPR 2025 MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models EMNLP 2025 MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025 Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025 M-BRe: Discovering Training Samples for Relation Extraction from Unlabeled Texts with Large Language Models EMNLP 2025 Medium-Difficulty Samples Constitute Smoothed Decision Boundary for Knowledge Distillation on Pruned Datasets ICLR 2025 Membership and Memorization in LLM Knowledge Distillation EMNLP 2025 MemDistill: Distilling LiDAR Knowledge into Memory for Camera-Only 3D Object Detection ICCV 2025 Memorization Inheritance in Sequence-Level Knowledge Distillation for Neural Machine Translation ACL 2025 Mergenetic: a Simple Evolutionary Model Merging Library ACL 2025 MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities AAAI 2025 Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs EMNLP 2025 MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025 MimicGait: A Model Agnostic Approach for Occluded Gait Recognition using Correlational Knowledge Distillation WACV 2025