Model Compression

Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning ICCV 2025 Learning What to Remember: Adaptive Probabilistic Memory Retention for Memory-Efficient Language Models EMNLP 2025 Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025 Less, but Better: Efficient Multilingual Expansion for LLMs via Layer-wise Mixture-of-Experts ACL 2025 Less Is More? Examining Fairness in Pruned Large Language Models for Summarising Opinions EMNLP 2025 Let’s Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model COLING 2025 Leveraging Attention to Effectively Compress Prompts for Long-Context LLMs AAAI 2025 Libra-Merging: Importance-redundancy and Pruning-merging Trade-off for Acceleration Plug-in in Large Vision-Language Model CVPR 2025 LiteLMGuard: Seamless and Lightweight On-Device Guardrails for Small Language Models against Quantization Vulnerabilities IJCNLP 2025 LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing ICLR 2025 LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation ICLR 2025 LLMs on a Budget? Say HOLA EMNLP 2025 LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning ICLR 2025 Local Prompt Optimization NAACL 2025 Lock on Target! Precision Unlearning via Directional Control EMNLP 2025 Logits-Based Finetuning EMNLP 2025 LoLCATs: On Low-Rank Linearizing of Large Language Models ICLR 2025 LoRACoE: Improving Large Language Model via Composition-based LoRA Expert EMNLP 2025 LoRaDA: Low-Rank Direct Attention Adaptation for Efficient LLM Fine-tuning EMNLP 2025 LoRA-Gen: Specializing Large Language Model via Online LoRA Generation ICML 2025 LoRA-Pro: Are Low-Rank Adapters Properly Optimized? ICLR 2025 LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models CVPR 2025 LoRA Unlearns More and Retains More (Student Abstract) AAAI 2025 LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging EMNLP 2025 LoRMA: Low-Rank Multiplicative Adaptation for LLMs ACL 2025