Model Merging

Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference NeurIPS 2024 RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Models NeurIPS 2024 Scalable Data Ablation Approximations for Language Models through Modular Training and Merging EMNLP 2024 SedarEval: Automated Evaluation using Self-Adaptive Rubrics EMNLP 2024 Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective ICLR 2024 SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data NeurIPS 2024 Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation AAAI 2024 Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning ICLR 2024 SpaceByte: Towards Deleting Tokenization from Large Language Modeling NeurIPS 2024 SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models EMNLP 2024 The Art of Saying No: Contextual Noncompliance in Language Models NeurIPS 2024 The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse ACL 2024 The MOLOR Lemma Bank: a New LLOD Resource for Old Irish COLING 2024 To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models EMNLP 2024 Towards Making Learnware Specification and Market Evolvable AAAI 2024 Training-Free Pretrained Model Merging CVPR 2024 Transformer Fusion with Optimal Transport ICLR 2024 Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging NeurIPS 2024 Unlocking the Potential of Global Human Expertise NeurIPS 2024 Unlocking the Potential of Model Merging for Low-Resource Languages EMNLP 2024 VLFeedback: A Large-Scale AI Feedback Dataset for Large Vision-Language Models Alignment EMNLP 2024 V-PETL Bench: A Unified Visual Parameter-Efficient Transfer Learning Benchmark NeurIPS 2024 What the Weight?! A Unified Framework for Zero-Shot Knowledge Composition EACL 2024 When Babies Teach Babies: Can student knowledge sharing outperform Teacher-Guided Distillation on small datasets? CoNLL 2024 When Quantization Affects Confidence of Large Language Models? NAACL 2024