Model Merging

Knowledge Fusion of Large Language Models ICLR 2024 LANDeRMT: Dectecting and Routing Language-Aware Neurons for Selectively Finetuning LLMs to Machine Translation ACL 2024 LaRA: Large Rank Adaptation for Speech and Text Cross-Modal Learning in Large Language Models EMNLP 2024 LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024 Layer-wise linear mode connectivity ICLR 2024 Learning or Self-aligning? Rethinking Instruction Fine-tuning ACL 2024 Llama-VITS: Enhancing TTS Synthesis with Semantic Awareness COLING 2024 LM-Cocktail: Resilient Tuning of Language Models via Model Merging ACL 2024 Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning NeurIPS 2024 LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 Low-Rank Adaptation for Multilingual Summarization: An Empirical Study NAACL 2024 Low-Rank Knowledge Decomposition for Medical Foundation Models CVPR 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection CVPR 2024 McGill NLP Group Submission to the MRL 2024 Shared Task: Ensembling Enhances Effectiveness of Multilingual Small LMs EMNLP 2024 MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024 Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy ICLR 2024 Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging EMNLP 2024 MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic EMNLP 2024 MindMerger: Efficiently Boosting LLM Reasoning in non-English Languages NeurIPS 2024 Mind’s Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models NAACL 2024 Mitigating Catastrophic Forgetting in Language Transfer via Model Merging EMNLP 2024 Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging EMNLP 2024 Mixing and Matching: Combining Independently Trained Translation Model Components EACL 2024