Model Merging

Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods ICLR 2025 Analyzing the Role of Permutation Invariance in Linear Mode Connectivity AISTATS 2025 Hindsight Merging: Diverse Data Generation with Language Models UAI 2025 Less for More: Enhanced Feedback-aligned Mixed LLMs for Molecule Caption Generation and Fine-Grained NLI Evaluation ACL 2025 Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better ICLR 2025 MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation ICLR 2025 Robust fine-tuning of speech recognition models via model merging: application to disordered speech Interspeech 2025 Split-Merge: Scalable and Memory-Efficient Merging of Expert LLMs EMNLP 2025 Chamain: Harmonizing Character Persona Integrity with Domain-Adaptive Knowledge in Dialogue Generation ACL 2024 DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging EMNLP 2024 Toward Data Efficient Model Merging between Different Datasets without Performance Degradation ACML 2024 Dataless Knowledge Fusion by Merging Weights of Language Models ICLR 2023