No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces

Daniel Marczak; Simone Magistri; Sebastian Cygert; Bartłomiej Twardowski; Andrew D. Bagdanov; Joost van de Weijer

2025 ICML ICML 2025

No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Daniel Marczak, Simone Magistri, Sebastian Cygert, Bartłomiej Twardowski, Andrew D. Bagdanov, Joost van de Weijer

Topics

Artificial Intelligence > Core AI > Foundation Models Deep Learning > Techniques > Model Architecture

Keywords

model merging pre-trained model task-specific model common subspace singular value spectrum task-specific subspaces

Download PDF