Skip to content
conftrace_
2024 ICML ICML 2024

Merging Multi-Task Models via Weight-Ensembling Mixture of Experts

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Anke Tang, Li Shen, Yong Luo, Nan Yin, Lefei Zhang, Dacheng Tao

Topics

Artificial Intelligence > Core AI > Multimodal Learning Machine Learning > Core Methods > Representation Learning Deep Learning > Architectures > Transformers

Keywords

transformer mixture of expert shared knowledge parameter interference weight ensembling moe
Download PDF