conftrace_

expert diversity

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (2) large language model (1) parameter alignment (1) model upcycling (1) expert pruning (1) expert specialization (1) parameter efficiency (1) model reconstruction (1) feed-forward network (1) pre-trained model (1)

Papers

Symphony-MoE: Harmonizing Disparate Pre-trained Models into a Coherent Mixture-of-Experts AAAI 2026 DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts ACL 2025