conftrace_

expert expansion

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (2) instruction tuning (2) dense-to-moe conversion (1) sparse mixture-of-experts (1) semantic specialization (1) parameter merging (1) expert specialization (1) genetic algorithm (1) continual instruction tuning (1) parameter-efficient fine-tuning (1)

Papers

Grow-on-Demand: Sparse and Adaptive Expert Expansion for Continual Instruction Tuning AAAI 2026 How Many Experts Are Enough? Towards Optimal Semantic Specialization for Mixture-of-Experts AAAI 2026 Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging ACL 2025