conftrace_

sparse mixture-of-experts

7 papers

Explore in graph

Also known as

SMOE SPARSE-MOE

Co-occurring keywords · papers mentioning both

multi-task learning (2) expert expansion (1) multi-attribute fairness (1) counterfactual routing (1) out-of-distribution tasks (1) meta-tuning (1) computational requirements (1) pruning experts (1) router l2 norm (1) semantic specialization (1)

Papers

Awakening Dormant Experts:Counterfactual Routing to Mitigate MoE Hallucinations ACL 2026 How Many Experts Are Enough? Towards Optimal Semantic Specialization for Mixture-of-Experts AAAI 2026 A-SMiLE: Affective Sparse Mixture-of-Experts Adapter with Multi-Task Learning for Spoken Dialogue Models Interspeech 2025 FairSMOE: Mitigating Multi-Attribute Fairness Problem with Sparse Mixture-of-Experts IJCAI 2025 MoEMoE: Question Guided Dense and Scalable Sparse Mixture-of-Expert for Multi-source Multi-modal Answering NAACL 2025 A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts ICML 2024 Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts ICML 2024