Skip to content
conftrace_

sparse mixture of expert

9 papers

Explore in graph

Also known as

SMOE

Co-occurring keywords · papers mentioning both

parameter efficiency (3) expert routing (2) model scaling (2) parameter-efficient fine-tuning (2) parameter efficient (2) expert specialization (1) top-k selection (1) transportation plan (1) gradient method (1) routing mechanism (1)

Papers

GMoE: Global Mixture of Experts with Logit Propagation ACL 2026 Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss ACL 2025 Mixture of In-Context Prompters for Tabular PFNs ICLR 2025 MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NeurIPS 2024 Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective ICML 2023 Scaling Vision-Language Models with Sparse Mixture of Experts EMNLP 2023 Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers ICLR 2023 Sparse Universal Transformer EMNLP 2023 Sparsity-Constrained Optimal Transport ICLR 2023