conftrace_

sparse mixture of expert

6 papers

Explore in graph

Also known as

SMOE

Co-occurring keywords

parameter efficiency (417) expert routing (44) model scaling (135) parameter efficient (173) top-k selection (20) routing mechanism (17) adaptive router (1) model scalability (6) sparse gating (11) isotonic optimization (3)

Papers

GMoE: Global Mixture of Experts with Logit Propagation ACL 2026

Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss ACL 2025

MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024

Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective ICML 2023

Sparse Universal Transformer EMNLP 2023

Scaling Vision-Language Models with Sparse Mixture of Experts EMNLP 2023