conftrace_

mixture-of-experts

34 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (4) router (3) scaling law (3) hallucinations (2) throughput (2) parameter scalability (2) hierarchical gating (2) routing mechanism (2) parameter reduction (2) sparse activation (2)

Papers

Scaling Laws for Upcycling Mixture-of-Experts Language Models ICML 2025 What Limits Bidirectional Model’s Generative Capabilities? A Uni-Bi-Directional Mixture-of-Expert Method For Bidirectional Fine-tuning ICML 2025 MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts ICML 2024 Fast Training of Diffusion Transformer with Extreme Masking for 3D Point Clouds Generation ECCV 2024 Mixtures of Experts Unlock Parameter Scaling for Deep RL ICML 2024 MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts ICML 2024 One Prompt is not Enough: Automated Construction of a Mixture-of-Expert Prompts ICML 2024 OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models ICML 2024 Scaling Beyond the GPU Memory Limit for Large Mixture-of-Experts Model Training ICML 2024