conftrace_

expert activation

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (5) large language model (3) parameter efficiency (2) language model (2) representation learning (2) inference latency (1) expert specialization (1) mixed precision (1) multilingual model (1) knowledge retrieval (1)

Papers

CasMoE: A Cascaded Framework for Efficient MoE Inference on Resource-constrained Devices AAAI 2026 HMoE: Heterogeneous Mixture of Experts for Language Modeling EMNLP 2025 MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design ICML 2025 Oracle-MoE: Locality-preserving Routing in the Oracle Space for Memory-constrained Large Language Model Inference ICML 2025 Multi-Head Mixture-of-Experts NeurIPS 2024 Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications EMNLP 2024 Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs EMNLP 2024