conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models IJCAI 2025
AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting IJCAI 2025
Equipping Vision Foundation Model with Mixture of Experts for Out-of-Distribution Detection ICCV 2025
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models ACL 2025
DHMoE: Diffusion Generated Hierarchical Multi-Granular Expertise for Stock Prediction AAAI 2025
Mixture of Languages: Improved Multilingual Encoders Through Language Grouping EMNLP 2025
Task-aware Contrastive Mixture of Experts for Quadruple Extraction in Conversations with Code-like Replies and Non-opinion Detection EMNLP 2025
Automatic Expert Discovery in LLM Upcycling via Sparse Interpolated Mixture-of-Experts ACL 2025
P-React: Synthesizing Topic-Adaptive Reactions of Personality Traits via Mixture of Specialized LoRA Experts ACL 2025
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization EMNLP 2025
DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Robotics ACL 2025
A Closer Look into Mixture-of-Experts in Large Language Models NAACL 2025
Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts NAACL 2025
Too Helpful, Too Harmless, Too Honest or Just Right? EMNLP 2025
Enhancing Mixture of Experts with Independent and Collaborative Learning for Long-Tail Visual Recognition IJCAI 2025
DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs EMNLP 2025
LoRACoE: Improving Large Language Model via Composition-based LoRA Expert EMNLP 2025
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders EMNLP 2025
RetroMoE: A Mixture-of-Experts Latent Translation Framework for Single-step Retrosynthesis IJCAI 2025
Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning EMNLP 2025
Examining and Adapting Time for Multilingual Classification via Mixture of Temporal Experts NAACL 2025
Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routing EMNLP 2025
Towards a Multimodal Large Language Model with Pixel-Level Insight for Biomedicine AAAI 2025
Connector-S: A Survey of Connectors in Multi-modal Large Language Models IJCAI 2025
MoFE: Mixture of Frozen Experts Architecture NAACL 2025