conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications EMNLP 2024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers CVPR 2024
Psychometry: An Omnifit Model for Image Reconstruction from Human Brain Activity CVPR 2024
ConstitutionalExperts: Training a Mixture of Principle-based Prompts ACL 2024
Spiking Transformer with Experts Mixture NIPS 2024
Mixture of Link Predictors on Graphs NIPS 2024
Language-driven All-in-one Adverse Weather Removal CVPR 2024
LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024
MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024
Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language Models COLING 2024
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024
Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation AAAI 2024
LLMs Can Evolve Continually on Modality for $\mathbb{X}$-Modal Reasoning NIPS 2024
LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NIPS 2024
Multimodal Instruction Tuning with Conditional Mixture of LoRA ACL 2024
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NIPS 2024
MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer NIPS 2024
Unity by Diversity: Improved Representation Learning for Multimodal VAEs NIPS 2024
DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling ACL 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024
MoE-SLU: Towards ASR-Robust Spoken Language Understanding via Mixture-of-Experts ACL 2024
Mixture-of-Linear-Experts for Long-term Time Series Forecasting AISTATS 2024
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024
MedCoT: Medical Chain of Thought via Hierarchical Expert EMNLP 2024
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts ACL 2024