mixture of expert

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models EMNLP 2024 MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024 Memory Augmented Language Models through Mixture of Word Experts NAACL 2024 Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy ICLR 2024 Merging Multi-Task Models via Weight-Ensembling Mixture of Experts ICML 2024 MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024 Mitigating Emergent Robustness Degradation while Scaling Graph Learning ICLR 2024 Mixture of Demonstrations for In-Context Learning NeurIPS 2024 Mixture of Diverse Size Experts EMNLP 2024 Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models ICLR 2024 Mixture of Experts Meets Prompt-Based Continual Learning NeurIPS 2024 Mixture of In-Context Experts Enhance LLMs' Long Context Awareness NeurIPS 2024 Mixture-of-Linear-Experts for Long-term Time Series Forecasting AISTATS 2024 Mixture of Link Predictors on Graphs NeurIPS 2024 Mixture of LoRA Experts ICLR 2024 Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language Models COLING 2024 Mixture of Nested Experts: Adaptive Processing of Visual Tokens NeurIPS 2024 Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding COLING 2024 Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts ACL 2024 Mixture of Tokens: Continuous MoE through Cross-Example Aggregation NeurIPS 2024 Mixture of Weak and Strong Experts on Graphs ICLR 2024 Mixtures of Experts for Audio-Visual Learning NeurIPS 2024 MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts EMNLP 2024 MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024 MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024