mixture of expert

Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNA NeurIPS 2024 MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning EMNLP 2024 MoEAD: A Parameter-efficient Model for Multi-class Anomaly Detection ECCV 2024 MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition EMNLP 2024 MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks NeurIPS 2024 MoE-SLU: Towards ASR-Robust Spoken Language Understanding via Mixture-of-Experts ACL 2024 MoEUT: Mixture-of-Experts Universal Transformers NeurIPS 2024 MoExtend: Tuning New Experts for Modality and Task Extension ACL 2024 MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models NeurIPS 2024 MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking COLING 2024 MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer NeurIPS 2024 MoVA: Adapting Mixture of Vision Experts to Multimodal Context NeurIPS 2024 Multi-Head Mixture-of-Experts NeurIPS 2024 Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NeurIPS 2024 Multimodal Instruction Tuning with Conditional Mixture of LoRA ACL 2024 Multi-Task Dense Prediction via Mixture of Low-Rank Experts CVPR 2024 Neural Experts: Mixture of Experts for Implicit Neural Representations NeurIPS 2024 Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE ICLR 2024 OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers CVPR 2024 Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts CVPR 2024 On Parameter Estimation in Deviated Gaussian Mixture of Experts AISTATS 2024 Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models EMNLP 2024 Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts NeurIPS 2024 Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks EMNLP 2024 PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning ACL 2024