mixture of expert

Event Representation Learning with Multi-Grained Contrastive Learning and Triple-Mixture of Experts COLING 2024 Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NeurIPS 2024 Exploring Domain Robust Lightweight Reward Models based on Router Mechanism ACL 2024 FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models EMNLP 2024 Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts NeurIPS 2024 Frequency-Adaptive Pan-Sharpening with Mixture of Experts AAAI 2024 From Sparse to Soft Mixtures of Experts ICLR 2024 FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion NeurIPS 2024 Generator Assisted Mixture of Experts for Feature Acquisition in Batch AAAI 2024 GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Experts NeurIPS 2024 Harder Task Needs More Experts: Dynamic Routing in MoE Models ACL 2024 HDformer: A Higher-Dimensional Transformer for Detecting Diabetes Utilizing Long-Range Vascular Signals AAAI 2024 How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NeurIPS 2024 HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts ACL 2024 Integrating Plutchik’s Theory with Mixture of Experts for Enhancing Emotion Classification EMNLP 2024 Language-driven All-in-one Adverse Weather Removal CVPR 2024 LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models EMNLP 2024 Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models EMNLP 2024 LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training EMNLP 2024 LLMCarbon: Modeling the End-to-End Carbon Footprint of Large Language Models ICLR 2024 LLMs Can Evolve Continually on Modality for X-Modal Reasoning NeurIPS 2024 LocMoE: A Low-overhead MoE for Large Language Model Training IJCAI 2024 LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024 LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing NeurIPS 2024 MedCoT: Medical Chain of Thought via Hierarchical Expert EMNLP 2024