mixture of expert

PICSR: Prototype-Informed Cross-Silo Router for Federated Learning (Student Abstract) AAAI 2024 Psychometry: An Omnifit Model for Image Reconstruction from Human Brain Activity CVPR 2024 Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning ICLR 2024 Remix-DiT: Mixing Diffusion Transformers for Multi-Expert Denoising NeurIPS 2024 SAML: Speaker Adaptive Mixture of LoRA Experts for End-to-End ASR Interspeech 2024 Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models EMNLP 2024 Scaling Laws for Fine-Grained Mixture of Experts ICML 2024 Scaling physics-informed hard constraints with mixture-of-experts ICLR 2024 SciMind: A Multimodal Mixture-of-Experts Model for Advancing Pharmaceutical Sciences ACL 2024 SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR Interspeech 2024 Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices NeurIPS 2024 Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts NeurIPS 2024 Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning CoRL 2024 Sparse MoE with Language Guided Routing for Multilingual Machine Translation ICLR 2024 Spiking Transformer with Experts Mixture NeurIPS 2024 Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts ICLR 2024 SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 Task-Customized Mixture of Adapters for General Image Fusion CVPR 2024 TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts ICLR 2024 Toward Efficient Inference for Mixture of Experts NeurIPS 2024 Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts AISTATS 2024 Towards One-to-Many Visual Question Answering EMNLP 2024 Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NeurIPS 2024 Turn Waste into Worth: Rectifying Top-k Router of MoE EMNLP 2024