conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model ACL 2023
Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach ACL 2023
PAD-Net: An Efficient Framework for Dynamic Networks ACL 2023
Improving Grammatical Error Correction with Multimodal Feature Integration ACL 2023
DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships ACL 2023
AutoMoE: Heterogeneous Mixture-of-Experts with Adaptive Computation for Efficient Neural Machine Translation ACL 2023
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts EMNLP 2023
Approximating Two-Layer Feedforward Networks for Efficient Transformers EMNLP 2023
FEAMOE: Fair, Explainable and Adaptive Mixture of Experts IJCAI 2023
Robust Mixture-of-Expert Training for Convolutional Neural Networks ICCV 2023
Semantic-Aware Dynamic Parameter for Video Inpainting Transformer ICCV 2023
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts EMNLP 2023
Towards Effective Long-Form QA with Evidence Augmentation EMNLP 2023
Improving End-to-End Modeling For Mandarin-English Code-Switching Using Lightweight Switch-Routing Mixture-of-Experts INTERSPEECH 2023
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023
On the Benefits of Learning to Route in Mixture-of-Experts Models EMNLP 2023
Offline Reinforcement Learning for Mixture-of-Expert Dialogue Management NIPS 2023
Information Maximizing Curriculum: A Curriculum-Based Approach for Learning Versatile Skills NIPS 2023
FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing NIPS 2023
Emergent Modularity in Pre-trained Transformers ACL 2023
Transforming Visual Scene Graphs to Image Captions ACL 2023
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners CVPR 2023
Long-Tailed Visual Recognition via Self-Heterogeneous Integration With Knowledge Excavation CVPR 2023
MMNMT: Modularizing Multilingual Neural Machine Translation with Flexibly Assembled MoE and Dense Blocks EMNLP 2023
Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity EMNLP 2023