mixture of expert

LUL’s WMT22 Automatic Post-Editing Shared Task Submission EMNLP 2022 M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design NeurIPS 2022 Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NeurIPS 2022 Mixture of Attention Heads: Selecting Attention Heads Per Token EMNLP 2022 Mixture-of-Experts with Expert Choice Routing NeurIPS 2022 Mixtures of Controlled Gaussian Processes for Dynamical Modeling of Deformable Objects L4DC 2022 Modular Action Concept Grounding in Semantic Video Prediction CVPR 2022 MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022 MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022 MoESR: Blind Super-Resolution Using Kernel-Aware Mixture of Experts WACV 2022 Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts NeurIPS 2022 Named Entity and Relation Extraction with Multi-Modal Retrieval EMNLP 2022 Neural Implicit Dictionary Learning via Mixture-of-Expert Training ICML 2022 NeurMiPs: Neural Mixture of Planar Experts for View Synthesis CVPR 2022 On the Adversarial Robustness of Mixture of Experts NeurIPS 2022 On the Representation Collapse of Sparse Mixture of Experts NeurIPS 2022 P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts ICLR 2022 Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022 QaDialMoE: Question-answering Dialogue based Fact Verification with Mixture of Experts EMNLP 2022 RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling AAAI 2022 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022 Spatial Mixture-of-Experts NeurIPS 2022 StableMoE: Stable Routing Strategy for Mixture of Experts ACL 2022 Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity JMLR 2022 Table-based Fact Verification with Self-adaptive Mixture of Experts ACL 2022