mixture of expert

Task-customized Masked Autoencoder via Mixture of Cluster-conditional Experts ICLR 2023 TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Experts ICCV 2023 TJUNLP:System Description for the WMT23 Literary Task in Chinese to English Translation Direction EMNLP 2023 Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity EMNLP 2023 Towards Effective Long-Form QA with Evidence Augmentation EMNLP 2023 Transforming Visual Scene Graphs to Image Captions ACL 2023 AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning EMNLP 2022 A Theoretical View on Sparsely Activated Networks NeurIPS 2022 BMCook: A Task-agnostic Compression Toolkit for Big Models EMNLP 2022 Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation Interspeech 2022 Convergence Rates for Gaussian Mixtures of Experts JMLR 2022 DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022 DEMix Layers: Disentangling Domains for Modular Language Modeling NAACL 2022 Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts ACL 2022 Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts NAACL 2022 Eliciting and Understanding Cross-task Skills with Task-level Mixture-of-Experts EMNLP 2022 Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts EMNLP 2022 Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers ICML 2022 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022 Go Wider Instead of Deeper AAAI 2022 GraphDIVE: Graph Classification by Mixture of Diverse Experts IJCAI 2022 How Can Cross-lingual Knowledge Contribute Better to Fine-Grained Entity Typing? ACL 2022 HydraSum: Disentangling Style Features in Text Summarization with Multi-Decoder Models EMNLP 2022 Learning Expressive Meta-Representations with Mixture of Expert Neural Processes NeurIPS 2022 Learning Mixture of Domain-Specific Experts via Disentangled Factors for Autonomous Driving AAAI 2022