conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Compressed MoE ASR Model Based on Knowledge Distillation and Quantization INTERSPEECH 2023
TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Experts ICCV 2023
Partition-And-Debias: Agnostic Biases Mitigation via a Mixture of Biases-Specific Experts ICCV 2023
Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts ICCV 2023
Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition INTERSPEECH 2023
MoEC: Mixture of Expert Clusters AAAI 2023
Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022
Unified Scaling Laws for Routed Language Models ICML 2022
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NIPS 2022
Table-based Fact Verification with Self-labeled Keypoint Alignment COLING 2022
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts NIPS 2022
Neural Implicit Dictionary Learning via Mixture-of-Expert Training ICML 2022
Learning Expressive Meta-Representations with Mixture of Expert Neural Processes NIPS 2022
On the Adversarial Robustness of Mixture of Experts NIPS 2022
Mixture-of-Experts with Expert Choice Routing NIPS 2022
NeurMiPs: Neural Mixture of Planar Experts for View Synthesis CVPR 2022
HydraSum: Disentangling Style Features in Text Summarization with Multi-Decoder Models EMNLP 2022
Convergence Rates for Gaussian Mixtures of Experts JMLR 2022
Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation INTERSPEECH 2022
M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design NIPS 2022
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022
Modular Action Concept Grounding in Semantic Video Prediction CVPR 2022
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs NIPS 2022