conftrace_

expert routing

56 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (36) large language model (15) model compression (10) load balancing (6) neural network (6) parameter-efficient fine-tuning (5) expert specialization (4) sparse activation (4) language model (4) model efficiency (3)

Papers

RepMode: Learning to Re-Parameterize Diverse Experts for Subcellular Structure Prediction CVPR 2023 Collaboration of Experts: Achieving 80% Top-1 Accuracy on ImageNet with 100M FLOPs ICML 2022 Mixture-of-Experts with Expert Choice Routing NeurIPS 2022 A Mixture-of-Experts Model for Antonym-Synonym Discrimination ACL 2021 BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021 Long-tailed Recognition by Routing Diverse Distribution-Aware Experts ICLR 2021