conftrace_

token routing

26 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (11) efficient computing (5) model compression (5) large language model (4) model efficiency (4) load balancing (2) expert specialization (2) expert routing (2) feed-forward network (2) multimodal large language model (2)

Papers

BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021