conftrace_

routing network

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

multi-task learning (4) mixture of expert (3) neural network (2) adaptive knowledge sharing (1) world knowledge (1) knowledge retention (1) policy representation (1) large language model (1) modular network (1) sub-network routing (1)

Papers

LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024 MoEC: Mixture of Expert Clusters AAAI 2023 Unified Scaling Laws for Routed Language Models ICML 2022 Multi-Task Reinforcement Learning with Soft Modularization NeurIPS 2020 SNR: Sub-Network Routing for Flexible Parameter Sharing in Multi-Task Learning AAAI 2019 Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine Translation ACL 2018 Routing Networks: Adaptive Selection of Non-Linear Functions for Multi-Task Learning ICLR 2018