Skip to content
conftrace_

training regime

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

plasticity-stability dilemma (1) neural network (1) large language model (1) local minimum (1) parameter efficiency (1) feed-forward network (1) learning rate (1) neural network training (1) catastrophic forgetting (1) continual learning (1)

Papers

Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers NeurIPS 2024 Understanding the Role of Training Regimes in Continual Learning NeurIPS 2020