conftrace_

exponential decaying memory

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

state space model (2) layer-wise nonlinearity (1) reparameterization (1) memory limitation (1) optimization stability (1) neural network (1) large language model (1) universal approximator (1) sequence modeling (1)

Papers

StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization ICML 2024 State-space models with layer-wise nonlinearity are universal approximators with exponential decaying memory NeurIPS 2023