conftrace_

forget gate

5 papers

Explore in graph

Co-occurring keywords · papers mentioning both

recurrent neural network (3) gating mechanism (2) language modeling (2) selective state space (1) minimalist grammar (1) forgetting attention (1) forgetting transformer (1) linguistic constraint (1) long-context modeling (1) architecture search (1)

Papers

Forgetting Transformer: Softmax Attention with a Forget Gate ICLR 2025 Demystify Mamba in Vision: A Linear Attention Perspective NeurIPS 2024 Different Ways to Forget: Linguistic Gates in Recurrent Neural Networks CoNLL 2024 Hierarchically Gated Recurrent Neural Network for Sequence Modeling NeurIPS 2023 An Empirical Exploration of Recurrent Network Architectures ICML 2015