conftrace_

length extrapolation

31 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) positional encoding (182) large language model (13587) transformer architecture (1560) language model (4599) context window (73) rotary position embedding (32) position encoding (54) transformer model (1996) context length (48)

Papers

Empirical Investigation of Neural Symbolic Reasoning Strategies EACL 2023
Transformer Working Memory Enables Regular Language Reasoning And Natural Language Length Extrapolation EMNLP 2023
LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition ICCV 2023
A Length-Extrapolatable Transformer ACL 2023
KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation NIPS 2022
The EOS Decision and Length Extrapolation EMNLP 2020