conftrace_

length generalization

29 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) positional encoding (182) transformer architecture (1560) position encoding (54) large language model (13587) transformer model (1996) language model (4599) knowledge tracing (66) arithmetic reasoning (40) passkey retrieval (3)

Papers

Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers EACL 2026
Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models ACL 2026
Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoning EACL 2026
Lizard: An Efficient Linearization Framework for Large Language Models ACL 2026
Which Word Orders Facilitate Length Generalization in LMs? An Investigation with GCG-Based Artificial Languages EMNLP 2025
Principled Understanding of Generalization for Generative Transformer Models in Arithmetic Reasoning Tasks ACL 2025
On the Power of Convolution-Augmented Transformer AAAI 2025
How do autoregressive transformers solve full addition? EMNLP 2025
DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search EMNLP 2025
Robust and Unbounded Length Generalization in Autoregressive Transformer-Based Text-to-Speech NAACL 2025
On the Expressiveness and Length Generalization of Selective State Space Models on Regular Languages AAAI 2025
Cognitive Fluctuations Enhanced Attention Network for Knowledge Tracing AAAI 2025
Learning to Reason from Feedback at Test-Time ACL 2025
How Do Position Encodings Affect Length Generalization? Case Studies On In-Context Function Learning AAAI 2025
Enhancing Length Generalization for Attention Based Knowledge Tracing Models with Linear Biases IJCAI 2024
An Exploration of Length Generalization in Transformer-Based Speech Enhancement INTERSPEECH 2024
Length Generalization of Causal Transformers without Position Encoding ACL 2024
Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure NIPS 2024
LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models NAACL 2024
Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs NIPS 2024
Generalization on the Unseen, Logic Reasoning and Degree Curriculum JMLR 2024
Monotonic Location Attention for Length Generalization ICML 2023
Grounded Image Text Matching with Mismatched Relation Reasoning ICCV 2023
The Impact of Positional Encoding on Length Generalization in Transformers NIPS 2023
Randomized Positional Encodings Boost Length Generalization of Transformers ACL 2023