Skip to content
conftrace_

long dependency

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

tree-based architecture (1) invertible network (1) gradient bound (1) tree-based transformer (1) dependency distance (1) delta perplexity (1) hamiltonian system (1) neural network (1) orthogonal matrix (1) long-context language model (1)

Papers

Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models ACL 2024 LooGLE: Can Long-Context Language Models Understand Long Contexts? ACL 2024 UnICORNN: A recurrent model for learning very long time dependencies ICML 2021 TreeGen: A Tree-Based Transformer Architecture for Code Generation AAAI 2020