conftrace_

context length

48 papers

Explore in graph

Co-occurring keywords

large language model (13587) long context (121) rotary position embedding (32) long-context understanding (24) language model (4599) efficient computing (781) attention mechanism (4001) inference efficiency (248) retrieval-augmented generation (1592) computational efficiency (362)

Papers

E2-LLM: Efficient and Extreme Length Extension of Large Language Models ACL 2024
On the Adaptation of Unlimiformer for Decoder-Only Transformers COLING 2024
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts ACL 2024
Long Sequence Modeling with Attention Tensorization: From Sequence to Tensor Learning EMNLP 2024
TAIL: A Toolkit for Automatic and Realistic Long-Context Large Language Model Evaluation EMNLP 2024
Beyond Attention: Breaking the Limits of Transformer Context Length with Recurrent Memory AAAI 2024
HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position ACL 2024
An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla ACL 2024
Base of RoPE Bounds Context Length NIPS 2024
Systematic Evaluation of Long-Context LLMs on Financial Concepts EMNLP 2024
LongAlign: A Recipe for Long Context Alignment of Large Language Models EMNLP 2024
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NIPS 2024
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack NIPS 2024
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NIPS 2024
Focused Transformer: Contrastive Training for Context Scaling NIPS 2023
Random-Access Infinite Context Length for Transformers NIPS 2023
Black-box language model explanation by context length probing ACL 2023
Making the Most Out of the Limited Context Length: Predictive Power Varies with Clinical Note Type and Note Section ACL 2023
Scaling Law for Document Neural Machine Translation EMNLP 2023
Long-Range Language Modeling with Selective Cache EMNLP 2023
Classification of Adolescents’ Risky Behavior in Instant Messaging Conversations AISTATS 2023
∞-former: Infinite Memory Transformer ACL 2022
Mediators in Determining what Processing BERT Performs First NAACL 2021