conftrace_

long context

121 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) question answering (2963) attention mechanism (4001) context window (73) retrieval-augmented generation (1592) kv cache (74) efficient computing (781) information retrieval (1514) context length (48)

Papers

Mixture of In-Context Experts Enhance LLMs' Long Context Awareness NIPS 2024
StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses NIPS 2024
Base of RoPE Bounds Context Length NIPS 2024
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression ACL 2024
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending ACL 2024
Marathon: A Race Through the Realm of Long Context with Large Language Models ACL 2024
Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization ACL 2024
Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning NIPS 2024
An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding NIPS 2024
BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language Models COLING 2024
Effective Long-Context Scaling of Foundation Models NAACL 2024
X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024
L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024
∞Bench: Extending Long Context Evaluation Beyond 100K Tokens ACL 2024
Long-Context Language Modeling with Parallel Context Encoding ACL 2024
Where am I? Large Language Models Wandering between Semantics and Structures in Long Contexts EMNLP 2024
Systematic Evaluation of Long-Context LLMs on Financial Concepts EMNLP 2024
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches EMNLP 2024
LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024
Can’t Remember Details in Long Documents? You Need Some R&R EMNLP 2024
GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models EMNLP 2024
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems EMNLP 2024
SnapKV: LLM Knows What You are Looking for Before Generation NIPS 2024
Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration ACL 2024
Evaluating Very Long-Term Conversational Memory of LLM Agents ACL 2024