long context

Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization ACL 2024 Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding NeurIPS 2024 Functional Interpolation for Relative Positions improves Long Context Transformers ICLR 2024 GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models EMNLP 2024 Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs ICLR 2024 HyperAttention: Long-context Attention in Near-Linear Time ICLR 2024 In-context Autoencoder for Context Compression in a Large Language Model ICLR 2024 InfiniPot: Infinite Context Processing on Memory-Constrained LLMs EMNLP 2024 Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP EMNLP 2024 KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches EMNLP 2024 L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024 Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning NeurIPS 2024 LLoCO: Learning Long Contexts Offline EMNLP 2024 Long-Context Language Modeling with Parallel Context Encoding ACL 2024 LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression ACL 2024 LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference EMNLP 2024 Make Your LLM Fully Utilize the Context NeurIPS 2024 Marathon: A Race Through the Realm of Long Context with Large Language Models ACL 2024 Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk EMNLP 2024 Mixture of In-Context Experts Enhance LLMs' Long Context Awareness NeurIPS 2024 QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism EMNLP 2024 Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach EMNLP 2024 Retrieval meets Long Context Large Language Models ICLR 2024 Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration ACL 2024