long context

LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs ICLR 2025 MadaKV: Adaptive Modality-Perception KV Cache Eviction for Efficient Multimodal Long-Context Inference ACL 2025 MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference NAACL 2025 MELODI: Exploring Memory Compression for Long Contexts ICLR 2025 MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference ACL 2025 Mitigate Position Bias in LLMs via Scaling a Single Hidden States Channel ACL 2025 Mitigating Posterior Salience Attenuation in Long-Context LLMs with Positional Contrastive Decoding ACL 2025 MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention ICML 2025 Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Models NAACL 2025 Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention ACL 2025 Needle Threading: Can LLMs Follow Threads Through Near-Million-Scale Haystacks? ICLR 2025 Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning ICLR 2025 OkraLong: A Flexible Retrieval-Augmented Framework for Long-Text Question Answering EMNLP 2025 One-Minute Video Generation with Test-Time Training CVPR 2025 Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios NAACL 2025 POSITION BIAS MITIGATES POSITION BIAS: Mitigate Position Bias Through Inter-Position Knowledge Distillation EMNLP 2025 PRISM: Efficient Long-Range Reasoning With Short-Context LLMs EMNLP 2025 Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model ICLR 2025 QuickLLaMA: Query-aware Inference Acceleration for Large Language Models COLING 2025 Re3Syn: A Dependency-Based Data Synthesis Framework for Long-Context Post-training ACL 2025 Rethinking Long Context Generation from the Continual Learning Perspective COLING 2025 Revealing and Mitigating the Local Pattern Shortcuts of Mamba ACL 2025 Revisiting In-Context Learning with Long Context Language Models ACL 2025 Scaling up the State Size of RNN LLMs for Long-Context Scenarios ACL 2025 SCBench: A KV Cache-Centric Analysis of Long-Context Methods ICLR 2025