Skip to content
conftrace_

long-context modeling

48 papers

Papers

An Exploration of Mamba for Speech Self-Supervised Models ACL 2026 AraModernBERT: Transtokenized Initialization and Long-Context Encoder Modeling for Arabic EACL 2026 CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling ACL 2026 Latent-Condensed Transformer for Efficient Long Context Modeling ACL 2026 LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs AAAI 2026 PHOTON: Hierarchical Autoregressive Modeling for Lightspeed and Memory-Efficient Language Generation ACL 2026 REAL: REtrieval-reAsoning and Logic-constructed Attention Behaviors for Long-Context KV Cache Compression ACL 2026 SG-UniBuc-NLP at SemEval-2026 Task 6: Multi-Head RoBERTa with Chunking for Long-Context Evasion Detection SemEval 2026 3D-RPE: Enhancing Long-Context Modeling Through 3D Rotary Position Encoding AAAI 2025 A Training-Free Sub-quadratic Cost Transformer Model Serving Framework with Hierarchically Pruned Attention ICLR 2025 Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models COLING 2025 CHATTER: A character-attribution dataset for narrative understanding NAACL 2025 Core Context Aware Transformers for Long Context Language Modeling ICML 2025 Cost-Optimal Grouped-Query Attention for Long-Context Modeling EMNLP 2025 Curse of High Dimensionality Issue in Transformer for Long Context Modeling ICML 2025 Design Choices for Extending the Context Length of Visual Language Models ACL 2025 DINT Transformer EMNLP 2025 DocHPLT: A Massively Multilingual Document-Level Translation Dataset EMNLP 2025 FAEDKV: Infinite-Window Fourier Transform for Unbiased KV Cache Compression EMNLP 2025 FlashMask: Efficient and Rich Mask Extension of FlashAttention ICLR 2025 Forgetting Transformer: Softmax Attention with a Forget Gate ICLR 2025 Ko-LongRAG: A Korean Long-Context RAG Benchmark Built with a Retrieval-Free Approach EMNLP 2025 LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs ACL 2025 LAWCAT: Efficient Distillation from Quadratic to Linear Attention with Convolution across Tokens for Long Context Modeling EMNLP 2025 LongSafety: Enhance Safety for Long-Context LLMs ACL 2025