conftrace_

long-context training

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) long context (2) attention mechanism (2) question-answer dataset (1) long-context modeling (1) language model pretraining (1) context utilization (1) document concatenation (1) continual training (1) contextual dependency (1)

Papers

AdaSplash: Adaptive Sparse Flash Attention ICML 2025 LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs ACL 2025 NExtLong: Toward Effective Long-Context Training without Long Documents ICML 2025 Scaling Long Context Training Data by Long-Distance Referrals ICLR 2025 Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models ACL 2025 Base of RoPE Bounds Context Length NeurIPS 2024 Make Your LLM Fully Utilize the Context NeurIPS 2024