conftrace_

long-context training

4 papers

Explore in graph

Co-occurring keywords

large language model (13587) long context (121) attention mechanism (4001) question-answer dataset (1) language model pre-training (56) long-context modeling (34) context utilization (8) continual training (10) contextual dependency (5) long-context learning (6)

Papers

Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models ACL 2025

LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs ACL 2025

Make Your LLM Fully Utilize the Context NIPS 2024

Base of RoPE Bounds Context Length NIPS 2024