long-context language modeling

long-context modeling (2) retrieval-augmented generation (2) landmark embedding (1) position-aware objective (1) chunking-free architecture (1) multi-stage learning (1) long-context language model (1) global context (1) fine-grained retrieval (1) differential attention (1)