conftrace_

context window

73 papers

Explore in graph

Co-occurring keywords

large language model (13587) long context (121) positional encoding (182) language model (4599) attention mechanism (4001) retrieval-augmented generation (1592) question answering (2963) in-context learning (1405) length extrapolation (31) rotary position embedding (32)

Papers

An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding NIPS 2024
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA EMNLP 2024
Memory-Augmenting Decoder-Only Language Models through Encoders (Student Abstract) AAAI 2024
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending ACL 2024
LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024
More Bang for your Context: Virtual Documents for Question Answering over Long Documents EMNLP 2024
Probing the Capacity of Language Model Agents to Operationalize Disparate Experiential Context Despite Distraction EMNLP 2024
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding ACL 2024
Extending Context Window of Large Language Models via Semantic Compression ACL 2024
Extending Context Window of Large Language Models from a Distributional Perspective EMNLP 2024
Augmenting Language Models with Long-Term Memory NIPS 2023
Parallel Context Windows for Large Language Models ACL 2023
The AISP-SJTU Simultaneous Translation System for IWSLT 2022 ACL 2022
ChapterBreak: A Challenge Dataset for Long-Range Language Models NAACL 2022
Context Limitations Make Neural Language Models More Human-Like EMNLP 2022
Dynamic Context Extraction for Citation Classification IJCNLP 2022
How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling EMNLP 2022
Revisiting the Context Window for Cross-lingual Word Embeddings ACL 2020
Context in Informational Bias Detection COLING 2020
Syntactic Interchangeability in Word Embedding Models NAACL 2019
Unsupervised Learning of Style-sensitive Word Vectors ACL 2018
A Deeper Look into Dependency-Based Word Embeddings NAACL 2018
Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understanding INTERSPEECH 2016