conftrace_

long context

121 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) question answering (2963) attention mechanism (4001) context window (73) retrieval-augmented generation (1592) kv cache (74) efficient computing (781) information retrieval (1514) context length (48)

Papers

Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP EMNLP 2024
SEGMENT+: Long Text Processing with Short-Context Language Models EMNLP 2024
LLoCO: Learning Long Contexts Offline EMNLP 2024
Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens EMNLP 2024
LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference EMNLP 2024
InfiniPot: Infinite Context Processing on Memory-Constrained LLMs EMNLP 2024
Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk EMNLP 2024
Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach EMNLP 2024
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism EMNLP 2024
Make Your LLM Fully Utilize the Context NIPS 2024
TableLlama: Towards Open Large Generalist Models for Tables NAACL 2024
Focused Transformer: Contrastive Training for Context Scaling NIPS 2023
HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution NIPS 2023
Improving Long Context Document-Level Machine Translation ACL 2023
∞-former: Infinite Memory Transformer ACL 2022
Coherence boosting: When your pretrained language model is not paying enough attention ACL 2022
LawngNLI: A Long-Premise Benchmark for In-Domain Generalization from Short to Long Contexts and for Implication-Based Retrieval EMNLP 2022
Locality-Sensitive Hashing for Long Context Neural Machine Translation ACL 2022
Long Context Question Answering via Supervised Contrastive Learning NAACL 2022
SAS: Dialogue State Tracking via Slot Attention and Slot Information Sharing ACL 2020
Bidirectional Recurrent Neural Network with Attention Mechanism for Punctuation Restoration INTERSPEECH 2016