Skip to content
conftrace_
2026 EMNLP EMNLP 2026

MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Models

AbstractWith the surge of AI-powered real-world applications, large language models (LLMs) increasingly adopt memory-centric mechanisms to handle multi-turn interactive tasks. Under this paradigm, intermediate processing trajectories, i.e., memory, are central to ensuring LLMs’ faithfulness and effectiveness. Scalable evaluation of the memory management process serves as the cornerstone for further enhancing model performance. Yet, appropriate evaluators for the assessment of memory are currently lacking. Thus, in this work, we seek to employ reward models (RMs) as evaluators and introduce MemoryRewardBench, the first benchmark to systematically study the capability of RMs in assessing LLM memory management processes. MemoryRewardBench covers both long-form comprehension and generation tasks that simulate real-world multi-turn interaction scenarios, featuring 10 distinct settings with different memory management patterns. Evaluations on 13 cutting-edge RMs indicate a diminishing performance gap between open-source and proprietary models, with newer-generation models consistently outperforming their predecessors regardless of parameter count. Additionally, we reveal the fundamental limitations of RMs in evaluating LLMs’ memory.

More from EMNLP 2026

All EMNLP 2026 papers →