Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Entity Blackboard: Structured Agent Memory for Long Document Summarization

AbstractHierarchical merging is commonly used to summarize long documents by splitting the input into chunks, summarizing each chunk independently, and merging the results into a final summary. However, because each chunk is processed independently, entity state changes across chunks are not tracked, leading to coherence and consistency issues in the final summary. We propose EntityBB (Entity Blackboard), an agent memory framework that equips chunk-based LLM summarizers with structured entity memory. During sequential chunk processing, the model records and updates entity states through tool calls, while automatic safeguards and model-driven rejection limit noisy writes. Experiments on three long document summarization benchmarks show that EntityBB consistently improves over a controlled hierarchical merging baseline across ROUGE and BERTScore, while NarrativeFactScore indicates improved source-grounded factuality. Targeted human and LLM-as-a-Judge evaluations further indicate fewer entity-level issues and higher judged summary quality.

More from EMNLP 2026

All EMNLP 2026 papers →