TriggerBench: Investigating Prospective Memory for Large Language Models
Abstract
AbstractWhile Large Language Models (LLMs) are increasingly deployed in long interactions, existing evaluations focus predominantly on retrospective memory (RM) via explicit queries. Prospective memory (PM), the ability to spontaneously recall and act on latent constraints without direct requests, remains largely unevaluated. We introduce **TriggerBench**, a five-dimensional PM benchmark across daily assistants and professional workflows. TriggerBench pairs scenarios with matched RM controls, contrastive positive/negative variants, and overloaded triggers, enabling fine-grained measurement of proactive recall, false-alarm rate, and attentional robustness. We find: (i) PM shows a precision-recall trade-off and attentional fragility. Though enhanced reasoning improves proactive recall, models can overfit to always-remind heuristics. Furthermore, PM accuracy degrades substantially under implicit constraints or triggers overloaded by concurrent requests, indicating that robust PM remains an open challenge. (ii) PM is notably harder than RM: on identical contexts, RM remains near-saturated up to 100K tokens, while PM decays sharply as context length increases. (iii) PM may serve as a behavioral probe of spare reasoning capacity. Pairing PM with AIME-2025 math problems reveals that successful trajectories yield higher PM accuracy than failed ones at the same context length, showing PM is a behavioral correlate of spare reasoning budget that token count obscures. Project page: https://github.com/KristenZHANG/TriggerBench-Official.