Did You Forget What I Asked? Prospective Memory Failures in Large Language Models

Avni Mittal · 2026

Read Did You Forget What I Asked? Prospective Memory Failures in Large Language Models by Avni Mittal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23530.txt.

Introduction

Mittal studies why language models drop formatting orders while busy with hard tasks. She frames the slip as a prospective memory failure, borrowed from mind science. Across three model families and 8,000 prompts, rule following falls as task load grows. End-of-answer rules suffer most, with drops near half. Avoidance rules hold up far better. A clearer frame plus a trailing reminder restores most lost compliance. The load cuts both ways: one model's math score fell from 93 to 27 percent under format rules.

Catalog record

CREATORAvni Mittal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57129
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23530

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Did You Forget What I Asked? Prospective Memory Failures in Large Language Models Avni Mittal Abstract Large language models often fail to satisfy formatting instructions when they must simultaneously perform demanding tasks. We study this behavior through a prospective memory -inspired lens from cognitive psychology, using a controlled paradigm that combines verifiable formatting constraints with benchmark tasks of increasing complexity. Across three model families and over 8,000 prompts, compliance drops by 2–21% under concurrent task load. Vulnerability is highly type-dependent: terminal constraints (requiring action at the response boundary) degrade most, with drops up to 50%, while avoidance constraints remain comparatively robust. A salience-enhanced format (explicit instruction framing plus a trailing reminder) recovers much of the lost compliance, restoring performance to 90–100% in many settings. Interference is bidirectional: formatting constraints can also reduce task accuracy, with one model’s GSM8K accuracy dropping from 93% to 27%. In additional stacking experiments, joint compliance declines sharply as constraints accumulate. All results use deterministic programmatic checkers, with no LLM-as-judge component, on publicly available datasets. 1 Introduction Large language models are increasingly used in settings where users provide behavioral or formatting constraints alongside substantive requests. A typical prompt might ask for an explanation while also requiring a specific output form (e.g., all capitals, a required ending phrase, or a fixed number of bullets). Users expect the model to preserve such constraints throughout generation. In practice, models often produce strong content while violating the requested format. We study this pattern as a functional analog of prospective memory (PM): remembering to execute a deferred intention at the appropriate future point 4 . In humans, PM failures increase under cognitively demanding intervening tasks; this is often discussed as a cognitive-load effect. Our paper asks whether an analogous behavioral pattern appears in LLMs when instruction maintenance and task solving must be carried out together. To test this, we compose verifiable IFEval-style constraints with benchmark tasks spanning low to high operational load (TriviaQA, MMLU, GSM8K, CNN/DailyMail). We evaluate both instruction compliance and task correctness with deterministic code-based checkers, avoiding LLM-as-judge components. Importantly, our load ordering is operational rather than a definitive cognitive scale, so we interpret load effects behaviorally. Across three models from distinct architecture families and over 8,000 evaluated prompts, we find: 1. Systematic forgetting under concurrent load. Compliance drops 2–21% when models must solve an additional task, with vulnerability varying sharply by instruction type (terminal constraints are most affected; avoidance constraints are nearly immune). 2. A simple mitigation via salience. A salience-enhanced prompt format recovers most lost compliance, restoring performance to 90–100% in many settings. 3. Dual-task tradeoffs and scaling fragility. Interference is bidirectional (format constraints can reduce task accuracy, e.g., GSM8K 93% to 27%), and joint compliance declines as multiple constraints are stacked. Figure 1: Overview of the experimental pipeline. A verifiable formatting constraint from IFEval is composed with a benchmark task of varying difficulty (TriviaQA, MMLU, GSM8K, or CNN/DailyMail) using either the natural embedding template or the salience-enhanced reminder template. The model’s response is then evaluated along two independent axes: (1) deterministic IFEval compliance checking (strict and loose) and (2) task-specific accuracy verification. This dual-evaluation design enables simultaneous measurement of prospective memory failure (compliance drop) and dual-task interference (accuracy drop). 2 Related Work Instruction Following, Salience, and Robustness. IFEval 23 established a practical, checker-based protocol for verifiable instruction compliance. More recent benchmarks broaden this picture: FollowBench shows that performance degrades as constraints are incrementally added 8 , while AGENTIF evaluates long, highly constrained agentic prompts 15 . In parallel, work on instruction prioritization and robustness shows that failures can arise from conflict resolution or adversarial pressure rather than pure forgetting 19 ; 22 ; 20 . We focus on a complementary failure mode: non-adversarial forgetting under concurrent task load. Prospective Memory and Dual-Task Interference. Our framing follows prospective-memory theory. Beyond the multiprocess account 4 ; 14 , PAM-style evidence shows measurable ongoing-task costs when deferred intentions must be maintained 18 . Additional studies show that interference scales with intention characteristics and task complexity 13 . This aligns with our finding that instruction type and concurrent-load level modulate both compliance and task accuracy. Methodologically, this perspective is consistent with the broader line of treating LLMs as subjects in cognitive experiments 1 ; 9 . Long-Context and Retrieval Failures. Prior long-context work, including Lost in the Middle 11 , documents strong position sensitivity in retrieval from long prompts. RULER further shows that long-context performance can degrade sharply on harder compositional retrieval tasks 7 . Separately, GSM-IC demonstrates that irrelevant context can substantially harm reasoning accuracy 17 . Our setting differs: the instruction is salient and fixed in position, but compliance still drops as concurrent demands rise, pointing to generation-time intention maintenance rather than pure retrieval failure. Prompt Salience and Evaluation Reliability. Prompt ordering and template choices materially affect model behavior, supporting reminder-based interventions 2 ; 5 ; 12 . At evaluation time, LLMBar highlights weaknesses in judge-based assessment 21 , reinforcing the value of deterministic, code-based checkers used in our experiments. 3 Methodology Figure 1 provides an overview of our experimental pipeline. 3.1 Problem Formulation Given a prompt containing a formatting instruction I and a task T , the model produces response R . We measure compliance rate CR , defined as the fraction of responses passing the deterministic IFEval checker, and define the forgetting delta : \Delta=CR(I_{\text{alone}})-CR(I+T) (1) Positive \Delta indicates the additional task caused the model to forget the instruction. 3.2 Composition Framework Instructions (IFEval). We use 15 of IFEval’s 25 instruction types, selected for compatibility with task composition (the full list is given in Table 5 , Appendix A ). These span seven categories: case constraints, keyword requirements, terminal actions, structural formatting, avoidance rules, counting constraints, and length limits. Distraction tasks. We pair each IFEval constraint with a benchmark task at one of four cognitive load levels: TriviaQA (factual recall, low load), MMLU (multiple-choice reasoning, medium), GSM8K (multi-step arithmetic, high), and CNN/DailyMail (long-context summarization). 3.3 Primary Experiment: Natural Embedding Each IFEval prompt already contains both a task and a constraint (e.g., “Write an essay about Java. Use all capital letters.”). We append additional benchmark tasks using a neutral transition: Natural Embedding Template { original IFEval prompt with embedded constraint } Additionally, please also complete the following: { benchmark question } The baseline is the original IFEval prompt with no added task. The only variable between the baseline and the experimental conditions is the appended workload; the instruction format and salience are identical. 3.4 Mitigation Experiment: Adding a Reminder We test whether a simple prompt modification can recover compliance. We extract the constraint from IFEval metadata and present it with explicit framing and a trailing reminder sentence: Reminder Template IMPORTANT FORMATTING INSTRUCTION: { extracted constraint text } Now please help me with the following task: { benchmark question } Remember to follow ALL of my formatting instructions above. This adds two modifications relative to the natural condition: (1) the “IMPORTANT FORMATTING INSTRUCTION:” prefix, and (2) the trailing reminder. Together, these test whether instruction salience , i.e., making the constraint more prominent, can mitigate forgetting. 3.5 Evaluation All evaluation is fully deterministic and uses code-based checkers with no LLM-as-judge component. IFEval compliance. Each of the 15 constraint types

Read the complete text