DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory
Wentao Qiu 1,2 Haotian Hu 1 Fanyi Wang 1 Jinwei Kong 1,3 Yu Zhang 1 1 StepOS 2 Xiamen University 3 ShanghaiTech University [email protected] {huhaotian,wangfanyi}@stepos.com · 2026
Read DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory by Wentao Qiu 1,2 Haotian Hu 1 Fanyi Wang 1 Jinwei Kong 1,3 Yu Zhang 1 1 StepOS 2 Xiamen University 3 ShanghaiTech University [email protected] {huhaotian,wangfanyi}@stepos.com (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15759.txt.
Introduction
Wentao Qiu and four colleagues present DimMem, a dimensional memory frame that beats the cost-versus-fidelity trade-off for language-model agents. DimMem stores a memory as a unit with fields for time, location, reason, purpose, and keywords. That structure powers dimension retrieval, update, and recall without histories in context. On LoCoMo-10 and LongMemEval-S it scores 81.43 percent and 78.20 percent, beating systems while cutting per-query cost by 24 percent. After tuning on the DimMem schema, a Qwen3-4B extractor tops LightMem with GPT-4.1-mini on benchmarks and rivals extractors.
Catalog record
| CREATOR | Wentao Qiu 1,2 Haotian Hu 1 Fanyi Wang 1 Jinwei Kong 1,3 Yu Zhang 1 1 StepOS 2 Xiamen University 3 ShanghaiTech University [email protected] {huhaotian,wangfanyi}@stepos.com |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63593 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15759
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory Wentao Qiu 1,2 Haotian Hu 1 Fanyi Wang 1 Jinwei Kong 1,3 Yu Zhang 1 1 StepOS 2 Xiamen University 3 ShanghaiTech University [email protected] {huhaotian,wangfanyi}@stepos.com Abstract Large language model (LLM) agents require long-term memory to leverage information from past interactions. However, existing memory systems often face a fidelity–efficiency trade-off: raw dialogue histories are expensive, while flat facts or summaries may discard the structure needed for precise recall. We propose DimMem , a lightweight dimensional memory framework that represents each memory as an atomic, typed, and self-contained unit with explicit fields such as time, location, reason, purpose, and keywords. This representation exposes the structure needed for dimension-aware retrieval, memory update, and selective assistant-context recall without storing full histories in the model context. Across LoCoMo-10 and LongMemEval-S, DimMem achieves 81.43% and 78.20% overall accuracy, respectively, outperforming existing lightweight memory systems while reducing LoCoMo per-query token cost by 24% . We further show that dimensional memory extraction is learnable by compact models: after fine-tuning on the DimMem schema, a Qwen3-4B extractor surpasses LightMem with GPT-4.1-mini on both benchmarks and reaches performance comparable to, or better than, much larger extractors in key settings. These results suggest that explicit dimensional structuring is an effective and efficient foundation for long-term memory in LLM agents. Github: github.com/ChowRunFa/DimMem Data: huggingface.co/datasets/wtqiu/DimMem-SFT Models: huggingface.co/wtqiu/DimMem-4B-LoCoMo | | DimMem-4B-LME 1 Introduction Large language model (LLM) agents are increasingly expected to act as persistent assistants: they must remember user preferences, past decisions, evolving facts, prior recommendations, and temporally grounded events across many sessions. This requirement has motivated a broad family of long-term memory systems that externalize interaction histories into retrievable stores ( 26 ; 46 ; 25 ) . Recent systems further improve efficiency by compressing dialogues into facts, summaries, linked memory units, or staged memory stores ( 2 ; 39 ; 4 ; 21 ) . However, results on long-term conversational benchmarks such as LoCoMo and LongMemEval show that agent memory is not merely a problem of storing more text or retrieving semantically similar passages ( 24 ; 36 ) . Queries often depend on when something happened, why a user changed a plan, where an event occurred, which person or object was involved, or whether the user is asking about a previous assistant response. Figure 1: Conceptual motivation of DimMem. Prior memory systems often store conversations as raw, flat, or entangled memory forms, making retrieval and update depend on incomplete or costly context. DimMem instead exposes key dimensions within each memory unit, enabling more direct retrieval, easier update, and compact extractor learning. Existing memory systems therefore face a fidelity–efficiency dilemma. Raw dialogue or large text chunks preserve context, but they are expensive to store, retrieve, update, and place into the model context. Flat extracted facts are efficient, but they often discard the temporal, causal, intentional, and contextual information needed for precise recall. More structured designs, such as graph-based or hierarchical memory systems, can recover relational structure, but they introduce additional construction and maintenance cost ( 37 ; 44 ; 38 ; 23 ) . A parallel line of work learns memory operations through parameterized policies, using supervised fine-tuning or reinforcement learning to decide when to create, read, update, or delete memories ( 9 ; 42 ; 40 ) . These approaches improve the control policy of memory management, but they still depend on the quality of the memory representation being controlled. If the stored unit does not expose time, reason, purpose, or memory type, downstream retrieval and update policies must infer these missing dimensions from an impoverished record. Figure 1 summarizes our central observation: long-term agent memory should be structured before it is retrieved, updated, or learned by a memory controller. Inspired by cognitive distinctions among episodic, semantic, and personal semantic memory ( 32 ; 33 ; 29 ) and by event-oriented 5W1H information structure ( 6 ) , we propose DimMem , a lightweight dimensional memory framework for LLM agents. DimMem represents each memory as an atomic, self-contained unit with an explicit memory type ( fact , episodic , or profile ) and decoupled dimensional fields including time , location , reason , purpose , and typed keywords . Rather than treating metadata as optional annotations, DimMem makes these fields the operational interface of the memory system. This dimensional representation enables three system-level capabilities. First, DimMem performs dimension-aware retrieval by parsing a user query into the same schema as memory records and combining lexical matching, smantic matching, and dimension scoring. This tri-path retrieval prevents semantically related but temporally or causally mismatched memories from dominating the context. Second, DimMem supports dimension-aware update: memory type, keywords, temporal order, and causal/purpose fields provide cheap structural filters for identifying redundant or conflicting memories before expensive embedding or LLM-based consolidation. Third, DimMem introduces dynamic assistant-memory recall. Assistant replies are not blindly embedded into every memory record; instead, the query parser predicts whether assistant context is needed and retrieves the corresponding source replies only on demand. DimMem also changes what is learned by a small model. Instead of training a model to choose memory CRUD actions, we train a compact extractor to produce high-quality dimensional memory records. This is important because memory extraction quality determines the substrate available to every later retrieval and update step. We fine-tune a 4B model on teacher-generated dimensional extraction examples and obtain a local structured extractor that learns the schema rather than merely imitating surface summaries. In our experiments, this fine-tuned 4B extractor reaches performance comparable to a much larger Qwen3-30B-A3B extractor, and in some settings even surpasses it, showing that dimensional memory extraction is a learnable capability rather than a privilege of proprietary or large-scale models. Empirically, DimMem demonstrates that explicit dimensional structure is a strong inductive bias for agent memory. Across LoCoMo-10 and LongMemEval-S, DimMem consistently outperforms existing lightweight memory systems, with the largest gains appearing on dimension-dependent cases such as temporal reasoning, multi-session reasoning, knowledge updates, and assistant-dependent recall. Ablations further confirm that the dimensional schema, dimension retrieval route, and reason/purpose fields are not cosmetic metadata: they directly improve retrieval precision, memory update quality, and context efficiency. Our contributions are summarized as follows: • Dimensional memory representation. We introduce DimMem, a lightweight long-term memory framework that represents each memory as an atomic, typed, and dimensionally structured record rather than a flat passage, summary, or isolated fact. • Dimension-aware memory operations. We design retrieval, update, and assistant-recall mechanisms that align parsed query intents with explicit memory dimensions, improving temporal, causal, multi-session, and assistant-dependent reasoning while reducing retrieval and update cost. • Learnable structured extraction. We show that high-quality dimensional memory extraction can be learned by a compact SFT model, and that extraction quality is crucial to end-to-end memory performance: a 4B extractor can approach or surpass larger general-purpose extractors when trained on the DimMem schema. 2 Related Work 2.1 Memory Systems for LLM Agents Long-term memory has long been studied through neural memory and retrieval-augmented models ( 35 ; 31 ; 5 ; 13 ; 1 ) . For LLM agents, however, memory must support not only factual recall but also personalization, temporal continuity, preference tracking, and knowledge updates across interactions. Existing agent memory systems externalize dialogue history into retrievable stores,