ProcMEM: Learning Reusable Procedural Memory from Experience via Non-Parametric PPO for LLM Agents

Qirui Mi, Zhijian Ma, Mengyue Yang, Haoxuan Li, Yisen Wang, Haifeng Zhang, Jun Wang · 2026

Read ProcMEM: Learning Reusable Procedural Memory from Experience via Non-Parametric PPO for LLM Agents by Qirui Mi, Zhijian Ma, Mengyue Yang, Haoxuan Li, Yisen Wang, Haifeng Zhang, Jun Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01869.txt.

Description

Qirui Mi and colleagues stop agents from re-deriving solutions, giving them reusable skills learned from interaction without parameter updates. Their Skill-Pro formalizes a Skill-MDP turning episodic narratives into skills with activation, execution and termination conditions. Non-Parametric PPO uses gradients for generation and a PPO Gate for verification, keeping skills reusable without capability loss. Scoring keeps procedural memory compact and high quality. Tests in domain, across tasks and across agents show reuse rates and gains with extreme memory compression.

Catalog record

CREATORQirui Mi, Zhijian Ma, Mengyue Yang, Haoxuan Li, Yisen Wang, Haifeng Zhang, Jun Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57206
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01869

Browse the full library · About the Tower of Babel