Empirical-MCTS: Continuous Agent Evolution via Dual-Experience Monte Carlo Tree Search

Hao Lu, Haoyuan Huang, Yulin Zhou, Chen Li, Ningxin Zhu · 2026

Read Empirical-MCTS: Continuous Agent Evolution via Dual-Experience Monte Carlo Tree Search by Hao Lu, Haoyuan Huang, Yulin Zhou, Chen Li, Ningxin Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04248.txt.

Description

Search that forgets teaches agents nothing between problems. Hao Lu and 4 co-authors give Monte Carlo tree search a memory in their 2026 framework, Empirical-MCTS. Standard search discards successful reasoning patterns after each instance, unlike human solvers who accumulate know-how.

Two mechanisms close the loop. A meta-prompting optimizer refines the search's own criteria from pairwise feedback during local exploration. A memory agent curates a global repository that acts as a policy prior for future searches. The dual loop turns stateless inference-time search into continuous, non-parametric learning, letting an agent's experience compound across problems.

Catalog record

CREATORHao Lu, Haoyuan Huang, Yulin Zhou, Chen Li, Ningxin Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04248

Browse the full library · About the Tower of Babel