Regret-Guided Search Control for Efficient Learning in AlphaZero

Yun-Jui Tsai, Wei-Yu Chen, Yan-Ru Ju, Yu-Hung Chang, Ti-Rong Wu · 2026

Read Regret-Guided Search Control for Efficient Learning in AlphaZero by Yun-Jui Tsai, Wei-Yu Chen, Yan-Ru Ju, Yu-Hung Chang, Ti-Rong Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20809.txt.

Description

Yun-Jui Tsai and four co-authors borrow a human learning trick for AlphaZero-style agents: revisit the positions where you went wrong, rather than always starting fresh. Earlier search-control work sampled past states evenly, ignoring which states held the most learning value.

Their Regret-Guided Search Control adds a regret network that spots high-regret states. These are states where the agent's judgment diverged most from the true outcome. The states go into a priority buffer for reuse as new starting points. Across 9x9 Go, 10x10 Othello, and 11x11 Hex it beats AlphaZero and Go-Exploit by 77 and 89 Elo on average. It also lifts a strong Go model against KataGo from about 69 percent wins to about 78 percent.

Catalog record

CREATORYun-Jui Tsai, Wei-Yu Chen, Yan-Ru Ju, Yu-Hung Chang, Ti-Rong Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-20809

Browse the full library · About the Tower of Babel