Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs

Idan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman · 2025

Read Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs by Idan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12181.txt.

Introduction

Idan Lev-Yehudi and four co-authors sharpen tree search planning for robots that must act under uncertainty in continuous worlds, in this 2025 paper. Monte Carlo tree search scales by sampling, but most versions pick actions blindly where smooth models would allow gradient guidance. Their framework grafts local gradient refinement onto the global search while keeping value estimates honest.

Three theoretical pieces support the design. A theorem gives the gradient of action scores under particle based beliefs. A sampling tree reuses old samples when action branches update, avoiding estimate drift. And a calculus formula supplies tractable gradients for smooth simulators. On hard continuous planning benchmarks, both fully and partially observable, the method beat leading sample based solvers. The authors aim it at autonomous systems that plan online.

Catalog record

CREATORIdan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE147 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-12181

Browse the full library · About the Tower of Babel