Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs
Idan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman · 2025
Read Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs by Idan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12181.txt.
Introduction
Idan Lev-Yehudi and four co-authors sharpen tree search planning for robots that must act under uncertainty in continuous worlds, in this 2025 paper. Monte Carlo tree search scales by sampling, but most versions pick actions blindly where smooth models would allow gradient guidance. Their framework grafts local gradient refinement onto the global search while keeping value estimates honest.
Three theoretical pieces support the design. A theorem gives the gradient of action scores under particle based beliefs. A sampling tree reuses old samples when action branches update, avoiding estimate drift. And a calculus formula supplies tractable gradients for smooth simulators. On hard continuous planning benchmarks, both fully and partially observable, the method beat leading sample based solvers. The authors aim it at autonomous systems that plan online.
Catalog record
| CREATOR | Idan Lev-Yehudi, Michael Novitsky, Moran Barenboim, Ron Benchetrit, Vadim Indelman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 147 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-12181