From Roots to Rewards: Dynamic Tree Reasoning with RL
Ahmed Bahloul, Simon Malberg · 2025
Read From Roots to Rewards: Dynamic Tree Reasoning with RL by Ahmed Bahloul, Simon Malberg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13142.txt.
Description
Ahmed Bahloul and Simon Malberg present in 2025 a reinforcement learning upgrade for tree shaped reasoning in language models. Step by step text reasoning can carry one early error all the way down, and lookup tools are hard to weave in. Tree methods that split a question into branches and weigh answers by confidence help. But the leading such framework builds its whole tree up front and tests every strategy at every node, wasting effort.
Their fix lets the tree grow as answers stream in. Live confidence scores steer which branches to extend. A learned policy picks each node's move: split the question, fetch outside facts, or merge results. The scheme keeps the older framework's weighted voting rigor while spending compute only where it pays. The authors pitch it as a more flexible mold for question answering in the wild.
Catalog record
| CREATOR | Ahmed Bahloul, Simon Malberg |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13142