Bonsai : Interpretable Tree-Adaptive Grounded Reasoning

Kate Sanders, Benjamin Van Durme · 2025

Read Bonsai : Interpretable Tree-Adaptive Grounded Reasoning by Kate Sanders, Benjamin Van Durme (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03640.txt.

Introduction

Kate Sanders and Benjamin Van Durme present Bonsai in this 2025 paper, a reasoning system that shows its work instead of hiding it. Helpful AI partners must adapt to new domains and reason openly about doubt, so people can check and fix them. Black-box models fail that brief. Bonsai builds inference trees: it pulls grounding evidence, breaks a claim into sub-claims, and scores each with likelihoods.

Its reasoning strength can be dialed at test time by scaling how much evidence it gathers. The system handled transcripts, photos, video, audio, and databases without domain-specific builds. On question answering and human alignment tests, it matched specialist black-box methods. The difference is the trace: every answer comes with an inspectable, grounded chain that carries its uncertainty on its sleeve.

Catalog record

CREATORKate Sanders, Benjamin Van Durme
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03640

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bonsai : Interpretable Tree-Adaptive Grounded Reasoning Kate Sanders, Benjamin Van Durme Abstract To develop general-purpose collaborative agents, humans need reliable AI systems that can (1) adapt to new domains and (2) transparently reason with uncertainty to allow for verification and correction. Black-box models demonstrate powerful data processing abilities but do not satisfy these criteria due to their opaqueness, domain specificity, and lack of uncertainty awareness. We introduce Bonsai , a compositional and probabilistic reasoning system that generates adaptable inference trees by retrieving relevant grounding evidence and using it to compute likelihoods of sub-claims derived from broader natural language inferences. Bonsai ’s reasoning power is tunable at test-time via evidence scaling and it demonstrates reliable handling of varied domains including transcripts, photographs, videos, audio, and databases. Question-answering and human alignment experiments demonstrate that Bonsai matches the performance of domain-specific black-box methods while generating interpretable, grounded, and uncertainty-aware reasoning traces. 1 Introduction Human professionals often write full documents describing the veracity and scope of individual claims, while many AI systems consider them to simply be true or false. To be useful in practical settings, reasoning systems must be able to model concerns like subjectivity, epistemic uncertainty, and ambiguity in natural language statements, and should be able to identify which portions of the statements these concerns apply to. Furthermore, these systems should be robust to knowledge sources of different modalities, as in many settings a grounding source may be a research report, a photograph, or a news article with embedded video clips. With these ideas in mind we introduce Bonsai , an adaptable reasoning tree generator for transparent, grounded, and probabilistic inference. Bonsai introduces a set of key design choices that enable sophisticated interpretable reasoning. First, Bonsai extends the “evidence extraction” paradigm – in which natural language summaries of complex or out-of-distribution source documents are generated as data to reason over ( Li et al., 2024a ) – to multimodal content. It accomplishes this by mapping non-textual data to evidence banks of natural language observations which it draws from during reasoning. Bonsai applies contextual conditioning to generated observations to mitigate the well-documented issue of perspective and attention ambiguity in multimodal domains ( Zur et al., 2024 ) . Bonsai accounts for uncertainty and subjectivity in data by replacing categorical labels used in traditional claim verification (“true”, “false”, etc.) with scalar likelihood scores. We introduce an iterative approach to scalar likelihood score calculation using retrieved evidence samples as explanatory conditional variables, inspired by Tversky & Kahneman (1974) ’s “anchoring and adjustment” framework for human judgments. This approach integrates naturally with chain-of-thought ( Wei et al., 2022 ) and allows Bonsai to behave as an evidence-grounded adaptable prediction system ( Mohri & Hashimoto, 2024 ; Jiang et al., 2025 ) that can restructure its output depending on risk threshold. Figure 1: A reasoning tree over a news video as a grounding source. Bonsai recursively decomposes natural language statements about data into small, verifiable pieces. It uses retrieved evidence samples from multimodal knowledge sources to iteratively score these pieces in terms of how likely each piece is. This procedure results in grounded likelihood scores for leaves of compositional tree structures representing the original claim, alongside natural language explanations. Low-scoring branches of a reasoning tree may then be pruned, shown by the strikethrough text in the original statement and sub-claims. Finally, Bonsai outputs grounded, natural language explanations for each sub-claim judgment, which may be propagated upwards to generate likelihood scores and explanations for any set of sub-claims. Since Bonsai decomposes claims into tree structures (shown in Figure 1 ) this enables straightforward human analysis and quick correction of intermediate sub-claims, in contrast to individually assessing every atomic claim, one-by-one. Using tree structures, contextualized evidence extraction may also be computed at arbitrary levels of granularity, and through this we adapt test-time search scaling ( Zhao et al., 2025 ) to facilitate flexibility in performance-compute tradeoffs with test-time evidence search scaling. In summary, Bonsai is a transparent and probabilistic multimodal reasoning system that promotes three key ideas: (1) Mapping raw data to contextualized natural language observations enables high-performance modality-agnostic reasoning, (2) assigning sub-claims with probabilistic scalars enables adaptable prediction and nuanced reasoning over ambiguities, and (3) coupled with (1) and (2), a tree-based decomposition structure can enable impactful compute scaling and easy human-in-the-loop interpretation and corrections. Through experiments, we demonstrate that Bonsai enables state-of-the-art performance on both single- and multi-modal tasks such as EntailmentBank ( Dalvi et al., 2021 ) and TVQA ( Lei et al., 2018 ) , while crucially providing a fully grounded, human interpretable thought process. 2 Related Work 2.1 Probabilistic Reasoning with LLMs Earlier research in probability estimation has explored fine-tuning models on human probability judgments ( Chen et al., 2019 ) . Recent work has investigated if LLMs can perform probabilistic calculations, such as estimating percentiles and basic probability computations ( Paruchuri et al., 2024 ) , and even update belief states given new information ( Qiu et al., 2024 ) . The BIRD framework leverages LLM judgments for downstream probability inference ( Feng et al., 2024 ) , and Piriyakulkij et al. (2024) and Mo & Xin (2024) leverage Monte-Carlo algorithms. Notably, some approaches consider graph-centric probabilistic reasoning, either using explicit knowledge graphs ( Li et al., 2024b ) or graphs extracted via chain-of-thought reasoning ( Razghandi et al., 2025 ) . A growing body of work considers LM uncertainty quantification ( Xiao et al., 2022 ; Stengel-Eskin et al., 2024 ; Chen & Mueller, 2023 ; Wang et al., 2022 ) , some directly via prompting ( Tian et al., 2023 ; Xiong et al., 2023 ; Lin et al., 2022 ) . Some methods incorporate conformal prediction by considering object sets in their probabilistic reasoning ( Ozturkler et al., 2022 ) . Conformal prediction produces answer sets or intervals with assigned correctness probability scores ( Angelopoulos et al., 2023 ) . Many applications to language modeling have been identified in recent years: Quach et al. (2023) and Cherian et al. (2024) propose a framework for conformal language modeling, Mohri & Hashimoto (2024) leverage conformal prediction for correctness guarantees, and Jiang et al. (2025) introduce a pragmatics-inspired framework for factuality and specificity tradeoffs. 2.2 Transparent Reasoning While chain-of-thought ( Wei et al., 2022 ) and related approaches ( Besta et al., 2024 ; Yao et al., 2023 ; Xia et al., 2024 ) are critical to understanding LLM explanations, alongside the complementary vein of research in reasoning model traces ( Jaech et al., 2024 ; Guo et al., 2025 ; Muennighoff et al., 2025 ) , these methods generally lack the trustworthiness of fully transparent reasoning approaches ( Lanham et al., 2023 ; Yeo et al., 2024 ; Bentham et al., 2024 ) . Such lines of work include entailment tree generation, in which claims are recursively decomposed and verified through entailment using an underlying knowledge source ( Weir et al., 2022 ) , Proof of Thought, a first-order logic-inspired LLM approach ( Ganguly et al., 2024 ) , other tree- or graph-based reasoning methods ( Luo et al., 2023 ; Mei et al., 2024 ) such as those leveraging Monte-Carlo Tree Search ( Gao et al., 2024b ) , and other

Read the complete text