Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation
Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernández University of Amsterdam, MCML Munich, LMU Munich {j.s.baan,w.aziz,raquel.fernandez}@uva.nl , [email protected] · 2026
Read Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation by Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernández University of Amsterdam, MCML Munich, LMU Munich {j.s.baan,w.aziz,raquel.fernandez}@uva.nl , [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25831.txt.
Introduction
Baan, Aziz, Plank and Fernández present Belief-Augmented Generation, grounding models in their belief state. Sampling responses reveals what a model deems plausible, yet models rarely clarify or abstain, ignoring uncertainty. It feeds models their samples, letting them reason over them to choose to ask, hold back or answer. Across six models in multi-turn question answering, it improves accuracy and beats prompt-only baselines on faithfulness. Separating asking from holding back stays challenging.
Catalog record
| CREATOR | Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernández University of Amsterdam, MCML Munich, LMU Munich {j.s.baan,w.aziz,raquel.fernandez}@uva.nl , [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63190 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25831
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation Joris Baan, Wilker Aziz, Barbara Plank, Raquel Fernández University of Amsterdam, MCML Munich, LMU Munich {j.s.baan,w.aziz,raquel.fernandez}@uva.nl , [email protected] Abstract Large language models (LLMs) define a distribution over text, which can be viewed as a probabilistic representation of uncertainty: sampling K K responses yields a belief state —responses a model deems plausible. Existing work exploits this representation for narrow tasks like either decoding or selective prediction, and often requires manual interventions, not controlling generation directly. We propose Belief-Augmented Generation (BAG): grounding LLMs in their own belief state via the prompt and letting them reason over these K K samples to decide on a conversational strategy: answer, clarify, or abstain. In a multi-turn ambiguous QA setting, we find that LLMs by default rarely clarify or abstain, ignoring uncertainty about the input or facts. BAG improves QA accuracy across six models and yields strategy decisions more faithful to the belief state than prompt-only baselines. Disentangling when to clarify from when to abstain, however, remains challenging. 1 Introduction Large language models (LLMs) are statistical models that autoregressively define a distribution over text. This can be viewed as a probabilistic representation of uncertainty or belief Baan et al. 2023 . By drawing multiple samples we obtain a textual representation, i.e., belief state : responses a model deems plausible under a given prompt. Such representations are routinely and effectively used in decoding by selecting the highest expected utility or majority generation Eikema and Aziz 2020 ; Wang et al. 2023 ; in selective prediction when entropy across semantic clusters of generations is high Kuhn et al. 2023b ; or to communicate uncertainty reflective of the relative frequency of a claim in the belief state Yona et al. 2024 ; Eikema et al. 2025 . However, these applications require manual interventions ( e.g., decoders, uncertainty quantifiers, selective prediction heuristics, or finetuning) and focus on single, narrow decision-making tasks. Furthermore, we argue that it is unlikely that LLMs can ‘introspect’ or exploit their own probabilistic representation of uncertainty, since there is no mechanism in training or inference supporting this. Indeed, initial empirical evidence indicates that LLMs do not communicate uncertainty faithful to their distribution Yona et al. 2024 ; Kirchhof et al. 2025 . In this paper, we propose to give LLMs access to their own probabilistic belief state to power richer conversational strategies and improve responses in a multi-turn ambiguous question answering (QA) environment; see Figure 1 . Figure 1: Turn 1 : User asks a potentially ambiguous question. Turn 2 : BAG samples K responses, analyses them, and formulates a strategy and response. Turn 3 : BAG asked a clarification question so we simulate a user answer. Turn 4 : Final answer, optionally with another round of BAG. Real Qwen3-14B example. The key idea is simple: let LLMs reason over their own belief state, obtained via sampling, guiding them to clarify, abstain or answer directly—harnessing their strong ability to reason about available textual evidence as demonstrated in retrieval-augmented generation ( Lewis et al. 2020 , RAG; ). We call this Belief-Augmented Generation (BAG), grounding responses in the belief state (rather than external documents in RAG) via the prompt, letting the LLM decide when to answer, what strategy to follow, and how to formulate the answer all at once. BAG requires no training, no external data, and can be applied to any model, including closed models. We find that the six LLMs in our experiments by default rarely clarify or abstain and ignore uncertainty in the input ( e.g., ambiguity) and about facts. Belief-augmented generation improves QA performance, leading to strategies more faithful to probabilistic uncertainty. However, recognising when to clarify vs abstain remains challenging. Upon publication, we will release our code and an online tool to explore BAG’s output and conversations (see Appendix Figure 15 for a screenshot). 2 Related Work Decoding. One of the earliest works that exploit a textual representation of probabilistic belief ( i.e., K sampled generations) is Minimum Bayes Risk decoding (MBR), which selects the generation that best represents the entire set, demonstrating improved response quality Eikema and Aziz 2020 ; Suzgun et al. 2023 ; Wu et al. 2025 . Similarly, self-consistency samples multiple reasoning chains and pick the majority answer Wang et al. 2023 ; Bertsch et al. 2023 . Both can be viewed as test-time compute scaling Snell et al. 2025 . Selective prediction. Kuhn et al. 2023b ; Farquhar et al. 2024 instead capitalise on the idea that semantically distinct claims in the belief state may be indicative of error ( i.e., model or epistemic uncertainty)—an intuition widely used to detect hallucinations Geng et al. 2024 ; Vashurin et al. 2025 . Others view variation in belief states as uncertainty about the input ( Giulianelli et al. 2023 ; Baan et al. 2024 , i.e., data or aleatoric uncertainty; ), and there have been efforts to disentangle these sources Cole et al. 2023 ; Hou et al. 2024 . However, both decoding and selective prediction methods rely on hand-crafted features and their end goal is to predict error or select a generation rather than directly controlling generation. Faithful uncertainty. Another line of research guides models to communicate their uncertainty faithfully, i.e., hedge or strengthen a claim such that it reflects the relative frequency of that claim in the belief state Yona et al. 2024 ; Xu et al. 2024 ; Eikema et al. 2025 . Most similar to our work is Kirchhof et al. 2025 , who propose to communicate the full internal distribution over possible answers rather than hedging a single answer, and find directly conditioning on K samples in the prompt most effective. We go beyond hedging and let models reason over their own belief state to decide on more complex conversational strategies. Also similar is Nan et al. 2025 who condition a bigger, auxiliary model on another model’s belief state to analyse the source of its uncertainty. We instead let the same model reason about its own uncertainty to directly inform its generation process. Conversational strategies. LLMs use a limited range of conversational strategies and often answer directly, failing to recognize ambiguity or ask clarification questions, instead implicitly assuming an interpretation Deng et al. 2023 ; Shaikh et al. 2024 ; Zhang et al. 2024 ; Testoni et al. 2025 . While there have been attempts to remedy this via prompting Kuhn et al. 2023a ; Zhang et al. 2024 and fine-tuning Andukuri et al. 2024 ; Chen et al. 2025 , the belief state has been under-explored. Testoni and Fernández 2024 suggest that human clarification questions as supervision for deciding when and how to clarify may not be ideal to resolve model uncertainty, which is echoed by Kim et al. 2024 who finetune on questions ‘perceived’ by a model as ambiguous, and Zhang et al. 2025 who construct clarification questions via an external model prompted to separate K sampled generations. Zhang and Choi 2025 predict ambiguity via entropy over multiple simulated user responses without exploiting them for how to clarify, and do not allow abstaining. We focus on clarification to address ambiguity, but other valid strategies ( e.g., long form answers) are fully compatible