Emergent Bayesian Behaviour and Optimal Cue Combination in LLMs
Julian Ma, Jun Wang, Zafeirios Fountas, [1.0em] Huawei Noah’s Ark Lab, London, UK · 2025
Read Emergent Bayesian Behaviour and Optimal Cue Combination in LLMs by Julian Ma, Jun Wang, Zafeirios Fountas, [1.0em] Huawei Noah’s Ark Lab, London, UK (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02719.txt.
Introduction
Julian Ma, Jun Wang, and Zafeirios Fountas test whether language models quietly reason like good statisticians. Humans combine noisy cues in near optimal Bayesian ways in perception tasks, without being taught the math. Explicit reasoning in models is well studied, but their implicit strategies are not.
The team asks if models blend multimodal cues optimally without instruction or special training. Emergent Bayesian behavior would suggest models absorb sound uncertainty handling from data alone. Findings here inform how much to trust model judgments under noise, a daily issue in medicine, law, and finance applications. Trust in a tool grows when its gut calls match the math a good judge would use on the same facts.
Catalog record
| CREATOR | Julian Ma, Jun Wang, Zafeirios Fountas, [1.0em] Huawei Noah’s Ark Lab, London, UK |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-02719
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Emergent Bayesian Behaviour and Optimal Cue Combination in LLMs Julian Ma, Jun Wang, Zafeirios Fountas, [1.0em] Huawei Noah’s Ark Lab, London, UK Abstract Large language models (LLMs) excel at explicit reasoning, but their implicit computational strategies remain underexplored. Decades of psychophysics research show that humans intuitively process and integrate noisy signals using near-optimal Bayesian strategies in perceptual tasks. We ask whether LLMs exhibit similar behaviour and perform optimal multimodal integration without explicit training or instruction. Adopting the psychophysics paradigm, we infer computational principles of LLMs from systematic behavioural studies. We introduce a behavioural benchmark - BayesBench: four magnitude estimation tasks (length, location, distance, and duration) over text and image, inspired by classic psychophysics, and evaluate a diverse set of nine LLMs alongside human judgments for calibration. Through controlled ablations of noise, context, and instruction prompts, we measure performance, behaviour and efficiency in multimodal cue-combination. Beyond accuracy and efficiency metrics, we introduce a Bayesian Consistency Score that detects Bayes-consistent behavioural shifts even when accuracy saturates. Our results show that while capable models often adapt in Bayes-consistent ways, accuracy does not guarantee robustness. Notably, GPT-5 Mini achieves perfect text accuracy but fails to integrate visual cues efficiently. This reveals a critical dissociation between capability and strategy, suggesting accuracy-centric benchmarks may over-index on performance while missing brittle uncertainty handling. These findings reveal emergent principled handling of uncertainty and highlight the correlation between accuracy and Bayesian tendencies. We release our psychophysics benchmark and consistency metric as evaluation tools and to inform future multimodal architecture designs 1 1 1 Project webpage: https://bayes-bench.github.io . 1 Introduction The estimation of magnitudes, including quantities like length, duration, or distance, represents one of the most fundamental computations in biological and artificial intelligence. Humans perform these judgments through the Bayesian integration of noisy sensory signals, automatically weighting cues by their reliability ( 2 ) and incorporating prior expectations to minimise estimation error ( 22 ; 10 ) . This computational strategy emerges without explicit instruction across diverse cultures and developmental stages, suggesting it reflects a fundamental solution to information processing under uncertainty. This universality raises the critical question of whether modern LLMs, trained solely on next-token prediction without explicit perceptual objectives ( 21 ) , spontaneously develop analogous computational strategies. Understanding how LLMs process and integrate uncertain information has immediate implications for building robust multimodal systems that appropriately handle varying input quality ( 9 ; 15 ) . Figure 1: Comparison of LLMs vs human behaviour A: Llama-4 Maverick in one of the line length ratio estimation experiments. The fitted lines are based on a static Bayesian observer model. Light dots are individual data points B: Response from typical human psychophysics studies (adapted from 25 ). We see in both that there is a regression to the mean effect, where responses are biased towards the centre of the stimulus range. 2 Related Work To investigate this, we apply classical psychophysics methodology ( 18 ) to probe these implicit computational strategies in LLMs, treating them as black-box observers and inferring their mechanisms from systematic behavioural analysis. By controlling stimulus uncertainty and measuring characteristic signatures of Bayesian processing, we can determine whether LLMs exhibit human-like optimal perception without explicit training. We found that classic identity mapping tasks, prevalent in psychophysics studies, transfer well to experiments with LLMs and reveal a rich set of patterns. We demonstrate that these controlled tasks serve as necessary ’unit tests’ for multimodal robustness. Unlike naturalistic tasks where noise is unquantifiable, our protocol enables controlled ablations that test for optimal integration strategies, exposing brittleness invisible to standard benchmarks. We present three contributions: 1) We introduce a systematic psychophysics framework for LLMs, a reproducible pipeline for four synthetic magnitude estimation tasks probing length, location, distance, and duration. Our pipeline allows controlled ablations of noise, context, and instruction prompts to track behavioural changes. This framework can serve as infrastructure for future investigations bridging human psychophysics studies 2) We develop a new benchmark: BayesBench based on task performance, cue-combination efficiency, and Bayesian consistency computed with a novel Bayesian Consistency Scores 3) We demonstrate emergent Bayes-consistent behaviour in capable LLMs, while uncovering a critical ’Safety Gap’ where highly accurate models fail to adopt robust strategies. Human psychophysics. The quantitative study of perception has revealed systematic relationships between physical stimuli and perceptual judgements, formalised in classical laws like Weber-Fechner’s logarithmic scaling and Vierordt’s temporal regression effects ( 3 ; 26 ; 7 ; 8 ; 23 ; 24 ; 6 ) . These phenomena, including scalar variability and sequential biases, emerge from optimal Bayesian inference under uncertainty ( 19 ) . Recent computational models further suggest that these perceptual biases, particularly in time perception, are intrinsically supported by predictive mechanisms in episodic memory 5 . When observers estimate magnitudes, they automatically combine noisy measurements with prior expectations, producing characteristic behavioural patterns. Figure 1 illustrates this regression-to-the-mean effect in both Llama-4 Maverick’s responses and human psychophysics data—evidence of shared computational principles despite vastly different substrates, as we will see in later sections. LLMs and Bayesian behaviour. Certain aspects of LLMs are shown to be consistent with Bayesian computation. For example, in-context learning can be interpreted as approximate Bayesian inference ( 28 ) and, in reasoning, Bayesian teaching is shown to improve performance ( 20 ) . Similarly, LLMs spontaneously segment sequences using Bayesian surprise in ways that correlate with human event perception ( 12 ; 4 ) . However, most studies probe explicit reasoning or learned behaviours, where models can leverage acquired statistical rules, rather than perceptual tasks that could reveal computational strategies emerging implicitly from pretraining. Multimodal studies. Progress have been rapid in developing multimodal LLMs, alongside this is the deployment of benchmarks such as MMbench ( 14 ) and SEED-bench ( 13 ) that test multimodal reasoning. However, most of these benchmarks do not cover controlled manipulations of modality specific noise for studying fusion strategies. Our synthetic datasets allow fine-grained cue-combination analysis and studies how LLMs combine noisy information from multiple modalities. This is still a nascent area of research but crucial for better understanding how we may build more robust and generalisable models that will behave optimally under uncertainty. 3 Methods 3.1 Estimation tasks and ablations We develop four psychophysics-inspired magnitude–estimation tasks illustrated in Figure 2 : • Marker location estimation: given a line with a red marker (or ‘0’ in text input) estimate the position of a marker on a line as a number between 0 to 1. • Line ratio estimation: given two lines, estimate the ratio of the shorter line to the longer line. • Maze distance estimation: given a non-self-intersecting path, estimate the straight line distance between start and the end of the path. • Duration estimation: given an extract of a conversation transcript, estimate the duration of the dialogue. Transcripts are extracted from the AMI Meeting Corpus 11 . The first three tasks are multimodal, with text input and image inputs. We conduct ablations to probe LLMs and analyse changes in behaviours (see Appendix A.3 for ablation details): • Steering: provide additional textual or numerical information in the system prompt. Aimed at studying how LLMs behaviour changes when asked to consider uncertainty in its responses. • Noise: add constant or gradually increasing blur to the image