The Principle of Redundant Reflection

Martin Metodiev, Maarten Marsman, Lourens Waldorp, Quentin F. Gronau, and Eric-Jan Wagenmakers · 2025

Read The Principle of Redundant Reflection by Martin Metodiev, Maarten Marsman, Lourens Waldorp, Quentin F. Gronau, and Eric-Jan Wagenmakers (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21719.txt.

Introduction

Martin Metodiev and co-authors prove a neat foundation for Bayesian reasoning. Their principle says that information which adds nothing new must leave a rational belief unchanged. From that starting point, rational beliefs turn out to be updated by Bayes' rule. Working in a general framework, they show the result holds under mild conditions for discrete outcomes, continuous ones, and arbitrary measure spaces. Two examples illustrate the principle at work.

Catalog record

CREATORMartin Metodiev, Maarten Marsman, Lourens Waldorp, Quentin F. Gronau, and Eric-Jan Wagenmakers
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-21719

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Principle of Redundant Reflection Martin Metodiev, Maarten Marsman, Lourens Waldorp, Quentin F. Gronau, and Eric-Jan Wagenmakers Abstract The fact that redundant information does not update a rational belief implies that rational beliefs are updated using Bayes’ rule. In the framework of Hild (1998a), this is true under mild conditions for discrete, continuous, and arbitrary measure spaces. We prove this result and illustrate it with two examples. REDUNDANT REFLECTION There exist multiple arguments as to why rational beliefs must be updated using the laws of probability (e.g., the Cox axioms, Cox1946 ; Dutch book arguments, Ramsey1926 ; deFinetti19311989 ; closeness-to-the-truth arguments, Joyce1998 ; see also Jeffreys1939 ; Carnap1950 ). Our goal is to add another such argument based on a simple and intuitive rule that we term the principle of redundant reflection . The rule holds that once multiple accounts \theta of the world have been completely specified and assigned prior probabilities p(\theta) , the mere contemplation of potential future outcomes Y^{\star} (i.e., consideration of the prior predictive distribution) does not add novel information and therefore ought to leave the prior probabilities unaffected. In other words: the expected posterior probability (i.e., \mathbb{E}_{Y^{\star}\sim p(Y^{\star})}\left[p(\theta\,|\,Y^{\star})\right] ) equals the prior probability p(\theta) (e.g., Skyrms1997 ; Goldstein1983 ; VanFraassen1984 ; Chamley2004 ; Huttegger2017 ; see also CookEtAl2006 ; FongEtAl2024 ; GandyScott2021 ; Geweke2004 ; SchadEtAl2023 ; TaltsEtAl2018 ; WagenmakersGrasmansubm ; this is also known as the iteration principle , Hild1998a ; Hild1998b ; Spohn1978 , p. 161 ; Spohn2012 , p. 191 ). We refer to beliefs as rational if they are updated via this principle. Agents are rational if they use such an updating rule. The principle of redundant reflection follows immediately from the law of total probability. Let each potential future realization of discrete data be denoted y_{i}^{\star} . We then have \begin{split}\mathbb{E}_{Y^{\star}\sim p(Y^{\star})}\left[p(\theta\mid Y^{\star})\right]&=\sum_{i}p(\theta\mid y_{i}^{\star})\,p(y_{i}^{\star})\\ &=p(\theta).\end{split} This result also holds for continuous probability density functions (replacing sums by integrals). The result is intuitive because the prior predictive Y^{\star} is a direct consequence of the model definition: by specifying the model, the analyst indirectly also specifies the prior predictive distribution. If contemplating the prior predictive distribution would provide cause to adjust the prior probabilities, this can only mean that the original model specification was faulty or incomplete; a rational agent would have adjusted the models ex ante . In other words, the prior predictive is epistemically redundant given the model specification. In the statistical literature, the process of an unfolding posterior probability is known as a martingale and typifies a fair game ( deFinetti1974 , pp. 345–346 ; see also DeGroot1970 ; Skyrms1997 ; Ville1939 ; Doob1953 ; Doob1971 ; Levy1937 ). As stated by Doob1971 , “successive conditional expectations (…), as we know more and more, yield a martingale. (…)the game man plays with nature as he learns more and more is fair.” The examples below highlight the delicate balance of factors that is required such that the expected posterior distribution equals the prior distribution. This balance is achieved automatically by applying the rules of probability. 0.1 Example 1: Contemplating an update to a posterior distribution An analyst assigns a beta(2,2) prior distribution to a binomial chance parameter \theta . The analyst contemplates the expected posterior distribution based on collecting n^{\star}=2 future observations. There are n^{\star}+1=3 possible number of successes s^{\star} that may be observed. Under a beta(2,2) prior, the probability of outcomes s^{\star}=\{0,1,2\} equals \{\nicefrac{{3}}{{10}},\nicefrac{{4}}{{10}},\nicefrac{{3}}{{10}}\} , respectively. Hence, the expected posterior distribution is a mixture of three beta distributions, with the mixture weights set equal to the respective outcome probabilities: \begin{split}\mathbb{E}_{s^{\star}\sim p(s^{\star})}\left[p(\theta\mid n^{\star}=2)\right]&=\frac{3}{10}\cdot p(\theta\mid s^{\star}=2)+\frac{4}{10}\cdot p(\theta\mid s^{\star}=1)+\frac{3}{10}\cdot p(\theta\mid s^{\star}=0)\\ &=\frac{3}{10}\cdot\text{beta}(\theta\mid 4,2)+\frac{4}{10}\cdot\text{beta}(\theta\mid 3,3)+\frac{3}{10}\cdot\text{beta}(\theta\mid 2,4).\end{split} This three-component mixture is equal to the beta(2,2) prior distribution. Had the analyst instead contemplated n^{\star}=100 future observations, the expected posterior would have been a 101-component mixture of beta distributions, whose weighted average would again equal the beta(2,2) prior distribution. 0.2 Example 2: Contemplating an update to a posterior model probability An analyst entertains two models for a binomial chance parameter \theta , the null hypothesis \mathcal{H}_{0}\colon\theta=\nicefrac{{1}}{{2}} and the alternative hypothesis \mathcal{H}_{1}\colon\theta\sim\text{beta}(1,1) . The analyst deems \mathcal{H}_{0} and \mathcal{H}_{1} equally plausible a priori . The first five observations are all successes, and this gradually increases the probability for \mathcal{H}_{1} from \nicefrac{{1}}{{2}} to \nicefrac{{16}}{{19}}\approx 0.84 . The analyst anticipates collecting the sixth observation and wishes to compute the expected posterior probability for \mathcal{H}_{1} . Denote the hypothetical success and failure on the sixth trial by s^{\star} and f^{\star} , respectively. Note that the posterior odds for \mathcal{H}_{1} over \mathcal{H}_{0} equals \nicefrac{{16}}{{3}}\approx 5.33 , and that the posterior distribution for \theta under \mathcal{H}_{1} is a beta(6,1) distribution. The probability that the sixth observation will be a success can be obtained by applying the law of total probability: \begin{split}p(s^{\star}\mid y)&=p(s^{\star}\mid\mathcal{H}_{0},y)\cdot p(\mathcal{H}_{0}\mid y)+p(s^{\star}\mid\mathcal{H}_{1},y)\cdot p(\mathcal{H}_{1}\mid y)\\ &=\frac{1}{2}\cdot\frac{3}{19}+\frac{6}{7}\cdot\frac{16}{19}\\ &=\frac{213}{266}\approx 0.80,\end{split} and hence p(f^{\star}\,|\,y)=\nicefrac{{53}}{{266}}\approx 0.20 . In case the sixth observation is a success, the associated Bayes factor \text{BF}_{10} is (\nicefrac{{6}}{{7}})/(\nicefrac{{1}}{{2}})=\nicefrac{{12}}{{7}} . The total posterior odds for \mathcal{H}_{1} after this observation then equals \nicefrac{{16}}{{3}}\cdot\nicefrac{{12}}{{7}}=\nicefrac{{192}}{{21}} , which translates to a posterior probability of (\nicefrac{{192}}{{21}})/(\nicefrac{{192}}{{21}}+1)=\nicefrac{{192}}{{213}} . In case the sixth observation is a failure, the associated Bayes factor \text{BF}_{10} is (\nicefrac{{1}}{{7}})/(\nicefrac{{1}}{{2}})=\nicefrac{{2}}{{7}} . The total posterior odds for \mathcal{H}_{1} after this observation then equals \nicefrac{{16}}{{3}}\cdot\nicefrac{{2}}{{7}}=\nicefrac{{32}}{{21}} , which translates to a posterior probability of (\nicefrac{{32}}{{21}})/(\nicefrac{{32}}{{21}}+1)=\nicefrac{{32}}{{53}} . In sum: (a) there is a probability of \nicefrac{{213}}{{266}}\approx 0.80 of observing a success, which then yields a posterior probability for \mathcal{H}_{1} of \nicefrac{{192}}{{213}}\approx 0.90 (i.e., an increase of about 0.06); (b) there is a probability of \nicefrac{{53}}{{266}}\approx 0.20 of observing a failure, which then yields a posterior probability for \mathcal{H}_{1} of \nicefrac{{32}}{{53}}\approx 0.60 (i.e., a decrease of about 0.24). When contemplating the updated prior predictive p(s^{\star}\,|\,y) , the expected posterior probability for \mathcal{H}_{1} therefore equals \begin{split}\mathbb{E}_{s^{\star}\sim p(s^{\star}\mid y),f^{\star}\sim p(f^{\star}\mid y)}\left[p(\mathcal{H}_{1}\mid s^{\star},f^{\star},y)\right]&=p(\mathcal{H}_{1}\mid s^{\star},y)\cdot p(s^{\star}\mid y)+p(\mathcal{H}_{1}\mid f^{\star},y)\cdot p(f^{\star}\mid y)\\ &=\frac{192}{213}\cdot\frac{213}{266}+\frac{32}{53}\cdot\frac{53}{266}\\ &=\frac{16}{19}=p(\mathcal{H}_{1}\mid y).\end{split} Observing a sequence of five successes gradually strengthens the expectation that the next observation will also be a success, in which case the probability for \mathcal{H}_{1} would continue to increase; however, there remains a probability that the next trial will be a failure, and this will greatly decrease the probability for \mathcal{H}_{1} . The probabilities for the possible outcomes and the effect that these outcomes will have on the posterior plausibilities of the models cancel out exactly so that the expected model probability equals the prior model probability. To conclude: when contemplating hypothetical future outcomes, the analyst generally expects to gain information, but is completely uncertain about the impact that this future information will have on the model probability of interest. This holds irrespective of how deeply the analyst looks into the future (e.g., the result holds regardless of whether the expected posterior probability is computed across the next observation, the next 100 observations, or the next 100 billion observations). The result also holds at any point in time as the observations accumulate (e.g., the analyst continually updates their prior to a posterior; because the posterior acts as a prior for the next batch of data, the informational impact of the new batch is completely unknown). 1 The Necessity of Bayes’ Rule The fact that redundant information should not update a rational belief follows from the law of total probability. We

Read the complete text