Resolution of the Borel–Kolmogorov Paradox via the Maximum Entropy Principle
Raphaël Trésor Mykola Lukashchuk · 2025
Read Resolution of the Borel–Kolmogorov Paradox via the Maximum Entropy Principle by Raphaël Trésor Mykola Lukashchuk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24735.txt.
Introduction
Raphaël Trésor and Mykola Lukashchuk tackle a classic puzzle in chance theory in 2025. When an event has zero chance on paper, such as an exact reading of a smooth value, two fair ways of framing it can give two unlike answers. That clash is the Borel-Kolmogorov paradox.
The authors add a distance measure to the model and define the answer as a limit. As the allowed gap to the event shrinks, each step picks the most even spread that fits. Under their rules the answer is unique and stable under fair reshaping. Tests on old rock magnet data show how rival distance choices can be compared head to head.
Catalog record
| CREATOR | Raphaël Trésor Mykola Lukashchuk |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24735
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Resolution of the Borel–Kolmogorov Paradox via the Maximum Entropy Principle Raphaël Trésor Mykola Lukashchuk Abstract This paper presents a rigorous resolution of the Borel–Kolmogorov paradox using the Maximum Entropy Principle. We construct a metric-based framework for Bayesian inference that uniquely extends conditional probability to events of null measure. The results unify classical Bayes’ rules and provide a robust foundation for Bayesian inference in metric spaces. 1 Introduction Conditional probability of an event B given an event A is classically defined as \mathbb{P}\left(B\mid A\right)\vcentcolon=\frac{\mathbb{P}\left(B\cap A\right)}{\mathbb{P}\left(A\right)}\,, (1.1) provided that \mathbb{P}\left(A\right)>0 [ Kolmogorov 1956 , Chapter 1.4] . This formulation constitutes the core of Bayes’ rule, also known as Bayesian conditionalization, which updates a prior probability measure to reflect new information. When an event A is known to occur almost surely, Bayes’ rule prescribes replacing the prior with the conditional probability measure defined above. However, in many practical and theoretical contexts, the event A of interest has null measure under the prior, rendering the classical definition ( 1.1 ) inapplicable. A canonical example arises when A corresponds to the observation of a continuous random variable Y taking a specific value \hat{y} . Attempts to generalize Bayes’ rule to the case \mathbb{P}\left(A\right)=0 have yielded either multiple and conflicting definitions or concluded that such an extension is inherently ill-posed. This leads to the well-known Borel–Kolmogorov paradox, which highlights the ambiguity and inconsistency in extending conditional probability to events of measure zero. Given that the primary utility of conditional probability lies in its role within Bayes’ rule, the existence of multiple Bayes posteriors for the same pair (\mathbb{P},A) raises significant concerns about the coherence of Bayesian inference, as highlighted by Meehan and Zhang 2021 , Rescorla 2015 , Arnold and Roberston 2003 , Bordley 2015 . In this work, we seek a principled and mathematically rigorous framework that yields a unique conditional probability formula for each probabilistic model. Departing from purely measure-theoretic approaches, we incorporate geometric considerations, following the insights of Borel 1909 and Gyenis et al. 2017 , who argue that intuitive resolutions to the Borel–Kolmogorov paradox are best understood through the joint lens of geometric and probabilistic structures rather than probabilistic only. We construct a metric-based extension of Bayes’ rule, resolving the paradox via continuity arguments. Specifically, we demonstrate that topology enables the definition of a sequence (\mathbb{P}_{n})_{n\in{\mathbb{N}}} converging to a unique limiting measure, denoted \mathbb{P}(.\mid A) regardless of whether \mathbb{P}\left(A\right)=0 . This sequence is derived from the Maximum Entropy Principle (MaxEnt), originally introduced by Jaynes 1957 in the context of statistical mechanics and now widely applied across disciplines including physics, economics, and information theory Ben-Naim 2019 , Chandrasekaran and Shah 2017 , Wu 1997 , Gull and Skilling 1984 , Baldwin 2009 , Clarke 2007 . MaxEnt provides a natural framework for extending conditional probability. Indeed, Williams 1980 then later Giffin and Caticha 2007 proved that classical conditional probability ( 1.1 ) can be recovered as a special case of MaxEnt (see Section 2.1 ). Building on the convex duality framework of Borwein and Lewis 1992 (see Section 2.2 ), we make explicit the sequence (\mathbb{P}_{n})_{n\in{\mathbb{N}}} of MaxEnt problems and define its limit as the Bayes’ posterior (see Section 3 ). Subject to mild regularity conditions, we prove that our definition is coherent and applicable to both null and non-null events (see Section 3.2 ). We prove that in metric spaces, our definition is the unique extension of the conditional probability ( 1.1 ) to the case \mathbb{P}\left(A\right)=0 (see Section 3.3 ). Our extension depends on the underlying metric. This dependence explains the multiplicity of Bayes’ posterior for the same couple ( probabilistic model , conditionalization set ) and clarifies the role of geometry in resolving ambiguities (see Section 4 ). To our knowledge, this geometric approach provides a mathematically rigorous framework for resolving the Borel–Kolmogorov paradox while addressing practical modeling needs. Beyond its theoretical contributions, our framework offers a robust and intuitive methodology for Bayesian inference in models enriched with metrizable topologies (see Section 5 ). Our main contributions are as follows: 1. We derive conditional probability formulas from a single unifying principle—the Maximum Entropy Principle—yielding a coherent generalization of Bayes’ rule (Section 3 ). 2. We provide a geometric resolution of the Borel–Kolmogorov paradox (Section 4 ). 3. We demonstrate that our approach enables consistent and principled Bayesian inference in any probabilistic model endowed with a metrizable topology (Section 5 ), thereby offering a rigorous solution to a longstanding modeling challenge. 2 Preliminary 2.1 Maximum Entropy Principle To avoid ambiguity, we begin by clarifying our usage of Bayes’ rule and the Maximum Entropy Principle (MaxEnt). We then explain how the classical definition of conditional probability ( 1.1 ) arises from MaxEnt. Both Bayes’ rule and MaxEnt are procedures that update a prior probability measure — representing initial knowledge — based on new information, yielding a posterior measure. In MaxEnt, the update is performed by selecting the posterior measure that minimizes the relative entropy (also known as the Kullback-Leibler divergence) subject to constraints imposed by the new information. We define the relative entropy as follows: Definition 1 (Relative Entropy or Kullback Leibler divergence) . Consider a \sigma -finite measure \nu on a measurable space (E,\mathcal{E}) . For a probability measure \mu absolutely continuous with respect to \nu (i.e., \mu\ll\nu ) the entropy of \mu relative to \nu is defined by \text{H}_{\nu}\left[\mu\right]\vcentcolon=\int_{E}\frac{\operatorname{d}\!{}\mu}{\operatorname{d}\!{}\nu}(x)\ln\left(\frac{\operatorname{d}\!{}\mu}{\operatorname{d}\!{}\nu}(x)\right)\operatorname{d}\!{}\nu(x)\,. (2.1) where \frac{d\mu}{d\nu} denotes the Radon-Nikodym derivative. If \mu is not absolutely continuous with respect to \nu (i.e., \mu\not\ll\nu ), we set \text{H}_{\nu}\left[\mu\right]\vcentcolon=+\infty\,. (2.2) When the evaluated measure is absolutely continuous with respect to the reference measure, the relative entropy is always a positive value or null: Proposition 1 ( Cover and Thomas 2001 Theorem 2.6.3) . Consider two probability measure \nu and \mu on a measurable space (E,\mathcal{E}) . If \mu\ll\nu , then \text{H}_{\nu}\left[\mu\right]\geqslant 0\,, (2.3) with equality if and only if \mu=\nu . Unlike conditional probability, Bayes’ rule and MaxEnt are not mathematical objects per se, but rather inference procedures. Due to their widespread use beyond mathematics, the definition of MaxEnt often lacks the precision required for rigorous comparison with Bayes’ rule (see [ Uffink 1996 ] ). In this work, we adopt a specific formulation of MaxEnt based on linear constraints: Definition 2 (MaxEnt with Linear Constraints) . Consider a prior probability \nu measure on a measurable space (E,\mathcal{E}) . On the space of measures that measure \mathcal{E} , consider a constrained set defined as follows: I\mathrel{\hbox{\hskip 3.8889pt\hskip-3.8889pt\hbox{$=$}\hskip-3.8889pt\hskip-2.7431pt\raisebox{4.66875pt}{\hbox{$\scriptscriptstyle\Delta$}}\hskip-2.7431pt\hskip 3.8889pt}}\left\{\mu:\int_{E}f_{i}(x)\operatorname{d}\!{}\mu(x)=a_{i}\,,\;\textit{ for }i=1\ldots n\right\}\,, (2.4) where each f_{i} is a measurable real-valued function, a_{i}\in\mathbb{R} and n\in\mathbb{N} . Then the MaxEnt problem (\nu,I) consists of finding \inf_{\mu\in I}\text{H}_{\nu}\left[\mu\right]\,. (2.5) The problem is said to be well-defined if the infimum ( 2.5 ) is attained by a unique measure. If the MaxEnt problem (\nu,I) is well-defined, the MaxEnt refers to the procedure that returns this unique measure. Williams 1980 showed that the classical conditional probability ( 1.1 ) can be derived from this MaxEnt formulation. Given a probability measure \mathbb{P} with \mathbb{P}\left(A\right)>0 , and the constraint set \displaystyle I=\left\{\mathbb{Q}\,:\,\mathbb{Q}(A)=1\right\}=\left\{\mathbb{Q}:\int_{E}1\,\operatorname{d}\!{}\mathbb{Q}(x)=1\,,\;\int_{E}\mathds{1}_{A}(x)\,\operatorname{d}\!{}\mathbb{Q}(x)\right\}\,, (2.6) the solution to the MaxEnt problem (\mathbb{P},I) is the conditional probability \mathbb{P}\left(.\mid A\right) ( 1.1 ) (see Appendix A for a modern version of Williams’s proof). Thus, where conditional probability is unambiguous,