Practical Boundary Degeneracy and Reverse-Martingale Limits in Sequential Binary Models
Yuan-chin Ivan Chang · 2026
Read Practical Boundary Degeneracy and Reverse-Martingale Limits in Sequential Binary Models by Yuan-chin Ivan Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02274.txt.
Introduction
Yuan-chin Ivan Chang warns against one common error. A run of all failures, or all successes, can tempt a reader to claim a chance of exactly zero or one. The same trap appears with full separation in logistic regression. Chang argues finite data support only bounds, such as a chance below a small value.
The paper joins the three cases under one reverse-martingale frame. Its stopping rule needs three things at once. The estimate must sit near the boundary. The uncertainty width must be narrow. The path must also be stable. Boundary issues are cast as traits of a limit law, not finite-sample events. The view sits beside classic binomial tests and Wald's methods.
Catalog record
| CREATOR | Yuan-chin Ivan Chang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02274
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Practical Boundary Degeneracy and Reverse-Martingale Limits in Sequential Binary Models Yuan-chin Ivan Chang Abstract A run of all failures, a run of all successes, or complete separation in a logistic regression each tempts the analyst to declare a probability of exactly zero or one. The central message of this paper is that all three phenomena share a common structure: finite sequential data justify practical boundary statements of the form p ≤ ε p\leq\varepsilon or p ≥ 1 − ε p\geq 1-\varepsilon , but not exact boundary probabilities. The paper’s contribution is to unify these three settings under a single reverse-martingale framework and to derive a stopping rule, τ RM \tau_{\mathrm{RM}} , that requires three conditions simultaneously—boundary closeness B n ≤ ε B_{n}\leq\varepsilon , uncertainty width W n ≤ w W_{n}\leq w , and trajectory stability r n ≤ η r_{n}\leq\eta —rather than boundary closeness alone. The reverse-martingale view recasts boundary degeneracy as a property of the limiting conditional law M ∞ = 𝔼 ( Y ∣ 𝒢 ∞ ) M_{\infty}=\mathbb{E}(Y\mid\mathcal{G}_{\infty}) rather than a finite-sample event, complementing classical one-sided binomial tests and Wald’s sequential probability ratio test without replacing them. Numerical studies across Bernoulli rare-event trials, low- and high-dimensional logistic regression, controlled risk trajectories, and a real health-economics data set demonstrate that boundary closeness alone is an unreliable stopping signal, and that the stability condition separates transient apparent certainty from genuine limiting degeneracy. Keywords: Bernoulli trial; boundary probability; complete separation; confidence sequence; logistic regression; reverse martingale; sequential inference. MSC 2020: Primary 60G42, 62L12; Secondary 62F03, 62J12. Submitted for publication. Comments welcome. 1 Introduction Sequential binary data frequently create the appearance of degeneracy. A safety monitor observes a long run of non-events; a logistic regression separates outcomes perfectly; a sequential risk score approaches zero before the underlying state has stabilized. Each tempts the analyst to conclude that a probability is exactly zero or one. The central statistical point of this paper is: \displaystyle\text{finite sequential data may justify practical boundary statements,} \displaystyle\text{but not exact boundary probabilities.} These three phenomena—Bernoulli all-failure runs, logistic separation, and near-degenerate risk trajectories—are treated as unrelated technical inconveniences in their respective literatures. The contribution of this paper is to unify them. All three are manifestations of the same confusion between a finite near-boundary estimate and the limiting conditional law to which the underlying process converges. Once that identification is made, a common remedy follows: a stopping rule that requires boundary closeness, uncertainty control, and trajectory stability simultaneously, rather than boundary closeness alone. The mathematical vehicle is the classical reverse-martingale convergence theorem ( Doob 1953 ; Durrett 2019 ) . For a decreasing filtration \mathcal{G}_{1}\supseteq\mathcal{G}_{2}\supseteq\cdots and Y\in\{0,1\} , the process M_{n}=\mathbb{E}(Y\mid\mathcal{G}_{n}) converges almost surely to M_{\infty}=\mathbb{E}(Y\mid\mathcal{G}_{\infty}) . Boundary degeneracy is a property of M_{\infty} , not of any finite M_{n} . The paper applies this observation to give a unified interpretation of the three settings and to derive the three-condition stopping rule \tau_{\mathrm{RM}} . The classical tools—one-sided binomial tests and confidence bounds ( Clopper and Pearson 1934 ) , confidence sequences ( Howard et al. 2021 ) , and Wald’s SPRT ( Wald 1945 ; Wald 1947 ) —each address one part of the picture and are used here as building blocks. They are not replaced. In particular, SPRT is the correct tool when the problem is genuinely simple-versus-simple Bernoulli monitoring; it does not cover composite one-sided statements, logistic separation, or trajectory stability, which is where the present framework adds content. A brief technical comparison is given in Appendix A.2 . The paper is organized as follows. Section 2 gives the Bernoulli boundary rules. Section 3 covers logistic separation. Section 4 develops the reverse-martingale formulation and its illustrated example. Section 5 states the three-condition stopping rule. Section 7 discusses sequential prediction and adaptive treatment. Section 6 presents numerical evidence, and Section 8 concludes. 2 Forward sequential boundary statements for Bernoulli trials Let Y_{1},Y_{2},\ldots\overset{\mathrm{iid}}{\sim}\operatorname{Bernoulli}(p),\qquad 0\leq p\leq 1, and define S_{n}=\sum_{i=1}^{n}Y_{i} . The ordinary maximum-likelihood estimator is \hat{p}_{n}=\frac{S_{n}}{n}. If S_{n}=0 , then \hat{p}_{n}=0 ; if S_{n}=n , then \hat{p}_{n}=1 . These finite-sample equalities are estimates, not proofs that the data-generating probability is exactly zero or one. 2.1 All-failure and all-success stopping The following elementary calculation gives a useful benchmark for practical degeneracy. Proposition 1 (All-failure practical-zero rule) . Fix \varepsilon\in(0,1) and \alpha\in(0,1) . Consider the rule that declares p<\varepsilon after observing n consecutive failures. If (1-\varepsilon)^{n}\leq\alpha, then \sup_{p\geq\varepsilon}\mathbb{P}_{p}(Y_{1}=\cdots=Y_{n}=0)\leq\alpha. Equivalently, it is sufficient that n\geq\frac{\log\alpha}{\log(1-\varepsilon)}. Proof. For every p\geq\varepsilon , \mathbb{P}_{p}(Y_{1}=\cdots=Y_{n}=0)=(1-p)^{n}\leq(1-\varepsilon)^{n}\leq\alpha. This proves the claimed type-I error bound. ∎ Corollary 1 (All-success practical-one rule) . If n consecutive successes are observed and (1-\varepsilon)^{n}\leq\alpha , then the rule declaring p>1-\varepsilon has type-I error at most \alpha under p\leq 1-\varepsilon . Proposition 1 and Corollary 1 are intentionally simple. They show that a finite run can justify a one-sided practical statement with specified error control. They do not justify p=0 or p=1 . Remark 1 (Classical comparators) . The all-failure rule above is the s=0 special case of the standard one-sided binomial test of H_{0}:p\geq\varepsilon against H_{1}:p<\varepsilon , with exact p -value (1-\varepsilon)^{n} and dual upper Clopper–Pearson bound U_{n}(0;\alpha)=1-\alpha^{1/n} ( Clopper and Pearson 1934 ; Lehmann and Romano 2005 ) . For sequential problems where the stopping time is data-dependent, fixed-time intervals are replaced by confidence sequences valid under optional stopping ( Howard et al. 2021 ) . When the question is instead a simple-versus-simple comparison between two pre-specified probabilities, Wald’s SPRT is the canonical tool ( Wald 1945 ; Wald 1947 ) . None of these classical methods addresses the composite, model-based, or trajectory-stability aspects of the boundary problem studied here; the present paper adds content in those directions rather than replacing the classical tools. A brief SPRT comparison is in Appendix A.2 . 2.2 Smoothing and time-uniform uncertainty A common stabilized estimate arises from a beta prior, p\sim\operatorname{Beta}(a,b),\qquad a,b>0. After observing S_{n} successes in n trials, p\mid\mathcal{D}_{n}\sim\operatorname{Beta}(a+S_{n},b+n-S_{n}),\qquad\mathcal{D}_{n}=\sigma(Y_{1},\ldots,Y_{n}), and the posterior mean is \tilde{p}_{n}=\mathbb{E}(p\mid\mathcal{D}_{n})=\frac{S_{n}+a}{n+a+b}. This estimate is strictly inside (0,1) for every finite n when a,b>0 . For sequential inference, the more important object is not the smoothed point estimate but a stopping-valid uncertainty statement. A confidence sequence is a sequence of random intervals (C_{n}) satisfying \mathbb{P}_{p}\{p\in C_{n}\text{ for all }n\geq 1\}\geq 1-\alpha,\qquad p\in[0,1]. Such intervals are valid under arbitrary data-dependent stopping times; see, for example, Wald 1945 and Howard et al. 2021 . A practical-zero stopping time can be written as \tau_{0}=\inf\{n:C_{n}\subseteq[0,\varepsilon]\}, and a practical-one stopping time as \tau_{1}=\inf\{n:C_{n}\subseteq[1-\varepsilon,1]\}. On the event that the confidence sequence covers p at all times, \tau_{0} cannot falsely declare practical zero when p>\varepsilon , and \tau_{1} cannot falsely declare practical one when p<1-\varepsilon . Proposition 2 (Sequential validity of confidence-sequence stopping) . Let (C_{n}) be a (1-\alpha) confidence sequence for p . Define \tau_{0} and \tau_{1} as above. Then \mathbb{P}_{p}(\tau_{0}<\infty\text{ and }p>\varepsilon)\leq\alpha,\qquad\mathbb{P}_{p}(\tau_{1}<\infty\text{ and }p<1-\varepsilon)\leq\alpha. Proof. If p\in C_{n} for all n , then C_{\tau_{0}}\subseteq[0,\varepsilon] implies p\leq\varepsilon , and C_{\tau_{1}}\subseteq[1-\varepsilon,1] implies p\geq 1-\varepsilon . Therefore either type of false boundary declaration can occur only on the event that the confidence sequence fails to cover p at some time, which has probability at most \alpha . ∎ 3 Logistic regression and separation Let (Y_{i},x_{i}) be sequentially observed, where Y_{i}\in\{0,1\} and x_{i}\in\mathbb{R}^{d} . The logistic model is \mathbb{P}(Y_{i}=1\mid x_{i})=\pi_{i}(\beta)=\operatorname{expit}(x_{i}^{\top}\beta)=\frac{\exp(x_{i}^{\top}\beta)}{1+\exp(x_{i}^{\top}\beta)}.