SCORE: A Unified Framework for Overshoot Refund in Online FDR Control
Qi Kuang, Bowen Gang, Yin Xia · 2026
Read SCORE: A Unified Framework for Overshoot Refund in Online FDR Control by Qi Kuang, Bowen Gang, Yin Xia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20386.txt.
Introduction
Qi Kuang, Bowen Gang, and Yin Xia present SCORE, a framework for online false discovery rate control. Online testing judges hypotheses one by one as data arrives, while keeping the share of false findings in check. Methods based on e-values control this rate under weak assumptions, but they lose power by discarding evidence that overshoots the rejection threshold.
SCORE recovers that overshoot as a refund that can be spent on later tests. More power at the same error guarantee means more true findings from the same data stream. The idea suits live settings like platform experiments and sequential clinical monitoring.
Catalog record
| CREATOR | Qi Kuang, Bowen Gang, Yin Xia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20386
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SCORE: A Unified Framework for Overshoot Refund in Online FDR Control Qi Kuang, Bowen Gang, Yin Xia Abstract We propose a unified framework to enhance the power of online multiple hypothesis testing procedures based on e e -values. While e e -value-based methods offer robust online False Discovery Rate (FDR) control under minimal assumptions, they often suffer from power loss by discarding evidence that exceeds the rejection threshold. We address this inefficiency via the S equential C ontrol with O vershoot R efund for E -values (SCORE) framework, which leverages the inequality 𝕀 ( y ≥ 1 ) ≤ y − ( y − 1 ) + \mathbb{I}(y\geq 1)\leq y-(y-1)_{+} to reclaim this otherwise “wasted” evidence. This simple yet powerful insight yields a unified principle for improving a broad class of online testing algorithms. Building on this framework, we develop SCORE-enhanced versions of several state-of-the-art procedures, including SCORE-LOND, SCORE-LORD, and SCORE-SAFFRON, all of which strictly dominate their original counterparts while preserving valid finite-sample FDR control. Furthermore, under mild assumptions, SCORE permits retroactive updates of alpha‑wealth by using the latest decision twice: first to determine its reward or loss, and then to refresh past wealth. Such a mechanism enables more aggressive testing strategies while maintaining valid FDR control, thereby further improving statistical power. The effectiveness of the proposed methods is validated through extensive simulation and real-data experiments. Keywords: Online FDR, e -values, Multiple Testing 1 Introduction In the era of big data, scientific research and industrial decision-making are increasingly driven by large-scale, continuous experimentation. From pharmaceutical companies screening thousands of drug candidates ( 6 ) to tech giants conducting ongoing A/B testing on user interfaces ( 5 ) , hypotheses are frequently tested sequentially over time rather than in a single static batch. In this online setting, decisions for each hypothesis must be made immediately upon data acquisition, without knowledge of future tests or even the total number of hypotheses, and once made, these decisions cannot be revised. Consequently, the fundamental statistical challenge is to maximize the number of true discoveries while rigorously controlling the False Discovery Rate (FDR) ( 3 ) at every step of the testing process. To address this challenge, the theoretical framework for online FDR control was pioneered by 10 , who introduced the concept of alpha-investing . This approach treats the error budget \alpha as a limited resource, or “wealth”, that is allocated to individual tests and credited back upon rejections. This paradigm was significantly expanded by 1 through the development of Generalized Alpha Investing (GAI). Building on this foundation, later work refined and strengthened the framework: 17 proposed GAI++ to uniformly improve GAI; 14 ; 15 developed LOND and LORD to explicitly manage wealth recovery; and adaptive procedures such as SAFFRON ( 18 ) and ADDIS ( 20 ) were designed to enhance power by estimating the proportion of null hypotheses or accommodating conservative p -values. However, the validity of these widely used p -value-based methods typically relies on specific dependence assumptions, such as independence or Positive Regression Dependence on a Subset (PRDS) ( 4 ) . In complex, real-world data streams involving time-series or shared control groups, these assumptions are often violated, potentially compromising FDR control. More recently, 25 proposed SupLORD, which requires only conditional superuniformity. However, its primary focus is controlling the False Discovery Exceedance (FDX) rather than the FDR. To circumvent the reliance on dependence assumptions, recent methodological advances have pivoted toward e -values as a robust alternative ( 22 ; 13 ) . Leveraging the property that an e -value’s expectation is bounded by one under the null, 26 and 27 developed algorithms such as e-LOND, e-LORD, and e-SAFFRON that maintain valid FDR control under minimal assumptions. Despite this attractive safety guarantee, these methods frequently suffer from reduced statistical power compared to their p -value counterparts. A key source of this low efficiency is the so-called “overshoot” phenomenon: once the evidence crosses the rejection threshold, existing procedures make a binary decision and effectively discard any excess magnitude of the e -value beyond that threshold. By failing to exploit this additional evidence, standard algorithms do not fully capitalize on the strength of the observed signal. To improve statistical power, we propose a unified framework centered on the Overshoot Refund principle. The core intuition is straightforward: rather than treating the rejection threshold as a hard cutoff that discards excess evidence, we rigorously quantify this “overshoot” and refund it back to the algorithm’s wealth budget. Our main contributions are as follows: • We introduce the S equential C ontrol with O vershoot R efund for E -values ( SCORE ) framework. By exploiting a tighter bound on the false discovery proportion (FDP), we develop SCORE versions of state-of-the-art algorithms—specifically SCORE-LOND, SCORE-LORD, and SCORE-SAFFRON. We prove that these algorithms strictly dominate their original counterparts, offering uniformly higher power while maintaining valid finite-sample FDR control. • We extend the theoretical analysis to enable retroactive wealth updates . Under mild dependence assumptions, the algorithm can leverage the latest decision to retroactively refresh the effective cost of past tests. This mechanism supports more aggressive procedures, denoted as SCORE + , that further narrow the efficiency gap relative to traditional p -value-based methods. 2 Problem Formulation The online multiple testing problem can be formally described as follows. We consider an unlimited stream of null hypotheses H_{1},H_{2},\dots arriving sequentially over time. At each step t\in\mathbb{N} , the analyst must make a decision regarding the null hypothesis H_{t} immediately, utilizing only the information available up to that point and without knowledge of future hypotheses or the total number of tests. Let \delta_{t}\in\{0,1\} denote the decision for the t -th hypothesis, where \delta_{t}=1 indicates that H_{t} is rejected (a discovery), and \delta_{t}=0 indicates a failure to reject. Let \mathcal{H}_{0}\subset\mathbb{N} denote the set of indices corresponding to true null hypotheses and \mathcal{H}_{0}^{t}=\{1,\ldots,t\}\cap\mathcal{H}_{0} . The cumulative number of rejections up to time t is denoted by R_{t}=\sum_{j=1}^{t}\delta_{j} . The primary objective is to control the error rate at any time t . The FDR is defined as the expected FDP where the FDP is the ratio of false rejections to total rejections: \mathrm{FDP}(t)=\frac{\sum_{j\in\mathcal{H}_{0}^{t}}\delta_{j}}{R_{t}\vee 1},\quad\text{and}\quad\mathrm{FDR}(t)\coloneqq\mathbb{E}[\mathrm{FDP}(t)]. Given a pre-specified error budget \alpha\in(0,1) , our goal is to ensure \mathrm{FDR}(t)\leq\alpha for all t\geq 1 , regardless of the stopping time. Subject to this constraint, the secondary objective is to maximize average power (AP), i.e., \mathrm{AP}(t)=\mathbb{E}\left({\sum_{j\in\mathcal{H}_{1}^{t}}\delta_{t}}/{|\mathcal{H}^{t}_{1}|}\right), where \mathcal{H}^{t}_{1}=\{1,\ldots,t\}\backslash\mathcal{H}_{0}^{t} . To achieve robust control without relying on restrictive dependence assumptions between hypotheses, we focus on a testing framework based on e -values . Let \mathcal{F}_{t-1} denote the \sigma -algebra generated by the history of decisions and observations prior to step t . An e -value e_{t} for hypothesis H_{t} is a non-negative random variable satisfying the following condition: \text{if }H_{t}\text{ is true, then }\mathbb{E}[e_{t}\mid\mathcal{F}_{t-1}]\leq 1. (1) Under the alternative hypothesis, e_{t} may take large values, reflecting evidence against the null. The online testing procedure using e -values proceeds as follows: 1. Threshold Selection: Before observing e_{t} , the algorithm selects a significance level (or rejection threshold) \alpha_{t}\in(0,1) based on the history \mathcal{F}_{t-1} . Formally, this means that the sequence \{\alpha_{t}\}_{t\geq 1} is predictable , i.e., each \alpha_{t} is measurable with respect to \mathcal{F}_{t-1} . 2. Decision Rule: Upon