Controlling False Discovery in Arbitrarily Structured Hypothesis Spaces via Reproducing Kernels.
Binyamin Perets, Shie Mannor · 2026
Read Controlling False Discovery in Arbitrarily Structured Hypothesis Spaces via Reproducing Kernels. by Binyamin Perets, Shie Mannor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17559.txt.
Introduction
Perets and Mannor reframe structured false-discovery control as a regularized learning problem. Classical methods treat links among hypotheses as obstacles needing cautious correction, yet proximity, links and levels can raise power. Working inside a kernel Hilbert space unifies domains, graphs and hierarchies under one method through kernel choice alone. Smooth fits replace piecewise-constant fits, data-driven tuning replaces guesswork, and inference at unseen spots supports efficient design. Two decision rules are proved to control the false discovery rate, tested on spatial data and gene expression.
Catalog record
| CREATOR | Binyamin Perets, Shie Mannor |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101288 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17559
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Controlling False Discovery in Arbitrarily Structured Hypothesis Spaces via Reproducing Kernels. Binyamin Perets, Shie Mannor Abstract Large-scale hypothesis testing is central to modern science, where controlling the False Discovery Rate (FDR) has become the standard approach to managing false positives across many simultaneous tests. Hypotheses rarely exist in isolation; they often exhibit structure through proximity, connectivity, or hierarchy. This structure represents both a challenge and an opportunity: while classical methods treat these dependencies as obstacles requiring conservative correction, leveraging them can substantially increase discovery power. Here, we reframe structured FDR control as a regularized learning problem. By optimizing within a suitable Reproducing Kernel Hilbert Space (RKHS), we introduce a framework that unifies continuous domains, graphs, and hierarchies under a single algorithm through kernel choice alone. This formulation enables smooth solutions in place of the piecewise-constant fits of prior methods, principled likelihood-based hyperparameter selection rather than heuristic tuning, and inference at unobserved locations which in turn supports sample-efficient experimental design. Building on this estimator, we provide two decision rules which we prove to control the FDR. We validate our method on two sources: spatial locations derived from high-dimensional real-world datasets, and a differential gene expression task utilizing protein-protein interaction graphs. 1 Introduction The challenge of multiple hypothesis testing is one of the most fundamental in science, addressing our ability to control the probability of false discoveries that arise purely from random chance when evaluating a large number of hypotheses. In practice, this often translates to controlling the False Discovery Rate (FDR). In most domains, it is more the rule than the exception to encounter multiple hypothesis testing problems where hypotheses are not independent, forming a structured hypothesis space: nearby brain regions activate together, genes in the same pathway co-regulate, and spatially proximate cells share molecular signatures. In practice, this structure significantly affects FDR results [ 25 ] . While the hypothesis testing literature uses several related terms inconsistently, we frame our work under the structured hypothesis space setup, i.e., with geometric or topological organization induced by relations between hypotheses (any measurable association, from spatial proximity to hierarchical nesting, that indicates hypotheses “belong together” in some sense). This differs from approaches that require explicit dependencies , i.e., formal probabilistic relationships specified through joint or conditional distributions (e.g., positive regression dependency, correlation structures), which need not be present for relations or structure to be meaningful. While classical FDR control methods typically aim to provide guarantees under unknown or arbitrary dependencies [ 5 ] (see Section 2 ), recent work has shown that when hypotheses exhibit known structure, this information can be leveraged for substantial power gains [ 31 , 8 ] . This represents a conceptual paradigm shift: rather than treating dependencies as obstacles requiring conservative correction, these methods exploit known structure as prior information to enhance discovery while maintaining rigorous FDR control. However, such dependency-based approaches face fundamental limitations. They require that the structure be expressed through formal probabilistic dependencies and to be sparse. As demonstrated by 8 and 13 , violating either condition renders the problem computationally intractable or statistically infeasible, limiting applicability to settings with both known probabilistic form and low-degree dependency graphs. An alternative regularization-based approach operates on relational information without requiring probabilistic interpretation. The leading example, SmoothFDR [ 30 ] , encodes relations through graph connectivity and uses Total Variation regularization to enforce piecewise-constant significance patterns over connected components. This relaxes the probabilistic requirement but introduces new limitations: the graph structure must be specified a priori, solutions are constrained to piecewise-constant functions poorly suited to smoothly varying phenomena, and the framework lacks principled mechanisms for hyperparameter selection or interpolation to unobserved locations. In this paper, we address the general problem by assuming a continuous hypothesis space defined over a d -dimensional domain, subsequently demonstrating that almost any discrete problem can be approximated under this framework. By modeling the spatially varying structure within a Reproducing Kernel Hilbert Space (RKHS) [ 1 ] , diverse structures, from spatial grids and phylogenetic trees to protein interaction networks, can be incorporated through kernel choice alone. Moreover, we move beyond the restrictive piecewise-constant assumptions of current L_{1} -based methods, enabling flexible smoothness regularization and the generation of continuous significance maps valid at both observed and unobserved locations. Our framework is computationally efficient, scaling as O(N^{2}) via natural gradient optimization, and distinguishes itself by supporting valid likelihood-based cross-validation through proving the model is properly normalized for all hyperparameter choices. The remainder of this paper is organized as follows. Section 2 provides preliminary definitions and positions the approach within the literature. Section 3 establishes the problem formulation and introduces the spatially-varying mixture model. Section 4 details our point-wise optimization framework in Reproducing Kernel Hilbert Spaces (RKHS). Section 5 translates the resulting estimates into two decision rules with formal FDR guarantees and characterizes their relative power. Section 6 extends inference to the entire domain and addresses optimal experimental design for untested locations. Section 7 discusses practical implementation, including likelihood-based hyperparameter selection and the application of our framework to discrete structures via graph kernels. Finally, Section 8 evaluates the method on semi-synthetic benchmarks and on two real-world tasks: HIGGS particle physics and TCGA gene expression on the STRING protein-protein interaction network. 2 Preliminaries, Related Works, and Positioning p-value is the probability under the null of obtaining a test statistic at least as extreme as the one observed. False Discovery Rate (FDR) is the expected proportion of false positives in the multiple hypotheses scenario: FDR=E\left[\frac{V}{R}\mid R\geq 0\right]P(R>0) where V is the number of false positives and R is the total number of rejections. FDR control literature distinguishes between global and local FDR ( lfdr ): lfdr is a Bayesian approach providing per-hypothesis significance by estimating the posterior null probability [ 11 ] using a two-group mixture with marginal density: f(z)=\alpha_{0}f_{0}(z)+(1-\alpha_{0})f_{1}(z). Here, \alpha_{0} and (1-\alpha_{0}) are the prior probabilities of the null and alternative hypotheses, respectively, f_{0}(z) is the null distribution (theoretically uniform for p-values, though often empirically estimated), and f_{1}(z) is the alternative distribution (typically unknown but assumed to be skewed toward zero). Given this mixture model, the local-fdr for test statistic z is defined as the posterior probability: \text{lfdr}(z)=P(H_{0}|Z=z)=\frac{\alpha_{0}f_{0}(z)}{\alpha_{0}f_{0}(z)+(1-\alpha_{0})f_{1}(z)} . 2.1 Related Works and Positioning Controlling the FDR for related hypotheses is a long-standing challenge. Classical procedures, such as the Benjamini-Hochberg (B-H) method [ 4 ] , control the FDR under independence or positive regression dependency, while other [ 3 ] are required for arbitrary relations. These methods treat the structure as a nuisance to be corrected for. Recent work leverages relations for power gains, yielding structured FDR methods that fall into several categories: Explicit Dependency Modeling models dependencies as proper statistical relations (e.g., joint or conditional distributions), and have shown that this can lead to optimal "oracle" procedures that significantly boost power [ 8 ] . However, those methods [ 31 , 13 ] typically require restrictive conditions: (1) the dependencies must represent actual probabilistic relationships with dependency graph given explicitly; this lacks mechanisms for handling continuous domains, (2) these dependencies must be sparse as noted by [ 13 ] . Adaptive P-value Methods. Methods such as LAWS [ 9 ] and STRAW [ 33 ] addresses spatial dependencies through adaptive p-value weighting, constructing local weights