Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking
Ihor Kendiukhov · 2026
Read Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking by Ihor Kendiukhov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03493.txt.
Description
Ihor Kendiukhov measures how easily gene network rankings flip when the scoring rules change. Benchmarks rank methods that infer gene regulatory networks from single-cell data, and papers cite those rankings as proof of quality. His 2026 study asks whether the order survives plausible changes in evaluation protocol, using existing benchmark outputs for six methods across three human tissues.
Four protocol choices were varied: which candidate genes count, which tissue, which reference network, and how gene symbols map. Rankings reversed for roughly one pair in six under candidate changes, one in five across tissues, and one in three across reference networks, while symbol mapping changed nothing. A permutation test shows the order is far from random, yet far from fixed. Reversals trace to genuine shifts in discrimination ability, not base-rate inflation. Kendiukhov proposes stability-aware reporting practices and releases a diagnostic toolkit.
Catalog record
| CREATOR | Ihor Kendiukhov |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25820 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03493