Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking

Ihor Kendiukhov · 2026

Read Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking by Ihor Kendiukhov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03493.txt.

Description

Ihor Kendiukhov measures how easily gene network rankings flip when the scoring rules change. Benchmarks rank methods that infer gene regulatory networks from single-cell data, and papers cite those rankings as proof of quality. His 2026 study asks whether the order survives plausible changes in evaluation protocol, using existing benchmark outputs for six methods across three human tissues.

Four protocol choices were varied: which candidate genes count, which tissue, which reference network, and how gene symbols map. Rankings reversed for roughly one pair in six under candidate changes, one in five across tissues, and one in three across reference networks, while symbol mapping changed nothing. A permutation test shows the order is far from random, yet far from fixed. Reversals trace to genuine shifts in discrimination ability, not base-rate inflation. Kendiukhov proposes stability-aware reporting practices and releases a diagnostic toolkit.

Catalog record

CREATORIhor Kendiukhov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25820
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03493

Browse the full library · About the Tower of Babel