Better Together: Cross and Joint Covariances Enhance Signal Detectability in Undersampled Data

Arabind Swain, Sean Alexander Ridout, Ilya Nemenman · 2025

Read Better Together: Cross and Joint Covariances Enhance Signal Detectability in Undersampled Data by Arabind Swain, Sean Alexander Ridout, Ilya Nemenman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22207.txt.

Description

Arabind Swain, Sean Alexander Ridout, and Ilya Nemenman ask which math view best reveals a signal shared by two large data sets. When samples are few and measures are many, noise can fake links. The 2025 study uses random matrix theory to find when a shared signal can be spotted and rebuilt. Three views are weighed: each set alone, the cross view between sets, and a joint view that stacks both.

All three views show a sharp threshold where the signal pops out from noise. The cross and joint views always cross that line sooner than single-set views. Which of the two wins depends on how the sizes of the sets differ. The authors discuss how to pick a method for real data work.

Catalog record

CREATORArabind Swain, Sean Alexander Ridout, Ilya Nemenman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22207

Browse the full library · About the Tower of Babel