Missing Links in Public Email and Covert Networks: A Comparative Evaluation of Link Prediction, Hyperlink Prediction, and ERGM Estimation

Moses Boudourides · 2026

Read Missing Links in Public Email and Covert Networks: A Comparative Evaluation of Link Prediction, Hyperlink Prediction, and ERGM Estimation by Moses Boudourides (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22606.txt.

Introduction

Boudourides studies missing guessing in partly seen networks, weighing dyadic link guessing (LP), hyper guessing (HP), and an ERGM rival. LP is the base, using old rules. HP scores trial higher shapes (cliques) via lifted dyadic scores and CHESHIRE. All methods share a masking plan cutting dyadic proof from held links. Across public email and covert sets, LP remains strong for dyadic rescue, while HP gains for higher groups. ERGMs offer a clear helper via tie odds. The result shows when LP, HP, and ERGM fit network gaps.

Catalog record

CREATORMoses Boudourides
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27976
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Missing Links in Public Email and Covert Networks: A Comparative Evaluation of Link Prediction, Hyperlink Prediction, and ERGM Estimation Moses Boudourides Abstract We study missing-link inference in partially observed networks by systematically comparing dyadic link prediction (LP) with hyperlink prediction (HP) and an estimation-based ERGM comparator. LP serves as the primary baseline, using classical heuristics computed on the observed graph. HP extends this framework by scoring candidate higher-order structures (cliques) via lifted dyadic scores and via the CHEbyshev Spectral HyperlInk pREdictor (CHESHIRE). All methods are evaluated under a common masking protocol that removes dyadic evidence induced by held-out hyperlinks to ensure comparability. Across public email and covert-network datasets, LP remains strong for dyadic recovery, while HP—particularly CHESHIRE—provides gains when the inferential target is higher-order group structure. ERGMs offer an interpretable dependence-based complement through conditional tie probabilities. The contribution is a comparative, reproducible evaluation clarifying when LP, HP, and ERGM estimation are most appropriate under network missingness. keywords Missing data; Email communication networks; Covert networks; Link prediction; Hyperlink prediction; Spectral methods; ERGM; Reproducible research 1 Introduction Covert networks are shaped by secrecy: interactions that matter are systematically under-recorded, strategically concealed, or only partially observed through intelligence and investigative traces. This setting amplifies classical missing-data problems in social network analysis. The consequences are not merely technical: missingness can induce spurious structural signatures, hide key brokers, and distort assessments of coordination or compartmentalization. Recent work has emphasized that in “dark” networks, missingness mechanisms themselves may be endogenous to the observed process and cannot be treated as benign measurement noise ( Januar et al. 2026 ) . A complementary perspective is to treat missingness as a prediction task. Graph link prediction (LP) has a long history in network science ( Liben-Nowell and Kleinberg 2007 ; Adamic and Adar 2003 ) , and predictive framing naturally supports sensitivity analyses: how robust are conclusions when a fraction of ties is unobserved? In this study, LP serves as the primary baseline against which all higher-order extensions are evaluated. However, covert settings often involve higher-order interactions (small teams, cells, and coordinated groups) that are naturally modeled as hyperedges rather than dyads. Therefore, we extend our evaluation to compare standard LP against hyperlink prediction (HP) methods, leveraging hypergraphs to clarify how higher-order structure can carry information not reducible to pairwise links ( Benson et al. 2016 ; Chen and Liu 2023 ) . From Link to Hyperlink Prediction. We begin with standard dyadic link prediction (LP) as the primary task: scoring missing edges from the observed graph. However, in covert settings the inferential object is often group structure (e.g., operational cells), which is not directly captured by dyads. We therefore extend the analysis to hyperlink prediction (HP) on clique-derived hypergraphs, where candidate node sets represent minimal higher-order interactions. HP is implemented in two ways: (i) lifting dyadic LP scores to node sets, and (ii) applying a dedicated hypergraph method (CHESHIRE). This formulation allows a direct comparison between LP and HP under a common evaluation design, and provides a bridge to ERGM estimation, whose dependence terms capture higher-order closure effects. Contributions. The paper provides a comparative evaluation framework for missing-link inference under controlled missingness. It establishes LP as the primary baseline, extends the comparison to HP via lifted scores and CHESHIRE, and incorporates ERGM-based estimation as a complementary benchmark. The contribution is empirical and methodological in evaluation design, not a new predictive method. Therefore, the contribution is comparative: we do not propose a new predictor, but clarify the relative behavior of LP, HP, and ERGM-based estimation under controlled missingness. 2 Related work 2.1 Missing data and network sampling Missingness in relational data can bias centrality, clustering, and community detection, and can compromise inference about network processes ( Kossinets 2006 ; Smith et al. 2017 ) . In covert settings, missingness may be structured: high-risk actors avoid observable channels, surveillance is targeted, and documentation can be selectively redacted. Januar et al. 2026 highlights the importance of explicitly modeling missingness mechanisms in dark networks. Our approach is complementary. Rather than proposing a new inferential model of missingness, we develop a comparative evaluation framework. We begin with classical dyadic link prediction as a primary baseline, and then extend the comparison to hyperlink prediction methods, using both as sensitivity analysis tools and imputation engines under observational constraints. 2.2 (Hyper)link prediction Graph link prediction uses neighborhood similarity indices (common neighbors, Adamic–Adar), preferential attachment, and supervised models ( Adamic and Adar 2003 ; Liben-Nowell and Kleinberg 2007 ) . Low-rank matrix completion provides a baseline when adjacency is approximately low-rank ( Candès and Recht 2009 ) . Hypergraph and higher-order link prediction has expanded rapidly, with recent surveys highlighting algorithmic families and evaluation challenges such as candidate generation and negative sampling ( Chen and Liu 2023 ) . This paper focuses on the case where candidate higher-order interactions are derived from dyadic evidence (via clique structure) and evaluated under controlled missingness, allowing direct comparison between LP and HP within a unified experimental design. Recent work has examined the limits of purely topological features in link prediction and emphasized the role of higher-order motifs and structural signals ( Zhang et al. 2024a ; Wang et al. 2022 ) . In addition, evaluation itself is nontrivial: different metrics may yield inconsistent rankings across methods, underscoring the need for careful comparative design ( Zhang et al. 2024b ) . These considerations motivate our focus on a controlled, side-by-side evaluation of LP and HP methods. Recent work has highlighted the theoretical limits of topological features in link prediction ( Zhang et al. 2024a ) and the importance of multiple motif features for predicting collaborations ( Wang et al. 2022 ) . Furthermore, evaluating link prediction methods requires care, as there can be inconsistency among evaluation metrics ( Zhang et al. 2024b ) . 2.3 ERGM as a model-based comparator Exponential Random Graph Models (ERGMs) provide a generative statistical framework for network structure and serve here as an estimation-based comparator to predictive LP and HP methods ( Handcock and Gile 2010 ; Handcock et al. 2008 ) . In this project we treat ERGM analysis as a complementary benchmark: unlike predictive LP and HP scoring, ERGMs attempt to explain the observed network in terms of sufficient statistics (e.g., density, triadic closure) and can be used for imputation by sampling missing dyads from the fitted model. We provide a full R pipeline (Reproducibility Reproducibility ) to run ERGM-based missingness experiments on the same datasets. 3 Data and derived hypergraphs 3.1 Dataset collection We analyze two public email communication corpora and two institutional email networks, as well as six benchmark covert-network case studies representing terrorist operational cells and a criminal gang. The covert networks were obtained from the Covert Networks collection distributed with UCINET ( Borgatti et al. 2002 ) . The email networks were obtained as follows. The Enron network is derived from the Enron email corpus ( Klimt and Yang 2004 ) and is accessed here via the SNAP dataset collection ( Leskovec and Krevl 2014 ) . The EU-core email network is accessed via SNAP ( Leskovec and Krevl 2014 ; Leskovec and Krevl 2014a ) . The university email network (labeled URV ) is the email interchange network from

Read the complete text