PRING : Rethinking Protein-Protein Interaction Prediction from Pairs to Graphs

Xinzhe Zheng, Hao Du, Fanding Xu, Jinzhe Li, Zhiyuan Liu, Wenkang Wang, Tao Chen, Wanli Ouyang, Stan Z. Li, Yan Lu, Nanqing Dong, Yang Zhang · 2025

Read PRING : Rethinking Protein-Protein Interaction Prediction from Pairs to Graphs by Xinzhe Zheng, Hao Du, Fanding Xu, Jinzhe Li, Zhiyuan Liu, Wenkang Wang, Tao Chen, Wanli Ouyang, Stan Z. Li, Yan Lu, Nanqing Dong, Yang Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05101.txt.

Introduction

Xinzhe Zheng and eleven co-authors present a 2025 benchmark, PRING, for judging how well computer models predict which proteins bind to each other. Most past tests grade one pair at a time. Real biology, though, needs whole networks of such bonds, and a model that scores pairs well may still fail to rebuild the web.

PRING rests on a curated data set of 21,484 proteins and 186,818 bonds across species, built to avoid repeat data and leaks between train and test parts. Grading runs on two tracks. One track checks how well a model rebuilds network shape, within and across species. The other checks use in real work, such as finding protein groups and key proteins. Tests of four model families showed wide gaps in both tracks, which the authors offer as a sterner test for the field.

Catalog record

CREATORXinzhe Zheng, Hao Du, Fanding Xu, Jinzhe Li, Zhiyuan Liu, Wenkang Wang, Tao Chen, Wanli Ouyang, Stan Z. Li, Yan Lu, Nanqing Dong, Yang Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05101

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PRING : Rethinking Protein-Protein Interaction Prediction from Pairs to Graphs Xinzhe Zheng, Hao Du, Fanding Xu, Jinzhe Li, Zhiyuan Liu, Wenkang Wang, Tao Chen, Wanli Ouyang, Stan Z. Li, Yan Lu, Nanqing Dong, Yang Zhang Abstract Deep learning-based computational methods have achieved promising results in predicting protein-protein interactions (PPIs). However, existing benchmarks predominantly focus on isolated pairwise evaluations, overlooking a model’s capability to reconstruct biologically meaningful PPI networks, which is crucial for biology research. To address this gap, we introduce PRING , the first comprehensive benchmark that evaluates PR otein-protein IN teraction prediction from a G raph-level perspective. PRING curates a high-quality, multi-species PPI network dataset comprising 21,484 proteins and 186,818 interactions, with well-designed strategies to address both data redundancy and leakage. Building on this golden-standard dataset, we establish two complementary evaluation paradigms: (1) topology-oriented tasks, which assess intra and cross-species PPI network construction, and (2) function-oriented tasks, including protein complex pathway prediction, GO module analysis, and essential protein justification. These evaluations not only reflect the model’s capability to understand the network topology but also facilitate protein function annotation, biological module detection, and even disease mechanism analysis. Extensive experiments on four representative model categories, consisting of sequence similarity-based, naive sequence-based, protein language model-based, and structure-based approaches, demonstrate that current PPI models have potential limitations in recovering both structural and functional properties of PPI networks, highlighting the gap in supporting real-world biological applications. We believe PRING provides a reliable platform to guide the development of more effective PPI prediction models for the community. The dataset and source code of PRING are available at https://github.com/SophieSarceau/PRING . 1 Introduction Protein-protein interactions (PPIs) refer to the physical or functional association between proteins, which is central to most biological processes, such as signal transduction vinayagam2011directed , gene regulation guan2014pthgrn , and immune response Li2014 . They also play a key role in the study of disease mechanisms safari2014protein . For instance, the interactions between certain cellular proteins can trigger abnormal signaling pathways that promote tumor growth and metastasis in cancer Martin2003 . By revealing those types of PPI, small molecules are developed to disrupt the interactions, thereby inducing cancer cell death Zhou2023 . Therefore, characterizing the organization of PPIs is fundamental for understanding the molecular basis of health and advancing drug discovery in precision medicine turn0search1 ; ni2019emerging . Experimental techniques are adopted to identify PPIs in traditional biological research, including instrument-based methods such as X-ray crystallography skubak2013automatic ; engh1991accurate and cryo-electron microscopy zhan2018structure ; su2022cryo , as well as high-throughput approaches like yeast two-hybrid causier2002analysing ; bruckner2009yeast and cross-linking mass spectrometry o2018cross ; lenz2021reliable . Nevertheless, these methods are limited by low scalability and incomplete coverage of the interactome. The rise of deep learning provides powerful computational alternatives for PPI identification sledzieski2021d ; yang2023deploying ; yang2024exploring ; ullanat2025learning , which designs neural networks to capture structural and sequence patterns of proteins to predict PPIs and demonstrates promising performance. More recently, the development of AlphaFold jumper2021highly ; evans2021protein ; abramson2024accurate and protein language models (PLMs) rives2021biological ; lin2023evolutionary ; hayes2025simulating ; liu2024prott3 has led to remarkable breakthroughs in PPI prediction, enabling more accurate and large-scale identification of PPI directly from protein sequences. Although current deep learning-based PPI prediction models achieve high pairwise accuracy on standard benchmarks hu2021survey ; tang2023machine ; du2017deepppi ; pan2010large ; richoux2019comparing ; sledzieski2021d , these evaluations treat each interaction in isolation and overlook how individual predictions contribute to the cohesive PPI networks. While some studies wu2023dl ; sledzieski2021d have applied these models to reconstruct PPI networks in specific contexts ( e.g. , bovine rumen), a systematic and fair evaluation of network-level performance remains absent. Since PPI networks support biological insights from both topological and functional perspectives rual2005towards ; gavin2006proteome , it is important to evaluate how well models recover both aspects. Topologically, PPI networks exhibit properties such as sparsity and local communities, which reflect the modular organization of cellular processes. Functionally, they offer a foundation for annotating uncharacterized proteins and discovering coherent biological modules. Hence, we pose the following research question: How well do current PPI models demonstrate their pure capabilities in recapitulating the structural and functional features of PPI networks? Figure 1: Overview of PRING benchmark. ( a ) Diverse databases are used to construct the PRING . ( b ) PRING includes two topology-oriented tasks and three function-oriented tasks for extensive evaluation. ( c ) List of baseline models, consisting of sequence similarity-based, naive sequence-based, structure-based, and PLM-based methods. ( d ) Evaluation metrics used for each task in the PRING . To fill this blank, we propose PRING , a multi-organisms holistic benchmark that evaluates the PR otein-protein IN teraction prediction from a G raph perspective. As illustrated in Fig. 1 , PRING compiles high-confidence physical interactions across four organisms, Human, Arath, Ecoli, and Yeast, sourced from STRING szklarczyk2023string , UniProt uniprot2023uniprot , Reactome milacic2024reactome , and IntAct del2022intact , yielding 21,484 proteins and 186,818 interactions, with efforts made to minimize both data redundancy and leakage. Through this golden dataset, we benchmark representative PPI prediction methods, including sequence similarity-based, naive sequence-based, PLM-based models, and structure-based, across five tasks: two topology-oriented, namely intra-species and cross-species PPI network construction, to assess whether models can recover the topology properties of PPI networks, such as network density and local community structures, and facilitating cross-species biological knowledge transfer study, and three function-oriented, including protein complex pathway prediction, GO functional module analysis, and essential protein justification, which can support disease mechanism analysis, protein function annotation, and therapeutic target identification. Collectively, these evaluations reveal whether a model is capable of capturing both the topological and the functional semantics of real interactomes, moving beyond pairwise classification to network - level understanding. Extensive experiments yield the following insights: (1) current models tend to generate overly dense graphs, diverging from the sparsity nature of real PPI networks; (2) predicted PPI modules exhibit limited functional alignment with the ground-truth, restricting their utility in downstream tasks such as pathway reconstruction and function annotation; and (3) reconstructed graphs struggle to separate essential from non - essential proteins, indicating that critical topological signals remain uncaptured; (4) classification metrics cannot completely reflect a model’s ability to recover network structure, highlighting the need for graph-level evaluations. While these findings highlight challenges, we hope they can serve as a positive step forward for the community. PRING complements existing benchmarks and provides a reliable platform for more holistic research in modeling PPI networks. To sum up, our key contributions include: • We propose PRING , to the best of our knowledge, the first comprehensive benchmark that evaluates PPI prediction models from topological and functional perspectives on PPI networks. • Through extensive experiments, we demonstrate that existing models exhibit limited functional awareness and poor topological fidelity, revealing a potential gap between computational approaches and their applicability in biological research. • We release a fully reproducible pipeline, including dataset construction and model evaluation tools, to facilitate future research and benchmarking efforts within the community. 2 Related Work 2.1 Protein-Protein Interaction Prediction Benchmark Numerous PPI benchmarks have been developed to assess the effectiveness of prediction models. Most existing benchmarks guo2008using ; huang2015using ; pan2010large ; du2017deepppi ; richoux2019comparing focus on physical interaction evaluations, which curate Human and Yeast PPI

Read the complete text