Compact Artificial Neural Network Models for Predicting Protein Residue - RNA Base Binding

Stanislav Selitskiy · 2025

Read Compact Artificial Neural Network Models for Predicting Protein Residue - RNA Base Binding by Stanislav Selitskiy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08648.txt.

Introduction

Stanislav Selitskiy asks whether small neural networks, trainable on ordinary university hardware, can predict where proteins bind RNA. Big models do this job well but demand heavy computing and large datasets, which many life-science labs do not have, and their binding data is often scarce and lopsided.

Shallow feed-forward networks with two hidden layers read sequence context through a sliding window instead of explicit structure. Only three of seven common activation functions produced converging models. Standard rebalancing tricks failed, while more training data and model ensembles helped greatly. A context window near thirty residues and bases balanced the two error types best. The study concludes that accurate protein-RNA binding prediction is within reach of modest hardware.

Catalog record

CREATORStanislav Selitskiy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08648

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Compact Artificial Neural Network Models for Predicting Protein Residue - RNA Base Binding Stanislav Selitskiy Abstract Large Artificial Neural Network (ANN) models have demonstrated success in various domains, including general text and image generation, drug discovery, and protein-RNA (ribonucleic acid) binding tasks. However, these models typically demand substantial computational resources, time, and data for effective training. Given that such extensive resources are often inaccessible to many researchers and that life sciences data sets are frequently limited, we investigated whether small ANN models could achieve acceptable accuracy in protein-RNA prediction. We experimented with shallow feed-forward ANNs comprising two hidden layers and various non-linearities. These models did not utilize explicit structural information; instead, a sliding window approach was employed to implicitly consider the context of neighboring residues and bases. We explored different training techniques to address the issue of highly unbalanced data. Among the seven most popular non-linearities for feed-forward ANNs, only three—Rectified Linear Unit (ReLU), Gated Linear Unit (GLU), and Hyperbolic Tangent (Tanh)—yielded converging models. Common re-balancing techniques, such as under- and over-sampling of training sets, proved ineffective, whereas increasing the volume of training data and using model ensembles significantly improved performance. The optimal context window size, balancing both false negative and false positive errors, was found to be approximately 30 residues and bases. Our findings indicate that high-accuracy protein-RNA binding prediction is achievable using computing hardware accessible to most educational and research institutions. 1 Introduction Recent advancements in molecular biology have revealed the intricate and multifaceted roles of RNA, sparking significant interest in methods for predicting RNA-protein interactions and previously dismissed as "junk" sequences, large non-coding regions of RNA are now understood to be crucial in the actualization, regulation, and fine-tuning of genetic expression and evolution [ 19 ] . These regions, though not directly involved in the transcription process of converting DNA to RNA to protein, play essential roles in various regulatory mechanisms. A comprehensive understanding of RNA functions, including DNA transcription, splicing mechanisms, interactions with nuclear pore proteins, nucleo-cytoplasmic transport, cytoplasmic motor protein functions, RNA localization, translation, post-translational modifications, and RNA folding stability, necessitates extensive research into RNA-protein binding. Additionally, RNA’s role in encoding small regulatory peptides and non-protein-binding regulatory functions, such as low-affinity strand binding, further underscores the importance of studying these interactions on a larger scale than previously considered [ 6 , 23 ] . To address these needs, researchers have developed various experimental techniques to identify RNA-protein interactions. These methods fall into two categories: RNA-centric (identifying proteins that bind to specific RNA sequences) and protein-centric (identifying RNA sequences that bind to specific proteins). While each method offers unique strengths for targeted studies, they also present limitations when applied to broader research contexts [ 28 ] . Despite advancements in high-throughput sequencing technologies for some proteins, the experimental validation of RNA-protein binding remains labor-intensive and limited in throughput [ 20 ] . In response to these challenges, computational machine learning (ML) approaches have been developed to facilitate the targeted experimental verification of promising RNA-protein interactions, offering a scalable and efficient alternative to traditional experimental methods. 1.1 Existing Literature on Computational Protein-RNA Interaction Modeling The prediction of RNA-protein binding sites has emerged as a vibrant area of research, leveraging various types of input data, including sequencing information, secondary and tertiary structures, and physicochemical properties. Accurate and interpretable models for RNA-protein interactions necessitate a three-dimensional spatial understanding of protein structures, employing analytical approaches to identify structural similarities. Techniques such as template-based clustering [ 43 ] , energy function methods [ 42 ] , electrochemical properties for homologous proteins (e.g., DR_bind1) [ 4 ] , and score-based methods like OPRA [ 25 ] and KYG [ 15 ] have been pivotal in this domain. Despite their initial popularity in the early 2000s, these methods continue to evolve and remain relevant [ 43 ] . However, obtaining the spatial structures of proteins and RNA is a labor-intensive experimental process, with known structures available for only a small subset of possible protein sequences [ 36 ] . This limitation has driven extensive research into computational protein folding, aiming to predict 3D structures from sequence data alone [ 7 ] . Early combinatorial approaches [ 10 ] and recent advancements in large deep learning (DL) models, such as AlphaFold [ 13 ] and subsequent iterations, have achieved remarkable accuracy in solving the protein folding problem [ 41 ] . Nevertheless, these models demand significant computational resources, presenting a challenge for resource-constrained laboratory settings. To mitigate the complexity of high-dimensional data, mixed 3D-2D models have been proposed. For instance, models integrating 2D RNA and 3D protein interactions using score matrices have shown promise [ 40 ] . Further dimensionality reduction has led to the development of 1D or 1D+ models, often utilizing machine learning (ML) to capture subtle sequence-structure relationships that escape traditional analytical methods. Early shallow artificial neural networks (ANNs) [ 11 ] , Naive Bayes classifiers like RNABindR [ 35 ] , support vector machine (SVM) models such as BindN/BindN+ [ 38 ] , Pprint [ 17 ] , PRINTR [ 39 ] , PiRaNhA [ 22 ] , and decision tree or random forest methods like NAPS [ 3 ] and PRBR [ 21 ] , have all contributed significantly to this field. Hybrid SVM and evolutionary algorithms, such as RISP [ 37 ] , also play a crucial role. A more detailed comparison of these methods can be found in [ 26 ] . Despite originating in the early 2000s, these approaches are still actively researched, exemplified by recent work like the scoring SVM model of Kashiwagi et al. [ 14 ] . In recent years, the advent of large-scale DL ANNs with numerous parameters has become increasingly popular for molecular ML research [ 29 ] . Innovative ANN architectures that consider relationships between data entities, such as graph neural networks (GNNs) [ 8 ] and physics-informed neural networks (PINNs) [ 9 ] , have shown great potential. These models predict the energy state of entire molecular structures based on atomic descriptors and their spatial configurations [ 24 ] . GNNs have been particularly useful for RNA [ 12 ] and protein [ 34 ] design, while attention mechanisms have enhanced the learning of molecular structures [ 18 ] and protein-protein interactions [ 2 ] . Additionally, reinforcement learning (RL) has been applied to the design of protein and other biomolecular structures [ 1 ] . The goal of this study and future work is to leverage recent ANN methods within "Green AI" frameworks that emphasize small resource footprints, making advanced computational techniques accessible to researchers without extensive computational resources. This paper explores relatively shallow yet wide and straightforward feed-forward ANN models with limited non-linearity complexity, exploring their applicability to the RNA-protein binding problem. 2 Materials and Methods 2.1 Data Set We utilized a data set of protein and RNA segments, indexed by binding positions, as described in [ 27 ] and constructed by the authors of [ 14 ] . This data set is organized into an “input" folder containing various file types: “.fa" files for protein residues and RNA bases in alphabetical encoding, “.ss" files for structural information encoded in ASCII symbols, and “.dat" files for binding

Read the complete text