LAMP-PRo: Label-aware Attention for Multi-label Prediction of DNA- and RNA-binding Proteins using Protein Language Models
Nimisha Ghosh, Dheeran Sankaran, Rahul Balakrishnan Adhi, Sharath S, Amrut Anand · 2025
Read LAMP-PRo: Label-aware Attention for Multi-label Prediction of DNA- and RNA-binding Proteins using Protein Language Models by Nimisha Ghosh, Dheeran Sankaran, Rahul Balakrishnan Adhi, Sharath S, Amrut Anand (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24262.txt.
Introduction
Proteins that bind DNA look much like proteins that bind RNA, and telling them apart by sequence is a known trap. Nimisha Ghosh and 4 co-authors built LAMP-PRo, a predictor that uses a pre-trained protein language model with label-aware attention. Proteins that bind both are a further hard case, often missed.
The system embeds sequences, runs them through a convolutional layer, then applies self-attention for context. Label-aware attention builds a tailored view for each class, and cross-label attention captures links between the DNA and RNA classes. Tests show steady, competitive performance against prior methods. Visualizations highlight which sequence parts drove each call.
Catalog record
| CREATOR | Nimisha Ghosh, Dheeran Sankaran, Rahul Balakrishnan Adhi, Sharath S, Amrut Anand |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24262
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LAMP-PRo: Label-aware Attention for Multi-label Prediction of DNA- and RNA-binding Proteins using Protein Language Models Nimisha Ghosh, Dheeran Sankaran, Rahul Balakrishnan Adhi, Sharath S, Amrut Anand Abstract Identifying DNA- (DBPs) and RNA-binding proteins (RBPs) is crucial for the understanding of cell function, molecular interactions as well as regulatory functions. Owing to their high similarity, most of the existing approaches face challenges in differentiating between DBPs and RBPs leading to high cross-prediction errors. Moreover, identifying proteins which bind to both DNA and RNA (DRBPs) is also quite a challenging task. In this regard, we propose a novel framework viz. LAMP-PRo which is based on pre-trained protein language model (PLM), attention mechanisms and multi-label learning to mitigate these issues. First, pre-trained PLM such ESM-2 is used for embedding the protein sequences followed by convolutional neural network (CNN). Subsequently multi-head self-attention mechanism is applied for the contextual information while label-aware attention is used to compute class-specific representations by attending to the sequence in a way that is tailored to each label (DBP, RBP and non-NABP) in a multi-label setup. We have also included a novel cross-label attention mechanism to explicitly capture dependencies between DNA- and RNA-binding proteins, enabling more accurate prediction of DRBP. Finally, a linear layer followed by a sigmoid function are used for the final prediction. Extensive experiments are carried out to compare LAMP-PRo with the existing methods wherein the proposed model shows consistent competent performance. Furthermore, we also provide visualization to showcase model interpretability, highlighting which parts of the sequence are most relevant for a predicted label. The original datasets are available at http://bliulab.net/iDRBP_MMC and the codes are available at https://github.com/NimishaGhosh/LAMP-PRo. 1 Introduction To understand complex cellular operations, it is imperative to have knowledge of the functional roles being executed by nucleic acid binding proteins (NABP); broadly classified as DNA-binding proteins (DBPs) and RNA-binding proteins (RBPs). The key functionalities of DBPs and RBPs include transcription and translation regulation, DNA replication and repair, chromatin organisation, RNA splicing etc. Thus, analysis of these proteins may unveil the fundamental mechanisms of several diseases like cancer, neurological disorders, myopathies etc. Thus, classifying such proteins based on their functional characteristics enable the researchers to understand the molecular processes of a cell. However, there are several challenges that are faced while executing such classification. First of all, DBPs and RBPs have very similar structure and highly correlated in terms of function and evolution as well, making it highly difficult to distinguish them, thus leading to cross-prediction problem; DBP is identified as RBP and vice-versa. Second, most of the works do not explore the possibility of designing a model for multi-label learning to identify the relationship between labels. In this regard, there are some works like [ 1 , 2 ] who have applied deep learning architecture as well as multi-label learning for such prediction. To identify DBPs and RBPs, high throughput screening techniques can be considered to be an important step [ 3 ] . Many other methods have also been employed such as nuclear magnetic resonance spectroscopy [ 4 ] , X-ray crystallography [ 5 ] , etc. These methods can provide a comprehensive understanding of how proteins bind to DNA and RNA. However, they are time-consuming and expensive, leading to the development of computational methods. In this regard, several works have come up in the past few years but mostly they consider DBP and RBP recognition tasks separately; very few of them address both. For DBP prediction, in [ 6 ] , the authors have used evolutionary information along with Support Vector Machine (SVM) wherein they achieved an accuracy of 86.62%. Deep-WET proposed in [ 7 ] uses feature encoding schemes like Global Vectors, Word2Vec and fastText for protein sequence, the results of which are combined and passed through Differential Evolution (DE) algorithm. Finally, the optimal feature subset learned from SHapley Additive exPlanations (SHAP) are provided as input to Convolutional Neural Network (CNN) for the final prediction. This led to an accuracy of 78.08%, MCC of 0.550 and AUC of 0.805. Ahmad et al. [ 8 ] have proposed StackDPP which utilises Random Forest (RF) and Recursive Feature Elimination with Cross-validation (RFECV) to select best features and eventually uses a stacking archutecture for the final prediction of DBPs. Independent testing on the PDB186 dataset fetched an accuracy of 93%. LBi-DBP proposed by Zeng et al. [ 9 ] uses five sequence feature sources like position specific scoring matrix (PSSM), Hidden Markov Model Profile (HMM), Predicted Secondary Structure Probability Matrix (PSSPM), Predicted Solvent Accessibility Probability Matrix (PSAPM) and Predicted Probabilities of DNA-Binding Sites (PPDBS) and subsequently applies BiLSTM to extract the protein sequence context information. This information is then combined with five pseudo sequence order (SO) features and provided as input to an MLP-based neural network module to predict DBP. On UniSwiss-Tst and PDB2272 datasets, LBi-DBP achieves MCC values of 0.762 and 0.574. In [ 10 ] , Kumar et al. have considered evolutionary information in the form of PSSM for the encoding. Further, they have used SVM to distinguish between RBP and non-binding proteins with an MCC of 0.66. Ma et al. [ 11 ] have proposed PRBP which uses RF along with an RNA-binding residue to predict RBPs. PRBP achieves an accuracy of 85.61%, MCC of 0.67 and AUC of 0.90. Zhang et al. [ 12 ] have also explored the detection of RBPs by combining evolutionary information and physicochemical properties of protein sequences along with SVM. In this regard, they have achieved an AUC of 0.975 and MCC of 0.814. This work has been further improved in [ 13 ] by introducing CNN where they achieved an MCC of 0.82. More recently, Yan et al. have proposed Seq-RBPPred [ 14 ] which uses feature representation from biophysical properties and hidden-state features derived from protein sequences by employing Protr, UniRep, SeqVec and ESM-1b. Henceforth, they have used XGBoost on these features to predict RBPs. This resulted in an accuracy of 92% and MCC of 0.75. Some notable works which have addressed both DBPs and RBPs are described next. Zhang et al. [ 15 ] have proposed DeepDRBP-2L which uses CNN and LSTM for the prediction of DBP and RBP. Although the prediction accuracy of DBP is quite good, RBP is relatively low. Overall, the model achieves a total accuracy of 80%. Wu et al. [ 16 ] employ two layers of CNN and one layer of LSTM to predict DBPs and RBPs resulting in the total prediction accuracy of 81%. iDRBP_MMC proposed in [ 17 ] uses multi-label learning strategy during training process to reduce cross-prediction between DNA-binding proteins and RNA-binding proteins. It incorporates motif-based CNN and traditional CNN to capture special patterns of nucleic acid binding proteins. In another work, Wang et al. [ 18 ] have proposed a hierarchical ensemble learning method to predict DNA-binding and RNA-binding proteins. It fuses 60 base models which integrates multiple tasks, feature sets and classification algorithms for such prediction. However, a major limitation lies in their scalability, as the process of designing, training, and integrating multiple models reduces both interpretability and transparency. DMJL [ 1 ] uses a deep multi-label joint learning framework that exploits the relationships between multiple labels and binding proteins. First, a