GLProtein: Global-and-Local Structure Aware Protein Representation Learning
Yunqing Liu, Wenqi Fan, Xiaoyong Wei, Qing Li · 2025
Read GLProtein: Global-and-Local Structure Aware Protein Representation Learning by Yunqing Liu, Wenqi Fan, Xiaoyong Wei, Qing Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06294.txt.
Introduction
Teaching a computer what a protein does takes more than its letter sequence: shape matters, at every scale. Yunqing Liu and co-authors build GLProtein, a pre-training framework that reads both the whole and the parts. Globally, it scores how alike two proteins' structures are. Locally, it encodes the small molecular pieces amino acids are made of, alongside a map of three-dimensional distances inside the protein.
Training mixes masked modeling, where parts of the protein are hidden and must be guessed, with the global and local signals above. The authors call GLProtein the first protein pre-training framework to fuse both scales of structure. Across tasks such as predicting whether two proteins interact and which residues touch, it beat earlier methods. They argue that honoring structure at both scales yields richer protein representations for biology.
Catalog record
| CREATOR | Yunqing Liu, Wenqi Fan, Xiaoyong Wei, Qing Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06294
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GLProtein: Global-and-Local Structure Aware Protein Representation Learning Yunqing Liu, Wenqi Fan, Xiaoyong Wei, Qing Li Abstract Proteins are central to biological systems, participating as building blocks across all forms of life. Despite advancements in understanding protein functions through protein sequence analysis, there remains potential for further exploration in integrating protein structural information. We argue that the structural information of proteins is not only limited to their 3D information but also encompasses information from amino acid molecules (local information) to protein-protein structure similarity (global information). To address this, we propose GLProtein , the first framework in protein pre-training that incorporates both global structural similarity and local amino acid details to enhance prediction accuracy and functional insights. GLProtein innovatively combines protein-masked modelling with triplet structure similarity scoring, protein 3D distance encoding and substructure-based amino acid molecule encoding. Experimental results demonstrate that GLProtein outperforms previous methods in several bioinformatics tasks, including predicting protein-protein interaction, contact prediction, and so on. 1 Introduction Proteins are fundamental to virtually every biological process, serving as the building blocks for cells and organs and acting as catalysts, messengers, and structural elements in all life forms. Understanding the structure and function of proteins is crucial for advances in health guo2017roles ; williams2019plasma ; li2022dietary ; ding2019selective , agriculture rischer2020cellular ; peydayesh2021protein ; davis2024food , and environmental science wheeler2021environmental ; sobhi2023advanced ; zhao2024holistic ; weng2021late , making protein research a cornerstone of biotechnology and medicinal science. Recognizing the critical role of proteins in various scientific fields, many efforts have been made to design computational methods to further understand these crucial molecules sliwoski2014computational ; zhao2020exploring ; li2024tomg . Particularly, protein representation learning, as one significant part, involves capturing the complex features and relationships within proteins in a condensed form that can be utilized for various computational tasks and analyses. It is crucial for enhancing the understanding of protein structures and functions, improving predictive modelling in bioinformatics, facilitating the drug discovery process, and advancing our knowledge of biological systems through interpretable and efficient representations of proteins somnath2021multi ; liu2023generative ; gao2024drugclip . Figure 1: An illustration on protein representation learning flow. Protein information from local information (inside proteins) to global information (between proteins) can be used as input. This input undergoes encoding by a protein encoder to generate a protein representation across various downstream tasks. In recent years, the success of language models zhao2024recommender ; hu2023improving ; li2024empowering ; li2024molreflect in natural language processing (NLP) has paved the way for innovative approaches in bioinformatics areas, such as protein modeling xiao2021modeling ; chowdhury2022single , protein generation madani2020progen ; ferruz2022protgpt2 , and protein-protein interaction prediction wang2019high ; ofer2021language . To be specific, by treating protein sequences as linguistic strings, these models have demonstrated remarkable effectiveness in predicting protein function based on sequence data alone. Technically, as shown in Figure 1 , protein sequences (e.g., the amino acid sequence ‘MLTAHV…’ ) are treated as sentences in natural language and amino acids (e.g., ‘M’, ‘L’, and ‘T’) resemble words. Thus, Leveraging the powerful BERT architecture originally developed for natural language, ProtBert elnaggar2021prottrans adeptly adapts the BERT devlin2018bert masked language modelling framework to the field of bioinformatics. This analogy allows ProtBert to employ the technique of predicting randomly masked elements in sequences, thereby learning to identify complex patterns and dependencies among amino acids. Similar to ProtBert, ESM rives2021biological ; verkuil2022language ; hie2022high extends this paradigm by employing a more refined Transformer-based architecture, focusing on capturing the evolutionary relationships and functional dynamics within protein sequences. In other words, most existing protein modelling methods aim to perform protein representation learning by encoding the protein’s sequence information for various downstream applications, such as amino acid contact prediction singh2022spot , protein homology detection kaminski2023plm , protein stability prediction chu2024protein , protein-protein interaction identification wang2019high ; ofer2021language , etc. Despite the aforementioned successes, most existing protein language modelling methods suffer from intrinsic limitations. Specifically, most of their focuses have primarily been on the amino acid sequence, often neglecting the crucial aspects of protein structure. Proteins possess the ability to fold into diverse 3D shapes, interacting with various proteins and small molecules in biologically significant ways jumper2021highly ; mirdita2022colabfold ; tsaban2022harnessing . Since protein’s structure determines function greslehner2018molecular , utilizing protein 3D structure information effectively is crucial for protein language modelling, in which many studies have demonstrated the potential of pre-training on experimentally determined protein structures hermosilla2022contrastive ; su2023saprot ; wang2022lm ; zhang2022protein . Nevertheless, these methods focus only on the structure within proteins and ignore the global similarities between proteins. We emphasize that the information on protein structure is not only limited to its structure (i.e., conformation) in 3D space but also includes information ranging from local amino acid molecules to the global structural similarity between proteins, as shown in Figure 1 . Local information involves the detailed properties and orientations of individual amino acids, which can affect protein stability and biochemical activity renaud2021deeprank . These specifics are vital as they demonstrate how modifications or mutations at the amino acid level can alter the overall structure and functionality of the protein jumper2021highly . Furthermore, protein structure similarities provide information on evolutionary relationships and functional classes, which are crucial for understanding how structurally similar proteins of different species can perform similar or complementary functions within biological systems hamamsy2023protein . For example, as shown in Figure 2 , the bacterial ice-binding protein FfIBP and the diatom adhesion protein CaTrailin_4 exhibit no detectable sequence similarity despite their functional similarities zackova2023diatom ; al2023protein . Their predicted structures exhibit a remarkable similarity (TM-Score = 0.6), with both proteins adopting a beta-helical fold comprised of two units linked by an alpha helix. This structural topology is characteristic of ice-binding proteins. Such comparisons are key to predicting the functions of newly discovered proteins based on known structures, thereby enhancing our grasp of complex biological processes and interactions lipman1985rapid ; hamamsy2022tm ; hamamsy2023protein . However, most existing approaches have ineffectively incorporated amino acid molecule information and protein structural similarities into protein representation learning. (a) FfIBP (b) CaTrailin_4 (c) Structure Alignment Figure 2: An example of protein structure similarity. Given the predictive structures of a protein pair: (a) the bacterial ice-binding protein FfIBP and (b) the diatom adhesion protein CaTrailin_4 zackova2023diatom ; al2023protein , (c) is FfIBP (blue) and CaTrailin_4 (green) structure alignment. To eliminate these limitations, we propose a novel protein pre-training framework GLProtein with G lobal-and- L ocal Protein structure information for protein representation learning. Our major contributions are summarized as follows: • We introduce a principled approach for capturing protein structural characteristics in a thorough and detailed manner. This approach incorporates a holistic view of protein structure data, encompassing global structural information, protein structure similarities, as well as local structure information such as protein 3D distance encoding and substructure-based molecular encoding. To the best of our knowledge, we are the first to investigate global and local protein structure information in protein language modelling. • We propose a novel protein pre-training framework (GLProtein), where protein structure information is incorporated into protein language models for enhancing protein representation learning. • The comprehensive experiments demonstrate the effectiveness of the proposed method on a wide range of downstream tasks, which verify the performance superiority of GLProtein. 2 Related Work In this section,