Topotein: Topological Deep Learning for Protein Representation Learning

Zhiyu Wang, Arian Jamasb, Mustafa Hajij, Alex Morehead, Luke Braithwaite, Pietro Liò · 2025

Read Topotein: Topological Deep Learning for Protein Representation Learning by Zhiyu Wang, Arian Jamasb, Mustafa Hajij, Alex Morehead, Luke Braithwaite, Pietro Liò (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-03885.txt.

Introduction

Topotein, a framework bringing topological deep learning to protein learning, is the subject of a 2025 research paper by Zhiyu Wang and five co-authors. How a protein's structure maps to its function is a central question in biology. Sequence and graph methods capture much, but miss the hierarchical organisation built into protein structures, from residues up to the whole molecule.

Their Protein Combinatorial Complex represents a protein at several levels at once: residues, secondary structures, and complete proteins, keeping geometric information at every level. A companion network, TCPNet, passes messages across that hierarchy with geometry-aware updates that respect rotations and translations. Four protein learning tasks test the framework against leading geometric graph networks. TCPNet wins consistently across them. Its clearest strength appears in fold classification, where recognising how secondary structures are arranged matters most. The results validate the value of layered topological features in this setting.

Catalog record

CREATORZhiyu Wang, Arian Jamasb, Mustafa Hajij, Alex Morehead, Luke Braithwaite, Pietro Liò
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-03885

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Topotein: Topological Deep Learning for Protein Representation Learning Zhiyu Wang, Arian Jamasb, Mustafa Hajij, Alex Morehead, Luke Braithwaite, Pietro Liò Abstract Protein representation learning (PRL) is crucial for understanding structure-function relationships, yet current sequence- and graph-based methods fail to capture the hierarchical organization inherent in protein structures. We introduce Topotein, a comprehensive framework that applies topological deep learning to PRL through the novel Protein Combinatorial Complex (PCC) and Topology-Complete Perceptron Network (TCPNet). Our PCC represents proteins at multiple hierarchical levels—from residues to secondary structures to complete proteins—while preserving geometric information at each level. TCPNet employs SE(3)-equivariant message passing across these hierarchical structures, enabling more effective capture of multi-scale structural patterns. Through extensive experiments on four PRL tasks, TCPNet consistently outperforms state-of-the-art geometric graph neural networks. Our approach demonstrates particular strength in tasks such as fold classification which require understanding of secondary structure arrangements, validating the importance of hierarchical topological features for protein analysis. Our code is made available at github.com/ZW471/TopoteinWorkshop for reproduction. 1 Introduction Advances in protein structure prediction have revolutionized structural data availability ( Jumper et al. 2021 ; Lin et al. 2023 ) , with over 200 million protein structures now available through AlphaFold Database ( Varadi et al. 2022 ) and even larger collections like ESM Atlas ( Lin et al. 2023 ) containing over 600 million structures. However, these structures remain largely unannotated, creating a critical gap between available data and functional understanding ( Jamasb et al. 2024 ) . Protein Representation Learning (PRL) addresses this challenge by learning vector representations that bypass manual feature engineering, automatically extracting meaningful patterns from protein sequences or structures to enable effective downstream prediction of functional properties ( Gligorijević et al. 2021 ) . Current PRL approaches fall into two main categories: transformer-based protein language models that process amino acid sequences ( Lin et al. 2023 ; Heinzinger et al. 2024 ; Elnaggar et al. 2020 ; Elnaggar et al. 2023 ) , and structure-based geometric graph neural networks (GGNNs) that represent proteins as 3D graphs of residues ( Morehead & Cheng 2024 ; Jing et al. 2020 ; Zhang et al. 2022 ) . However, both approaches are typically limited to learning local representations at the residue level. They fundamentally miss the hierarchical organization of proteins that would enable learning representations simultaneously across multiple levels, including the more global secondary structure level. A holistic understanding of proteins requires learning representations at all hierarchical levels simultaneously. In particular, secondary structures and their spatial arrangements are central to how biologists understand and classify proteins. Popular protein structure classification systems like CATH and SCOP employ hierarchical schemes where three out of four levels in CATH and half the levels in SCOP are based on secondary structure organization ( Knudsen & Wiuf 2010 ; Murzin et al. 1995 ) . This biological importance translates directly to computational applications: recent generative modeling work like ProtComposer ( Stark et al. 2025 ) has demonstrated that using 3D ellipsoids that represent secondary structures to guide the protein generation process significantly improves protein design quality, achieving better designability, novelty, and structural diversity compared to residue-only approaches. The success in generative modeling suggests that secondary structure representations could similarly enhance PRL when combined with residue-level representations, enabling more expressive pure-structure representations that better capture the hierarchical organization of protein architecture. This can be particularly important for applications such as more expressive pre-sequence filtering and inverse folding in de novo antibody design. Figure 1: Overview of the Topotein framework. Given PDB protein structures ( Berman et al. 2000 ) , we construct Protein Combinatorial Complexes that hierarchically organize residues (rank-0), interactions (rank-1), secondary structures (rank-2), and complete proteins (rank-3). These multi-rank representations can be processed by any topological neural network (e.g. our TCPNet) to generate protein embeddings for downstream prediction tasks. Topological Deep Learning (TDL) ( Papillon et al. 2023 ) offers a promising approach to address these hierarchical modeling limitations by extending graph neural networks to generalized topological domains. Among these domains, the most popular is hypergraphs, which allow edges to connect sets of nodes rather than pairs, enabling higher-order relationships but still representing flat structures. On the other hand, simplicial and cellular complexes address hierarchical modeling by representing relationships beyond node and edge levels—from nodes to edges to faces and volumes. However, these impose strict boundary requirements where a rank- n cell ( n -cell for short) can only exist if all boundary (n-1) -cells also exist, introducing artificial constraints for biological systems. A recently introduced TDL domain, combinatorial complexes ( Hajij et al. 2022 ) , provides a more flexible solution by generalizing both cellular complexes and hypergraphs, merging the hierarchical properties of cellular complexes with the flexible set-type relationships of hypergraphs while removing strict boundary constraints. One of the most representative works using combinatorial complexes is E(n)-equivariant Topological Neural Networks (ETNN) ( Battiloro et al. 2024 ) , which achieved state-of-the-art results on small molecule property prediction by representing molecules as combinatorial complexes with atoms as rank-0 cells, bonds as rank-1 cells, and rings/functional groups as rank-2 cells. This flexibility makes combinatorial complexes particularly suitable for protein representations, where secondary structures can be modeled as higher-order cells containing residues without artificial edges. However, ETNN has not been tested on large biomolecules like proteins and lacks the support for geometric features such as orientations that are needed for protein secondary structures. This raises our central research question: What novel topological data structures and neural architectures are needed to explicitly capture protein-specific hierarchical inductive biases for more effective protein representation learning? We answer this question by presenting Topotein (Figure 1 ), the first topological framework for learning protein structures. Following a standard PRL workflow ( Jamasb et al. 2024 ) , we introduce two key innovations: Protein Combinatorial Complexes (PCCs) as a hierarchical set-type structure to replace traditional pair-wise graphs, and topological neural network (TNN) encoders such as TCPNet that leverage these multi-rank representations to generate protein embeddings for downstream tasks. Our contributions are threefold: • Protein Combinatorial Complex : A hierarchical data structure representing proteins at multiple levels with comprehensive featurization schemes for scalar and vector features, along with localized reference frames enabling SE(3)-equivariant topological networks. • Topology-Complete Perceptron Network (TCPNet) : An SE(3)-equivariant TNN designed for hierarchical protein structures, featuring four-step hierarchical message passing that leverages the multi-rank representations and localized reference frames from PCCs. • Comprehensive Experimental Validation : We demonstrate that TCPNet consistently outperforms state-of-the-art GNNs across four protein analysis tasks, with improved performance and robustness in structure-only scenarios. Additionally, we show that effective TDL requires careful architectural design by comparing against adapted versions of existing methods (GVP-GNN ( Jing et al. 2020 ) and ETNN ( Battiloro et al. 2024 ) ). 2 Why Topological Representations for Proteins? Figure 2: Message passing comparison across protein representation paradigms. The figure illustrates three approaches to protein representation, each showing five consecutive steps of passing information from one secondary structure to another. Note that there should also be edges between nodes and supernodes in the middle row, but they are omitted for clarity. Traditional GNNs represent proteins as graphs where nodes are residues and edges connect spatially proximate residues, typically determined by k-nearest neighbors or

Read the complete text