Graph Neural Network-Based Reinforcement Learning for Controlling Biological Networks – the GATTACA Framework
Andrzej Mizera, Jakub Zarzycki · 2025
Read Graph Neural Network-Based Reinforcement Learning for Controlling Biological Networks – the GATTACA Framework by Andrzej Mizera, Jakub Zarzycki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02712.txt.
Introduction
Andrzej Mizera and Jakub Zarzycki published a computing paper in 2025 on steering cell networks with reinforcement learning guided by graph networks. Reprogramming cells between types could treat complex diseases, but lab searches are slow and pricey. Their framework, GATTACA, learns control policies for Boolean models of gene and signaling networks under asynchronous updating. A sharpened method finds near-attractor states to keep the search tractable.
Graph convolution layers inside the value network bake the network's wiring into the learner's view of dynamics. Tests on several large real biological networks showed the approach scales and works. The authors offer it as in-silico help for designing reprogramming strategies.
Catalog record
| CREATOR | Andrzej Mizera, Jakub Zarzycki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02712
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph Neural Network-Based Reinforcement Learning for Controlling Biological Networks – the GATTACA Framework Thanks: A. Mizera and J. Zarzycki are with the Faculty of Mathematics, Informatics and Mechanics, University of Warsaw, Banacha 2, 02-097 Warsaw, Poland. A. Mizera is with the IDEAS Research Institute, Królewska 27, 00-060 Warsaw, Poland, and J. Zarzycki is with IDEAS NCBR Sp. z o.o., Chmielna 69, 00-801 Warsaw, Poland. Corresponding author: A. Mizera, [email protected] . Andrzej Mizera, Jakub Zarzycki Abstract Cellular reprogramming, the artificial transformation of one cell type into another, has been attracting increasing research attention due to its therapeutic potential for complex diseases. However, identifying effective reprogramming strategies through classical wet-lab experiments is hindered by lengthy time commitments and high costs. In this study, we explore the use of deep reinforcement learning (DRL) to control Boolean network models of complex biological systems, such as gene regulatory and signalling pathway networks. We formulate a novel control problem for Boolean network models under the asynchronous update mode, specifically in the context of cellular reprogramming. To solve it, we devise GATTACA, a scalable computational framework. To facilitate scalability of our framework, we consider previously introduced concept of a pseudo-attractor and improve the procedure for effective identification of pseudo-attractor states. We then incorporate graph neural networks with graph convolution operations into the artificial neural network approximator of the DRL agent’s action-value function. This allows us to leverage the available knowledge on the structure of a biological system and to indirectly, yet effectively, encode the system’s modelled dynamics into a latent representation. Experiments on several large-scale, real-world biological networks from the literature demonstrate the scalability and effectiveness of our approach. I Introduction Complex diseases remain a major challenge for biomedical research due to the intricate interactions between genes forming gene regulatory networks (GRNs). These networks exhibit complex dynamics emerging from the structure of the network: the state of the genome evolves in time, finally reaching some stable gene expression profiles characterising cell types or, more generally, stable cellular functional states [ 1 ] . In some cases, when a GRN is perturbed, it can reach an “unhealthy” state, that is otherwise inaccessible [ 2 ] . An artificial change of the cell fate, referred to as cellular reprogramming , aims to solve this issue by steering the GRN back to a “healthy” state. However, identifying effective reprogramming targets and intervention strategies through wet-lab experiments alone is prohibitively expensive and time-consuming. This motivates the development of in-silico methods. Capturing emergent properties of GRN dynamics requires the consideration of the system as a whole. To this end, GRNs can be holistically modelled with the formalism of Boolean networks (BNs) originally introduced by Kauffman in [ 3 ] . Its simplicity enables tractable simulations and analysis of non-linear biological dynamics while retaining essential, emergent complex system behaviour. Cellular reprogramming can be formulated as a control problem within the framework of BNs. To support cellular reprogramming, control strategies must be computed for large-scale BNs, taking into account both the structure and dynamics of the network [ 4 ] . Scalability is the main concern when devising new computational methods for control of asynchronous BNs. Existing state-of-the-art methods and tools, such as CABEAN [ 5 ] , provide exact algorithms for attractor-based control. Nevertheless, they are limited in scalability because of the infamous “curse of dimensionality” problem, i.e. the size of the state space grows exponentially with the number of genes considered, which is handled by additional assumptions about network decomposability. Deep reinforcement learning (DRL) has proven highly successful in decision problems characterised by very large state-action spaces [ 6 ] . Therefore, it seems a promising alternative to traditional methods for controlling GRNs. In [ 7 ] , pbn-STAC – a DRL-based tool for control of asynchronous BNs and probabilistic Boolean networks (PBNs) was introduced, which was a result of exploration into the potential of DRL for developing scalable control methods for both BN and PBN models of GRNs in the context of cellular reprogramming. Therein, notions of a pseudo-attractor and a pseudo-attractor state were introduced, a pseudo-attractor states identification procedure (PASIP) was devised, and a novel control problem, i.e. the Source-Target Attractor Control, that corresponds with the problem of identifying cellular reprogramming strategies was formulated. The pbn-STAC framework was shown to be able to find optimal and sub-optimal control strategies between source and target attractors for BN and PBN models of sizes up to 33 nodes. In this study, we build on the initial idea of [ 7 ] to devise a general and scalable approach capable of handling very large BN models of biological networks. To this end, we introduce the G raph-based At tractor- Ta rget C ontrol A lgorithm (GATTACA) computational framework to solve a novel, general target-control problem for BN models of biological networks under the asynchronous update mode. Our new control problem is tailored for cellular reprogramming in the sense that control actions are allowed to take place only in attractor states as they correspond to observable phenotypic cellular states understood as discrete, mutually exclusive, stable, and observable cell phenotypes or cell fates that can undergo transitions from one to another under the influence of regulatory inputs. This approach addresses the constraints of wet-lab biology, where it is very difficult to experimentally determine a transient state of a cell, without destroying it, for the application of a control intervention in a real-world scenario. In contrast, stable cell phenotypes, which correspond to the attractor states of a dynamical system [ 8 ] , are expected to be more easily, optically observable realisations of complex interactions between the genome, epigenome, and local environment. To reflect these constraints, we restrict control actions to be applied only in observable phenotypic cellular states, which are represented by attractors of a BN model. The core of our GATTACA framework is a Graph Neural Network (GNN)-based Q-learning agent which learns minimal control strategies that drive the system from a given source attractor state to one aligned with a given target configuration, i.e. an attractor with user-specified values for a subset of nodes. The structure of the biological network is encoded directly into the GNN, allowing the model to exploit topological relationships between the network components (nodes) during training. Furthermore, to facilitate effective identification of attractors in large BN models of complex networks, we consider the notion of pseudo-attractor states introduced in [ 7 ] and we enhance the pseudo-attractor states identification procedure proposed therein. To assess the scalability potential, we evaluate the GATTACA framework on several large-scale, real-world biological networks, demonstrating its scalability and effectiveness in cases where exact symbolic approaches, such as those implemented in CABEAN, fail. Our contributions result in a scalable and effective computational method for cellular reprogramming scenarios. The paper is organised as follows. Related works are discussed in Section II . The preliminaries are presented in Section III . Our novel target control problem in the context of cellular reprogramming is formulated in Section IV . Next, a DRL-based framework for controlling large-scale biological networks is developed in Section V . The framework is evaluated on large models of real-world gene regulatory and signalling networks in accordance with a methodology presented in Section VI . The obtained evaluation