Symbolic Foundation Regressor on Complex Networks

Weiting Liu, Jiaxu Cui, Jiao Hu, En Wang, Bo Yang · 2025

Read Symbolic Foundation Regressor on Complex Networks by Weiting Liu, Jiaxu Cui, Jiao Hu, En Wang, Bo Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21879.txt.

Introduction

Weiting Liu and co-authors present a pretrained symbolic regressor for complex networks in this 2025 paper. Symbolic regression seeks a readable formula behind data, not just a forecast. Networks add many interacting parts, which makes formula hunting slow by hand.

Their model was trained in advance and then applied to fresh problems. It handles plain symbolic tasks, network data, and the recovery of network dynamics laws. Tests spanned physics, biochemistry, ecology, and disease spread. Equation finding ran about three times more efficiently than baseline tools while keeping accuracy. Applied to global outbreak data, it fit well and gave intuitive spread laws.

Catalog record

CREATORWeiting Liu, Jiaxu Cui, Jiao Hu, En Wang, Bo Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21879

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Symbolic Foundation Regressor on Complex Networks Weiting Liu, Jiaxu Cui, Jiao Hu, En Wang, Bo Yang Abstract In science, we are interested not only in forecasting but also in understanding how predictions are made, specifically what the interpretable underlying model looks like. Data-driven machine learning technology can significantly streamline the complex and time-consuming traditional manual process of discovering scientific laws, helping us gain insights into fundamental issues in modern science. In this work, we introduce a pre-trained symbolic foundation regressor that can effectively compress complex data with numerous interacting variables while producing interpretable physical representations. Our model has been rigorously tested on non-network symbolic regression, symbolic regression on complex networks, and the inference of network dynamics across various domains, including physics, biochemistry, ecology, and epidemiology. The results indicate a remarkable improvement in equation inference efficiency, being three times more effective than baseline approaches while maintaining accurate predictions. Furthermore, we apply our model to uncover more intuitive laws of interaction transmission from global epidemic outbreak data, achieving optimal data fitting. This model extends the application boundary of the pre-trained symbolic regression models to complex networks, and we believe it provides a foundational solution for revealing the hidden mechanisms behind changes in complex phenomena, enhancing interpretability, and inspiring further scientific discoveries. keywords Scientific discovery, Symbolic regression, Complex networks, Foundation model Introduction Mankind’s pursuit of scientific laws and the eagerness to explore the unknown have never ceased. From Galileo’s principle of relativity and Hermann’s law of conservation of energy to Schrödinger’s wave equation in modern quantum mechanics, scientific revolutions have long been linked to the milestone discoveries of these laws. Traditionally, this discovery process has depended primarily on human intelligence, requiring strong empirical assumptions [ 1 ] and often taking a considerable amount of time, accompanied by elements of chance. For instance, it took thousands of years, from ancient stargazing activities and hypotheses about celestial movement, to the discovery of the law of universal gravitation, which helps us understand the solar system. Fortunately, with the flourishing development of artificial intelligence technology, data-driven machine learning methods show significant potential to accelerate the process of scientific discovery [ 2 , 3 , 4 ] . For example, by using 30 years of trajectory data from our solar system’s sun, planets, and large moons, Newton’s law of gravitation has been successfully and efficiently identified through a combination of graph networks and symbolic regression [ 5 ] . The origins of data-driven methods for mining symbolic scientific laws trace back to the 1950s, when genetic algorithms [ 6 ] were utilized to search for target mathematical expressions fitting input-output pairs across a broad expression space. The regression tools developed based on this principle, such as Eureqa [ 7 ] , GPLearn [ 8 ] , and PySR [ 9 ] , have been instrumental in deriving analytical formulas for the design of one-dimensional sonic crystals [ 10 ] , discovering a mass scaling relationship for planar black holes in spiral galaxies [ 11 ] , and aiding in jet background subtraction during heavy-ion collisions [ 12 ] . However, when exploring a vast expression space, search-based approaches often require extensive time and yield complex, hard-to-understand outcome expressions, limiting their practical applications. Learning-based symbolic regression approaches introduce assumptions such as sparsity [ 13 , 14 , 15 , 16 , 17 , 18 , 19 ] and physical symmetry [ 20 ] , along with external inference systems [ 21 ] , to identify simple and scientifically meaningful mathematical expressions, and employ cutting-edge techniques like reinforcement learning [ 22 , 23 , 24 , 25 , 26 ] or Monte Carlo tree search [ 27 , 28 , 29 ] to efficiently perform trial-and-error processes. Nonetheless, they continue to struggle with defining scientifically meaningful expressions, experience long inference times, and do not fully leverage existing prior knowledge and data. With the emergence of large language models such as ChatGPT [ 30 ] and DeepSeek [ 31 ] , artificial intelligence technology has reached a new stage of development, achieving impressive results in protein design [ 32 ] and natural evolution simulation [ 33 ] . Due to being built on extensive data and knowledge, they typically exhibit remarkable generality and can adapt to various tasks. Inspired by this principle, a new generation of scientific discovery techniques has emerged, specifically the pre-trained symbolic regression models [ 34 , 35 , 36 , 37 , 38 ] , which create extensive mappings from data to equations, such as 100 million data-equation pairs [ 35 ] , to pre-train transformer-based autoregressive models. Through the integration of massive knowledge, these pre-trained models have the potential to emerge predictive abilities for new equations. Meanwhile, in contrast to the hour-long search overhead associated with search-based approaches, these models do not require starting from scratch during testing. Instead, the input data is only propagated forward, allowing for the quick generation of the corresponding equation in just minutes. However, the performance of existing pre-trained models for symbolic regression problems significantly declines when dealing with more than three variables [ 35 ] , and they can typically handle up to a maximum of ten variables [ 36 ] . This can lead to resistance in discovering scientific laws, as complex phenomena often arise from the coevolution of numerous interrelated variables. For example, global epidemic transmission involves free variables from over 200 countries and regions [ 39 ] . If the modeling is fine enough to consider each individual as a variable, the transmission system could encompass over a billion free variables. Therefore, how to represent the numerous complex phenomena generated by so many variables and the various interactive relationships formed between variables, while effectively and efficiently uncovering the underlying simple governing laws, remains an open challenge. In this work, we propose a symbolic foundation regressor on complex networks that can effectively handle spatio-temporal data of complex phenomena with massive correlated variables and efficiently reconstruct the corresponding governing equations to address the challenge. We create approximately 2 billion mathematical expressions on complex networks as the training set to pre-train the foundation model, allowing it to learn a unified mapping from the data space to the expression space. Our analysis of symbolic regression tasks involving independent (non-network) low-dimensional variables, as well as those applied to complex networks, alongside various network dynamics scenarios in fields such as physics, biochemistry, ecology, and epidemiology, shows that our model is highly applicable, effective, and efficient. In particular, within the context of network dynamics scenarios, our model can reconstruct the network dynamics equation in only 1.2 minutes, which is more than three times faster than the search-based and learning-based approaches, and shorten the time for discovering more accurate new laws of real-world global infectious disease outbreaks to within half a minute. To our knowledge, this is the first foundation symbolic regression model designed specifically for complex networks, extending pre-trained models to effectively address complex phenomena involving a large number of variables. We believe that our foundation regressor can serve as a basis for accelerating the discovery of scientific laws while enhancing the practicality of symbolic regression tools, marking an important step towards the long-term goal of developing artificial intelligence scientists. Figure 1: a. Human

Read the complete text