Fast Symbolic Regression Benchmarking
Viktor Martinek · 2025
Read Fast Symbolic Regression Benchmarking by Viktor Martinek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14481.txt.
Introduction
Viktor Martinek presents a faster, fairer way to grade programs that find math formulas hidden in data, in a 2025 report. Such programs, known as symbolic regression tools, try to write a short formula that fits a set of numbers. Older tests kept searching even after a tool had found a good answer, which wasted time.
The new test stops as soon as a tool finds a form on a list of sound answers. On a known set of hard problems, one tool more than doubled its score, and grading took far less time. A second tool scored higher still, which gives builders a sharper way to compare their work.
Catalog record
| CREATOR | Viktor Martinek |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-14481
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Symbolic Regression Benchmarking Thanks: This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – HE 6077/14-2 – within the Priority Programme \enquote SPP 2331: Machine Learning in Chemical Engineering. Viktor Martinek Abstract . SR ( SR ) uncovers mathematical models from data. Several benchmarks have been proposed to compare the performance of SR algorithms. However, existing ground-truth rediscovery benchmarks overemphasize the recovery of \enquote the one expression form or rely solely on computer algebra systems (such as SymPy \xspace ) to assess success. Furthermore, existing benchmarks continue the expression search even after its discovery. We improve upon these issues by introducing curated lists of acceptable expressions, and a callback mechanism for early termination. As a starting point, we use the SRSD ( SRSD ) benchmark problems proposed by Yoshitomo et al. \xspace , and benchmark the two SR packages SymbolicRegression.jl \xspace and TiSR \xspace . The new benchmarking method increases the rediscovery rate of SymbolicRegression.jl \xspace from \SI [round-mode = places, round-precision = 1]26.7 \percent , as reported by Yoshitomo et al. \xspace , to \SI [round-mode = places, round-precision = 1]44.7 \percent . Performing the benchmark takes \SI [round-mode = places, round-precision = 1]41.2 \percent less computational expense. TiSR \xspace ’s rediscovery rate is \SI [round-mode = places, round-precision = 1]69.4 \percent , while performing the benchmark saves \SI [round-mode = places, round-precision = 0]63 \percent time. 1. Introduction SR aims to discover mathematical expressions that fit data without assuming a predefined model, making it a powerful tool for scientific discovery. In contrast to many other supervised machine learning approaches, SR aims to discover the expression structure and identify its parameters. There is much research and many types of algorithms for SR . However, as proven by [ 10 ] , SR is NP-hard and very computationally expensive. Its optimization objectives typically balance two goals: achieving a high fit quality to accurately model the data, and minimizing expression complexity to ensure interpretability. The complexity reflects an expression’s structural simplicity. It is commonly measured by the number of operators and operands, favoring concise expressions. Realistic benchmarking is crucial, as it enables fair and meaningful comparisons between methods by testing them under conditions that mirror practical applications. It also facilitates hyperparameter tuning by providing a representative set of challenges, ensuring optimized settings that translate to real-world performance. SR benchmarking primarily falls into two categories: ground-truth rediscovery and real-world. Ground-truth rediscovery benchmarks use datasets with known expressions to test an algorithm’s ability to rediscover those. Some benchmarks also utilize a fallback measure, \eg , the coefficient of determination, to judge the fit quality, or the normalized editing distance, to judge the similarity to the ground truth expression. Real-world benchmarks, conversely, employ experimental or observational data without known expressions, evaluating the capacity to uncover novel, interpretable expressions. Requiring exact rediscovery of an expression does neither fully align with SR ’s optimization objectives, nor does it reflect a real-world use case. Equivalent forms of the expression should be considered found if they are functionally equivalent and remain concise. For many expressions, there are potentially infinite functionally equivalent forms with the same or a similar complexity. As a first example, a list of expressions is provided below. All listed expressions are functionally equivalent forms of the SRSD benchmark problem II.38.14 . • problem ID II.38.14 – v_{1}/(2\cdot(1+v_{2})) – v_{1}/(2+2v_{2}) – 0.5v_{1}/(v_{2}+1) In the above example, the functionally equivalent forms consist of the same number of operators and operands. Thus, there is no difference in their complexity, and no incentive for the SR algorithm to prefer any of these forms. La Cava et al. \xspace [ 2 ] introduced a new definition for a symbolic solution, which aims to detect functionally equivalent expressions. Both, the target and the candidate expression, are simplified using a computer algebra system, \ie the \python (see [ 9 ] ) package SymPy \xspace (see [ 6 ] ). If, according to SymPy \xspace , their difference or their ratio simplifies to a constant, the expressions are deemed equivalent. This definition accepts any constant, not only zero or one for the difference and the ratio, respectively. The ability of this approach to detect expressions, which differ at most by a constant offset or multiplier, is limited by the capabilities of the SymPy \xspace library. For the first example shown above, this approach works. However, this approach fails in some cases, such as the following examples from the SRSD benchmark. The constants in the expressions listed below are rounded to five significant digits. • problem ID I.34.1 – -v_{1}/(3.3356\cdot 10^{-9}\cdot v_{2}-1) – -2.9979\cdot 10^{8}v_{1}/(v_{2}-2.9979\cdot 10^{8}) • problem ID II.11.3 – v_{1}v_{2}/(v_{3}\cdot(v_{4}^{2}-v_{5}^{2})) – v_{1}v_{2}/(v_{3}\cdot(v_{4}-v_{5})\cdot(v_{4}+v_{5})) • problem ID I.6.2a – 0.39894\cdot\exp(-v_{1}^{2}/2) – 0.39894\cdot\sqrt{\exp(-v_{1}^{2})} – 0.39894/\sqrt{\exp(v_{1}^{2})} – 0.39894\cdot 0.60653^{v_{1}^{2}} All expression forms shown above should be equally accepted. In a real-world setting, a researcher utilizing SR and finding an optimally-matching, concise expression, can and would rearrange it to their preferences or use-case. On the other hand, SR is very computationally expensive. SR benchmarks allot a high computational budget for algorithms. This budget is fixed for each run, and the search continues even after the expression is discovered. As SR algorithms are typically non-deterministic, each problem is run several times, multiplying the impact of this inefficiency. Also, many SR algorithms, in particular, genetic programming-based approaches, have many hyperparameters, which must be tuned for optimal performance. Thus, tuning the hyperparameters of SR algorithms is very expensive. In the next section, we provide a brief overview of some existing SR benchmarks. In \cref sec:method, we introduce our proposed method, and in \cref sec:experiments, we demonstrate its effectiveness. Lastly, we draw a conclusion in \cref sec:conclusion. 2. Related Work The Feynman SR benchmark (see [ 8 ] ), derived from the Feynman Lectures on Physics, provides a set of expressions to test an algorithm’s ability to recover known physical laws. For all variables and constants occurring in the expressions, sampling ranges are provided, which are, however, not realistic. SRBench \xspace (see [ 2 ] ) offers a broader evaluation framework, encompassing both synthetic and real-world datasets to assess SR methods across diverse conditions. Among other things, they adopt the Feynman benchmark problems, and extend them with real-world datasets without known ground truth. As mentioned in the previous section, in their ground-truth rediscovery benchmarks, they relax the requirement for an exact rediscovery using a new definition of a symbolic solution. If, according to SymPy \xspace , the difference or the ratio of two expressions simplify to a constant, the expressions are deemed equivalent. EmpiricalBench \xspace (see [ 1 ] ) focuses on real-world applications. Although the ground-truth expressions are known, they are to be discovered based on realistic datasets, \ie , the variable ranges are realistic. And, even more importantly, the constants are not provided as variables, but need to be identified by the SR algorithm. To assess whether the discovered expressions are equivalent to the ground-truth, they manually inspect the hall of fame 1 1 1 set of best (non-dominated) expressions found during the expression search at the end of the search. This approach is thorough, but time-consuming and error-prone. The SRSD (see [ 5 ] ) benchmark adopts the expressions from the Feynman SR benchmark,