Composition-Weighted Symbolic Regression for General-Purpose Property Prediction

Yang Huang, Jingrun Chen · 2026

Read Composition-Weighted Symbolic Regression for General-Purpose Property Prediction by Yang Huang, Jingrun Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02267.txt.

Introduction

Yang Huang and Jingrun Chen predict the traits of materials from their chemical makeup, using formulas a reader can inspect. Their method learns both a formula form and a weight for each element in that formula. No fixed descriptors are needed first. Max and min steps inside the formula enforce natural limits, such as a band gap that cannot go below zero.

Search joins tree search with genetic programming, plus gradient steps and parallel work. On MatBench tasks, scores stay close to top black-box models, while the output stays a clear formula. On semiconductor alloys, trends vary smoothly with makeup. Learned element weights also show a sensible periodic pattern across the table.

Catalog record

CREATORYang Huang, Jingrun Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.02267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Composition-Weighted Symbolic Regression for General-Purpose Property Prediction Yang Huang, Jingrun Chen Abstract We introduce a composition-weighted symbolic regression framework for interpretable prediction of materials properties directly from chemical composition. The method jointly learns analytical functional forms and task-dependent elemental weightings without predefined descriptors. By incorporating max \max / min \min operators, it naturally enforces constraints such as non-negative band gaps and bounded classification probabilities, unifying regression and classification tasks. Efficient search is achieved through a hybrid Monte Carlo tree search–genetic programming algorithm with gradient-based refinement and parallel computation. Benchmarks on MatBench tasks show competitive accuracy relative to state-of-the-art black-box models while yielding explicit analytical expressions. Applied to III–V semiconductor alloys, the model produces smooth composition-dependent trends and learned elemental weights with chemically meaningful periodic behavior. This framework provides a scalable and interpretable route for materials discovery and property screening. I Introduction Machine learning for materials property prediction is commonly divided into structure-based and composition-based approaches. Structure-based models often achieve high accuracy by explicitly exploiting atomic configurations and local environments Xie and Grossman 2018 ; Schütt et al. 2018 ; Chen et al. 2019 ; Gasteiger et al. 2020 ; Dunn et al. 2020 . Representative examples include interatomic-potential frameworks such as Equiformer Liao and Smidt 2022 , TACE Kim et al. 2026 , SevenNet Park et al. 2024 , and DPA Zhang et al. 2024a ; Zhang et al. 2024b , as well as structure-informed property-prediction models including MODNet De Breuck et al. 2021a ; De Breuck et al. 2021b , coGN Ruff et al. 2024 , AMMExpress Dunn et al. 2020 , Finder Ihalage and Hao 2022 , and CrabNet Wang et al. 2021 . These approaches, however, depend on reliable structural information, which is frequently unavailable, uncertain, or computationally expensive to obtain. Composition-based methods instead predict materials properties directly from chemical formulas, enabling rapid screening over vast compositional spaces without structural relaxation or first-principles calculations Wang et al. 2021 ; Wang et al. 2022 ; De Breuck et al. 2021a ; Dunn et al. 2020 . Despite their efficiency, most current composition-based models rely on neural-network architectures or other black-box learners whose internal representations are difficult to interpret physically. This creates a central challenge for general-purpose materials informatics: how to retain competitive predictive accuracy while recovering transparent and chemically meaningful analytical relationships. Here we propose a composition-weighted symbolic regression framework that integrates interpretable composition-based modeling with data-driven functional discovery. A material property P is expressed as P=\mathcal{F}(\bm{x};\bm{\theta}),\quad x_{k}=\sum_{i}w_{k,i}c_{i}, (1) where c_{i} is the elemental composition fraction and w_{k,i} are learnable elemental weights. The variables \bm{x} represent composition-weighted averages of latent elemental properties, while \mathcal{F} is an analytical function identified via symbolic regression. This formulation can be interpreted as learning effective elemental properties that combine nonlinearly to reproduce macroscopic observables. Unlike existing composition-weighted models with predefined functional forms, such as linear or hand-crafted nonlinear descriptors Meredig et al. 2014 ; Ward et al. 2016 ; Goodall and Lee 2020 ; Guo et al. 2022 , our approach learns both the functional form and elemental representations directly from data. Both the elemental weights \bm{w} and the function parameters \bm{\theta} are optimized during training, enabling physically interpretable yet flexible predictions. By mapping compositions to a low-dimensional space of composition-weighted variables, our method mitigates the combinatorial complexity of symbolic regression and enables its application to general property prediction. The resulting framework provides a general, interpretable, and scalable approach to property prediction from chemical composition alone, enabling predictions without predefined descriptors or prior physical assumptions. II Method The central task is to jointly determine the functional form \mathcal{F} and optimize the associated elemental weights \bm{w} and parameters \bm{\theta} in Eq. ( 1 ). We address this problem through a hybrid framework that combines symbolic regression for functional discovery with gradient-based optimization for continuous parameter estimation. II.1 Operator Set The symbolic search space includes standard continuous operators, such as \exp(\cdot) , \log(\cdot) , multiplication, and addition, together with the non-smooth operators \max(\cdot,\cdot) and \min(\cdot,\cdot) . These additional operators extends the hypothesis space by enabling piecewise-defined and bounded functional behavior. For example, the electronic band gap is non-negative by definition. Incorporating \max and \min directly into the symbolic form allows such bounds to emerge naturally within the learned expression. As shown in Ref. Ma et al. 2025 , this can improve modeling of constrained quantities, including cumulative band-gap distributions. Several prediction tasks involve probabilistic outputs, such as the likelihood that a material is metallic, insulating, or glass-forming. These quantities are restricted to the interval [0,1] . Rather than introducing task-specific output layers or activation functions, we represent these constraints within the same symbolic formalism. Regression and classification problems are therefore treated on equal footing. By extending the operator set to include bounded non-smooth functions, physically meaningful constraints become part of the learned analytical expression itself. II.2 Symbolic Regression Figure 1 : Hybrid Monte Carlo tree search and genetic programming. The proposed function class and expanded operator set introduce significant challenges for conventional Monte Carlo tree search (MCTS)-based symbolic regression. First, the dimensionality of the continuous optimization problem increases substantially. In addition to the symbolic parameters \bm{\theta} , whose number is typically of order \mathcal{O}(1) , the model introduces elemental weights \bm{w} whose dimensionality scales with the number of chemical species represented in the dataset. In practice, this corresponds to an additional \mathcal{O}(10^{2}) trainable variables. The parameter-fitting stage therefore becomes a moderately high-dimensional nonlinear optimization problem, with a corresponding increase in computational cost. Second, the inclusion of non-smooth operators such as \max(\cdot,\cdot) and \min(\cdot,\cdot) further complicates the search procedure. During the MCTS stage, enlarging the operator set increases the branching factor of the search tree, thereby expanding the combinatorial search space and increasing exploration cost. During parameter refinement, the resulting symbolic expressions are generally piecewise defined and non-differentiable at switching boundaries. The fitting problem is thus transformed into a segmented optimization landscape that can reduce convergence efficiency. II.2.1 Gradient-Based Optimization Strategy A gradient-based refinement strategy is adopted for continuous parameter optimization. Although operators such as \max(\cdot,\cdot) and \min(\cdot,\cdot) introduce non-smoothness, the resulting objective remains piecewise differentiable, with derivatives defined almost everywhere except at switching boundaries. This structure permits the practical use of gradient-based optimization methods. For each candidate symbolic expression, the elemental weights \bm{w} and symbolic coefficients \bm{\theta} are optimized using the limited-memory Broyden–Fletcher–Goldfarb–Shanno (L-BFGS) algorithm Saputro and Widyaningsih 2017 . To improve robustness with respect to initialization, we employ a multi-start strategy in which each expression is optimized from several independent initial conditions. In the calculations below, two random initializations and two positive random initializations are used, the latter ensuring validity in the presence of logarithmic terms. The solution with the lowest loss is retained. This procedure is effective when candidate expressions exhibit moderate curvature and are locally close to convex within the physically relevant parameter region. More complex landscapes may still contain additional local minima, particularly for highly nonlinear expressions. Nevertheless, we assume that physically meaningful governing relations are typically compact and structured, allowing efficient convergence via local refinement. II.2.2 Hybrid MCTS and GP To improve search efficiency, we employ a hybrid Monte Carlo tree search–genetic programming (MCTS–GP) framework, extending recent symbolic-regression search strategies Huang et al. 2025 ; Xu et al. 2023 ;

Read the complete text