Why Architecture Choice Matters in Symbolic Regression

Chakshu Gupta · 2026

Read Why Architecture Choice Matters in Symbolic Regression by Chakshu Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23256.txt.

Description

Gupta and LaGrow show that in differentiable symbolic regression, the recovered formula depends on the fixed architecture routing variables, not the grammar. Three depth-3 architectures across twenty-four operator-shape-leaf combinations show recovery swinging from zero to full success on the same target. Trees holding two equal-depth subtrees fail in all tested setups. A proof-of-concept fix trains a small architecture set and picks the expression with the lowest held-out error. On the jointly run subset, this lifts recovery from about one-third to 50.1 percent.

Catalog record

CREATORChakshu Gupta
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17329
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23256

Browse the full library · About the Tower of Babel