Why Architecture Choice Matters in Symbolic Regression
Chakshu Gupta · 2026
Read Why Architecture Choice Matters in Symbolic Regression by Chakshu Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23256.txt.
Description
Gupta and LaGrow show that in differentiable symbolic regression, the recovered formula depends on the fixed architecture routing variables, not the grammar. Three depth-3 architectures across twenty-four operator-shape-leaf combinations show recovery swinging from zero to full success on the same target. Trees holding two equal-depth subtrees fail in all tested setups. A proof-of-concept fix trains a small architecture set and picks the expression with the lowest held-out error. On the jointly run subset, this lifts recovery from about one-third to 50.1 percent.
Catalog record
| CREATOR | Chakshu Gupta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17329 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23256