Decision Tree Induction Through LLMs via Semantically-Aware Evolution
Tennison Liu, Nicolas Huynh & Mihaela van der Schaar · 2025
Read Decision Tree Induction Through LLMs via Semantically-Aware Evolution by Tennison Liu, Nicolas Huynh & Mihaela van der Schaar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14217.txt.
Description
Tennison Liu, Nicolas Huynh, and Mihaela van der Schaar grow decision trees with help from language models, in a 2025 paper. Decision trees sort cases through a chain of yes-no questions, and people can read them at a glance — a virtue in medicine and finance. Greedy builders settle for mediocre trees, while exact searches cost too much.
Their framework, LLEGO, evolves trees like organisms, breeding and mutating candidate trees over generations. Language models guide those steps with semantic knowledge about the features, not just blind chance. That guidance steers the search toward trees that make domain sense and predict well. Readable models built with expert-aware search could win trust where black boxes fail.
Catalog record
| CREATOR | Tennison Liu, Nicolas Huynh & Mihaela van der Schaar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14217