Decision Tree Induction Through LLMs via Semantically-Aware Evolution

Tennison Liu, Nicolas Huynh & Mihaela van der Schaar · 2025

Read Decision Tree Induction Through LLMs via Semantically-Aware Evolution by Tennison Liu, Nicolas Huynh & Mihaela van der Schaar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14217.txt.

Description

Tennison Liu, Nicolas Huynh, and Mihaela van der Schaar grow decision trees with help from language models, in a 2025 paper. Decision trees sort cases through a chain of yes-no questions, and people can read them at a glance — a virtue in medicine and finance. Greedy builders settle for mediocre trees, while exact searches cost too much.

Their framework, LLEGO, evolves trees like organisms, breeding and mutating candidate trees over generations. Language models guide those steps with semantic knowledge about the features, not just blind chance. That guidance steers the search toward trees that make domain sense and predict well. Readable models built with expert-aware search could win trust where black boxes fail.

Catalog record

CREATORTennison Liu, Nicolas Huynh & Mihaela van der Schaar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14217

Browse the full library · About the Tower of Babel