Zero-Shot Decision Tree Construction via Large Language Models
Lucas Carrasco, Felipe Urrutia, Andrés Abeliuk · 2025
Read Zero-Shot Decision Tree Construction via Large Language Models by Lucas Carrasco, Felipe Urrutia, Andrés Abeliuk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16247.txt.
Description
Lucas Carrasco, Felipe Urrutia, and Andrés Abeliuk grow decision trees straight out of a language model's knowledge, with no training data at all, in a paper from 2025. Classic tree building needs labeled rows to split on, using scores like information gain or the Gini index. Data is often the missing piece.
Their method follows the CART recipe but asks the model to do each job: bin the attributes, estimate class probabilities from its learned knowledge, and compute the split scores from those. The zero-shot trees beat other zero-shot baselines and rivaled supervised trees trained on real data across tabular benchmarks. Because the trees stay readable, the approach suits low-data problems where an explainable model matters.
Catalog record
| CREATOR | Lucas Carrasco, Felipe Urrutia, Andrés Abeliuk |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-16247