Embedding Domain-Specific Knowledge from LLMs into the Feature Engineering Pipeline
João Eduardo Batista · 2025
Read Embedding Domain-Specific Knowledge from LLMs into the Feature Engineering Pipeline by João Eduardo Batista (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21155.txt.
Description
João Eduardo Batista wrote this 2025 paper on how to build better input features for machine learning models. Feature building shapes the raw data a model learns from, and search methods that do it by trial and error can be slow and costly to run.
Batista suggests asking a large language model to draft useful new features first, using only the names of the data fields and the goal of the task. An older search method then refines those drafts. In tests, the added step helped the search settle faster and rarely hurt the final scores. Gains in test results showed up for only about a third of the data sets tried.
Catalog record
| CREATOR | João Eduardo Batista |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21155