Embedding Domain-Specific Knowledge from LLMs into the Feature Engineering Pipeline

João Eduardo Batista · 2025

Read Embedding Domain-Specific Knowledge from LLMs into the Feature Engineering Pipeline by João Eduardo Batista (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21155.txt.

Description

João Eduardo Batista wrote this 2025 paper on how to build better input features for machine learning models. Feature building shapes the raw data a model learns from, and search methods that do it by trial and error can be slow and costly to run.

Batista suggests asking a large language model to draft useful new features first, using only the names of the data fields and the goal of the task. An older search method then refines those drafts. In tests, the added step helped the search settle faster and rarely hurt the final scores. Gains in test results showed up for only about a third of the data sets tried.

Catalog record

CREATORJoão Eduardo Batista
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-21155

Browse the full library · About the Tower of Babel