Beyond algorithm hyperparameters: on preprocessing hyperparameters and associated pitfalls in machine learning applications
Christina Sauer, Anne-Laure Boulesteix, Luzia Hanßum, Farina Hodiamont, Claudia Bausewein, Theresa Ullmann · 2024
Read Beyond algorithm hyperparameters: on preprocessing hyperparameters and associated pitfalls in machine learning applications by Christina Sauer, Anne-Laure Boulesteix, Luzia Hanßum, Farina Hodiamont, Claudia Bausewein, Theresa Ullmann (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03491.txt.
Description
Christina Sauer and co-authors warn of a blind spot in machine learning work in a 2024 paper. Teams tune the knobs of a learning method with care, but data prep steps have knobs too. Choices such as how to fill gaps in data can shift scores a lot. When users try prep picks by hand to lift scores, that is tuning in all but name. If they fail to log it, score claims can swell past the truth.
The paper walks through ways teams build and grade prediction models. It shows, with real cases, how prep choices are handled in each path. Some paths hide the tuning, and some count it twice. The authors aim to lift model quality in applied fields. Their plea is plain: treat prep knobs as true knobs, tune them in the open, and grade the whole pipeline as one.
Catalog record
| CREATOR | Christina Sauer, Anne-Laure Boulesteix, Luzia Hanßum, Farina Hodiamont, Claudia Bausewein, Theresa Ullmann |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 186 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03491