Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules
Jonas Landsgesell, Pascal Knoll · 2026
Read Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules by Jonas Landsgesell, Pascal Knoll (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08206.txt.
Description
Landsgesell and colleagues study how the training goal shapes distribution forecasts from tabular foundation models. Models such as TabPFN and TabICL forecast the full conditional distribution, but benchmarks like TabArena and TALENT judge them mainly through RMSE and R-squared. Those scores reward good means while leaving the rest of the spread unjudged. The authors examine proper scoring rules as training goals and as yardsticks for ranking models. Fine-tuning tests show the goal changes results across scores.
Catalog record
| CREATOR | Jonas Landsgesell, Pascal Knoll |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58030 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08206