Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules

Jonas Landsgesell, Pascal Knoll · 2026

Read Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules by Jonas Landsgesell, Pascal Knoll (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08206.txt.

Description

Landsgesell and colleagues study how the training goal shapes distribution forecasts from tabular foundation models. Models such as TabPFN and TabICL forecast the full conditional distribution, but benchmarks like TabArena and TALENT judge them mainly through RMSE and R-squared. Those scores reward good means while leaving the rest of the spread unjudged. The authors examine proper scoring rules as training goals and as yardsticks for ranking models. Fine-tuning tests show the goal changes results across scores.

Catalog record

CREATORJonas Landsgesell, Pascal Knoll
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58030
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08206

Browse the full library · About the Tower of Babel