RegScore: Scoring Systems for Regression Tasks
Michal K. Grzeszczyk, Tomasz Szczepański, Pawel Renc, Siyeop Yoon, Jerome Charton, Tomasz Trzciński, Arkadiusz Sitek · 2025
Read RegScore: Scoring Systems for Regression Tasks by Michal K. Grzeszczyk, Tomasz Szczepański, Pawel Renc, Siyeop Yoon, Jerome Charton, Tomasz Trzciński, Arkadiusz Sitek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19155.txt.
Introduction
Michal Grzeszczyk and co-authors present a 2025 paper on scoring systems for regression. Scoring systems are simple point sheets used widely in medicine. Their clarity makes them trusted at the bedside. Past sheets mostly sort patients into classes, not predict a number. Their coefficients are also forced to whole numbers. The team builds RegScore, a sparse point sheet for number prediction.
Beam search plus sparse ridge fitting relax the whole-number rule. Scores stay readable while accuracy rises. A deep learning extension joins tables with medical images. A transformer token then sets personal coefficients for each patient. Personal sheets keep the clarity of a score card with tailored weights. The demo task estimates a heart pressure value. Clinicians get a model they can print, check, and explain, which black box models cannot offer.
Catalog record
| CREATOR | Michal K. Grzeszczyk, Tomasz Szczepański, Pawel Renc, Siyeop Yoon, Jerome Charton, Tomasz Trzciński, Arkadiusz Sitek |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19155
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RegScore: Scoring Systems for Regression Tasks Michal K. Grzeszczyk, Tomasz Szczepański, Pawel Renc, Siyeop Yoon, Jerome Charton, Tomasz Trzciński, Arkadiusz Sitek Abstract Scoring systems are widely adopted in medical applications for their inherent simplicity and transparency, particularly for classification tasks involving tabular data. In this work, we introduce RegScore, a novel, sparse, and interpretable scoring system specifically designed for regression tasks. Unlike conventional scoring systems constrained to integer-valued coefficients, RegScore leverages beam search and k-sparse ridge regression to relax these restrictions, thus enhancing predictive performance. We extend RegScore to bimodal deep learning by integrating tabular data with medical images. We utilize the classification token from the TIP (Tabular Image Pretraining) transformer to generate Personalized Linear Regression parameters and a Personalized RegScore, enabling individualized scoring. We demonstrate the effectiveness of RegScore by estimating mean Pulmonary Artery Pressure using tabular data and further refine these estimates by incorporating cardiac MRI images. Experimental results show that RegScore and its personalized bimodal extensions achieve performance comparable to, or better than, state-of-the-art black-box models. Our method provides a transparent and interpretable approach for regression tasks in clinical settings, promoting more informed and trustworthy decision-making. We provide our code at https://github.com/SanoScience/RegScore . 1 Introduction Scoring systems are sparse linear models that require the addition of points conditioned on binary features that sum to the final score. For example, in the CHADS 2 [ 7 ] system, if the age of the patient is higher or equal 75 ( age\geq 75 binary feature), 1 point is added to the final score of stroke risk. Based on the sum of points, a probability can be derived from the pre-computed table or a non-linear function. There are a large number of scoring systems in healthcare, such as CHADS 2 or NEWS 2 [ 21 ] as clinicians tend to favor methods that are easier to use and interpret, even if they are less accurate than deep learning models. The most popular approaches for data-driven scoring systems creation involve training penalized logistic regression (LR). Then, the coefficients are rounded or have \pm 1 assigned depending on their sign as the Unit method in [ 1 ] . Ustun and Rudin introduced the Risk Supersparse Linear Integer Model (RiskSLIM) [ 23 ] whose discrete coefficients are found with Integer Programming. Based on this approach, Multiclass Interpretable Scoring Systems (MISS) expanded scoring system use beyond two classes [ 10 ] . Liu et al. [ 17 ] presented FasterRisk, which finds scoring systems in a three-step process of solving sparse logistic regression via beam search (BS), finding a pool of nearly optimal solutions with continuous coefficients and rounding them. Although interpretable, traditional scoring systems may fall short when diagnosing conditions defined by thresholding a continuous variable. For example, Pulmonary Hypertension (PH) is diagnosed when the invasively measured mean Pulmonary Artery Pressure (mPAP) exceeds 20 mmHg [ 13 ] . Instead of assigning arbitrary points, a more informative approach would be to develop scoring systems that reflect the relationship between features and mPAP. Furthermore, diagnostics in modern healthcare involve collecting multimodal data in the form of images and tabular records. This aspect led to the development of methods that allow the injection of clinical data into vision deep learning models. Modules like Dynamic Affine Feature Map Transform (DAFT) [ 20 ] , TabAttention [ 9 ] or TabMixer [ 8 ] enhance the interaction between imaging and tabular data via affine transformations, attention learning conditioned on tabular data or multilayer perceptron-based mixing of multimodal features. Such methods have surpassed naïve approaches for merging both modalities based on concatenation [ 22 ] , maximum value selection [ 24 ] or multiplication [ 5 ] . Tabular data can also improve unimodal models when used during self-supervised learning (SSL) [ 11 ] or for guiding image feature learning [ 15 ] . The SSL on both modalities and bimodal inference in the Tabular Image Pretraining (TIP) achieves state-of-the-art results for imaging and tabular data [ 4 ] . Unfortunately, all these approaches are weakly explainable and do not take into account the interpretability of tabular features. Even though one can analyze feature attribution [ 11 ] or attention scores of the classification (CLS) token - serving as a learned representation for classification in transformers [ 4 ] - these methods offer only limited interpretability. In this paper, we present RegScore, a sparse, interpretable, transparent scoring system for regression tasks. By relaxing integer-only constraints of points in scoring systems and changing the task from classification to regression, we show two ways to create RegScore. Firstly, we find the solution to a sparse ridge regression problem on binary features based on BS [ 17 ] . The second approach is to solve it with OKRidge (OKR) [ 16 ] . Further, we leverage the interpretability of tabular data and show how to produce interpretable predictions for bimodal deep learning models. Given the CLS token from the TIP transformer, instead of computing the final output, we generate weights for linear regression computed with tabular features. We dub this approach Personalized Linear Regression (PLR) since separate linear operations are performed for each of the samples. Similarly, we dynamically mask binary features to produce a Personalized RegScore (PRS) from the CLS token. Our contributions are as follows: (1) we introduce RegScore, a scoring system for regression tasks, (2) we present PLR and PRS, two approaches for generating interpretable predictions from bimodal deep learning architecture, which while being more interpretable are competitive to other solutions, and (3) we apply the presented methods to the task of PH diagnosis and show that RegScore can outperform classification scoring systems by a significant margin. 2 Method Figure 1 : Given the tabular ( X^{t} ) dataset, we produce the discretized set ( \hat{X}^{t} ) to create RegScore with beam search or OKRidge (a). We further leverage the TIP method [ 4 ] with imaging data ( X^{i} ) (b) to compute CLS token for every sample and create interpretable regression predictions with PLR (c) and PRS (d). In this section, we present two methods for generating RegScore from tabular data, followed by a description of how the CLS token from the TIP transformer is used to derive PLR and PRS. An overview of our approach is shown in Fig. 1 . Let (X^{t}=[x^{t}_{1},\ldots,x^{t}_{N}]\in\mathbb{R}^{P\times N},X^{i}\in\mathbb{R}^{P\times H\times W\times 3}) be a dataset consisting of tabular-image pairs, where P is the number of samples and N is the number of features. We construct a binarized set (\hat{X}^{t}=[\hat{x}^{t}_{1},\ldots,\hat{x}^{t}_{D}]\in\{0,1\}^{P\times D}) by one-hot encoding N_{cat} categorical features and discretizing N-N_{cat} continuous features using a discretization function \xi . Various implementations of \xi exist; in this work, we consider the Minimum Description Length Principle (MDLP) [ 6 ] and tertile binning. Given \hat{X}^{t} , we generate RegScore. RegScore. The objective of RegScore is to minimize the mean squared loss under a sparsity constraint, resulting in a sparse ridge regression problem: \min_{\beta}\|\mathbf{y}-\mathbf{\hat{X}}\bm{\beta}\|_{2}^{2}+\lambda_{2}\|\bm{\beta}\|_{2}^{2}\quad\text{subject to}\quad\|\bm{\beta}\|_{0}\leq k, (1) Here \beta is the vector of weights (scores) assigned to each binary feature, \lambda_{2} is the \ell_{2} regularization rate, and k is the model size (bias is omitted for clarity). The sparsity constraint renders the problem NP-hard. We find two methods to train RegScore. First, by relaxing