Time-to-event prediction for grouped variables using Exclusive Lasso
Dayasri Ravi, Andreas Groll · 2025
Read Time-to-event prediction for grouped variables using Exclusive Lasso by Dayasri Ravi, Andreas Groll (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01520.txt.
Introduction
Dayasri Ravi and Andreas Groll predict survival times while forcing the model to pick from every data family in a 2025 paper. Cancer data arrive in blocks, gene methylation here, clinical measures there, and blocks repeat themselves internally. Standard penalized regression may drop a whole block, losing its distinct information.
Exclusive Lasso regularization instead selects a subset from each group, respecting the block structure. Plugged into a Cox survival model, it competes variables within groups rather than across the whole pool. On a real cancer data set the approach improved survival prediction over the conventional model. The authors offer it for the common case where data types are individually weak but jointly informative.
Catalog record
| CREATOR | Dayasri Ravi, Andreas Groll |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01520
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time-to-event prediction for grouped variables using Exclusive Lasso Dayasri Ravi, Andreas Groll Abstract The integration of high-dimensional genomic data and clinical data into time-to-event prediction models has gained significant attention due to the growing availability of these datasets. Traditionally, a Cox regression model is employed, concatenating various covariate types linearly. Given that much of the data may be redundant or irrelevant, feature selection through penalization is often desirable. A notable characteristic of these datasets is their organization into blocks of distinct data types, such as methylation and clinical predictors, which requires selecting a subset of covariates from each group due to high intra-group correlations. For this reason, we propose utilizing Exclusive Lasso regularization in place of standard Lasso penalization. We apply our methodology to a real-life cancer dataset, demonstrating enhanced survival prediction performance compared to the conventional Cox regression model. 1 Introduction In recent years, advancements in high-throughput genomic technologies have led to the availability of high-dimensional datasets, including DNA methylation, mRNA expression, and copy number variation, in addition to traditional clinical variables. These datasets may provide valuable information on the mechanisms of a certain disease, prompting the development of various methods to identify influential genomic and clinical characteristics for improved prognostic modeling. A common objective in clinical research is the prediction of patient survival outcomes. The Cox proportional hazards (PH) model ( Cox,, 1972 ) is widely used for this purpose, as it not only facilitates survival prediction but also enables the assessment of the impact of predictor variables on survival. However, given the high-dimensional nature of genomic datasets, variable selection becomes a critical step in model construction. To address this, an L_{1} -penalized Cox model, such as the Lasso, is often employed to identify the most relevant features in time-to-event modeling ( Tibshirani,, 1997 ) . Despite its effectiveness, this approach presents several limitations. First, standard Lasso-based methods do not inherently account for grouped variables, which is particularly relevant in genomic studies where genes are often organized in biological pathways. Ignoring such group structures may lead to suboptimal feature selection and loss of biologically meaningful information. Additionally, large sets of genomic features often overshadow low-dimensional clinical variables, such as tumor size and nodal status. This is a significant drawback, as clinicopathologic variables have been demonstrated to play a crucial role in oncological studies, and predictive performance improves when both clinical and genomic data are integrated ( Ma et al.,, 2007 ; Herrmann et al.,, 2021 ) . Finally, Lasso-based selection methods have been shown to produce a relatively high rate of false positives in certain settings, which may limit their reliability in time-to-event analysis, depending on the context. ( Meinshausen and Bühlmann,, 2006 ; Zhao and Yu,, 2006 ) . Several statistical methods have been proposed to incorporate grouped variables in the Cox PH model. Although Elastic Net Cox ( Simon et al., 2011b, ) does not explicitly enforce group selection, it tends to select correlated variables together, unlike pure Lasso, which typically selects only one from a correlated set. This behavior results from its combination of L_{1} and L_{2} -norm penalties. However, it does not guarantee that entire groups of variables will be retained or removed together. One of the most common approaches is Group Lasso ( Kim et al.,, 2012 ) , which applies L_{2,1} -norm regularization. This method enforces sparsity across groups using the L_{1} -norm while applying the L_{2} -norm within each group to regularize coefficients together. However, Group Lasso performs poorly when dealing with highly correlated groups, such as those found in multi-omics datasets. In such cases, it tends to select variables from only a few dominant groups, often overlooking smaller or lower-dimensional groups like clinical variables, which are essential for time-to-event prediction. This requires a method that can ensure the selection of variables for each group rather than selecting entire groups of variables. To overcome this challenge, Sparse Group Lasso was introduced ( Simon et al.,, 2013 ) , incorporating sparsity at both the group and individual variable levels. Another advancement in this area is the Integrative L_{1} -Penalized Regression with Penalty Factors (IPF-Lasso; Boulesteix et al.,, 2017 ), which allows for different penalty terms across variable groups, either based on prior knowledge or data-driven selection. However, none of these methods guarantee the selection of at least one variable from every group, which can lead to the exclusion of smaller yet important groups from the model. In biomedical studies, representing all relevant groups is important for gaining a complete understanding of underlying relationships. To overcome this limitation, we propose the use of Exclusive Lasso regularization ( Campbell and Allen,, 2017 ) . Exclusive Lasso encourages intra-group sparsity through the L_{1} -norm while promoting inter-group selection via the L_{2} -norm, ensuring that at least one variable is selected from each group. The properties of this regularization have been well studied in the literature ( Campbell and Allen,, 2017 ; Gregoratti et al.,, 2021 ) . In our previous work, we demonstrated the superior performance of Exclusive Lasso over traditional Lasso in GLM settings with high within-group correlation ( Ravi and Groll,, 2025 ; note that a preliminary compact version of this work can also be found in Ravi and Groll,, 2024 ). However, this approach has not yet been transferred to time-to-event prediction. In this study, we extend Exclusive Lasso to the Cox PH model, introducing it as a practical alternative for selecting informative predictors from different groups. Our goal is to integrate these selected features into a sparse prediction model while ensuring that no group is overlooked. We assess the performance of our proposed method by comparing it to traditional approaches that account for grouping effects, such as Elastic Net Cox, Sparse Group Lasso, and IPF-Lasso. Through extensive simulation studies, we show that our method consistently outperforms these alternatives across a range of scenarios. Additionally, we evaluate the practical applicability of our model by using it for survival prediction in a bladder cancer study. In addition to the standard prediction errors, we compare the biomarkers selected by each model and highlight the importance of Exclusive Lasso in selecting clinical and low-dimensional variables that other models fail to capture. The remainder of the manuscript is structured as follows. Section 2 introduces the Exclusive Lasso problem in the Cox PH framework. In Section 3 , we present the simulation scenarios and compare our method with other Lasso procedures. The applicability of our model is demonstrated in Section 4 using the aforementioned application example. Finally, Section 5 concludes. 2 Methods In this section, we first briefly review traditional methods for handling grouped predictors within the Cox PH framework and then introduce the Exclusive Lasso regularization in the Cox PH model. Let i=1,\dots,n denote the observations (patients) in the cohort. For each patient, we observe (t_{i},\delta_{i},\mathbf{x}_{i}) , where t_{i} is the event or censoring time for patient i , \delta_{i} is the censoring indicator, which is 1 if an event is observed and 0 if the observation is censored and \mathbf{x}_{i}=(x_{i1},\dots,x_{ip})^{T} is the vector of covariates associated with patient i . The partial log-likelihood function for the Cox PH model ( Cox,, 1972 ) , with parameter vector \bm{\beta} , is given by: \ell(\bm{\beta})=\sum_{i=1}^{n}\delta_{i}\left[\mathbf{x}_{i}^{T}\bm{\beta}-\log\left(\sum_{l\in R(t_{i})}\exp(\mathbf{x}_{l}^{T}\bm{\beta})\right)\right]\;, (2.1)