An introduction to R package mvs

Wouter van Loon · 2025

Read An introduction to R package mvs by Wouter van Loon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17546.txt.

Introduction

Wouter van Loon introduces an R software package for learning from multi-view data, in work from 2025. Medical studies often describe the same people through several data types at once. Standard learning tools flatten those views and lose structure in the process.

The package trains a model on each view alone first. Cross-checks then estimate how well each view predicts the target. A top model weighs the view models by those estimates to give the final call. Splitting the work makes the method fast and parallel-friendly. Each view model also stays small and readable. The paper walks users through setup, options, and a worked example.

Catalog record

CREATORWouter van Loon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17546

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An introduction to R package mvs Wouter van Loon Abstract 1 Package summary In biomedical science, a set of objects or persons can often be described by multiple distinct sets of features (also called independent variables or predictors ) obtained from different data sources or modalities (Y. Li, Wu, and Ngom 2018). These feature sets are said to provide different views of the objects or persons under consideration. Data sets consisting of multiple views are called multi-view data (J. Zhao et al. 2017; Sun et al. 2019; Smilde, Næs, and Liland 2022) 1 1 1 Depending on the research area, multi-view data is sometimes called multi-block, multi-set, multi-group, or multi-table data (Smilde, Næs, and Liland 2022). . Classical machine learning methods ignore the multi-view structure of such data, limiting model interpretability and performance. The R package mvs provides methods that were designed specifically for dealing with multi-view data, based on the multi-view stacking (MVS) framework (R. Li et al. 2011; Garcia-Ceja, Galván-Tejada, and Brena 2018; Van Loon et al. 2020). MVS is a form of supervised 2 2 2 Like classical machine learning, multi-view learning can be divided into supervised, unsupervised, and semi-supervised learning. Supervised learning means there is an outcome variable that is used to guide the learning process (Friedman, Hastie, and Tibshirani 2009). Unsupervised learning means that only the features are observed and there is no known outcome variable (Friedman, Hastie, and Tibshirani 2009). Semi-supervised learning refers to a setting where there is an outcome variable of interest, but it has only been measured for a subset of the observations (Goodfellow, Bengio, and Courville 2016). The methods provided by the R package mvs are supervised learning methods. However, they could also be used for semi-supervised learning by treating the unobserved values of the outcome variable as missing data and using the provided imputation methods (see Handling missing data ). For an overview of multi-view learning methods specific to semi-supervised or unsupervised settings see, for example, Sun et al. (2019) and Smilde et al. (2022). (machine) learning used to train multi-view classification or prediction models. MVS works by training a learning algorithm (the base-learner ) on each view separately, estimating the predictive power of each view-specific model through cross-validation, and then using another learning algorithm (the meta-learner ) to assign weights to the view-specific models based on their estimated predictions. MVS is a form of ensemble learning , dividing the large multi-view learning problem into smaller sub-problems. Most of these sub-problems can be solved in parallel, making it computationally attractive. Additionally, the number of features of the sub-problems is greatly reduced compared with the full multi-view learning problem. This makes MVS especially useful when the total number of features is larger than the number of observations (i.e., high-dimensional data). MVS can still be applied even if the sub-problems are themselves high-dimensional by adding suitable penalty terms to the learning algorithms (Van Loon et al. 2020). Furthermore, MVS can be used to automatically select the views which are most important for prediction (Van Loon et al. 2020). The R package mvs makes fitting MVS models, including such penalty terms, easily and openly accessible. mvs allows for the fitting of stacked models with any number of levels, with different penalty terms, different outcome distributions, and provides several options for missing data handling. 2 What is multi-view stacking? Consider the following hypothetical example: We want to build a model that can predict whether or not a person has Alzheimer’s disease based on different sources of data. Additionally, we want to find out which sources are most predictive of the outcome. That way, if certain sources turn out not to be predictive, they can be omitted from future data collection. We have collected data from 200 research subjects, half of which have been diagnosed with Alzheimer, and half are healthy controls. For each subject, we have the following sources of data available: 1. A structural magnetic resonance imaging (MRI) scan, containing information about the structure of the brain. 2. A resting-state functional MRI (fMRI) scan, containing information about the functioning of the brain at rest. 3. A blood or cerebrospinal fluid (CSF) sample, from which genetic information can be derived. Now we could just collect all the features (independent variables) from these three views together into a single data frame or matrix and fit a ‘traditional’ feature-selecting model on the complete data. Combining the views together like this is called feature concatenation . However, this approach typically ignores the multi-view structure of the data. To take the multi-view structure into account, we can instead fit a multi-view stacking (MVS) model. Multi-view stacking has several advantages over feature concatenation: 1. It explicitly takes into account the multi-view structure of the data. 2. It divides a big model training problem into smaller sub-problems, which are easier to compute and can be computed in parallel. 3. It estimates a regression coefficient for each view as well as for each feature. 4. The regression coefficients of the views are based on estimated out-of-sample predictions, improving generalization. A multi-view stacking model fitted on this data could look something like Figure 1 . Figure 1: A simple graphic representation of a multi-view stacking model including 3 views: structural MRI, functional MRI, and genetic information. A sub-model is fitted on each view separately, and the predictions of these sub-models are combined by the meta-learner into a single prediction. Note that the *n* persons are the same persons for each view. Multi-view stacking is a very broad framework: Any suitable learning algorithm can be chosen as the base and meta-learner. In this case, the outcome variable is binary (yes/no), so we will want to use some sort of classifier. Additionally, suitable penalty terms could be added to these classifiers to automatically select the views that are most important for prediction. Stacked penalized logistic regression (StaPLR) is a form of multi-view stacking where we use penalized logistic regression as both the base and meta-learner. If we use a penalty term that induces selection (such as the lasso (Tibshirani 1996)) in the meta-learner, it will automatically select the most important views. We also typically put additional nonnegativity constraints on the meta-learner, for both technical reasons and to improve interpretability (Van Loon et al. 2020). Since the views most likely contain many features (data obtained from fMRI scans can contain millions of features (Van Loon et al. 2022)), we may apply a penalty term in the base-learner that induces shrinkage (such as ridge regression ). If we apply StaPLR to the data, we may find that one of the views is not predictive of the outcome, like in Figure 2 . Figure 2: A simple graphic representation of how StaPLR can perform automatic view selection. In this (hypothetical) example, functional MRI was discarded from the model because it was not sufficiently predictive of the outcome in the presence of the other two views. Of course, Figures 1 and 2 are simplified and represent only the trained model. The training process itself is slightly more complicated, due to the inclusion of a cross-validation step. A more technically accurate description of MVS is given in Algorithm 1. We denote the views by X^{(v)},v=1\dots V . The

Read the complete text