Nonparametric modal regression with missing response observations

Ana Pérez-González, Tomás R. Cotos-Yáñez, Rosa M. Crujeiras · 2025

Read Nonparametric modal regression with missing response observations by Ana Pérez-González, Tomás R. Cotos-Yáñez, Rosa M. Crujeiras (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04914.txt.

Introduction

Ana Pérez-González, Tomás Cotos-Yáñez, and Rosa Crujeiras extend a flexible regression method to data with missing answers. Their 2025 paper works on modal regression, which tracks the most likely answer value instead of the mean or middle. That view helps when answers cluster at several peaks for one input.

Missing responses had not been handled in this strand of work before. The authors adapt smooth kernel tools and test several ways to fill in the gaps. A wide simulation study compares the fill-in choices under varied settings. Two real data examples then show how the methods behave in practice. The paper gives users a tested path for modal fits on incomplete samples.

Catalog record

CREATORAna Pérez-González, Tomás R. Cotos-Yáñez, Rosa M. Crujeiras
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-04914

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonparametric modal regression with missing response observations Ana Pérez-González, Tomás R. Cotos-Yáñez, Rosa M. Crujeiras Abstract Modal regression has emerged as a flexible alternative to classical regression models when the conditional mean or median are unable to adequately capture the underlying relation between a response and a predictor variable. This approach is particularly useful when the conditional distribution of the response given the covariate presents several modes, so the suitable regression function is a multifunction. In recent years, some proposals have addressed modal (smooth) regression estimation using kernel methods. In addition, some remarkable extensions to deal with censored, dependent or circular data have been also introduced. However, the case of incomplete samples due to missingness has not been studied in the literature. This paper adapts the nonparametric modal regression tools to handle missing observations in the response, investigating several imputation approaches through an extensive simulation study. The performance in practice of our proposals are also illustrated with two real–data examples. keywords Modal regression, Kernel smoothing, Missing data, Imputation 1 Introduction The relation between a response variable Y and a covariate \mathbf{X}\in\mathbb{R}^{d} is usually addressed by modelling (parametrically, non parametrically or semiparametrically) the conditional expectation of Y|\mathbf{X} . However, the conditional expectation may not be a suitable parameter to describe the conditional distribution, for instance, when this conditional distribution exhibits a strong asymmetry or a multimodal pattern. In a unimodal but asymmetric situation, quantile regression (considering the median instead of the mean, for instance) may be an alternative, but when more than one mode appears in the conditional distribution, the regression approach should be able to identify the (possibly) several conditional modes. Nonparametric conditional mode estimation was early introduced by Scott (2015) , from a kernel density estimation perspective. This approach was used by Einbeck and Tutz (2006) to propose an adaptation of the mean–shift algorithm, previously presented by Cheng (1995) and Comaniciu and Meer (2002) , for the regression setting. This algorithm maximizes a nonparametric estimator of the conditional density identifying the (regression) branches corresponding to the local conditional modes. Chen et al. (2016) derived the asymptotic properties of the estimator provided by the mean–shift algorithm and examined the links of modal regression with other methodologies such as mixture regression or cluster analysis. Subsequently, Zhou and Huang (2019) proposed bandwidth selectors for the modal regression based on bootstrap and cross-validation tools. Alonso Pena (2020) presents a comprehensive review on nonparametric multimodal regression with a simulation study comparing the performance of several bandwidth procedures. For a general overview on modal analysis, see Chacón (2020) . An alternative approach for modal regression is based on structural assumptions for the (unique) conditional mode. For instance, Lee (1989) and Yao and Li (2014) consider a linear model for the conditional mode and introduce kernel weights to define an objective function. More complex models, with semiparametric or nonparametric methodologies, are considered by Weixin Yao and Li (2012) , Jing Lv and Guo (2017) , or Ullah et al. (2023) among others. A drawback of this approach with respect to the nonparametric route is that all these methods are formulated in a unimodal setting, recovering just a single branch of the regression. In addition, modal regression has revealed as a powerful tool for regression analysis in different disciplines such as medicine, where it has been used to investigate conditions such as Alzheimer’s disease (see Wang et al. (2017) ) and the effects of the SARS-CoV-2 virus (see Ullah et al. (2022) ). It has also been employed in transport studies (see Einbeck and Tutz (2006) ) and in economic research (see Lee (1989) , Lee (1993) ). For a comprehensive overview of the applications of modal estimation, see Chen (2018) . Although most statistical methods are analyzed and designed to be applied in complete data cases, it is not uncommon to deal with incomplete samples showing missing observations. Missingness may be attributed to a variety of factors, including technical failures in measurement processes or individuals who refuse to answer. This phenomenon is not exclusive to a particular research area and it is usually encountered in fields as diverse as medicine, social studies, and economics. The presence of missing observations may have a profound impact on estimation and inference, justifying the importance of appropriate management strategies to prevent the introduction of biases and ensure the accuracy of statistical analysis. The statistical literature has analysed the impact of missing data on a wide range of methodologies, including, among others, mean and quantile regression, robust estimation or even goodness-of-fit tests (see Efromovich (2014) ; Chen et al. (2015) ; Boente et al. (2009) ; González-Manteiga and Pérez-González (2006) ). The relevance of this topic is evidenced by the numerous publications dealing with missing data. See, among others, Enders (2022) , Molenberghs and Kenward (2007) , Little and Rubin (2019) , Carpenter and Smuk (2021) , Ibrahim and Molenberghs (2009) and Pigott (2001) . These works consider a variety of analytical techniques to deal with the missingness feature. The simplest approach consist in considering just the complete part of the sample (simplified estimation), entailing the deletion of missing observations. An alternative procedure introduces weights that are inversely proportional to the observation probability. This approach is known as Inversely Probability Weighting (IPW). Another possibility is to fill or impute the missing observations using conditional and unconditional imputation methods. A route that has gained relevance in this field is multiple imputation (MI) where the imputation of each missing observation is done via an average estimate of a set of values, see e.g. Rubin (1987) , van Buuren (2018) or Kleinke et al. (2020) . Although modal regression tools has been adapted to deal with censored data ( Khardani (2019) ), dependent data ( Ullah et al. (2022) ), measurement error ( Zhou and Huang (2016) , Li and Huang (2019) or Liu and Huang (2024) ) and even circular regression models (as illustrated in Alonso-Pena and Crujeiras (2023) ), to the best of our knowledge, the effect of missing data on conditional mode estimation has not yet been studied. The performance of the different statistical methodologies is contingent upon the missing data model and the way this feature is considered in the analysis. Thus, the aim of this work is to introduce an adaptation of the nonparametric modal regression approach using the mean–shift algorithm by Einbeck and Tutz (2006) and Chen et al. (2016) , investigating the impact of various missing data methodologies on several modal regression scenarios where the response variable contains missing observations. In addition, an innovative multiple imputation method, specifically tailored for local mode estimation, will be also presented. This paper is organized follows. Section 2 provides a concise overview of the nonparametric modal regression estimator for complete data. Section 3 focuses on different approaches to deal with missingness in the response. Precisely, a simplified estimator, a IPW estimator, and a simple and multiple imputation estimators will be presented. Since our approach uses kernel methods, a bandwidth selector is introduced in Section 4 . The numerical performance of the proposed estimators is shown in Section 5 , whereas Section 6 illustrates their application in two real–data examples. Final comments and some discussion are given in Section 7 . Code

Read the complete text