DPERC: Direct Parameter Estimation for Mixed Data DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06
Tuan L. Vo, Quan Huu Do, Uyen Dang, Thu Nguyen, Pål Halvorsen, Michael A. Riegler, Binh T. Nguyen · 2025
Read DPERC: Direct Parameter Estimation for Mixed Data DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06 by Tuan L. Vo, Quan Huu Do, Uyen Dang, Thu Nguyen, Pål Halvorsen, Michael A. Riegler, Binh T. Nguyen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10540.txt.
Introduction
Much of statistics runs on how measures move together, summed up in a correlation matrix. Missing values break that matrix, and filling in guesses costs time or truth. Tuan Vo and co-authors skip the guessing. Their method, DPERC, estimates the values directly. It is built for mixed data: number fields with gaps, plus label fields that are fully filled in. The labels carry news about the numbers, and the method mines it.
Tests across varied datasets show results on par with current rival tools. The estimates also draw clean heatmaps for a first look at the data. Mixed data is the norm in medicine, business, and social research. A direct route through the gaps serves all of them.
Catalog record
| CREATOR | Tuan L. Vo, Quan Huu Do, Uyen Dang, Thu Nguyen, Pål Halvorsen, Michael A. Riegler, Binh T. Nguyen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10540
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DPERC: Direct Parameter Estimation for Mixed Data DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-XXXX-X/18/06 Tuan L. Vo, Quan Huu Do, Uyen Dang, Thu Nguyen, Pål Halvorsen, Michael A. Riegler, Binh T. Nguyen Abstract . The covariance matrix is a foundation in numerous statistical and machine-learning applications such as Principle Component Analysis, Correlation Heatmap, etc. However, missing values within datasets present a formidable obstacle to accurately estimating this matrix. While imputation methods offer one avenue for addressing this challenge, they often entail a trade-off between computational efficiency and estimation accuracy. Consequently, attention has shifted towards direct parameter estimation, given its precision and reduced computational burden. In this paper, we propose Direct Parameter Estimation for Randomly Missing Data with Categorical Features (DPERC), an efficient approach for direct parameter estimation tailored to mixed data that contains missing values within continuous features. Our method is motivated by leveraging information from categorical features, which can significantly enhance covariance matrix estimation for continuous features. Our approach effectively harnesses the information embedded within mixed data structures. Through comprehensive evaluations of diverse datasets, we demonstrate the competitive performance of DPERC compared to various contemporary techniques. In addition, we also show by experiments that DPERC is a valuable tool for visualizing the correlation heatmap. 1. Introduction Data are collected in various ways, such as paper-based and online surveys, interviews, and sensors. So, the data is usually incomplete. In fact, missing data happens for many reasons. For example, temperature and humidity data are often acquired through different sensors. Because of a variety of factors, such as human error, misunderstanding, and equipment malfunctions, data may frequently experience loss or disturbance. This leads to missing data, which can hinder analysis, modeling, and the explainability of the built model. A critical task in case of missing data is estimating the covariance matrix, which provides essential information about the relationships between different variables in a dataset, and this is usually reflected in the correlation plot ( Pham et al. 2024 ) . Also, various applications, such as hypothesis testing, modeling uncertainty with confidence intervals, parameter estimation, and principal component analysis, also rely on the estimation of the covariance matrix. Even minor enhancements in covariance matrix estimation can substantially impact the quality and reliability of statistical analyses and machine learning models. In finance, for instance, a precise covariance matrix is indispensable for tasks such as risk management ( Deshmukh and Dubey 2019 ) and portfolio optimization ( Zhang et al. 2022 ; Jay et al. 2019 ) . Slight improvements in covariance matrix estimation result in better precision matrix estimation ( Vo et al. 2024 ) and more accurate predictions of asset behaviors and correlations, thereby enhancing the performance of financial models. This improvement translates into more effective risk assessment and better-optimized investment strategies, ultimately leading to higher returns and reduced exposure to risk. In fields like signal processing, improved covariance matrix estimation can enhance techniques for noise reduction, facilitating clearer extraction of signals ( de Santi and Abramo 2022 ) . For handling missing data, it is proven that the two-step procedures (imputation - parameter estimation) can be computationally expensive compared to direct parameter estimation ( Nguyen et al. 2021 ; Nguyen et al. 2022a ) . Specifically, the DPER algorithm ( Nguyen et al. 2022a ) performs well in estimating the covariance matrix when data only come from continuous features. However, this algorithm only relies on continuous features for estimation and does not exploit the categorical features under mixed data. We, however, hypothesize that categorical can provide important information that aids the quality of the estimation for continuous features. Therefore, we present the DPERC algorithm (Direct Parameter Estimation for Randomly missing data with Categorical features) as an endeavor to enhance DPER for a single class dataset. This is done by selecting a categorical to maximize the log-likelihood, treating it as an artificial label, and applying the DPER algorithm ( Nguyen et al. 2022a ) . The contribution of our paper can be summarized as follows: (1) We propose DPERC, an improvement over DPER for mixed-type data for two following situations: (i) the data comes from a single class; (ii) the data comes from multiple classes without the assumption of equal covariance matrices, (2) We provide the theoretical ground for the proposed technique, (3) We illustrate that DPERC achieves better performance compared to method comparison and shows an improvement compared to DPER in covariance matrix estimation tasks, (4) We demonstrate with experiments that DPERC and DPER can provide correlation heatmaps better than various imputation techniques. The rest of this article is organized as follows. Section 2 overviews relevant recent work on incomplete data. Next, we provide background on the direct parameter estimation for randomly missing data (DPER) in Section 3 . In Section 4 , we present the main ideas and theoretical grounds for the algorithm DPERC and then present the algorithm DPERC for single-class and multiple-class mixed data. After that, in Section 5 , we illustrate the efficiency of our algorithm via experiments and analyze the results. Finally, the paper ends with conclusions and our future works in Section 6 . 2. Related works Due to the prevalence of missing data, numerous methods have been proposed to address this issue. Typically, there are two major approaches for the parameter estimation probability: (1) utilizing imputation methods and then estimating the covariance matrix from imputed data; (2) directly estimating parameters from missing data, which can be summarized as follows. The first approach uses imputation methods to fill in missing values before estimating the covariance matrix. In order to commence with single imputation methods, these approaches involve techniques that take advantage of the temporal correlation between data, thus imputing missing values using the available statistical values such as mean, mode, and median ( Donders et al. 2006 ) . Other methods based on statistics learning, such as Hot-deck ( Andridge and Little 2010 ) , impute missing values within a data matrix by using available values from the same matrix; Multiple imputation ( Rubin 2018 ) , addresses missing data by creating reasonable estimates based on the patterns and connections among the available variables in the dataset. Various machine-learning techniques have been utilized to fill in missing data. For example, k-nearest neighbor imputation (KNN ( Beretta and Santaniello 2016 ) , ( Sanjar et al. 2020 ) ) utilizes k-nearest neighbors (KNN) algorithm to estimate missing based on the characteristics of similar neighboring data points. As another example, multiple Imputation by Chained Equations (MICE ( Buuren and Groothuis-Oudshoorn 2010 ) ) iteratively imputes missing values using regression models based on other variables in the dataset. Next, Bayesian network imputation ( Hruschka et al. 2007 ) leverages probabilistic relationships between variables, while methods such as multiple imputation using Deep Denoising Autoencoders ( Audigier et al. 2016a ) employ neural networks to learn intricate data patterns for imputation. In addition, multi-layer perceptron (MLP ( Silva-Ramírez et al. 2011 ) ) and self-organization maps (SOM ( Vatanen et al. 2015 ) ) also utilize a neural network architecture to predict missing values in a dataset based on the relationships between observed variables. Another group of techniques includes methods based on matrix completion, where matrix factorization is used to exploit the inherent low-rank