Semi-Supervised Mixture Models under the Concept of Missing at Radom with Margin Confidence and Aranda–Ordaz Function

1 st Jinyang Liao, 2 nd Ziyang Lyu · 2026

Read Semi-Supervised Mixture Models under the Concept of Missing at Radom with Margin Confidence and Aranda–Ordaz Function by 1 st Jinyang Liao, 2 nd Ziyang Lyu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14631.txt.

Introduction

Jinyang Liao and Ziyang Lyu present a learning framework in this 2026 paper. It is semi-supervised learning for Gaussian mixture modelling under a Missing at Random mechanism. Semi-supervised means some data points carry labels and many do not. Missing at Random describes how the labels come to be missing. Their method explicitly parameterizes the missing-label mechanism.

They model the probability of missingness as a function of classification uncertainty. To quantify that uncertainty, they introduce margin confidence. They also incorporate the Aranda-Ordaz link function, which flexibly captures asymmetric relationships between uncertainty and missing probability. The fix is neat. Doubt is not a flaw in the data here; it is a clue the model can use. Readers get a mixture model that learns from its own doubtful cases instead of ignoring them.

Catalog record

CREATOR1 st Jinyang Liao, 2 nd Ziyang Lyu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14631

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Semi-Supervised Mixture Models under the Concept of Missing at Radom with Margin Confidence and Aranda–Ordaz Function 1 st Jinyang Liao, 2 nd Ziyang Lyu Abstract This paper presents a semi-supervised learning framework for Gaussian mixture modelling under a Missing at Random (MAR) mechanism. The method explicitly parameterizes the missing-label mechanism by modelling the probability of missingness as a function of classification uncertainty. To quantify classification uncertainty, we introduce margin confidence and incorporate the Aranda–Ordaz (AO) link function to flexibly capture the asymmetric relationships between uncertainty and missing probability. Based on this formulation, we develop an efficient Expectation–Conditional Maximization (ECM) algorithm that jointly estimates all parameters appearing in both the Gaussian mixture model (GMM) and the missingness mechanism, and subsequently imputes the missing labels by a Bayesian classifier derived from the fitted mixture model. This method effectively alleviates the bias induced by ignoring the missingness mechanism while enhancing the robustness of semi-supervised learning. The resulting uncertainty-aware framework delivers reliable classification performance in realistic MAR scenarios with substantial proportions of missing labels. I Introduction Modern machine learning applications often contend with partially labeled datasets, in which labels are available for merely a small proportion of the data, while the majority remain unlabeled. According to [ 21 , 27 , 24 , 11 ] , this scenario generally arises when labeling is expensive or infeasible for all data points. To provide a principled framework for reasoning about such incomplete data, [ 17 ] introduced the widely used classification of missing mechanisms into Missing Completely at Random (MCAR), Missing at Random (MAR), and Missing Not at Random (MNAR). Subsequently, [ 8 , 6 ] clarified Rubin’s taxonomy by emphasizing the conceptual and inferential distinction between MCAR and MAR, highlighting the critical challenge that labels in practice are typically not MCAR. In practice, missingness can be characterized within the MAR framework by [ 3 , 25 , 14 ] , which allows missingness to depend on observed characteristics such as classification uncertainty, but not on unobserved labels. This property has substantial implications, as evidence from [ 1 , 15 , 18 ] indicates that overlooking this structure can introduce bias in parameter estimation and weaken classification performance in both discrimination and calibration. Accordingly, explicitly modeling the missing-label mechanism is essential for accurate estimation and robust predictive performance in semi-supervised settings. Under the MAR assumption, [ 9 , 10 ] incorporates the dependence of missingness on observable characteristics. Building on the finite mixture modeling framework of [ 13 ] and following [ 9 , 12 ] together with the semi-supervised learning treatment of [ 1 ] , this article focuses on MAR within a two-component Gaussian mixture modeling framework and develops a new specification of MAR within the finite mixture setting. In modeling the MAR missingness mechanism, we introduce a new concept of margin confidence to quantify the classification uncertainty of each observation [ 26 , 7 , 22 ] . Compared with previous work that relies on Shannon entropy [ 9 , 12 ] , margin confidence provides a substantially more efficient approximation measure while retaining strong discriminative power. We further show that Shannon entropy is well approximated by the squared margin confidence in most practical settings, enabling significant computational savings with negligible loss in model performance. In addition, previous approaches commonly use logit link to model MAR mechanism. However, in complex settings such as non-Gaussian mixtures, the logit link exhibits limited robustness, as it enforces a symmetric response around the decision boundary and is therefore less flexible in capturing highly skewed or uncertainty-concentrated missingness mechanisms. In contrast, the Aranda–Ordaz link generalizes the logit by introducing a shape parameter \lambda , which relaxes the inherent symmetry of the logistic function [ 2 , 19 ] . By adjusting \lambda , the link allows the missing probability to depend asymmetrically on margin-based uncertainty [ 19 , 16 , 4 ] . This choice markedly improves the stability and adaptability of the proposed MAR-aware mixture model. In the experimental section, we evaluate the proposed framework using both controlled simulations and real-data experiments. In the simulation section, labels are removed by a margin-based MAR mechanism, allowing comparison between the proposed ECM–AO and a logistic baseline that ignores the missingness mechanism. To assess robustness beyond idealized settings, we further consider non-Gaussian mixture models and the MAGIC Gamma Telescope dataset. These experiments examine the performance of ECM–AO under distributional misspecification and realistic label sparsity. II Methodology II-A Gaussian mixture model Let \boldsymbol{Y} be a random vector of d dimensional arising from a K -component Gaussian mixture model. Each component k (k=1,\ldots,K) is associated with a prior probability \pi_{k} , where \pi_{k}\geq 0 and \sum_{k=1}^{K}\pi_{k}=1 . Conditional on assignment to component k , the distribution of \boldsymbol{Y} is multivariate Gaussian with density \mathcal{N}(\boldsymbol{y};\boldsymbol{\mu}_{k},\boldsymbol{\Sigma}_{k}) , where \boldsymbol{\mu}_{k}\in\mathbb{R}^{d} denotes the mean vector and \boldsymbol{\Sigma}_{k}\in\mathbb{R}^{d\times d} denotes the covariance matrix of the k -th component. The resulting marginal density of \boldsymbol{Y} is therefore f(\boldsymbol{y}_{j};\boldsymbol{\theta})=\sum_{k=1}^{K}\pi_{k}\,\mathcal{N}(\boldsymbol{y}_{j};\boldsymbol{\mu}_{k},\boldsymbol{\Sigma}_{k}), with the complete parameter vector given by \boldsymbol{\theta}=\big\{\pi_{1},\ldots,\pi_{K-1},\,\boldsymbol{\mu}_{1},\ldots,\boldsymbol{\mu}_{K},\,\boldsymbol{\Sigma}_{1},\ldots,\boldsymbol{\Sigma}_{K}\big\}. For an observation \boldsymbol{y}_{j} , the Bayes’ rule of allocation assigns it to class z_{j} if z_{j}=\arg\max_{k\in\{1,\ldots,K\}}\tau_{kj} , where \tau_{kj}={\pi_{k}\,\mathcal{N}\!\left(\boldsymbol{y}_{j}\mid\boldsymbol{\mu}_{k},\boldsymbol{\Sigma}_{k}\right)}/{\sum_{j=1}^{K}\pi_{j}\,\mathcal{N}\!\left(\boldsymbol{y}_{j}\mid\boldsymbol{\mu}_{j},\boldsymbol{\Sigma}_{j}\right)} denotes the posterior probability that observation \boldsymbol{y}_{j} belongs to the class k , given \boldsymbol{Y}=\boldsymbol{y}_{j} . Consider a training set \{\boldsymbol{y}_{j},m_{j},z_{j}\}_{j=1}^{n} , where \boldsymbol{y}_{j}\in\mathbb{R}^{d} denotes the feature vector, z_{j}\in\{1,\ldots,K\} is the class label, and m_{j} is the missingness indicator taking the value m_{j}=0 if z_{j} is observed and m_{j}=1 otherwise. To facilitate the formulation of the likelihood, we define the indicator variable z_{ij} such that z_{ij}=1 if observation \boldsymbol{y}_{j} belongs to component i and z_{ij}=0 otherwise, for i=1,\ldots,K and j=1,\ldots,n . Following the framework of [ 9 ] , the observed data log-likelihood can be decomposed into contributions from labeled and unlabeled samples given by \displaystyle\log L_{C}(\boldsymbol{\theta})= \displaystyle\sum_{j=1}^{n}(1-m_{j})\sum_{i=1}^{K}z_{ij}\,\log\Big\{\pi_{i}\mathcal{N}(\boldsymbol{y}_{j};\boldsymbol{\mu}_{i},\boldsymbol{\Sigma}_{i})\Big\}, (1) \displaystyle\log L_{UC}(\boldsymbol{\theta})=\sum_{j=1}^{n}m_{j}\log\Bigg(\sum_{i=1}^{K}\pi_{i}\mathcal{N}(\boldsymbol{y}_{j};\boldsymbol{\mu}_{i},\boldsymbol{\Sigma}_{i})\Bigg). (2) The total observed-data log-likelihood is then \log L_{PC}^{(\text{ig})}(\boldsymbol{\theta})=\log L_{C}(\boldsymbol{\theta})+\log L_{UC}(\boldsymbol{\theta}). (3) II-B Margin Confidence Margin confidence quantifies the model’s certainty in its prediction by measuring the difference between the highest and the second-highest posterior class probabilities for a given input. For a data point \boldsymbol{y}_{j} , the margin confidence \delta_{j} is defined as \delta_{j}=\tau_{(1)j}-\tau_{(2)j}, where \tau_{(1)j} and \tau_{(2)j} denote the largest and second largest posterior probabilities. In the case of binary classification, the margin confidence admits the following simplified form: \delta_{j}=\left|2\tau_{1j}-1\right|, (4) where \tau_{1j} is the posterior probability that y_{j} belongs to class 1 . A margin confidence value close to 1 indicates a confident classification, while values near 0 correspond to high predictive uncertainty. Based on the derivation in the supplementary material(Section S1), the relationship between margin confidence and entropy can be expressed as follows: H(\tau)\approx\log 2-\frac{\delta_{j}^{2}}{2}, (5) which reveals a linear relationship between entropy and squared margin confidence. II-C Missing at random mechanism Following the framework of [ 17 ] , we assume that the missingness is MAR, which means it depends only on the the observed feature vector. In this context, the missingness mechanism is specified as \displaystyle\Pr(M_{j}=1\mid y_{j},z_{j}) \displaystyle=\Pr(M_{j}=1\mid y_{j}) \displaystyle=q(y_{j};\boldsymbol{\theta},\boldsymbol{\xi}), where M_{j}\in\{0,1\} denotes the missingness indicator for observation j , with M_{j}=1 indicating a missing label and M_{j}=0 otherwise, and \boldsymbol{\xi}=(\xi_{0},\xi_{1}) parameterizes the missingness mechanism. Following [ 1 ] , missing probability is modeled as a logit function of log–entropy \log H(y_{j};\theta) . Based on

Read the complete text