TIE: A Training–Inversion–Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection

P. Suhail, R. Afroz, A Sethi · 2025

Read TIE: A Training–Inversion–Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection by P. Suhail, R. Afroz, A Sethi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00229.txt.

Introduction

Neural networks often fail silently when given inputs unlike anything in their training data. Suhail, Afroz, and Sethi present TIE in 2025, a framework for detecting such out-of-distribution inputs. The name stands for training, inversion, and exclusion, its three main stages.

Dependable systems need to estimate uncertainty and flag unfamiliar samples in a unified way, because overconfident predictions can be dangerous. TIE is designed to stay visually interpretable while it decides. The work matters for medical, driving, and security systems, where recognizing the unknown is as important as classifying the known. Interpretability is built into the framework's name and design, not added afterward. Uncertainty estimates give downstream systems a principled way to abstain.

Catalog record

CREATORP. Suhail, R. Afroz, A Sethi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00229

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TIE: A Training–Inversion–Exclusion Framework for Visually Interpretable and Uncertainty-Guided Out-of-Distribution Detection P. Suhail, R. Afroz, A Sethi Abstract Deep neural networks often struggle to recognize when an input lies outside their training experience, leading to unreliable and overconfident predictions. Building dependable machine learning systems therefore requires methods that can both estimate predictive uncertainty and detect out-of-distribution (OOD) samples in a unified manner. In this paper, we propose TIE: a Training–Inversion–Exclusion framework for visually interpretable and uncertainty-guided anomaly detection that jointly addresses these challenges through iterative refinement. TIE extends a standard n n -class classifier to an ( n + 1 ) (n+1) -class model by introducing a garbage class initialized with Gaussian noise to represent outlier inputs. Within each epoch, TIE performs a closed-loop process of training, inversion, and exclusion , where highly uncertain inverted samples reconstructed from the just-trained classifier are excluded into the garbage class. Over successive iterations, the inverted samples transition from noisy artifacts into visually coherent class prototypes, providing transparent insight into how the model organizes its learned manifolds. During inference, TIE rejects OOD inputs by either directly mapping them to the garbage class or producing low-confidence, uncertain misclassifications within the in-distribution classes that are easily separable, all without relying on external OOD datasets. A comprehensive threshold-based evaluation using multiple OOD metrics and performance measures such as AUROC , AUPR , and FPR@95%TPR demonstrates that TIE offers a unified and interpretable framework for robust anomaly detection and calibrated uncertainty estimation (UE) achieving near-perfect OOD detection with ≈ \!\approx\! 0 FPR@95%TPR when trained on MNIST or FashionMNIST and tested against diverse unseen datasets. 1 Introduction The rapid integration of machine learning models into safety-critical domains such as autonomous driving, medical diagnosis, and financial decision-making has made model reliability and robustness indispensable. Despite remarkable progress in predictive accuracy, modern neural networks remain vulnerable to overconfidence, often producing high-confidence predictions even for inputs far removed from the training distribution 35 . Such behavior compromises safety and trustworthiness, motivating the need for models that can not only recognize when they are uncertain but also identify when an input is fundamentally out-of-distribution (OOD) . The complementary tasks of OOD detection —discriminating in-distribution from anomalous inputs—and uncertainty estimation (UE) —quantifying predictive confidence—are therefore essential for building dependable, interpretable, and fail-safe learning systems. Although closely related, OOD detection and UE have traditionally been treated as disjoint problems. Most existing methods rely on post-hoc calibration or require access to auxiliary OOD datasets for fine-tuning, which limits scalability and interpretability. Furthermore, post-hoc uncertainty estimates often fail to capture epistemic uncertainty, as they are derived from fixed, discriminative models without revisiting how the underlying decision boundaries are formed. Consequently, there remains a need for frameworks that integrate uncertainty modeling directly into the learning process while maintaining interpretability and eliminating reliance on external supervision. In this paper, we introduce TIE (Training–Inversion–Exclusion) , a unified framework that jointly addresses uncertainty estimation and OOD detection through a self-refining training mechanism. Building upon the concept of network inversion 34 , TIE reconstructs input samples from classifier outputs to visualize and analyze class manifolds, thereby linking interpretability with uncertainty modeling. Within each epoch, TIE performs a cyclic process of training, inversion, and exclusion , where inverted reconstructions are assessed using a dynamic uncertainty threshold. Samples exhibiting high uncertainty are excluded into the garbage class, enabling the model to progressively purify its decision boundaries and enhance robustness. The framework extends a standard n -class classifier to an (n+1) -class architecture by introducing a dedicated garbage class initialized with Gaussian noise to represent outlier content. Over successive iterations, the inverted samples evolve from noisy artifacts into visually coherent class prototypes, offering interpretable insights into the structure of each class manifold and how uncertainty evolves during learning. During inference, TIE effectively rejects OOD samples by assigning them either directly to the garbage class or to any of the in-distribution class with relatively low confidence, making them easily separable by thresholding. Our results demonstrate that TIE provides a visually interpretable, uncertainty-aware, and self-correcting framework that unifies OOD detection and uncertainty estimation without reliance on post-hoc calibration or external OOD datasets. 2 Prior Work Network Inversion. Inversion aims to reconstruct inputs that elicit desired outputs from a neural network. Early work on multilayer perceptrons employed gradients to do reconstructions, however these were often noisy in appearance 15 ; 13 ; 29 . Later 39 explored evolutionary optimization and constrained search, while subsequent studies improved visual fidelity through explicit priors such as smoothness constraints or pretrained generative models 24 ; 41 ; 25 ; 28 ; 27 . The relationship between inversion and adversarial examples became evident, as unconstrained inversion frequently converged to adversarial artifacts 37 ; 9 . In contrast, adversarially robust networks were shown to yield more human-aligned reconstructions 38 ; 7 ; 30 . Recently surrogate loss learning for stable inversion 21 , generative modeling conditioned on classifier outputs 34 , and logical formulations using CNF constraints 36 for deterministic inversion have been explored. Out-of-Distribution Detection. OOD detection focuses on identifying test inputs that lie outside the distribution of the training data. 11 introduced the Maximum Softmax Probability (MSP) score as a simple yet effective measure, showing that correctly classified samples tend to yield higher softmax probabilities compared to misclassified or OOD inputs. Building upon this, 20 proposed ODIN , which enhances separability between in- and out-of-distribution samples by applying temperature scaling and small input perturbations, significantly reducing false positives. Subsequently, 22 reformulated OOD detection through an energy-based framework, demonstrating that energy scores aligned with the input’s log-likelihood offer superior separation between in- and out-of-distribution data while addressing softmax overconfidence. In parallel, 19 proposed the Mahalanobis distance -based approach, which models class-conditional feature distributions via Gaussian discriminant analysis to compute confidence scores, achieving strong performance on both adversarial and natural OOD detection tasks. Recent works like SCOOD 23 enhance semantic coherence in OOD detection through uncertainty-aware optimal transport and adaptive cost modeling. Gaussian process-based techniques 5 model predictive uncertainty using only in-distribution data, while normalizing flow–based models such as PostNet 4 learn posteriors over predictive probabilities for reliable OOD discrimination without explicit OOD supervision. Uncertainty Quantification(UQ). UQ has become fundamental to building trustworthy AI systems, especially where overconfident errors can have severe consequences. Post-hoc methods are widely used due to their compatibility with pretrained classifiers. Monte Carlo Dropout (MC Dropout) 8 introduces stochastic inference to approximate Bayesian model averaging, while temperature scaling 10 improves calibration via a single scalar parameter. Evidential Deep Learning 31 models classification as a Dirichlet evidence estimation problem, while DEUP 12 predicts generalization error using a learned uncertainty regressor and evidential meta-models 32 generate Dirichlet parameters directly from classifier embeddings. Bayesian neural networks (BNNs) 26 ; 3 and variational inference approaches estimate posterior weight distributions, whereas Deep Ensembles 18 combine multiple independently trained networks for superior calibration and robustness under shift. Domain-specific extensions include test-time augmentation, uncertainty-aware segmentation 14 , and Bayesian approximations for volumetric imaging 17 . BAY-MED 2 extends evidential meta-modeling to breast cancer classification, achieving improved robustness against OOD samples. Autoinverse 1 integrates predictive uncertainty into the inversion process, constraining reconstructions toward reliable training regions to improve robustness. Our Work. Prior research underscores the complementary nature of

Read the complete text