Fully Explainable Classification Models Using Hyperblocks

Austin Snyder *, Ryan Gallagher *, Boris Kovalerchuk · 2025

Read Fully Explainable Classification Models Using Hyperblocks by Austin Snyder *, Ryan Gallagher *, Boris Kovalerchuk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06986.txt.

Introduction

Austin Snyder, Ryan Gallagher, and Boris Kovalerchuk build class models that a human can read in full, in work from two thousand twenty-five. Their tool is the hyperblock, a block that sorts a case by the low and high bounds set for each trait. Experts can look at the rules and see why a case got its label.

They add ways to trim blocks, drop traits that add nothing, and merge blocks that overlap. A nearest-neighbor back-up sorts cases that fall in no block, so all data is covered. On test sets, from a small nine-trait set to the large MNIST image set, the trimmed models stay close in score while they grow much simpler.

Catalog record

CREATORAustin Snyder *, Ryan Gallagher *, Boris Kovalerchuk
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06986

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fully Explainable Classification Models Using Hyperblocks Austin Snyder *, Ryan Gallagher *, Boris Kovalerchuk Abstract Building on existing work with Hyperblocks, which classify data using minimum and maximum bounds for each attribute, we focus on enhancing interpretability, decreasing training time, and reducing model complexity without sacrificing accuracy. This system allows subject matter experts (SMEs) to directly inspect and understand the model’s decision logic without requiring extensive machine learning expertise. To reduce Hyperblock complexity while retaining performance, we introduce a suite of algorithms for Hyperblock simplification. These include removing redundant attributes, removing redundant blocks through overlap analysis, and creating disjunctive units. These methods eliminate unnecessary parameters, dramatically reducing model size without harming classification power. We increase robustness by introducing an interpretable fallback mechanism using k-Nearest Neighbor (k-NN) classifiers for points not covered by any block, ensuring complete data coverage while preserving model transparency. Our results demonstrate that interpretable models can scale to high-dimensional, large-volume datasets while maintaining competitive accuracy. On benchmark datasets such as WBC (9-D), we achieve strong predictive performance with significantly reduced complexity. On MNIST (784-D), our method continues to improve through tuning and simplification, showing promise as a transparent alternative to black-box models in domains where trust, clarity, and control are crucial. * * footnotetext: These authors contributed equally to this work. I Introduction This paper focuses on Hyperblocks (HBs) as interpretable means for solving classification tasks [ 1 ] . HBs define class regions using axis-aligned intervals across attributes and are inherently interpretable due to this. HBs structure allows for lossless visualization in high-dimensional space using techniques such as Parallel Coordinates (PC) and other General Line Coordinates (GLC) [ 2 ] . A HB consists of lower and upper bounds (intervals) on a subset of dataset attributes. HBs can also be described as an n-D rectangle due to the bound of min and max in each dimension. Not all attributes are required in each HB for successful classification of cases. Irrelevant or redundant dimensions can be removed entirely. The primary strength of HBs lies in their explainability. Unlike black-box models, HBs enable domain experts to understand and verify the classification logic behind each decision. Despite the simplicity of HBs the challenges are in multiplicity of HBs, the need to simplify the HBs, to minimize their number for a given dataset with high accuracy, and minimizing overfitting. The goal of this paper is to progress in addressing these challenges. We demonstrate significant improvements relative to prior work. The remainder of this paper is organized as follows: Section II defines HBs and their generation process. Section III introduces novel simplification algorithms. Section IV presents alternative approaches. Section V covers case studies, Section VI concludes the paper and presents an outline of future work. II Hyperblocks II-A Concept of Hyperblocks A HB is defined as a set of axis-aligned intervals, one for each attribute in the dataset, which together form a bounded hyper-rectangle. The key idea is to discover regions in the feature space that are pure, meaning the region only contains samples from a single class. When classifying a new point, if it falls fully within this bounded region, it is assigned the corresponding class label of that region, i.e., the HB. To put the classification more formally: \displaystyle\mathbf{x} \displaystyle=(x_{1},x_{2},\dots,x_{n})\in\mathbb{R}^{n}, \displaystyle m \displaystyle=(m_{1},m_{2},\dots,m_{n}),\quad M=(M_{1},M_{2},\dots,M_{n}), \displaystyle\quad\text{with }m_{i}\leq M_{i}\quad(i=1,\dots,n), \displaystyle H \displaystyle=\bigl\{\mathbf{x}\in\mathbb{R}^{n}\;\big|\;m_{i}\leq x_{i}\leq M_{i},\;\forall\,i=1,\dots,n\bigr\}, \displaystyle\text{Class}(\mathbf{x}) \displaystyle=\begin{cases}L,&\text{if }\mathbf{x}\in H\\ \text{undefined},&\text{if }\mathbf{x}\notin H\end{cases} \displaystyle\quad\text{where }L\text{ is the dominant class of points in }H. II-B Motivation for Hyperblocks The motivation for using HBs as a classification model lies in their explainable and interpretable nature. In high stakes domains such as medical diagnostics, domain experts, such as cardiologists, require justifiable and transparent logical reasoning behind predictions. Consider, for example, a model that classifies a heart disease with high accuracy using an algebraic expression such as: \frac{0.5\,\mathrm{weight}}{1.3\,\mathrm{age}+2.1\,\mathrm{smoking\ status}}\;-\;9.04\,\mathrm{cholesterol} While this expression may achieve high performance on cross-validation or test sets, it provides no intuitive explanation of decision logic. A cardiologist without a background in machine learning or mathematics cannot evaluate whether the model’s reasoning aligns with their domain-specific knowledge. As a result, the model becomes untrustworthy not due to its performance metrics, but because its internal logic is inaccessible to the experts best positioned to assess its validity. The goal of HBs are to provide state-of-the-art accuracy, while being easily interpretable by a domain expert with no training in ML. Many widely known and used classifiers, such as Linear Discriminant Functions (LDF), Support Vector Machines (SVM), and k-Nearest Neighbors (k-NN), suffer from limited interpretability. These methods often compress heterogeneous attributes into abstract numeric n-D space, which obscures the semantic difference and heterogeneity of the original features. In the case of k-NN, standard distance metrics such as Euclidean, Manhattan, or Mahalanobis, reduce multidimensional differences into a single scalar value, which hides the contribution of individual attributes. This transformation to a scalar value can misrepresent the true significance of individual attributes. For example, a large difference in an attribute that holds little importance to a SME can still influence the distance calculation, potentially overriding more relevant attributes. As a result, these models may misclassify critical cases and fail to earn the trust of experts in high-stakes domains. II-C Hyperblocks Generation Creating efficient HBs in a high-dimensional space with a large number of n-D points is quite computationally intense. First we summarize the IntervalHyper algorithm, initially developed in [ 3 ] . The purpose of the IntervalHyper algorithm is to create basic HBs from pure single dimensional intervals, in turn reducing the task of merging together all combinations of n-D points to HBs. It is a greedy algorithm to create an initial set of HBs and does not guarantee an optimal set of initial HBs. This algorithm serves as a first step. Later, in the CUDA Merger Hyper (CMH) algorithm, we will take these simple HBs, and attempt to merge their bounds to reduce the complexity of the model, and find dominant patterns in the data. Our modification of the IntervalHyper algorithm from [ 4 ] puts every point into an HB, even if it the HB only contains the single n-D point. However, if these single-point HBs remain unmerged by the end of the generation process, they are removed from the final HB set. II-D Generation of Joint Hyperblocks After executing the IntervalHyper Algorithm, the HBs created are merged by the CUDA Merger Hyper (CMH) algorithm. The CMH algorithm aims to combine two HBs of the same class together into a single, larger HB. This is achieved by expanding each attribute’s interval to cover the full extent of both input blocks: for each dimension, the new HB takes the lower of the two minimum bounds and the higher of the two maximum bounds. Once the merged bounds are constructed, a validation step is performed to ensure that no training point from an incorrect class lies within the expanded n-D region. This prevents the formation of impure or overly generalized HBs that could compromise classification accuracy. The CMH algorithm more formally is as follows as this series of steps: 1. Select a seed HB from the HBs from the current class. 2. For each other HB in the same class: • Compute merged bounds by taking the element-wise minimum

Read the complete text