SOMtime the World Ain’t Fair: Violating Fairness Using Self-Organizing Maps DOI: XXXXXXX.XXXXXXX Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 3–7, 2025; Toronto, ON, Canada ISBN: 978-1-4503-XXXX-X/2025/08 CCS: Computing methodologies Machine learning CCS: Computing methodologies Neural networks CCS: Applied computing Law, social and behavioral sciences Joseph Bingham, Netanel Arussy, Dvir Aran Abstract . Unsupervised representations are widely assumed to be neutral with respect to sensitive attributes when those attributes are withheld from training. We show that this assumption is false. Using SOMtime, a topology-preserving representation method based on high-capacity Self-Organizing Maps, we demonstrate that sensitive attributes such as age and income emerge as dominant latent axes in purely unsupervised embeddings, even when explicitly excluded from the input. On two large-scale real-world datasets (the World Values Survey across five countries and the Census-Income dataset), SOMtime recovers monotonic orderings aligned with withheld sensitive attributes, achieving Spearman correlations of up to 0.85, whereas PCA and UMAP typically remain below 0.23 (with a single exception reaching 0.31), and against t-SNE and autoencoders which achieve at most 0.34. Furthermore, unsupervised segmentation of SOMtime embeddings produces demographically skewed clusters, demonstrating downstream fairness risks without any supervised task. These findings establish that fairness through unawareness fails at the representation level for ordinal sensitive attributes and that fairness auditing must extend to unsupervised components of machine learning pipelines. We have made the code available at https://github.com/JosephBingham/SOMtime/ Figure 1. The SOMtime pipeline. (a) High-dimensional tabular data with sensitive attributes withheld. (b) A high-capacity Self-Organizing Map learns a topology-preserving discretization. (c) Activation patterns across the SOM lattice. (d) Observations mapped to a 3D embedding (BMU coordinates + activation energy), colored by withheld sensitive attribute (age group). For attributes with simple progression, the SOM embedding arranges observations along a monotonic axis aligned with the withheld sensitive attribute, revealing information leakage invisible to standard methods. (e) Trajectory of ordered centroid progressions of protected values recovered from downstream analysis. Pipeline showing data input, SOM training, activation heatmap, 3D embedding colored by age group, and inferred ordering. 1. Introduction Modern machine learning pipelines increasingly rely on unsupervised representations as foundational building blocks. Clustering, dimensionality reduction, and learned embeddings are used for customer segmentation, data exploration, visualization, and as preprocessing steps for downstream prediction ( 23 ) . These representations are often assumed to be neutral, particularly when sensitive attributes such as age, gender, race, or income are deliberately withheld from the input features. This assumption, known as fairness through unawareness ( 7 ) , has been widely critiqued in the supervised learning literature. It is well established that models can reconstruct sensitive attributes from correlated proxy features, leading to discriminatory outcomes even when the protected variable is absent from the training data ( 14 ; 26 ) . However, the fairness community has focused predominantly on supervised predictors, i.e. classifiers and regressors with explicit outcome labels ( 23 ) . Comparatively little attention has been paid to whether unsupervised representations themselves encode sensitive information, and if so, how severely. The presence of this gap is not trivial for end-users who are assuming their usage of unsupervised embedding prevents any fairness issues. When an unsupervised embedding systematically organizes data along a sensitive axis, any downstream use of that embedding (whether for clustering, recommendation, visualization, or feature extraction) inherits a fairness risk before any supervised task is even defined . Recent work in recommender systems has confirmed that collaborative filtering embeddings can capture user demographics even when demographic features are not provided ( 8 ) . Fair clustering research has shown that standard algorithms produce demographically imbalanced partitions ( 6 ; 9 ) . And studies of fair dimensionality reduction have demonstrated that methods like t-SNE can produce visualizations dominated by sensitive-attribute structure ( 25 ) . In this work, we make four contributions: Empirical demonstration of sensitive-attribute recoverability. We show that unsupervised representations encode sensitive attributes (age, income) with high fidelity, even when those attributes are excluded from training. A topology-based auditing method. We propose SOMtime, based on high-capacity Self-Organizing Maps ( 16 ) , as an unsupervised audit tool that reveals global sensitive structure, including monotonic orderings and gradients, that is attenuated or invisible in standard embeddings (PCA ( 20 ) , UMAP ( 22 ) , t-SNE ( 29 ) ). Comparative evidence against common baselines. We show that SOM-based representations leak substantially more sensitive information than PCA, UMAP, t-SNE, and autoencoders despite all methods being fully unsupervised. Implications for fairness beyond supervised learning. We argue that fairness interventions must operate at the representation level and include unsupervised components, motivating new auditing and mitigation strategies. We study this phenomenon empirically on two large, real-world datasets: the World Values Survey (WVS) ( 11 ) , a globally representative survey of political and moral values used in recent top-tier ML publications ( 1 ; 17 ; 33 ) , and the Census-Income (KDD) dataset ( 4 ) . In both cases, we withhold sensitive attributes entirely from the representation learning process and measure the degree to which they emerge as dominant latent structure. Our results show that SOMtime achieves Spearman correlations up to 0.85 between its learned embedding axes and withheld sensitive attributes, whereas PCA and UMAP typically remain below 0.23 (with a single exception reaching 0.31). Moreover, unsupervised segmentation of SOMtime embeddings produces clusters with substantial demographic skew, demonstrating that fairness risks arise even in the absence of any supervised objective. 2. Background and Related Work 2.1. Fairness Beyond Supervised Learning The principle of fairness through unawareness , the idea that removing sensitive attributes from model inputs suffices to prevent discrimination, has been extensively studied and shown to be insufficient ( 7 ; 18 ) . Proxy features correlated with protected attributes can enable models to reconstruct the withheld information and reproduce discriminatory patterns ( 23 ) . While this critique is well established for supervised learning, its implications for unsupervised representations have received less attention. Recent surveys document a growing body of work on fairness in machine learning ( 26 ; 23 ) , yet the vast majority of proposed fairness criteria (demographic parity, equalized odds, calibration ( 14 ) ) are defined with respect to outcome labels and are therefore specific to supervised tasks. The question of whether unsupervised representations are “fair” remains underexplored. 2.2. Fairness in Unsupervised Learning Fair Clustering. The seminal work of Chierichetti et al. ( 6 ) introduced fairlets , small balanced subsets used as preprocessing to ensure demographic balance in cluster assignments. Subsequent work extended fair clustering to k -center and k -means objectives with group-balance constraints ( 15 ; 2 ) , and Ghadiri et al. ( 9 ) proposed socially fair clustering that minimizes the maximum group-specific cost. Chhabra et al. ( 5 ) provide a comprehensive survey of fairness in clustering. Fair Representation Learning. A complementary line of work focuses on learning latent representations that are predictive of useful features but uninformative of protected attributes. Zemel et al. ( 32 ) proposed learning fair representations via an optimization objective that balances accuracy and demographic parity. Adversarial approaches ( 31 ; 21 ) train an encoder jointly with an adversary that attempts to predict the sensitive attribute from the latent code; the encoder is penalized when the adversary succeeds. The Variational Fair Autoencoder ( 19 ) uses Maximum Mean Discrepancy to match latent distributions across groups. Concept erasure methods ( 27 ) post-process representations by projecting out directions correlated with sensitive attributes. Beyond fairness-specific variants, standard autoencoders are widely used as general-purpose nonlinear dimensionality reduction tools ( 12 ) and are commonly employed as representation learning baselines in fairness auditing studies. Their ability to learn continuous, distributed latent codes with controllable bottleneck dimensionality makes them a natural point of comparison for any method claiming to expose latent structure. Fair Dimensionality Reduction. Samadi et al. ( 28 ) studied the “price of fair PCA,” showing that equal reconstruction error across groups can be achieved by increasing the target dimensionality by one. Peltonen et al. ( 25 ) introduced fairness-aware objectives for nonlinear embeddings, showing that standard t-SNE can produce visualizations dominated by sensitive-attribute structure. Conditional t-SNE ( 13 ) generates embeddings that factor out specified structure. Auditing for Sensitive-Attribute Leakage. A common auditing approach is the probing classifier : train a simple predictor on learned representations to assess whether a sensitive attribute can be recovered ( 23 ) . High prediction accuracy signals information leakage. This technique is standard for evaluating fair representation learning but has primarily been applied to supervised embeddings. Complementary approaches based on mutual information estimation ( 24 ) provide a more general measure of statistical dependence but are computationally more demanding and less interpretable for continuous ordinal attributes. 2.3. Topology-Preserving Representations and the Fairness Gap Self-Organizing Maps (SOMs), introduced by Kohonen ( 16 ) , learn topology-preserving discretizations of high-dimensional data onto a lattice of prototype vectors. While SOMs were widely used for clustering and visualization, they have seen little treatment in recent fairness literature ( 10 ; 26 ) . Modern fairness research has focused on deep learning and differentiable embeddings, leaving classical topology-preserving methods largely unexamined. Critically, prior work on fairness in unsupervised learning focuses primarily on local separability (whether groups can be locally distinguished) or classification leakage (whether a probing classifier can predict group membership). We identify a distinct and previously unaddressed risk: global geometric ordering . When an unsupervised representation arranges observations along a monotonic axis aligned with a sensitive attribute, this constitutes a form of structured leakage that is qualitatively different from local separability. Standard low-dimensional embeddings (PCA, UMAP) attenuate this signal; high-capacity SOMs amplify it. We show that topology-preserving maps with sufficient capacity expose a global fairness risk that projection- and reconstruction-based methods systematically obscure. 3. Method: SOMtime as a Tool We position SOMtime not as a solution to fairness, but as a lens that makes sensitive structure in unsupervised representations explicit. The method reveals whether and how strongly a representation encodes withheld sensitive attributes. 3.1. Problem Setup We consider a dataset-agnostic unsupervised setting. Each observation is a fixed-length feature vector \mathbf{x}_{i}\in\mathbb{R}^{d} , optionally associated with a sensitive attribute s_{i} that is withheld from all representation learning. The goal is to assess whether s is encoded in the learned representation, and if so, how strongly. Crucially, all representation learning steps are fully unsupervised with respect to s . Sensitive attributes are used only for post-hoc auditing via correlation analysis. 3.2. Self-Organizing Map Representation We map the input data into a two-dimensional discrete latent space using a Self-Organizing Map (SOM). Let X\in\mathbb{R}^{N\times d} denote the input matrix. The SOM consists of a square lattice of K\times K units, where each unit j is associated with a prototype vector \mathbf{w}_{j}\in\mathbb{R}^{d} . For each input observation \mathbf{x}_{i} , the best-matching unit (BMU) is defined as j^{*}=\arg\min_{j}\|\mathbf{x}_{i}-\mathbf{w}_{j}\|. Prototype vectors are updated according to \mathbf{w}_{j}(t+1)=\mathbf{w}_{j}(t)+\alpha(t)\,h(j,j^{*},t)\,(\mathbf{x}_{i}-\mathbf{w}_{j}(t)), where \alpha(t) is a learning rate and h(\cdot) is a Gaussian neighborhood function defined over the lattice topology. This competitive-learning rule induces a topology-preserving discretization of the data manifold: nearby neurons in the lattice specialize to similar regions of the input space. In contrast to conventional SOM usage for two-dimensional visualization, we employ a map with a large number of neurons ( K=5\cdot N^{0.54} ). This scaling follows a slight modification the heuristic proposed by Vesanto and Alhoniemi ( 30 ) , which balances representational capacity against computational cost. The resulting lattice allows the SOM to approximate the data distribution at finer granularity than is typical in visualization applications. 3.3. Continuous 3D Embedding To enable continuous analysis of latent structure, we transform the discrete SOM grid into a three-dimensional coordinate system. Each observation inherits the (x,y) coordinates of its BMU on the lattice, and a third coordinate z_{i}=\|\mathbf{x}_{i}-\mathbf{w}_{j^{*}}\| , the per-observation quantization error (distance to the BMU prototype). This results in an embedding \mathbf{z}_{i}\in\mathbb{R}^{3} that preserves local neighborhood relations while enabling global geometric analysis. This 3D embedding allows detection of smooth sensitive-attribute gradients across the representation, including monotonic orderings, neighborhood composition analysis, and structured demographic patterns. 3.4. Latent Sensitive-Axis Recovery To assess whether the learned representation encodes a global ordering aligned with a sensitive attribute, we analyze the induced geometry of SOM unit centroids. We construct an adjacency graph G=(V,E) over the K\times K lattice, where each vertex is an index for row and column, and values of the graph are boolean identifiers of edge existence from row to column vertices. Before this algorithm, cluster centers from the SOM distance map are calculated in XY-space. Those XY centroids are then mapped to their point on the SOM distance map to get the centroid activations. Algorithm 1 takes in these centroids to compute ordering and directionality of the trajectories. Edges are computed using a combination of initial ordering from the activation of nodes, followed by a euclidean distance in 3-dimensional space to find the closest node for trajectory. As seen in Algorithm 1 the values in XYZ-space, where Z is the activation, are scaled to emphasize differences in activation. The resulting adjacency graph gives the trajectories of our sensitive attributes. We formalize the notion of sensitive structure we aim to detect. A representation exhibits global geometric ordering with respect to a sensitive attribute s if there exists a path through the embedding along which s varies monotonically. This is distinct from local separability , which measures whether observations with similar s values are nearby in the embedding (e.g., via k -NN purity). A representation may exhibit high local separability without global ordering—for instance, if age groups form distinct clusters that are randomly arranged in space—or global ordering without local separability. We quantify ordering strength via the Spearman correlation \rho between s and position along the recovered path; higher |\rho| indicates stronger global alignment. Algorithm 1 Trajectory Adjacency Matrix Construction 1: \mathbf{C}\in\mathbb{R}^{n\times 3} \triangleright Centroids in form (x, y, z = activation) 2: K\in\mathbb{R} \triangleright Dimension of SOM 3: \mathbf{A}\in\{0,1\}^{n\times n} \triangleright Adjacency matrix of trajectories 4: \mathbf{A}\leftarrow\mathbf{0}_{n\times n} \triangleright Initialize adjacency matrix 5: // Trajectory computation 6: for i=1 to n do 7: if \sum_{k}A_{k,i}>0 or \sum_{k}A_{i,k}>0 then 8: continue \triangleright Skip if already connected 9: end if 10: d_{\min}\leftarrow\infty 11: j^{*}\leftarrow-1 12: for j=1 to n do 13: if i=j then 14: continue 15: end if 16: // Scale coordinates 17: \tilde{\mathbf{c}}_{i}\leftarrow\left(\frac{C_{i,1}}{\sum_{k=1}^{n}C_{k,1}},\frac{C_{i,2}}{\sum_{k=1}^{n}C_{k,2}},K\cdot C_{i,3}\right) 18: \tilde{\mathbf{c}}_{j}\leftarrow\left(\frac{C_{j,1}}{\sum_{k=1}^{n}C_{k,1}},\frac{C_{j,2}}{\sum_{k=1}^{n}C_{k,2}},K\cdot C_{j,3}\right) 19: d\leftarrow\|\tilde{\mathbf{c}}_{i}-\tilde{\mathbf{c}}_{j}\|_{2} \triangleright Euclidean distance 20: if d