Probabilistic Foundations of Fuzzy Simplicial Sets for Nonlinear Dimensionality Reduction

2025

Read Probabilistic Foundations of Fuzzy Simplicial Sets for Nonlinear Dimensionality Reduction (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03899.txt.

Introduction

UMAP, a popular tool for flattening high-dimensional data into pictures, is built on fuzzy simplicial sets, objects from algebraic topology. Janis Keck and colleagues give those objects a probabilistic meaning in a 2025 machine learning preprint. Without one, they argue, the theory floats free of the statistical frameworks data scientists normally use.

Their framework presents those fuzzy sets as shadows of probability measures on ordinary simplicial sets. Under that lens, UMAP's fuzzy weights become cumulative distribution functions of pairwise distances, sampled through a generative process over filtrations. The viewpoint clarifies how divergence scores relate to fuzzy cross-entropy, and recovers fuzzy logic rules from set rules. To show the approach can create as well as explain, the authors derive a generalised embedding method using Cech ones and triplet sampling.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03899

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Probabilistic Foundations of Fuzzy Simplicial Sets for Nonlinear Dimensionality Reduction Abstract Fuzzy simplicial sets have become an object of interest in dimensionality reduction and manifold learning, most prominently through their role in UMAP. However, their definition through tools from algebraic topology without a clear probabilistic interpretation detaches them from commonly used theoretical frameworks in those areas. In this work we introduce a framework that explains fuzzy simplicial sets as marginals of probability measures on simplicial sets. In particular, this perspective shows that the fuzzy weights of UMAP arise from a generative model that samples Vietoris–Rips filtrations at random scales, yielding cumulative distribution functions of pairwise distances. More generally, the framework connects fuzzy simplicial sets to probabilistic models on the face poset, clarifies the relation between Kullback–Leibler divergence and fuzzy cross-entropy in this setting, and recovers standard t-norms and t-conorms via Boolean operations on the underlying simplicial sets. We then show how new embedding methods may be derived from this framework, and illustrate this on an example where we generalize UMAP using Čech filtrations with triplet sampling. In summary, this probabilistic viewpoint provides a unified probabilistic theoretical foundation for fuzzy simplicial sets, clarifies the role of UMAP within this framework, and enables the systematic derivation of new dimensionality reduction methods. Janis Keck 1,2,3,∗ Lukas Silvester Barth 1, Fatemeh (Hannaneh) Fahimi 1,4 Parvaneh Joharinad 1,4 Jürgen Jost 1,2,5 1 Max Planck Institute for Mathematics in the Sciences, Leipzig, Germany 2 Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany 3 Max Planck School of Cognition 4 ScaDS.AI (Center for Scalable Data Analytics and AI), Leipzig, Germany 5 Santa Fe Institute for the Sciences of Complexity, New Mexico, USA ∗ Corresponding author [email protected] , [email protected] , [email protected] , [email protected] , [email protected] 1 Introduction Fuzzy simplicial sets have recently emerged as a theoretical concept fruitful for machine learning research, particularly in manifold learning, data visualization and clustering [ 24 , 31 , 32 ] . Standard simplicial sets, long used in algebraic topology and topological data analysis, encapsulate the topological structure of a space in a combinatorial framework [ 38 , 13 ] . However, they do not inherently encode metric information, which is often crucial in data analysis. Fuzzy simplicial sets address this limitation by introducing membership strength functions that encode both combinatorial and metric properties 34 . The dimensionality reduction method UMAP has been of high success in leveraging this theoretical idea to obtain a guideline on how to effectively arrange points in low dimensional space as to capture this structure [ 24 , 14 , 10 , 30 ] . Despite UMAP’s widespread adoption and some effort to investigate its properties [ 7 , 8 , 18 , 11 , 28 ] the theoretical framework underlying fuzzy simplicial sets remains underappreciated in the broader machine learning and topological data analysis communities - possibly owed to the fact that fuzzy logic is less commonly used than the more familiar probability theory. To unify these ideas, this work introduces a probabilistic perspective on fuzzy simplicial sets, framing them as objects generated by probability distributions over standard simplicial sets. By interpreting fuzzy weights as marginal probabilities, we not only provide an intuitive foundation for fuzzy simplicial sets but also establish that any such object can be generated probabilistically - at least in the finite setting relevant in practice. Using this framework, we reinterpret the UMAP algorithm, demonstrating how its weights emerge from distributions over Vietoris-Rips complexes. This probabilistic view also suggests several avenues for generalizing UMAP, such as using alternative filtrations or optimizing over richer probabilistic models. We hope this perspective fosters a deeper understanding of fuzzy simplicial sets and their applications, paving the way for new methods in topological data analysis, dimensionality reduction or manifold learning. This work thus makes three contributions: (1) We show that every finite fuzzy simplicial set arises as the image of a conventional probability distribution over standard simplicial sets, and we derive basic properties of this representation. (2) We establish relationships to filtrations, t-norm and t-conorm operations, divergences, and comparisons between simplicial structures. (3) Using the probabilistic formulation, we reinterpret UMAP and introduce a Čech-based variant that behaves similar as UMAP in preserving topological and geometric structure. 2 Preliminaries We now collect the minimal definitions and concepts required for our formulation. These are standard, and we include them only for completeness and to fix notation, while also providing some examples and illustrations for readers not familiar with the definitions. 2.1 Fuzzy Sets A fuzzy set is just a set where each element has an associated membership strength or weight: Definition 1 . A classical fuzzy set is a set S together with a weight function \mu:S\to[0,1] . Fuzzy sets have a rich history and well-developed theory, which we will not be able to even rudimentarily cover here - consider 43 for a full treatment. Most importantly, they were conceived by 40 to be able to model imprecise statements about membership (e.g., ’ x is in the set of numbers much larger than y ’) in a formal manner. In contrast to probability theory, which may be interpreted as modelling uncertainty about outcomes, fuzzy set theory is concerned with modelling imprecise outcomes [ 33 ] . Due to these complementary objectives, since the inception of fuzzy set theory there have been made various attempts to combine these theories [ 41 , 15 , 33 ] , such that one may model imprecisely defined events in a probabilistic manner. To anticipate our discussion below: here, we will not need such a sophisticated approach, as we will merely provide a way in which the fuzzy objects we want to study are generated from probability measures. As stated above, fuzzy sets are intended to model imprecise membership in a set. Many concepts from classical or ’crisp’ set theory and the associated logic then generalize to fuzzy theory. We will only need the t-(co)-norms, which are generalizations of intersection and union operations, respectively. They are standard in the respective literatures, but we state the definition here for convenience of the reader: Definition 2 . A t-norm is a map T:[0,1]\times[0,1]\to[0,1] (1) such that 1. T(a,b)=T(b,a) (Commutativity) 2. T(a,b)\leq T(c,d) if a\leq c and b\leq d (Monotonicity) 3. T(a,T(b,c))=T(T(a,b),c) (Associativity) 4. T(a,1)=a (Identity element). To each t-norm T we may associate a dual t-conorm \tilde{T} via \tilde{T}(a,b)=1-T(1-a,1-b) . Example 1 . Examples for a t-norm are the minimum (a,b)\mapsto\min(a,b) and the product norm (a,b)\mapsto ab. Their dual t-conorms are the maximum (a,b)\mapsto\max(a,b) and the probabilistic sum (a,b)\mapsto a+b-ab. Naturally, one may identify classical or ’crisp’ sets with those fuzzy sets that only take membership values in \{0,1\} via \mu\mapsto\mu^{-1}(1) (where \mu is the weight function from Def. 1 ) - we will use this identification repeatedly below. One asserts that for classical sets the above operations indeed retrieve union and intersection of sets, furthermore, many of the properties of these operations carry over [ 40 ] . 2.2 Fuzzy Simplicial Sets Our main object of interest are fuzzy simplicial sets . Simplicial sets are a powerful tool in algebraic topology to encode topological information about a space in a combinatorial object of simplex/face relations. In 34 , these were generalized to fuzzy

Read the complete text