An Algebraic Framework for Hierarchical Probabilistic Abstraction
Nijesh Upreti, Vaishak Belle · 2025
Read An Algebraic Framework for Hierarchical Probabilistic Abstraction by Nijesh Upreti, Vaishak Belle (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21216.txt.
Introduction
Nijesh Upreti and Vaishak Belle build an algebra-based framework for layered abstraction of chance models, in work from 2025. Abstraction shrinks complex systems into summaries that humans can grasp. Chance and uncertainty make that shrinking much harder to do soundly.
Single-layer summaries often lose the layered ties inside real systems. The new framework stacks mappings in levels, each with its own detail, yet linked in a strict math sense. Users can zoom into one level or read the whole stack as one model. The base rests on measure theory, a solid ground for chance. The authors target AI tasks that mix fast instinct with slow reasoning.
Catalog record
| CREATOR | Nijesh Upreti, Vaishak Belle |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-21216
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Algebraic Framework for Hierarchical Probabilistic Abstraction Nijesh Upreti, Vaishak Belle Abstract Abstraction is essential for reducing the complexity of systems across diverse fields, yet designing effective abstraction methodology for probabilistic models is inherently challenging due to stochastic behaviors and uncertainties. Current approaches often distill detailed probabilistic data into higher-level summaries to support tractable and interpretable analyses, though they typically struggle to fully represent the relational and probabilistic hierarchies through single-layered abstractions. We introduce a hierarchical probabilistic abstraction framework aimed at addressing these challenges by extending a measure-theoretic foundation for hierarchical abstraction. The framework enables modular problem-solving via layered mappings, facilitating both detailed layer-specific analysis and a cohesive system-wide understanding. This approach bridges high-level conceptualization with low-level perceptual data, enhancing interpretability and allowing layered analysis. Our framework provides a robust foundation for abstraction analysis across AI subfields, particularly in aligning System 1 and System 2 thinking, thereby supporting the development of diverse abstraction methodologies. 1 Introduction Abstraction serves as a core concept across knowledge domains, simplifying complex relationships into more comprehensible forms by focusing on essential details and discarding irrelevant ones [ 14 , 33 , 4 ] . In probabilistic models, abstraction is challenging due to inherent uncertainties and the stochastic nature of the systems involved [ 26 , 16 ] . Various methodologies have been developed to summarize detailed probabilistic information into higher-level representations while preserving essential characteristics and relationships, making such frameworks tractable and interpretable under uncertainty [ 4 , 21 , 22 , 25 , 31 ] . Yet, single-layered probabilistic abstractions are often inadequate for capturing the full relational and probabilistic hierarchy in a single low-to-high-level mapping. Recent works emphasize multi-layered representations to model real-world hierarchical complexities, such as in disease diagnosis [ 18 ] and epidemic modeling [ 15 ] . These layered approaches are essential for analyzing phenomena across multiple levels, providing interpretable insights into complex interactions and uncertainties [ 12 , 16 , 17 ] . Further, hierarchical modeling using directed acyclic graphs (DAGs) has become instrumental in fields like cognitive science, where hierarchical DAGs model complex concepts across layers [ 9 ] . However, constructing interpretable high-level theories from low-level data requires a structured framework for hierarchical relational and probabilistic information. A formal mathematical treatment of abstraction hierarchies is thus critical, offering a robust foundation for reasoning in complex spaces. Starting from single-layer mappings and progressing to multi-layered models captures complexities at each level while clarifying relationships between different layers [ 17 ] . Such a framework would further enable the development of methods to learn abstraction hierarchies in diverse contexts, supporting detailed decomposition for in-depth analysis [ 35 , 23 ] . To position our work within this existing research landscape, we draw upon several foundational studies. First, Hofmann and Belle’s work established an abstraction framework for robot programs with probabilistic beliefs, utilizing the DS logic and bisimulation in probabilistic dynamic systems to demonstrate sound and complete abstraction [ 20 ] . Second, Beckers et al. contributed a framework for analyzing abstraction and approximation within causal models, providing formal definitions and results for approximate causal abstractions [ 3 ] . Third, Segal et al.’s study on probabilistic abstraction hierarchies (PAH) introduced a principled approach for learning abstraction hierarchies from data, addressing complexities in modeling multi-level systems [ 35 ] . Our work is inspired by these research endeavors and directly builds on Holtzen et al.’s papers on probabilistic program abstraction, which establishes single-layered mappings from concrete programs to their abstract versions with soundness properties [ 21 , 22 ] . In this paper, we propose a hierarchical probabilistic abstraction framework that generalizes the measure-theoretic approach as introduced by Holtzen et al. to multi-layered settings while providing a structured, modular foundation for abstraction in complex systems. By decomposing abstraction into layered mappings, the framework supports detailed, layer-specific analysis alongside a comprehensive system-level understanding, enabling dual-level reasoning: individual transformations and probabilistic relationships at each layer, and cumulative effects across layers. This structured approach facilitates exploration of abstractions across AI subfields, notably in System 1 and System 2 cognition, by connecting high-level conceptual reasoning with low-level perceptual data [ 24 ] . This comprehensive perspective is vital for advancing research in cognitive AI, statistical relational learning, and neurosymbolic AI, laying a solid foundation for the development of diverse abstraction methodologies. 2 Motivating Example Imagine a personalized learning system designed to optimize educational outcomes for students with diverse backgrounds and abilities. The goal is to create an adaptive education platform that tailors learning experiences based on individual cognitive profiles, learning environments, and behavioral patterns. This example is a slightly more complex version of examples as outlined in Belle’s work [ 4 ] . Towards modeling such a system, consider a probabilistic relational model (PRM) for a university database U , representing student learning and performance. The model instantiates constraints for a parameterized Bayesian network as follows: \scriptsize\text{Environmental Factors}\rightarrow\text{Cognitive Processes}\leftarrow\text{Learning Behaviors}\rightarrow\text{Educational Outcomes} Low-Level Theory U_{l} : \square \textbf{0.7}\hskip 8.19447pt\text{HLE}(x,\text{High}) \square \textbf{0.2}\hskip 8.19447pt\text{HLE}(x,\text{Medium}) \square \textbf{0.1}\hskip 8.19447pt\text{HLE}(x,\text{Low}) \square \textbf{0.6}\hskip 8.19447pt\text{PI}(x,\text{High}) \square \textbf{0.3}\hskip 8.19447pt\text{PI}(x,\text{Medium}) \square \textbf{0.1}\hskip 8.19447pt\text{PI}(x,\text{Low}) \square \textbf{0.5}\hskip 8.19447pt\text{SES}(x,\text{High}) \square \textbf{0.3}\hskip 8.19447pt\text{SES}(x,\text{Medium}) \square \textbf{0.2}\hskip 8.19447pt\text{SES}(x,\text{Low}) \square \textbf{0.4}\hskip 8.19447pt\text{WM}(x,\text{High})\land\text{HLE}(y,\text{High})\land\text{PI}(z,\text{High})\land\text{SES}(w,\text{High})\\ \implies\text{cogAbility}(x,y,z,w,u) for u\in\{\text{Strong},\text{Moderate}\} \square \textbf{0.6}\hskip 8.19447pt\text{WM}(x,\text{Medium})\land\text{HLE}(y,\text{Medium})\land\text{PI}(z,\text{Medium})\land\text{SES}(w,\text{Medium})\\ \implies\text{cogAbility}(x,y,z,w,u) for u\in\{\text{Moderate},\text{Weak}\} High-Level Theory U_{h} : \square \textbf{0.7}\hskip 8.19447pt\text{engagement}(x,\text{High}) \square \textbf{0.3}\hskip 8.19447pt\text{engagement}(x,\text{Low}) \square \textbf{0.5}\hskip 8.19447pt\text{cogAbility}(x,\text{Strong})\land\\ \;\text{engagement}(y,\text{High})\land\text{adaptation}(z,\text{High})\\ \implies\text{academicPerformance}(x,y,z,u) for u\in\{\text{Excellent},\text{Good}\} \square \textbf{0.5}\hskip 8.19447pt\text{cogAbility}(x,\text{Weak})\land\\ \text{engagement}(y,\text{Low})\land\text{adaptation}(z,\text{Low})\\ \implies\text{academicPerformance}(x,y,z,u) for u\in\{\text{Average},\text{Poor}\} In the given example case, while a two-layer abstraction from U_{l} to U_{h} captures some relationships between variables, it falls short due to the complexity and interdependencies in educational systems. In the formal model, we see numerous variables such as Home Learning Environment (HLE), Parental Involvement (PI), and Socioeconomic Status (SES), each affecting Cognitive Abilities (WM) and Learning Styles (LS). The interaction of these variables in a two-layer mapping is insufficient to capture the nuanced impacts across all layers. For instance, a high-quality home learning environment (HLE = High) might significantly enhance working memory (WM = High), which in turn influences engagement (engagement = High) and ultimately leads to better academic performance (academicPerformance = Excellent). However, this pathway also intersects with other variables like parental involvement and socioeconomic status, creating a web of interdependencies that a two-layer model cannot fully address. To address complex interdependencies, we can use hierarchical abstractions to decompose the problem into multiple layers, each capturing specific relationships and interactions. This approach accommodates detailed representations that reflect the complex interdependencies among variables, such as those between home learning environment, parental involvement, and socioeconomic status. By maintaining probabilistic integrity across layers, this hierarchical model breaks down these complexities, providing interpretable insights that can guide educators and policymakers in addressing the nuanced factors impacting educational outcomes. 2.1 New Directions in Hierarchical Probabilistic Abstraction In exploring probabilistic abstraction, we encounter pivotal questions that challenge our understanding of hierarchical models. These largely unexplored questions require a structured methodology to articulate the foundational principles of hierarchical abstraction. Our approach—constructing complex abstraction layers from foundational taxonomy—serves as a starting point to address these inquiries, offering a systematic way to navigate and clarify the complexities of such models. Before delving into a detailed examination of hierarchical abstractions, it is essential to outline the key questions guiding our inquiry: 1. Defining Hierarchical Abstraction: What defines a hierarchical abstraction within probabilistic systems,