Graph Neural Network based Hierarchy-Aware Embeddings of Knowledge Graphs: Applications to Yeast Phenotype Prediction 2 2 2 This is an extended version of the paper “Ontology-based box embeddings and knowledge graphs for predicting phenotypic traits in Saccharomyces cerevisiae ” ( Kronström et al. 2025 ) , presented at NeSy 2025.
Filip Kronström, Alexander H. Gower, Daniel Brunnsåker, Ievgeniia A. Tiukova, Ross D. King · 2026
Read Graph Neural Network based Hierarchy-Aware Embeddings of Knowledge Graphs: Applications to Yeast Phenotype Prediction 2 2 2 This is an extended version of the paper “Ontology-based box embeddings and knowledge graphs for predicting phenotypic traits in Saccharomyces cerevisiae ” ( Kronström et al. 2025 ) , presented at NeSy 2025. by Filip Kronström, Alexander H. Gower, Daniel Brunnsåker, Ievgeniia A. Tiukova, Ross D. King (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03690.txt.
Introduction
Filip Kronström and four co-authors build hierarchy-aware embeddings of knowledge graphs using graph neural networks enriched with meaning from ontologies. Knowledge graphs store facts as linked triples, but flat embeddings can ignore the class hierarchies that organize a domain. Their test application is predicting what gene deletions do to yeast.
Working with the yeast Saccharomyces cerevisiae, they combine low-dimensional box embeddings with graph networks to predict cell growth for double gene knockouts. Cross-validated predictions beat baselines, and adding a semantic loss that aligns embeddings with ontology structure lifted accuracy further. The box embeddings also serve to judge revisions of a knowledge graph when no task of that kind is present.
Catalog record
| CREATOR | Filip Kronström, Alexander H. Gower, Daniel Brunnsåker, Ievgeniia A. Tiukova, Ross D. King |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph Neural Network based Hierarchy-Aware Embeddings of Knowledge Graphs: Applications to Yeast Phenotype Prediction 2 2 2 This is an extended version of the paper “Ontology-based box embeddings and knowledge graphs for predicting phenotypic traits in Saccharomyces cerevisiae ” ( Kronström et al. 2025 ) , presented at NeSy 2025. Filip Kronström, Alexander H. Gower, Daniel Brunnsåker, Ievgeniia A. Tiukova, Ross D. King Abstract We present a method for finding hierarchy-aware embeddings of knowledge graphs (KGs) using graph neural networks (GNNs) enriched with a semantic loss derived from underlying ontologies. This method yields embeddings that better reflect domain knowledge. To demonstrate their utility, we predict and interpret the effects of gene deletions in the yeast Saccharomyces cerevisiae and learn box embeddings for KGs in the absence of a prediction task. We further show how box embeddings can serve as the basis for evaluating KG revisions. Our yeast KG is constructed from community databases and ontology terms. Low-dimensional box embeddings combined with GNNs are used to predict cell growth for double gene knockouts. Over 10-fold cross validation, these predictions have a mean R 2 R^{2} score of 0.360, significantly higher than baseline comparisons, demonstrating that high-level qualitative knowledge is informative about experimental outcomes. Incorporating semantic loss terms in the training of the models improves their predictive performance ( R 2 R^{2} =0.377) by aligning embeddings with ontology structure. This shows that class hierarchies from ontologies can be exploited for quantitative prediction. We also test the trained models on triple gene knockouts, showing they generalise to data beyond those seen in training. Additionally, by identifying co-occurring relations in the yeast KG important for the cell-growth predictions, we construct hypotheses about interacting traits in yeast. A biological experiment validates one such finding, revealing an association between inositol utilisation and osmotic stress resistance, highlighting the model’s potential to guide biological discovery. 1 Introduction Knowledge graphs (KGs) are widely used to represent structured knowledge as sets of triples of the form ( subject, predicate, object ). In many domains, including the life sciences, KGs are enriched with ontological information, where formally defined vocabularies describe classes of entities and relations between them. In particular, hierarchical 1 1 1 Section 5.1 provides a detailed definition of what is meant by the terms hierarchy and hierarchical in this work. class information expressed through the ‘ subClassOf ’ relation is prevalent, as domain experts can organise concepts, without requiring formal expertise in logic or ontology engineering. As a result, such hierarchies constitute a pragmatic and high-impact source of background knowledge for representation learning. Representation learning enables the transformation of KGs into a form that works as an input to a program class that does not accept the KG itself as an input. A form of representation learning that has proven useful for downstream tasks, such as link prediction and property prediction, is embedding KGs into an n -dimensional vector space. Many KG embedding (KGE) methods are trained primarily on observed triples, using the relational structure of the graph as the main learning signal. However, when ontological knowledge is present, an embedding should ideally reflect not only the connectivity of the graph but also background semantic constraints. Rewarding compatibility between learned representations and known domain structure can provide additional inductive bias during training, improve generalisation beyond observed data, and support more interpretable predictions ( Gutiérrez-Basulto and Schockaert 2018 ) . Incorporating semantic constraints into continuous representations raises the question of how ontological concepts should be represented geometrically. Hierarchical relations impose inclusion constraints, which can be captured using point embeddings in non-Euclidean spaces, such as hyperbolic embeddings ( Nickel and Kiela 2017 ) . However, when the goal is to explicitly encode class inclusion and concept-level constraints, volumetric representations provide a natural alternative. In this paradigm, concepts are modelled as subsets of a latent space using geometric objects, such as hyperspheres ( Kulmanov et al. 2019 ) , hypercones ( Ganea et al. 2018 ) , or hyperrectangles (boxes) ( Vilnis et al. 2018 ; Peng et al. 2022 ; Xiong et al. 2022 ; Jackermeier et al. 2024 ; Yang et al. 2025 ) , enabling hierarchical relations to be expressed directly through geometric containment. While volumetric representations are well suited for capturing ontological structure, it is challenging to integrate them with complex heterogeneous graphs, and to train them end-to-end for task-specific prediction. Many real-world KGs are large, heterogeneous, and feature-rich. This motivates the use of graph neural networks (GNNs) as a framework for representation learning through aggregation of information from local neighbourhoods and node attributes ( Kipf and Welling 2017 ; Hamilton et al. 2017 ) . GNN-based approaches have been successfully applied to KGs and relational data for tasks such as node classification, link prediction, and property prediction ( Schlichtkrull et al. 2018 ; Ye et al. 2022 ) . However, standard GNN architectures do not explicitly enforce global semantic constraints derived from ontologies, and may therefore learn representations that violate known hierarchical relationships, even when such information is available as background knowledge. This motivates approaches that combine data-driven representation learning with explicit semantic constraints derived from ontologies. We also hypothesise that, particularly in settings with low-dimensional or scarce data, that the inductive bias introduced by using ontology constraints during representation learning will improve performance on downstream prediction tasks. In this paper, we address this limitation by combining GNN-based KG embeddings with box-based representations of ontological concepts by introducing Hierarchy-aware GNNs. Our methodological contribution is a framework in which box embeddings are used to encode hierarchical background knowledge, while GNNs are used to learn features from the graph structure. We evaluate this approach in the context of biological knowledge about the yeast Saccharomyces cerevisiae . Yeast is among the most extensively studied model organisms and plays a central role in both basic research and industrial applications ( Parapouli et al. 2020 ) . Decades of experimental work have produced large amounts of structured data, available through curated databases such as the Saccharomyces Genome Database ( Engel et al. 2024 ) . These resources integrate experimental observations with ontological annotations describing biological processes, phenotypes, chemical compounds, and interactions. Despite the depth of scientific research on yeast, our understanding of its biology remains incomplete: many genes are poorly annotated, and current models fail to predict many phenotypic outcomes of complex genetic interactions ( Wood et al. 2019 ; Costanzo et al. 2019 ) . Experimental investigation is therefore essential for advancing biological knowledge. However, biological experimentation is costly, and the space of possible experiments is vast. As a result, computational methods that support hypothesis generation at scale are of high value ( King et al. 2004 ; Brunnsåker et al. 2025 ) . We construct an ontology-enriched KG describing yeast biology and apply our embedding framework to predict gene fitness and to generate hypotheses about interactive properties. This application serves both as a realistic use case and as an empirical evaluation of whether incorporating hierarchical semantic constraints into KG embeddings improves predictive performance and supports biologically meaningful knowledge discovery. The remainder of the paper is structured as follows. Section 2 presents related work relevant for this paper. Sections 3 and 4 introduce background, and define terms and losses used throughout