Semialgebraic Conditions for Identifying Triangles in Phylogenetic Networks
Bryan Currie, Aviva K. Englander, Jose A. Esparza-Lozano, Elizabeth Gross, Max Hill, Colby Long, Devon Olds, Kawika O’Connor, Udani Ranasinghe, Christin Sum · 2026
Read Semialgebraic Conditions for Identifying Triangles in Phylogenetic Networks by Bryan Currie, Aviva K. Englander, Jose A. Esparza-Lozano, Elizabeth Gross, Max Hill, Colby Long, Devon Olds, Kawika O’Connor, Udani Ranasinghe, Christin Sum (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26673.txt.
Introduction
Bryan Currie and nine colleagues ask whether the wiring of evolutionary networks can be recovered from genetic data. A phylogenetic network models species history with hybridisation, so lineages merge as well as split. Triangles inside such networks are notoriously hard to orient. Earlier work showed standard algebraic tools cannot fix triangle directions under some models.
The authors study three small networks with three leaves and embedded triangles. Their model uses the Jukes-Cantor rule for DNA change and no merging of lineages within populations. They give a complete semialgebraic description of each model, inequalities as well as equations. For any pair of models, the shared and differing regions are full-dimensional. The models are therefore genuinely different, yet neither is identifiable from data, even generically. The signal distinguishing them is too weak to orient the triangles.
Catalog record
| CREATOR | Bryan Currie, Aviva K. Englander, Jose A. Esparza-Lozano, Elizabeth Gross, Max Hill, Colby Long, Devon Olds, Kawika O’Connor, Udani Ranasinghe, Christin Sum |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26673
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semialgebraic Conditions for Identifying Triangles in Phylogenetic Networks Bryan Currie, Aviva K. Englander, Jose A. Esparza-Lozano, Elizabeth Gross, Max Hill, Colby Long, Devon Olds, Kawika O’Connor, Udani Ranasinghe, Christin Sum Abstract . An important consideration for a model-based method of phylogenetic network inference is the identifiability of the network parameter of the model. A recurring theme in previous works exploring this issue is that it is often difficult to identify the orientation of edges in a triangle of the network. In fact, it has been shown that for some models it is impossible to determine the orientation of triangle edges utilizing the standard algebraic technique of phylogenetic invariants. In this work, we consider one such model with a Jukes-Cantor site-substitution process and no coalescence. We give a complete semialgebraic description of three, 3-leaf Jukes-Cantor phylogenetic network models with embedded triangles. By describing these base cases, we resolve several questions about the identifiability of networks with embedded triangles. We show that for any pair of models, the intersection and set differences of the models are full-dimensional regions of the space of site-pattern probability distributions. Thus, despite being algebraically indistinguishable, these network models are not identical, nor are they identifiable (or generically identifiable). Our results also yield a straightforward biological interpretation–that the signal from a hybridization event may be immediately detectable but decays over time until it is impossible to identify the orientation of edges in the triangle of a network. 1. Introduction A phylogenetic network model represents non-tree-like evolution along a directed acyclic graph. In such a model, network nodes of in-degree two correspond to reticulation events, such as hybridization or lateral gene transfer, where a certain proportion of the information at the node is assumed to have been inherited along each of the incoming edges. Recognizing that reticulation events are likely common in the evolutionary history of many species, there has been increasing interest in the theory of phylogenetic network models of DNA sequence evolution and their application to phylogenetic inference ( Barley et al. 2022 ; Cui et al. 2013 ; Gambette et al. 2017 ; Hibbins and Hahn 2022 ; Mallet et al. 2016 ; Pardi and Scornavacca 2015 ; Rose et al. 2025 ; Solís-Lemus and Ané 2016 ; van der Heijden et al. 2025 ; Zhang et al. 2018 ) . One important consideration for developing model-based methods of phylogenetic inference is the identifiability of the model parameters. In general, a model parameter is identifiable if it can be uniquely recovered from some output of the model. In the ideal case for phylogenetic inference, the observed data will perfectly fit a phylogenetic model and the corresponding model parameters are inferred. However, for this inference to be consistent, there must be a unique set of parameters corresponding to the data, that is, the parameters must be identifiable. As we consider the specific setting of networks, the same holds: to develop a consistent model-based method of network inference, the network parameter of the model must be identifiable. Several works have studied identifiability in phylogenetic network models with and without a coalescent process ( Allman et al. 2025 ; Allman et al. 2024 ; Allman et al. 2022 ; Baños 2019 ; Englander et al. 2025 ; Gross and Long 2018 ; Gross et al. 2021 ; Holtgrefe et al. 2025 ; Rhodes et al. 2025 ; Xu and Ané 2023 ) . One recurring theme in these works is that while many network features are identifiable from data, it is often not possible to identify network triangles or to determine the orientation of edges in a triangle of the network. For example, the results of Gross and Long 2018 establish only the identifiability of triangle-free networks, and the standard methods of algebraic statistics employed therein are unable to distinguish networks such as those shown in Figure 1 . Likewise, Barton et al. 2026 ; Englander et al. 2025 ; Gross et al. 2021 and Holtgrefe et al. 2025 also consider only triangle-free networks due to the inadequacy of algebraic methods for distinguishing triangles. It is thought that hybridization is negatively correlated with genetic distance between species ( Mallet 2005 ) . Since reticulation is expected to be most common among closely related species, triangles are likely an important part of the evolutionary history of many sets of taxa, making the gap in the current results especially unfortunate. One notable exception to this trend are the results of Allman et al. 2024 , who showed that under the network multispecies coalescent model, 3-cycles can sometimes be detected from gene tree quartet concordance factors. The results of Englander et al. 2025 ; Gross and Long 2018 and Gross et al. 2021 apply to DNA sequence models without a coalescent process. Here, each choice of parameters produces a probability distribution on the possible DNA site-patterns that may be observed in the aligned DNA sequences of the species under consideration. The algebraic approach used to prove the identifiability of the network parameter is based on finding phylogenetic invariants for each network. These are polynomial relationships that are always satisfied by the site-pattern probability distributions coming from a model on the network. The key idea is to show that every pair of networks is algebraically distinguishable , that is, there is a polynomial invariant for each that is not an invariant for the other. Thus, given a site-pattern probability distribution from a network model, one can evaluate the invariants at the distribution to determine the network parameter that produced the data. This is a standard technique in algebraic statistics and phylogenetic invariants have been used to establish many identifiability results ( Sullivant 2023 , Chapter 15, p.335-370) . Often, the approach is to first find phylogenetic invariants for trees or networks with just a few taxa using computational tools, and then, to use combinatorial arguments and restrictions to subsets of taxa to show that trees or networks with an arbitrary number of leaves are distinguishable. As noted above, despite the power of the algebraic approach, for certain models these methods are simply insufficient to establish the identifiability of networks with embedded triangles. For example, under the Jukes-Cantor model, there are no phylogenetic invariants for the three networks shown in Figure 1 and so they are not algebraically distinguishable. Figure 1. The three 3-leaf level-one triangle networks, each rooted on one of the non-hybrid leaf edges. For those familiar with considering phylogenetic models from an algebraic statistics perspective, the fact that there are no invariants for these networks means that each of the models is a full-dimensional subset of the probability simplex and its Zariski closure fills the entire space. However, although their Zariski closures are equal, the example below gives some intuition for why we may not expect the models themselves to be equal. Example 1.1 . Consider the site-pattern probability distribution generated by the Jukes-Cantor model on \mathcal{N}_{1} , the rooted 3-leaf network from Figure 1 . Figure 2 (left) shows this network with branch lengths given in expected number of mutations per site. The dotted reticulation edges are length \epsilon>0 and represent a near instantaneous hybridization event. For this example, we assume half of the genetic information is inherited along each