Discordance of species trees with their most likely gene trees.

Degnan JH, Rosenberg NA. · 2006

Read Discordance of species trees with their most likely gene trees. by Degnan JH, Rosenberg NA. (2006) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc1464820.txt.

Introduction

A gene tree and a species tree can tell different stories. Degnan and Rosenberg explored that clash in 2006. As species split, gene copies sort by chance, so a gene's history may not match the species path. They used a chance-based model of that sorting.

Their proof holds for any species tree with five or more species. For some branch lengths, the most likely gene tree differs from the species tree itself. Degnan warns that picking the most common gene tree can thus give a wrong answer with growing data. The pair close with ways to dodge this trap in genome studies.

Catalog record

CREATORDegnan JH, Rosenberg NA.
YEAR2006
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC1464820

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Discordance of Species Trees with Their Most Likely Gene Trees By James H Degnan, Noah A Rosenberg, John Wakeley Published in: PLoS Genetics DOI: 10.1371/journal.pgen.0020068 ABSTRACT Abstract Because of the stochastic way in which lineages sort during speciation, gene trees may differ in topology from each other and from species trees. Surprisingly, assuming that genetic lineages follow a coalescent model of within-species evolution, we find that for any species tree topology with five or more species, there exist branch lengths for which gene tree discordance is so common that the most likely gene tree topology to evolve along the branches of a species tree differs from the species phylogeny. This counterintuitive result implies that in combining data on multiple loci, the straightforward procedure of using the most frequently observed gene tree topology as an estimate of the species tree topology can be asymptotically guaranteed to produce an incorrect estimate. We conclude with suggestions that can aid in overcoming this new obstacle to accurate genomic inference of species phylogenies. INTRODUCTION In typical phylogenetic studies of individual genes, the estimated gene tree topology is used as the estimate of the species tree topology. When many loci are studied, the species tree topology is often estimated using the most frequently inferred gene tree topology [1–5]. Although it is well-known that the sorting of gene lineages at speciation can cause gene trees to differ in topology from species trees [6–9], the assumption that the most probable gene tree topology to be produced by this sorting is the same as the species tree topology—the implicit premise that makes it sensible to estimate a species tree using a single gene tree or the most common among several gene trees—has remained unquestioned. Here, under a population-genetic model for the evolution of gene lineages, we show that discordance can occur between the species tree and the most likely gene tree. Consequently, use of the most commonly observed gene tree topology to estimate the species tree topology—the “democratic vote” procedure among gene trees [10]—can be “positively misleading,” that is [11], convergent upon an erroneous estimate as the number of genes increases. RESULTS We refer to gene trees that are more likely than the tree that matches the species tree as anomalous gene trees (AGTs). To characterize the conditions under which AGTs exist, consider a rooted binary species tree σ with topology ψ and with a vector of positive branch lengths λ, where λi denotes the length of branch i. Following previous studies of gene trees and species trees [6,7,12–15], we use the coalescent process from population genetics [16,17] to model gene evolution in genetically variable populations along branches of a species tree. We consider gene trees that are known exactly, assuming that mutations have not obscured the underlying relationships among gene lineages. For n species, and one gene lineage sampled per species, there are n − 2 internal branches of the species tree that affect gene tree probabilities under the coalescent. Branch lengths are measured in coalescent time units, which can be converted to units of generations under any of several choices for models of evolution within species [16–18]. In the simplest model for diploids, each species has constant population size N/2 individuals, and λi coalescent units equal λiN generations. We can view gene lineages as moving backward in time, eventually coalescing down to one lineage. In each interval, lineages entering the interval from a more recent time period have the opportunity to coalesce, with coalescence equiprobable for each pair of lineages—as specified by the Yule model [19–22]—and the coalescence rate following the coalescent process [16,17]. For the fixed species tree σ, the gene tree topology G is viewed as a random variable whose distribution depends on σ. Under the model, this distribution is known for arbitrary rooted binary species trees [15]. Using Pσ(G = g) to denote the probability that a random gene tree has topology g when the species tree is σ, we define anomalous gene trees as follows. Definition 1 (i) A gene tree topology g is anomalous for a species tree σ = (ψ, λ) if Pσ(G = g) > Pσ(G = ψ). (ii) A topology ψ produces anomalies if there exists a vector of branch lengths λ such that the species tree σ = (ψ, λ) has at least one anomalous gene tree. (iii) The anomaly zone for a topology ψ is the set of vectors of branch lengths λ for which σ = (ψ, λ) has at least one anomalous gene tree. In other words, a gene tree topology g is anomalous for a species tree σ if a gene evolving along the branches of σ is more likely to have the topology g than it is to have the same topology as the species tree. AGTs do not exist for species trees with three taxa—the smallest number in a nontrivial, rooted, binary phylogeny. Denoting the length of the one internal branch in a three-taxon tree by λ, the probability is 1 − (2/3)e−λ that a gene tree has the same topology as the species tree [6,12,13]. This value always exceeds the probability that the gene tree topology matches one of the other two topologies, or (1/3)e−λ. What about four taxa? If the species tree has sufficiently short branches, all coalescences of gene lineages may happen more anciently than its root. When coalescences are “deep,” the fact that random joining of lineages has a higher probability of producing some topologies than others [19,20,22] makes it likely that a gene tree has one of the high-probability topologies, regardless of the shape of the species tree. For four taxa, symmetric topologies each have probability 1/9, whereas asymmetric topologies each have probability 1/18 [6,19,20]. Thus, if the species tree is asymmetric with short branch lengths, symmetric gene tree topologies are more likely to be produced than are asymmetric topologies (Figure 1). [Figure: Anomalous Gene Trees for Four TaxaColored lines represent gene lineages that trace back to a common ancestor along the branches of a species tree with topology (((AB)C)D). The figure illustrates how a gene tree can have a higher probability of having a symmetric topology, in this case ((AD)(BC)), than of having the topology that matches the species tree. If the internal branches of the species tree—x and y—are short so that coalescences occur deep in the tree, the two sequences of coalescences that produce a given symmetric gene tree topology together have higher probability than the single sequence that produces the topology that matches the species tree.(a) and (b) Two coalescence sequences leading to gene tree topology ((AD)(BC)). In (a), the lineages from B and C coalesce more recently than those from A and D, and in (b), the reverse is true.(c) The single sequence of coalescences leading to gene tree topology (((AB)C)D).] The set of branch lengths that lie in the four-taxon anomaly zone can be computed from the complete enumeration of probabilities for combinations of four-taxon gene trees and species trees [14,15]. For AGTs to occur with four taxa, the species tree must be asymmetric and the gene tree must be symmetric. To see that AGTs cannot occur with a symmetric four-taxon species tree, note that in Table 4 of Rosenberg [14],

Read the complete text