Identifying the Unique Geochemical Fingerprints of Omo Group Beds around Lake Turkana, Kenya by Modified Gaussian Discrimination Analysis Gerard T. Schuster and Shihang Feng Abstract A modified Gaussian Discriminant Analysis (GDA) is used with an optimal search strategy to identify the unique geochemical fingerprints of six different geological beds in the Lake Turkana area. Three-hundred samples were collected from six different beds in the Omo Group of Lake Turkana, where each sample consisted of the PPMs of 11 different chemical compound. The GDA analysis discovered a unique combination of three tuff compounds that can uniquely identify one of the five beds, where a 6th bed is excluded because only 7 samples were collected from it. These geochemical fingerprints are important because any Turkana hominin fossil in the Omo Group can now be efficiently identified by matching the geochemical fingerprint of a fossil’s host rock to the fingerprint of the bed in which it is found. In general, the GDA search strategy can be a powerful tool for efficiently identifying unique class fingerprints of high-dimensional data. \footer Manuscript \lefthead SchusterGathogo \righthead Geochemical Fingerprints 1 Introduction The Lake Turkana region in Kenya is a well-known site for many hominin fossils (Gathogo and Brown, 2006) that date back to about 4.3 million years ago (Myr). These fossils have provided crucial information for understanding the evolution of hominins during this period. Determining the age of these fossils is done by assigning their age to that of the bed they were embedded. The age of the formation can be determined through several methods, including isotopic dating and geochemical correlation of volcanic materials, which rely on the presence of volcanic ash or rocks in the formation. However, identifying the tuffs associated with a hominin discovery is not always easy, and geochemical analysis is required. Ideally, the geochemical signature of a tuff should be unique, allowing it to be distinguished from tuffs in the other formations. For the Turkana example, the ppms x_{i} of eleven different compounds, i.e. i\in\{1,2,...,11\} , in Figure 1 were measured by an electron microprobe for each tuff sample. A total of three hundred samples were obtained from six different beds, and the ppms for each sample is described by an 11\times 1 vector (x_{1},x_{2},...,x_{11}) in an eleven-dimensional space. It is hoped that the points from any one formation form a point cluster will be distinct from the other five point clusters. In this way, a new rock sample can be analyzed and uniquely matched to the formation and its associated age. Figure 1: Table of ppms for geochemical compounds in 5 samples of rocks from the Moi formation in Turkana. The top row of labels denotes the type of compound and the next five rows depict the ppm content in these samples. The coordinate labels for the compounds in the top row are, from left to right, x_{1},x_{2},...,x_{11} . There are a total of 300 samples from 6 different formations. Figure 2: Three-dimensional plots of 300 Turkana geochem points (x_{i},x_{j},x_{k}) , where each color corresponds to a different formation name abbreviated in a). There is too much overlap in the colored point clouds to assign a unique geochemical fingerprint of three compounds to all six beds. The units along axes are parts per million (ppm) and each coordinate x_{i} corresponds to one of the compounds in Figure 1 . Unfortunately, these point clusters most often overlap one another for different tuffs, as shown in Figure 2 for different 3D subspaces. For these examples, there is too much overlap of the point clouds to allow for a unique assignment of a sample to any one formation. Visually searching for non-overlapping point clouds in all triplet combinations of x_{i}-x_{j}-x_{k} for i,j,k\in\{1,2,...,11\} is too tedious. We propose using a modified Gaussian Discriminant Analysis (Bishop, 2006) to fit each point cloud to its Gaussian distribution. After fitting, we can then efficiently identify the triplet of coordinates where the Gaussians don’t overlap with one another within two standard deviations. If there are no such triplets, then the triplets of coordinates are sought where there are only two overlapping Gaussians. In this case, these two overlapping Gaussians for beds A and B in Figure 3 a are further tested by filtering out all points except for those in formations A and B to get Figure 3 b, Then, we find a unique combination of triplet coordinates (x_{i},x_{j},x_{k}) where the point clouds in beds A and B are non-overlapping. For example, a test point in the coordinate system (x_{1},x_{2},x_{3}) is found that belongs in the ellipsoids of both A and B, but not other ellipsoids. After muting out all the points except those in A and B, and then transforming the A and B points to the new coordinate system (x_{i},x_{j},x_{k}) indicates which formation the test point belongs to. This is similar to panning for gold, where screens with finer mesh sizes are sequentially used to sift out all but the finest gold nuggets. In our case, we are panning for the unique formation fingerprint of a sample. Figure 3: Schematic for determining the membership of a test point when it belongs to two overlapping ellipsoids. a) Black test point belongs to both the red and green ellipsoids in the coordinate system (x_{1},x_{2},x_{3}) . All points outside the red and green ellipsoids are eliminated to give b). c) A new coordinate system (x_{i},x_{j},x_{k}) is found where the A and B ellipsoids are separable, and the test point is now identified in c) as belonging to formation A. This paper is divided into 3 sections. The first one is the introduction, which is followed by a description of the traditional methods for signature identification such as Principal Component Analysis (PCA) for reducing the dimensionality of large-dimensional data sets. The next section describes how modified Gaussian Discriminant Analysis (GDA) can be used to uniquely identify the geochemical fingerprints of different formations. Results are presented for the geochemical data obtained from six different formations in the Lake Turkana area that are important sites of hominin fossils. Finally, the summary section is included. 2 Formation Fingerprint by Principal Component Analysis Identifying a subspace where the point clouds of different formations do not overlap one another can be very difficult. For example, plotting the 11-dimensional Turkana samples in a three-dimensional coordinate system (x_{i},x_{j},x_{k}) results in the point-cluster clouds in Figure 2 a. Here, there is significant overlap of point clouds with one another. Other combinations of 1\leq i,j,k\leq 11 shown in Figure 2 b- 2 d show a similar overlap of point clouds. For these examples, there is too much overlap of the point clouds to allow for a unique assignment of a sample to any one formation. We can visually inspect all * * * How many different random samples of size 3 can be obtained from a population whose size is 11? The answer (DeGroot, 1975) is known as the combinatoric \binom{N}{k}\penalty\ =\penalty\ \frac{N!}{k!(N-k)!} . \binom{N}{k}\penalty\ =\penalty\ \binom{11}{3}\penalty\ =\penalty\ 165 3D plots for different triplet combinations of (x_{i},x_{j},x_{k}) , but this is far too tedious to perform in practice. It’s even worse if, for example, there are 30 compounds so that there are \binom{30}{3}\penalty\ =\penalty\ 4060 3D graphs to inspect for separability of the point clouds. Can we reduce the dimensionality of such data so that the point clouds can be separable? Principal component analysis is one tool that can reduce the dimensionality of high-dimensional point clusters (Bishop, 2006) and perhaps achieve separability of the point clouds for each formation. 2.1 Principal Component Analysis Principal component analysis (PCA) is a statistical method used for dimensionality reduction in data analysis (Bishop, 2006). After demeaning the data, PCA transforms it into a new coordinate system where the first coordinate (principal component) accounts for the largest variance in the data, the second coordinate accounts for the second-largest variance, and so on. Thus, PCA method can be useful in reducing the number of variables needed to describe a dataset, while retaining the most important information. To apply PCA analysis, we demean the 300 11\times 1 data vectors and assemble them into the 300\times 11 data matrix denoted by \bf X . The covariance matrix \bf C is formed as {\bf C}={\bf X}^{T}{\bf X} , and its eigenvalues and eigenvectors are depicted in Figure 4 . In this way we might be able to achieve separability of the point clouds for each formation. Figure 4: a) 300 data points plotting formation class against sample number. Each data point is represented by an 11\times 1 vector {\bf x}=(x_{1},x_{2},...,x_{11}) , and each demeaned data vector forms a row in the 300\times 11 matrix \bf X . The eigenvalues and eigenvectors of the covariance matrix {\bf X}^{T}{\bf X} are respectively displayed in b) and c). The 300 data points projected onto the principal axes as \displaystyle{\bf{x}}^{\prime} \displaystyle= \displaystyle({\bf PC11}\cdot{\bf{x}},\penalty\ {\bf PC10}\cdot{\bf{x}},\penalty\ {\bf PC9}\cdot{\bf{x}}), (1) are shown in Figure 5 a, where there is more of a separation of the six classes of point clouds compared to the point clouds in Figure 2 . Here, the unit vectors along the PC axes are denoted as {\bf PC11} , {\bf PC10} , and {\bf PC9} . The largest eigenvalue is \lambda_{11} , the next largest is \lambda_{10} , and \lambda_{9} is the third largest, and are associated with the unit vectors along the PC axes. Similar to Figure 1 b, the eigenvalues become smaller by almost an order-of-magnitude with decreasing subscript number. We denote these PC axes as Total PC axes because they are formed from the 300 data vectors from all six formations. Figure 5: Demeaned data points projected onto the a) total Principal Component axes, b) KBS Principal Component axes, and c) Moiti (abbreviated as Moi) Principal Component axes. Using the GDA search strategy, the demeaned data plotted w/r to the x_{1}-x_{2}-x_{3} axes is in d), which is the best choice of axes where the point clouds are well separated from one another. Another approach is to form a covariance matrix from the 11\times 1 data vectors that are only sampled from a single formation, and project the data points from all the formations onto these first three principal component vectors. For example, the strongest PC vectors for the KBS formation are denoted as {\bf PC11}^{KBS},\penalty\ {\bf PC10}^{KBS}, and \penalty\ {\bf PC9}^{KBS} , and the 3D coordinates of any 11\times 1 data vector \bf x are obtained as \displaystyle{\bf x}^{\prime} \displaystyle= \displaystyle({\bf PC11}^{KBS}\cdot{\bf x},\penalty\ {\bf PC10}^{KBS}\cdot{\bf x},\penalty\ {\bf PC9}^{KBS}\cdot{\bf x}), (2) where \bf x^{\prime} represents the vector \bf x projected onto the {\bf PC11}^{KBS},{\bf PC10}^{KBS}, and {\bf PC9}^{KBS} axes. Figure 5 b depicts the results of projecting 300 data points onto the strongest three PC axes of the KBS formation, and shows less point-cloud separability compared to Figure 5 a. Similarly, Figure 5 c shows the data points projected onto the PC axes from the KBS data and show less cloud separability than that shown in Figure 5 a. The question now arises: is there a more effective way to explore a high-dimensional space for separable point clouds? The next section answers this question by using a systematic search method combined with Gaussian Discriminant Analysis (GDA). As an example, GDA analysis discovered the (x_{1},x_{2},x_{3}) coordinate system in Figure 5 d which maximizes the separation of different point clouds. 3 Formation Fingerprint by Modified Gaussian Discriminant Analysis Gaussian Discriminant Analysis fits a D -dimensional Gaussian distribution \displaystyle p({\bf{x}}|c,{\boldsymbol{\Sigma}}_{c},{\boldsymbol{\mu}}_{c}) \displaystyle= \displaystyle\frac{1}{\sqrt{(2\pi)^{D}|{\boldsymbol{\Sigma}}_{c}|}}e^{-\frac{1}{2}({\bf{x}}-{\boldsymbol{\mu}}_{c})^{T}{\boldsymbol{\Sigma}}_{c}^{-1}({\bf{x}}-{\boldsymbol{\mu}}_{c})}, (3) to clouds of data points {\bf{x}} that live in an D- dimensional space (Bishop, 2006). Here, {\boldsymbol{\Sigma}}_{c} is the 11\times 11 covariance matrix for the Turkana data associated with the class c , and {\boldsymbol{\mu}}_{c} is the 11\times 1 mean vector for the points in class c . For the Turkana example, c\in\{1,2,...,6\} . The 300 Turkana points can now be used to construct a Gaussian density distribution for each of the six formations. The Gaussian decision volume f({\bf{x}})_{c} is defined by saying that a point {\bf{x}} exclusively belongs to the class c if \displaystyle f({\bf{x}})_{c} \displaystyle= \displaystyle p(c|{\bf{x}})-\alpha\geq 0, (4) for each of the separable cluster classes c\in\{1,2,...,6\} . Here, \alpha>0 is very small, say \alpha=0.01 . This means that, for a point {\bf{x}} that belongs to class c , \alpha can be chosen so that more than 95% of the points in cluster c are within the decision volume defined by f({\bf{x}})_{c} . Thus, if a new untested data point {\bf{x}} satisfies the above decision equation then it belongs to the class c formation. This assumes that the 6 clusters don’t have overlapping Gaussian distributions. The workflow for GDA analysis of the Lake Turkana data is the following. 1. Choose a unique triplet of integer values (i,j,k)\in\{1,2,...,11\} and i\neq j\neq k , where each coordinate x_{i} is uniquely associated with one of the 11 chemical compounds listed in Figure 1 . This triplet of integers defines the 3D coordinate axes for (x_{i},x_{j},x_{k}) . 2. Compute the 1\times 3 mean vector {\boldsymbol{\mu}}_{c} and 3\times 3 covariance matrix {\boldsymbol{\Sigma}}_{c} of each formation class c\in\{1,2,...,6\} in the (x_{i},x_{j},x_{k}) coordinates. These quantities are then used in equation 3 to compute the generative conditional probability function p({\bf{x}}|c,{\boldsymbol{\Sigma}}_{c},{\boldsymbol{\mu}}_{c}) . We will denote this conditional function as p({\bf{x}}|c) . 3. Compute the discriminative probability function p(c|{\bf{x}}) by Bayes’ Rule (Bishop, 2006): \displaystyle p(c|{\bf{x}}) \displaystyle= \displaystyle\frac{p({\bf{x}}|c)p(c)}{p({\bf{x}})}, (5) where, for convenience, we assume p(c)=1/6\penalty\ \penalty\ for\penalty\ c\in\{1,2,...,6\} , and p({\bf{x}}|c) is computed from equation 3 . This allows us to compute p({\bf{x}})=\sum_{c=1}^{6}p({\bf{x}}|c)p(c) . 4. Identify the triplets of coordinates (x_{i},x_{j},x_{k}) where the point clusters are separable where there is no pair-wise intersection of the six decision volumes, i.e. \displaystyle f({\bf{x}})_{c^{\prime}}{\displaystyle\cap}f({\bf{x}})_{c}=0\penalty\ \penalty\ \penalty\ \forall{\bf{x}}\penalty\ \penalty\ ,\penalty\ \penalty\ \forall\penalty\ c,c^{\prime}\in\{1,2,...,6\}\penalty\ and\penalty\ c\neq c^{\prime}. (6) If the above cluster-separation condition is satisfied then (i,j,k) is a triplet of indices where the associated Gaussian ellipsoids for the rock formations do not overlap. 5. Repeat steps 1-4 until all possible triplet indices are tested. If there are no triplets of indices where all the ellipsoids are separable, then the indices can be searched where there are only two overlapping ellipsoids. In this case the sieve scheme outlined in Figure 1 can be implemented. This can be extended to indices where only three clusters overlap. A snippet from the MATLAB code for identifying ellipsoids without overlap is below. %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% % Sieve extracts the coordinate combinations of (ie1,ie2,ie3,ir) where all samples xx=xxx{ir} % in formation ir are outside of Test ellipse. The ppms of the Test samples are denoted % by the coordinates Test0=[Test(:,ie1) Test(:,ie2) Test(:,ie3)]. % % lim - input- threshold probability where a comparison sample is considered outside Test % ellipsoid if p