The Marginal Likelihood of two-way tables and Ecological Inference Antonio Forcina Abstract The paper derives new results on the marginal likelihood of a two-way table which clarify the conditions under which Ecological inference is possible and lead to an efficient algorithm for maximizing the exact multinomial likelihood. The first part generalizes the work of Plackett (1977) on the marginal likelihood of a 2 × 2 2\times 2 table to a general R × C R\times C table. In doing so, new conceptual tools are introduced and new insights on the geometry of the collection of tables having fixed row and column margins and the extended hypergeometric distribution are derived. In the second part, when observations on the row and the column marginal distributions are available for a collection of two-way tables sharing the same association structure, an efficient Fisher scoring algorithm for maximizing the exact likelihood under multinomial sampling is introduced and a small simulation study is used to compare the performance of the proposed method with two well established ones. ∎ The issue of whether it is possible to draw inference on the association structure of a two-way contingency table having observed only the row and column margins is relevant, for instance, in the context of ecological inference ( Brown and Payne, 1986 ; Greiner and Quinn, 2009 ; Cheema et al., 2024 , see, for instance, ) , a methodology which may be used to infer the distribution of voter decisions in a new election conditionally on the decisions taken by the same voters in an earlier election. Knowledge of such conditional distributions allow to estimate, for instance, the proportion of faithful voters of a given party or that of those who moved to a protest party or to abstention, see Forcina and Pavía (2025) . Though, due to the secrecy of the ballots, the joint distribution of voters’ decisions in two close in time elections cannot be observed, in many countries, the marginal distributions of voters recorded in each election, at each polling station, are available from official sources. Usually, voting options available in the earlier election are arranged by row and those in the second election by column and the objective of inference are the conditional probabilities by row, that is the probability of voting option j in the new election having voted option i in the previous one. Ecological inference is usually applied to data from a collection of local units, like polling stations, under the assumption that they share the same association structure. However, for instance, the information theoretic approach of Judge et al. (2004) for general two-way tables, can be applied to estimate the conditional distributions from the row and column totals of a single table and the question is whether the resulting inferences are meaningful. Plackett (1977) studied the log-likelihood of a single 2\times 2 table when only the margins can be observed and noted that statements derived from likelihood based inference were ”inconclusive”. In the first part of the paper we study the marginal likelihood for a single R\times C contingency table and show that the likelihood has a collection of local maxima achieved, in the limit, as the log-odds ratios which are not 0 diverge towards the boundary of the parameter space. It turns out that the collection of probability distributions approaching a local maximum have an association structure such that, after suitable permutations of the row and the column categories, the log-odds ratios which are not equal to 0 tend to +\infty . In other words, there exists a permutation of the row and column categories such that the table achieving a specific local maximum is the table with the strongest possible positive association within the Fréchet class of bivariate distributions having the given pair of margins. In the concluding section of the paper we argue that this is an instance where maximum likelihood estimates are inconsistent. Having established that it is essentially impossible to infer the conditional row distributions from the row and column totals of a single two-way table, in the second part of the paper we study the marginal likelihood for a collection of two-way tables assumed to share the same set of row conditional probabilities. An efficient Fisher scoring algorithm which maximizes the exact multinomial marginal likelihood is introduced and a small simulation study is is used to show that the resulting estimates are close to the assumed true generating mechanism and perform better than two well established method of Ecological Inference. Maximizing the exact multinomial likelihood has to face numerical complexities due to the need to construct, within each local unit, the collection of all possible tables compatible with the observed row and column totals; the size of these collections grow quickly with the number of observations and the number of row and column categories. However, once these collections have been constructed and stored, computation of the marginal likelihood and the conditional expectations according to the extended hypergeometric distribution are straightforward. In section 2 we describe a parametrization of the conditional row distributions in the multinomial context, write the likelihood function and its derivatives, characterize the collection of distributions achieving local maxima, describe their properties and show that they satisfy the likelihood equations in the limit as certain log-odds ratios diverge. The extension to a collection of two-way tables sharing the same set of row conditional distributions is studied in section 3 where we derive the likelihood equations, determine a necessary condition for the information matrix to be non singular, propose a Fisher scoring algorithm for maximum likelihood estimation and present a small simulation study to compare the new method with two existing ones. Some general issues are discussed in section 4. 1 The marginal likelihood of a single table 1.1 Notations and preliminary settings Consider an R\times C contingency table based on categorical variables, let n_{ij} ( i=1,\dots,R , j=1\dots,C ) denote the joint frequencies, and assume that the marginal frequencies, n_{i0},\>n_{0j} , are strictly positive. Let p_{ij} denote the joint probabilities, p_{i0} = \sum_{j}p_{ij} and p_{j\mid i} = p_{ij}/p_{i0} denote the conditional row probabilities. Conditional probabilities may be parameterized with logits and log-odds ration defined with reference to the initial category; more precisely, let \phi_{j} = \log[(p_{1j}/p_{11})] , \lambda_{ij} = \log[p_{11}p_{ij}] - \log[(p_{i1}p_{1j})] and note that \phi_{1}=0 and \lambda_{ij}=0 whenever i=1 and/or j=1 ; then p_{j\mid i}=\exp\left(\phi_{j}+\lambda_{ij}\right)/\sum_{j=1}^{C}\exp\left(\phi_{j}+\lambda_{ij}\right). Let \bm{N} denote a table of joint frequencies and {\cal N} the collection of all such tables compatible with the given row and column totals. The log likelihood may be computed by first summing across rows and columns and then across all possible configurations \bm{N}\in\mbox{${\cal N}$} . Let \gamma(\bm{N}) = -\sum_{i}\sum_{j}\log[\Gamma(n_{ij}+1)] , \bm{\Lambda} be the matrix with elements \lambda_{ij} and V(\bm{N},\bm{\Lambda}) = \sum_{i}\sum_{j}n_{ij}\lambda_{ij} ; after rearranging terms, we obtain L=\sum_{j=1}^{C}n_{0j}\phi_{j}+\log\sum_{\bm{N}\in\mbox{${\cal N}$}}\exp\left(V(\bm{N},\bm{\Lambda})+\gamma(\bm{N})\right)-\sum_{i=1}^{R}n_{i0}\log\sum_{j=1}^{C}\exp\left(\phi_{j}+\lambda_{ij}\right) 1.2 Solutions of the likelihood equations Let M_{ij} denote the conditional expectation of n_{ij} given the row and column totals, it may be computed as M_{ij}=\sum_{\bm{N}\in\mbox{${\cal N}$}}n_{ij}\frac{\exp\left(V(\bm{N},\bm{\Lambda})+\gamma(\bm{N})\right)}{\sum_{\bm{N}\in\mbox{${\cal N}$}}\exp\left(V(\bm{N},\bm{\Lambda})+\gamma(\bm{N})\right)} (1) By direct calculations, the likelihood equations may be written as \displaystyle n_{0j} \displaystyle=\sum_{i=1}^{R}n_{i0}p_{j\mid i}, (2) \displaystyle M_{ij} \displaystyle=n_{i0}p_{j\mid i},\>\forall\>(i>1,\>j>1). (3) Intuitively, as possible candidate solutions, one might consider the probability distributions {\cal P} defined as follows: for each \bm{N}\in\mbox{${\cal N}$} use the unconstrained estimates \hat{p}_{j\mid i}=n_{ij}/n_{i0} . It can be easily verified that these conditional probabilities satisfy likelihood equations ( 2 ). Inspection of likelihood equations ( 3 ) indicates that a \bm{P}\in\mbox{${\cal P}$} is a solution, if and only if M_{ij}=n_{ij} for all i>1 , j>1 . In the next section we show that, though no element of {\cal N} can satisfy ( 3 ), there exists a sub-collection, say \mbox{${\cal Z}$}\subset\mbox{${\cal N}$} , with the following property: for each \bm{Z}\in\mbox{${\cal Z}$} we may construct a sequence of probability distributions P(\bm{Z},\epsilon) , \epsilon>0 , which satisfy ( 3 ) in the limit as \epsilon\rightarrow 0 . 1.3 Extreme tables Below we give a formal definition of the elements of {\cal Z} by an algorithm for their construction, describe some of their properties and, for each extreme table, define a collection of row conditional probability distributions P(\bm{Z},\epsilon) and show that, as \epsilon\rightarrow 0 , they satisfy likelihood equations ( 3 ). In short, an extreme table is the upper bound of the Fréchet class of distributions after applying a pair of permutations, say \bm{\pi}_{r},\>\bm{\pi}_{c} to the row and column categories, see Fréchet (1960) , equation (8) on p. 11 and Cifarelli and Regazzini (2017) for a short history of the subject and some properties of the joint distributions derived from extreme tables. An informal algorithm for their construction is described by Salvemini (1939) , a disciple of C. Gini who apparently was aware of these tables before the work of Fréchet. 1.3.1 Definition and construction Let \bm{m}_{r} , \bm{m}_{c} denote, respectively, the vectors with elements n_{i0} and n_{0j} ; Definition 1 Given a pair of marginal distributions \bm{m}_{r},\>\bm{m}_{c} , we call extreme a frequency table with entries z_{ij} obtained by the following procedure: (i) select a pair of permutations one for the row categories and one for the column categories, (ii) apply Algorithm 1 below. Algorithm 1 Construction of an extreme frequency table . Let \bm{\pi}_{r},\bm{\pi}_{c} be two arbitrary permutations of the row and the column categories respectively, let the vector \bm{t}_{r}=\bm{m}_{r}(\bm{\pi}_{r}) with elements t_{i0} and \bm{t}_{c}=\bm{m}_{c}(\bm{\pi}_{c}) with element t_{0j} : the algorithm may start either from cell (1,1) or (R,C) ; the version starting from (1,1) is described below. The algorithm is a sequence of moves where each step determines the next cell to be processed: • Start by setting i=1,\>j=1 ; • Once in cell (i,j): 1. If t_{i0}-\sum_{h=1}^{j-1}t_{ih}j and go to cell (i+1,j); 2. If t_{i0}-\sum_{h=1}^{j-1}t_{ih}>t_{0j}-\sum_{h=1}^{i-1}t_{hj} , set z_{ij}=t_{0j}-\sum_{h=1}^{i-1}t_{hj} , z_{hj}=0 \forall h>i , go to cell (i,j+1); 3. if t_{i0}-\sum_{h=1}^{j-1}t_{ih}=t_{0j}-\sum_{h=1}^{i-1}t_{hj} , set z_{ij}=t_{i0}-\sum_{h=1}^{j-1}t_{ih} , z_{ik}=0 \forall k>j and z_{hj}=0 \forall h>i , move to cell i+1,j+1 ; • Go back to (1) and continue until cell (R,C) has been processed. Lemma 1 The table \bm{Z} produced by Algorithm 1 satisfies the right-hand side constraints in Fréchet (1960) , equation (8). Proof When t_{i0}-\sum_{h=1}^{j-1}t_{ih} and t_{0j}-\sum_{h=1}^{i-1}t_{hj} are both greater than 0, z_{ij} is set equal to the the smallest of these two expressions; z_{ij} is set to 0 otherwise- Example 1 Suppose that the vectors of row and column totals are equal, respectively, to (44, 37, 57, 62) and (57, 58, 42, 43), the three instances of extreme tables displayed in Table 1 are obtained by the following pairs of permutations: (3 4 1 2), (2 1 3 4); (1 3 2 4), (2 4 1 3); (3 2 1 4), (2 3 4 1). Table 1 : Three instances of extreme frequency distributions . \bm{Z}_{1} \bm{Z}_{2} \bm{Z}_{3} 57 0 0 0 57 42 2 0 0 44 43 14 0 0 57 1 57 4 0 62 0 55 2 0 57 0 37 0 0 37 0 0 38 6 44 0 0 37 0 37 0 6 38 0 44 0 0 0 37 37 0 0 4 58 62 0 0 20 42 62 58 57 42 43 200 42 57 43 58 200 43 57 58 42 200 Remark 1 If the row and column categories were ordinal and such that, after the rearrangement determined by \bm{\pi}_{r},\>\bm{\pi}_{c} they were both increasing, the resulting extreme table would be the table with the strongest positive association within all possible tables having the same marginal distributions. The table with the strongest negative association would be the extreme table where the order of the column categories has been reversed. In principle, the number of extreme tables is equal to the product of the possible permutations of the row and the column categories; however, the actual number of distinct tables might be smaller because different pairs of permutations may lead to the same extreme table. 1.4 Main results Recall that each extreme table is determined by a pair of permutations of the row and the column categories, by construction, they contain several 0 entries where the corresponding log-odds ratios \lambda_{ij} = \log[z_{11}z_{ij}/(z_{i1}z_{1j})] , are undefined. In the following, for conciseness, let \bm{Z} = \bm{Z}(\bm{\pi}_{r},\bm{\pi}_{c}) . For any given \bm{Z} , we may define a sequence of tables \bm{Z}(\epsilon) , \epsilon>0 , which converge to \bm{Z} as \epsilon\rightarrow 0 and are such that the log-odds ratios are all well defined. Table 2 displays the possible configurations of 0s in 2\times 2 sub-tables which include the cell (1,1) and are thus relevant in the computation of the log-odds ratios. Table 2: Possible configurations of 0s in 2\times 2 sub-tables of an extreme table that include the (1,1) cell . A_{1} A_{2} A_{3} B_{1} B_{2} C z_{11} 0 z_{11} z_{1j} z_{11} 0 z_{11} 0 z_{11} z_{1j} z_{11} 0 z_{i1} 0 0 0 0 0 z_{i1} z_{ij} 0 z_{ij} 0 z_{11} A procedure for approximating any given \bm{Z} with a table \bm{Z}(\epsilon) which converges to \bm{Z} as \epsilon\rightarrow 0 and is such that the log-odds ratio are all well defined is obtained by replacing 0s in the first row and first column with \epsilon and, for Z_{ij}=0 ( i>1,\>j>1 ) do the following • if Z_{1j}(\epsilon)=0 and Z_{i1}>0 , as in A_{1} , set Z_{ij}=\epsilon Z_{i1}/Z_{11} ; • if Z_{i1}(\epsilon)=0 and Z_{1j}>0 , as in A_{2} , set Z_{ij}=\epsilon Z_{1j}/Z_{11} ; • if Z_{1j}(\epsilon)=0 and Z_{i1}=0 , as in A_{3} , set Z_{ij}=\epsilon^{2}/Z_{11} ; Let \lambda_{ij}(\epsilon) , i,j\>>1 , denote the log-odds ratios computed in \bm{Z}(\epsilon) and \xi=-\log(\epsilon) . It can be easily seen that the log-odds ratios within any \bm{Z}(\epsilon) will be 0 under A, of order O(\xi) under B and of order 2O(\xi) under C. When \epsilon is sufficiently close to 0, the \lambda_{ij}(\epsilon) which are different from 0, tend to \xi or 2\xi . Construct P(\bm{Z},\epsilon) by dividing the elements of \bm{Z}(\epsilon) by the corresponding row totals; clearly this does not affect the log-odds ratios. The following Lemma states some basic properties of extreme tables and the corresponding P(\bm{Z},\epsilon) . Lemma 2 Suppose that the extreme table \bm{Z} is determined by the pair of permutations \bm{\pi}_{r},\bm{\pi}_{c} ; let \mbox{${\cal N}$}^{*} denote the collection {\cal N} after applying \bm{\pi}_{r},\bm{\pi}_{c} to each of its elements, then • (i) If \lambda_{ij}(\epsilon) is of order O(2\xi) , \lambda_{hk}(\epsilon) , h\geq i and k\geq j , is either 0 or of order O(2\xi) ; • (ii) If \lambda_{ij}(\epsilon) is of order O(\xi) , \lambda_{hk}(\epsilon) , h\geq i and k\geq j , is either 0 or, at least, of order O(\xi) . • (iii) for \>i>1,\>j>1 and any \bm{N}^{*}\in\mbox{${\cal N}$}^{*} , ∑ _h=i^R ∑ _k=j^C z_hk ≥∑ _h=i^R ∑ _k=j^C n_hk^*. Proof The construction algorithm of extreme tables implies that, if z_{i1}=z_{1j}=0 , \forall\>h>i,\>k>j , z_{h1}=z_{1k}=0 ; it follows that sub-tables defined by the (1,1 ) and (h,k) cells are either of type A_{3} or C implying (i). Concerning (ii), the corresponding sub-tables may be of type B_{1} or B_{2} , in the first case z_{1k} , k>j must be 0 while z_{h1},\>z_{hk} may either be 0 or positive. The last point follows by constructing the extreme table after collapsing row categories 1 to i-1 and i to R and column categories 1 to j-1 and j to C ; the content of cell (2,2) in the resulting extreme table is the maximum allowed by the margins. \Box Lemma 3 Let \bm{Z} be an extreme table and \bm{\Lambda}(\epsilon) be the matrix of log-odds ratios computed in P(\bm{Z},\epsilon) for any table of counts \bm{N}^{*}\in\mbox{${\cal N}$}^{*} and indices s,t,u,v such that 2\leq sv term may be dropped. Proof Recall that V(\bm{N}^{*},\bm{\Lambda}) = \sum_{i}\sum_{j}n^{*}_{ij}\lambda_{ij} and note that one can ignore the components of V(\bm{N}^{*},\bm{\Lambda}(\epsilon)) with \lambda_{ij}(\epsilon))=0 ; to a first order of approximation, the remaining terms are either of order O(\xi) or 2O(\xi) , with the latter ones, if present, located towards the lower right-hand corner and the result follows by rearranging terms. \Box The main result of this section is contained in the next Theorem: Theorem 1.1 For any extreme table \bm{Z}\in\mbox{${\cal Z}$} , the probability distribution P(\bm{Z},\epsilon) satisfies likelihood equations ( 2 ) and ( 3 ) in the limit as \epsilon\rightarrow 0 and is, thus, a local maximum of the marginal likelihood. Proof Though, as \epsilon tends to 0 the elements of V(\bm{N}^{*},\bm{\Lambda}) , \bm{N}^{*}\in(\mbox{${\cal N}$}^{*}\backslash\mbox{${\cal Z}$}) diverge as \epsilon\rightarrow 0 , the conditional expectations in ( 1 ) may still be computed by subtracting the maximum of V(\bm{N}^{*},\bm{\Lambda}) across the collection of possible tables both from the numerator and the denominator. Then, (iii) from Lemma 2 applied to the statement in Lemma 3 implies that V(\bm{N}^{*},\bm{\Lambda}(\epsilon))-V(\bm{Z},\bm{\Lambda}(\epsilon)) converges to -\infty as \epsilon\rightarrow 0 so that the corresponding exponentials tends to 0 and may be ignored, except for the exponential where \bm{N}^{*} = \bm{Z} which tends to 1; this implies that M_{ij} = n_{ij} for all i,j . \Box 1.5 Final comments It can be easily seen that the likelihood equations are also satisfied by the table of conditional probabilities computed under independence which are determined by the column totals, that is p_{j\mid i} = n_{0j}/n : \sum_{i}n_{i0}n_{0j}/n=n_{0j},\quad M_{ij}=n_{i0}n_{0j}/n. In the 2\times 2 case, Plackett (1977) showed that the likelihood function has a saddle-point at independence; though an extension of his argument to the R\times C context is not straightforward, examination of several numerical examples determined by a pair of row and column totals such that the corresponding collection {\cal N} is not too large to construct, indicates that the likelihood under independence is not larger than that of any \bm{N}\in\mbox{${\cal N}$} ; however there is a variety of probability distributions not derived from members of {\cal N} whose likelihood is even smaller than under independence. An instance is presented in Example 2 . Example 2 For each member of the collection of 2160 frequency tables compatible with the row margin (8,20,12) and column margin (12,7, 21) a probability distribution was constructed by replacing 0s with \epsilon=10^{-50} and scaling row totals to sum to 1. The log-likelihood of these probability distributions, arranged in the lexicographic order in which feasible tables are generated, are plotted in Figure 1 . The likelihood of extreme tables is marked with a square and the dotted line is the likelihood under independence. In addition, a collection of distributions obtained by mixing the independence distribution with conditional row distributions generated at random are also displayed; however, to improve visibility, among the distributions generated at random, only those whose likelihood was above a certain threshold are retained. The likelihood under independence seems to be below that of any distribution derived from \bm{N}\in\mbox{${\cal N}$} while most of the mixture distribution have a likelihood below that under independence. Certain probability distributions derived from tables which are not extreme, may have a likelihood larger than that of several extreme tables. This happens when a non extreme table may be obtained by an elementary swap, as defined by Diaconis and Sturmfels (1998) , from an extreme table with a very high likelihood. The kind of regular pattern appearing in the plot is due to the fact the algorithm that generates the collection {\cal N} moves by elementary swaps so that successive tables are in some sese adjacent. Figure 1 : Plots of the Log-likelihood, vertical axis, for all the distributions which may be derived from tables compatible with the row totals (8,20,12) and column totals (12,7,21); extreme distributions are marked with a square, ordinary ones with ” \cdot ”; the horizontal dotted line corresponds to independence and ” o ” to distributions obtained by mixing independence with conditional distributions generated at random. The probability distribution which achieves the global maximum is, obviously, derived from an extreme table; however, which extreme table leads to the global maximum is hard to say in general because, in addition to its log-odds ratios, the global maximum depends also on numerical features of the full collection {\cal N} , 2 Marginal likelihood for a collections of two-way tables 2.1 Introduction Suppose that row and column distributions have been observed for a collection of local units, each characterized by a two-way table, \bm{N}_{h} , h=1,\dots,s whose content, for some reason, cannot be observed, except for the row and column totals, say n_{hi0},\>n_{h0j} , i=1,\dots,R , j=1,\dots,C . In studies of voting behaviour in two close in time elections, \bm{N}_{h} would be the cross tabulation of voters choices in the two elections in polling station h ; clearly, this table cannot be observed due to the secrecy of the ballot. A similar issue arise in various contexts of Epidemiology, for a discussion of its consequences, see for instance Greenland and Morgenstern (1989) . Methods of ecological inference under the assumption that the given collection of two-way tables share the same set of conditional row distributions have been used since the first half of last century, like in Gosnell and Gill (1935) . Nonetheless it has always been looked at with suspicion within the sociological community, especially after Robinson (1950) showed that its estimates could be heavily biased. A formal statement of the problem was provided by Goodman (1953) who stated the conditions under which the approach based on linear regression (which was current practice at the time) provides unbiased estimates of the conditional row probabilities which are the quantities of interest. Methods of ecological inference are usually based on the assumption that the conditional probabilities p_{hij}/p_{hi0} = p_{j\mid i} , that is they are constant across local units. Assume that these conditional probabilities are parameterised as in section 1.1 ; to write the log likelihood, let n_{hi0} and n_{h0j} , h=1,\dots,s denote respectively the row and column totals. Then log likelihood may be written as L=\sum_{j=1}^{C}n_{00j}\phi_{j}+\sum_{h=1}^{s}\log\sum_{\mbox{${\cal N}$}_{h}}\exp\left(V(\bm{N}_{h},\bm{\Lambda})+G(\bm{N}_{h})\right)-\sum_{i=1}^{R}n_{0i0}\log\sum_{j=1}^{C}\exp\left(\phi_{j}+\lambda_{ij}\right). By a straightforward extension of the argument in 1.2 , the likelihood equations have the simple form n_{00j}=\sum_{i=1}^{R}n_{0i0}p_{j\mid i},\quad\sum_{h=1}^{s}M_{hij}=n_{0i0}p_{j\mid i},\>\forall i>1,\>j>1. While \hat{p}_{j\mid i} = \sum_{h}n_{hij}/n_{0i0} satisfies the first set of likelihood equations, finding estimates that, in addition, satisfy the second set of likelihood equations is much harder because, for any candidate estimate \hat{p}_{j\mid i} , the table of conditional expectations from the extended hypergeometric distribution have to be computed numerically within each collection \mbox{${\cal N}$}_{h} . It is worth noting that, in order for the kind of pathological phenomenon which arise when a single pair of marginals is available, the s pairs of marginals should have at least one common maximal table, which is impossible unless both row and column totals are proportional across polling stations. 2.2 A new method of Ecological Inference A simple estimate of \hat{p}_{j\mid i} may be computed by the linear regression method of Goodman (1953) which is worth reviewing briefly. Let \bm{U},\>\bm{V} denote, respectively, the s\times R and s\times C matrices with elements n_{hi0}/n_{h00} and n_{h0j}/n_{h00} , with h indexing rows. Let \bm{X} = \bm{U}\otimes\bm{I}_{C-1} and \bm{y} be the column vector obtained by arranging the matrix made of the first C-1 columns of \bm{V} row-wise. Let \hat{\bm{\beta}} = (\bm{X}^{\prime}\bm{X})^{-1}\bm{y} ; an estimate of the p_{j\mid i} s is obtained by arranging the elements of \hat{\bm{\beta}} into an R\times(C-1) matrix \bm{A} where \hat{p}_{j\mid i} = A_{ij} for jj=1,\dots,C.