A comparison of some conditional and unconditional exact tests for 2x2 contingency tables

In 1935, R.A. Fisher published his well-known “exact” test for 2x2 contingency tables. This test is based on the conditional distribution of a cell entry when the rows and columns marginal totals are held fixed. Tocher (1950) and Lehmann (1959) showed that Fisher s test, when supplemented by randomization, is uniformly most powerful among all the unbiased tests UMPU). However, since all the practical tests for 2x2 tables are nonrandomized - and therefore biased the UMPU test is not necessarily more powerful than other tests of the same or lower size. Inthis work, the two-sided Fisher exact test and the UMPU test are compared with six nonrandomized unconditional exact tests with respect to their power. In both the two-binomial and double dichotomy models, the UMPU test is often less powerful than some of the unconditional tests of the same (or even lower) size. Thus, the assertion that the Tocher-Lehmann modification of Fisher's conditional test is the optimal test for 2x2 tables is unjustified.     

Measure of departure from symmetry for the analysis of collapsed square contingency tables with ordered categories

For square contingency tables with ordered categories, there may be some cases that one wants to analyze them by considering collapsed tables with some adjacent categories combined in the original table. This paper considers the symmetry model for collapsed square contingency tables and proposes a measure to represent the degree of departure from symmetry. The proposed measure is defined as the arithmetic mean of submeasures each of which represents the degree of departure from symmetry for each collapsed 3×3 table. Each submeasure also represents the mean of power-divergence or diversity index for each collapsed table. Examples are given.     

Modeling symmetry models in square contingency tables with ordered categories

This paper provides alternative methods for fitting symmetry and diagonal-parameters symmetry models to square tables having ordered categories. We demonstrate here the implementation of the class of models discussed in Goodman (1979c) using GEN-MOD in SAS. We also provide procedures for testing hypotheses involving model parameters. The methodology provided here can readily be used to fit the class of models discussed in Lawal and Upton (1995). If desired, composite models can be fitted. Two data sets, the 4 × 4 unaided distance vision of 4746 Japanese students Tomizawa (1985) and the 5 × 5 British social mobility data Glass (1954) are employed to demonstrate the fitting of these models. Results obtained are consistent with those from Goodman (1972, 1979c, 1986) and Tomizawa (1985, 1987).     

Bayesian estimation methods for contingency tables

Summary A method of inputting prior opinion in contingency tables is described. The method can be used to incorporate beliefs of independence or symmetry but extensions are straightforward. Logistic normal distributions that express such beliefs are used as priors of the cell probabilities and posterior estimates are derived. Empirical Bayes methods are also discussed and approximate posterior variances are provided. The methods are illustrated by a numerical example.     

Marginal inhomogeneity models for square contingency tables with nominal categories

For the analysis of square contingency tables with nominal categories, this paper proposes two kinds of models that indicate the structure of marginal inhomogeneity. One model states that the absolute values of log odds of the row marginal probability to the corresponding column marginal probability for each category i are constant for every i. The other model states that, on the condition that an observation falls in one of the off-diagonal cells in the square table, the absolute values of log odds of the conditional row marginal probability to the corresponding conditional column marginal probability for each category i are constant for every i. These models are used when the marginal homogeneity model does not hold, and the values of parameters in the models are useful for seeing the degree of departure from marginal homogeneity for the data on a nominal scale. Examples are given.     

Markov chain Monte Carlo exact tests for incomplete two-way contingency tables

We consider testing the quasi-independence hypothesis for two-way contingency tables which contain some structural zero cells. For sparse contingency tables where the large sample approximation is not adequate, the Markov chain Monte Carlo exact tests are powerful tools. To construct a connected chain over the two-way contingency tables with fixed sufficient statistics and an arbitrary configuration of structural zero cells, an algebraic algorithm proposed by Diaconis and Sturmfels [Diaconis, P. and Sturmfels, B. (1998). The Annals of statistics, 26, pp. 363–397.] can be used. However, their algorithm does not seem to be a satisfactory answer, because the Markov basis produced by the algorithm often contains many redundant elements and is hard to interpret. We derive an explicit characterization of a minimal Markov basis, prove its uniqueness, and present an algorithm for obtaining the unique minimal basis. A computational example and the discussion on further basis reduction for the case of positive sufficient statistics are also given.     

Conditional tests for elliptical symmetry using robust estimators

This paper presents a procedure for testing the hypothesis that the underlying distribution of the data is elliptical when using robust location and scatter estimators instead of the sample mean and covariance matrix. Under mild assumptions that include elliptical distributions without first moments, we derive the test statistic asymptotic behavior under the null hypothesis and under special alternatives. Numerical experiments allow to compare the behavior of the tests based on the sample mean and covariance matrix with that based on robust estimators, under various elliptical distributions and different alternatives. We also provide a numerical comparison with other competing tests.     

Diagonal uniform association symmetry modelsfor cumulative probabilities in square tables

For the analysis of square contingency tables with ordered categories, Tomizawa (1991) considered the diagonal uniform association symmetry (DUS) model, which has a multiplicative form for cell probabilities and has the structure of uniform association in the tables constructed using two diagonals that are equidistant from the main diagonal. This paper proposes another DUS model which has a similar multiplicative form for cumulative probabilities. The model indicates that the odds that an observation will fall in row category i or below and column category i+k or above, instead of in column category i or below and row category i+k or above, increase (decrease) exponentially as the cutpoint i increases for a fixed k. Examples are given.     

Exact conditional tests for incomplete contingency tables: estimating attained significance levels

A Monte Carlo exact conditional test of quasi-independence in two-way incomplete contingency tables is proposed. The null distribution of a random table under quasiindependence is derived. This distribution depends only on the counts in the cells of interest and not on the counts in the remaining cells. This result is used to improve the efficiency of a proposed simulate-and-reject Monte Carlo procedure for estimating the attained significance level.     

Measure of departure from conditional marginal homogeneity for square contingency tables with ordered categories

For the analysis of square contingency tables with ordered categories, Tomizawa et al. (S. Tomizawa, N. Miyamoto, and N. Ashihara, Measure of departure from marginal homogeneity for square contingency tables having ordered categories, Behaviormetrika 30 (2003), pp. 173–193.) and Tahata et al. (K. Tahata, T. Iwashita, and S. Tomizawa, Measure of departure from symmetry of cumulative marginal probabilities for square contingency tables with ordered categories, SUT J. Math., 42 (2006), pp. 7–29.) considered the measures which represent the degree of departure from the marginal homogeneity (MH) model. The present paper proposes a measure that represents the degree of departure from the conditional MH, given that an observation will fall in one of the off-diagonal cells of the table. The measure proposed is expressed by using the Cressie–Read power-divergence or the Patil–Taillie diversity index, which is applied for the conditional cumulative marginal probabilities given that an observation will fall in one of the off-diagonal cells of the table. When the MH model does not hold, the measure is useful for seeing how far the conditional cumulative marginal probabilities are from those with an MH structure and for comparing the degree of departure from MH in several tables. Examples are given.     

Power-divergence-type measure of departure from symmetry for square contingency tables that have nominal categories

For square contingency tables that have nominal categories, Tomizawa considered two kinds of measure to represent the degree of departure from symmetry. This paper proposes a generalization of those measures. The proposed measure is expressed by using the average of the power divergence of Cressie and Read, or the average of the diversity index of Patil and Taillie. Special cases of the proposed measure include Tomizawa's measures. The proposed measure would be useful for comparing the degree of departure from symmetry in several tables.     

Power-divergence-type measure of departure from diagonals-parameter symmetry for square contingency tables with ordered categories

For the analysis of square contingency tables with ordered categories, Goodman considered the diagonals-parameter symmetry (DPS) model. This paper proposes a measure to represent the degree of departure from the DPS model. The proposed measure is expressed by applying Read and Cressie’s power-divergence or Patil and Taillie’s diversity index. The measure would be useful for comparing the degree of departure from the DPS model in several tables. Examples are given.     

Nonparametric tests for conditional independence using conditional distributions

The concept of causality is naturally defined in terms of conditional distribution, however almost all the empirical works focus on causality in mean. This paper aims to propose a nonparametric statistic to test the conditional independence and Granger non-causality between two variables conditionally on another one. The test statistic is based on the comparison of conditional distribution functions using an L₂ metric. We use Nadaraya–Watson method to estimate the conditional distribution functions. We establish the asymptotic size and power properties of the test statistic and we motivate the validity of the local bootstrap. We ran a simulation experiment to investigate the finite sample properties of the test and we illustrate its practical relevance by examining the Granger non-causality between S&P 500 Index returns and VIX volatility index. Contrary to the conventional t-test which is based on a linear mean-regression, we find that VIX index predicts excess returns both at short and long horizons.     

A comparison of tests of homogeneity for sparse contingency tables

Five tests of homogeneity for a 2x(k+l) contingency table are compared using Monte Carlo techniques. For these studiesit is assumed that k becomes large in such a way that thecontingency table is sparse for 2xk of the cells, but the sample size in two of the cells remains large. The test statistics studied are: the chi-square approximation to the Pearson test statistic, the chi-square approximation to the likelihood ratio statistic, the normal approximation to Zelterman's (1984)the normal approximation to Pearson's chi-square, and the normal approximation to the likelihood ratio statistic. For the range of parameters studied the chi-square approximation to Pearson's statistic performs consistently well with regard to its size and power.     

Partitioning chi-squape in contingency tables: A teaching approach

A representation of sums and differences of the form 2n log n, the lnn function, is introduced to express likelihood-ratio chi-square test statistics in contingency table analysis. This is a concise explicit form to display when partitioning chi-square statistics in accordance with hierarchical models. The lnn representation gives students insights into the construction of test statistics, and assists in relating identical forms under differing model sets. Hierarchies are presented for independence and equi-probability in two-way tables, for symmetry in correlated square tables, for independence-and-homogeneity of two-way responses across levels of a factor, and for mutual independence in three-way tables, along with relevant partitions of chi-square.     

A characterization of and new consistent tests for symmetry

Let X and Y be independent and identically distributed random variables having a continuous distribution function. We study new consistent tests for symmetry around a known median based on the fact that the distribution of X is symmetric around 0 if, and only if, |X| and |max(X,Y)| have the same distribution.     

Single-index modelling of conditional probabilities in two-way contingency tables

When analysing a contingency table, it is often worth relating the probabilities that a given individual falls into different cells from a set of predictors. These conditional probabilities are usually estimated using appropriate regression techniques. In particular, in this paper, a semiparametric model is developed. Essentially, it is only assumed that the effect of the vector of covariates on the probabilities can entirely be captured by a single index, which is a linear combination of the initial covariates. The estimation is then twofold: the coefficients of the linear combination and the functions linking this index to the related conditional probabilities have to be estimated. Inspired by the estimation procedures already proposed in the literature for single-index regression models, four estimators of the index coefficients are proposed and compared, from a theoretical point-of-view, but also practically, with the aid of simulations. Estimation of the link functions is also addressed.     

Efficient algorithms for exact inference in 2 × 2 contingency tables

We propose a simple and robust algorithm for exact inference in 2 × 2 contingency tables. It is based on recursive relations allowing efficient computation of odds-ratio estimates, confidence limits and p-values for Fisher's test. A factor of 3–10 is gained in terms of computer time compared with the classical algorithm of Thomas.     

Comparison of exact tests for association in unordered contingency tables using standard,mid-p,and randomized test versions

Pearson’s chi-square (Pe), likelihood ratio (LR), and Fisher (Fi)–Freeman–Halton test statistics are commonly used to test the association of an unordered r×c contingency table. Asymptotically, these test statistics follow a chi-square distribution. For small sample cases, the asymptotic chi-square approximations are unreliable. Therefore, the exact p-value is frequently computed conditional on the row- and column-sums. One drawback of the exact p-value is that it is conservative. Different adjustments have been suggested, such as Lancaster’s mid-p version and randomized tests. In this paper, we have considered 3×2, 2×3, and 3×3 tables and compared the exact power and significance level of these test’s standard, mid-p, and randomized versions. The mid-p and randomized test versions have approximately the same power and higher power than that of the standard test versions. The mid-p type-I error probability seldom exceeds the nominal level. For a given set of parameters, the power of Pe, LR, and Fi differs approximately the same way for standard, mid-p, and randomized test versions. Although there is no general ranking of these tests, in some situations, especially when averaged over the parameter space, Pe and Fi have the same power and slightly higher power than LR. When the sample sizes (i.e., the row sums) are equal, the differences are small, otherwise the observed differences can be 10% or more. In some cases, perhaps characterized by poorly balanced designs, LR has the highest power.