Improved likelihood ratio tests and pearson chi-square tests for independence in two dimensional contingency tables

When an I×J contingency table has many cells having very small frequencies, the usual chi-square approximation to the upper tail of the likelihood ratio goodness-of-fit statistic, G² and Pearson chi-square statistic, X², for testing independence, are not satisfactory. In this paper we consider the problem of adjusting G² and X². Suitable adjustments are suggested on the basis of analytical investigation of asymptotic bias terms for G² and X². A Monte Carlo simulation is performed for several tables to assess the adjustments of G² and X² in order to obtain a closer approximation to the nominal level of significance.     

On a new transformation to normality

A Gaussian approximation to the distribution of the nonnegative random variable Y is developed using the Wilson and Hilferty (1931) approach. This approximation uses the symmetrizing transformation ((Y + b)/k₁)^h where k₁ is the first moment of Y and h and b are determined from the first three cumulants of Y. The approximation is illustrated in the case which Y is a non-central chi-square, where numerical evaluations indicate that the new transformation is an improvement over existing ones, especially for small values of k₁.     

Performance of the weighted least squares apprdach to categorical data analysis

The weighted least squares method of Grizzle, Starmer and Koch is a common and convenient way to analyze categorical data. Tests of significance based on this method are typically performed by calculating a quadratic form which is asymptotically distrib-uted as a chi-square random variable under an appropriate null hy- pothesis.

This paper explores the validity of this distributional approximation for small samples in terms of the accuracy and power associated with this chi-square statistic. We report simulation results from the weighted least squares method applied to balanced factorial experiments, The simulations which constitute the majorpart of this work also provide insight into the relative performance of several response functions.     

On the Computation of Non-Central Chi-Square Distribution Function

The cumulative distribution function of the non-central chi-square is very important in calculating the power function of some statistical tests. On the other hand it involves an integral which is difficult to obtain. In literature some workers discussed the evaluation and the approximation of the c.d.f. of the non-central chi-square [see references (2)]. In the present work two computational formulae for computing the cumulative distribution function of the non-central chi-square distribution are given, the first one deals with the case of any degrees of freedom (odd and even), and the second deals with the case of odd degrees of freedom. Numerical illustrations are discussed.     

Editor's Report

There are two common methods for statistical inference on 2 × 2 contingency tables. One is the widely taught Pearson chi-square test, which uses the well-known χ²statistic. The chi-square test is appropriate for large sample inference, and it is equivalent to the Z-test that uses the difference between the two sample proportions for the 2 × 2 case. Another method is Fisher’s exact test, which evaluates the likelihood of each table with the same marginal totals. This article mathematically justifies that these two methods for determining extreme do not completely agree with each other. Our analysis obtains one-sided and two-sided conditions under which a disagreement in determining extreme between the two tests could occur. We also address the question whether or not their discrepancy in determining extreme would make them draw different conclusions when testing homogeneity or independence. Our examination of the two tests casts light on which test should be trusted when the two tests draw different conclusions.     

Moments of the product and ratio of two correlated chi-square variables

The exact probability density function of a bivariate chi-square distribution with two correlated components is derived. Some moments of the product and ratio of two correlated chi-square random variables have been derived. The ratio of the two correlated chi-square variables is used to compare variability. One such application is referred to. Another application is pinpointed in connection with the distribution of correlation coefficient based on a bivariate t distribution.      

Approximations of the Distributions of Test Statistics for Homogeneity of a Product Multinomial Model

Statistics R ^a based on power divergence can be used for testing the homogeneity of a product multinomial model. All R ^a have the same chi-square limiting distribution under the null hypothesis of homogeneity. R ⁰ is the log likelihood ratio statistic and R ¹ is Pearson's X ² statistic. In this article, we consider improvement of approximation of the distribution of R ^a under the homogeneity hypothesis. The expression of the asymptotic expansion of distribution of R ^a under the homogeneity hypothesis is investigated. The expression consists of continuous and discontinuous terms. Using the continuous term of the expression, a new approximation of the distribution of R ^a is proposed. A moment-corrected type of chi-square approximation is also derived. By numerical comparison, we show that both of the approximations perform much better than that of usual chi-square approximation for the statistics R ^a when a ≤ 0, which include the log likelihood ratio statistic.     

Re-examining two tests for bivariate normality

Many goodness of fit tests for bivariate normality are not rigorous procedures because the distributions of the proposed statistics are unknown or too difficult to manipulate. Two familiar examples are the ring test and the line test. In both tests the statistic utilized generally is approximated by a chi-square distribution rather than compared to its known beta distribution. These two procedures are re-examined and re-evaluated in this paper. It is shown that the chi-square approximation can be too conservative and can lead to unnecessary

rejection of normality.     

Negative exponential disparity based family of goodness-of-fit tests for multinomial models

This paper investigates a new family of goodness-of-fit tests based on the negative exponential disparities. This family includes the popular Pearson's chi-square as a member and is a subclass of the general class of disparity tests (Basu and Sarkar, 1994) which also contains the family of power divergence statistics. Pitman efficiency and finite sample power comparisons between different members of this new family are made. Three asymptotic approximations of the exact null distributions of the negative exponential disparity famiiy of tests are discussed. Some numerical results on the small sample perfomance of this family of tests are presented for the symmetric null hypothesis. It is shown that the negative exponential disparity famiiy, Like the power divergence family, produces a new goodness-of-fit test statistic that can be a very attractive alternative to the Pearson's chi-square. Some numerical results suggest that, application of this test statistic, as an alternative to Pearson's chi-square, could be preferable to the I ^2/3 statistic of Cressie and Read (1984) under the use of chi-square critical values.     

Improvement of the quality of the chi-square approximation for the ADF test on a covariance matrix with a linear structure

The asymptotically distribution-free (ADF) test statistic was proposed by Browne (1984). It is known that the null distribution of the ADF test statistic is asymptotically distributed according to the chi-square distribution. This asymptotic property is always satisfied, even under nonnormality, although the null distributions of other famous test statistics, e.g., the maximum likelihood test statistic and the generalized least square test statistic, do not converge to the chi-square distribution under nonnormality. However, many authors have reported numerical results which indicate that the quality of the chi-square approximation for the ADF test is very poor, even when the sample size is large and the population distribution is normal. In this paper, we try to improve the quality of the chi-square approximation to the ADF test for a covariance matrix with a linear structure by using the Bartlett correction applicable under the assumption of normality. By conducting numerical studies, we verify that the obtained Bartlett correction can perform well even when the assumption of normality is violated.     

Chi-square tests for multivariate normality with application to common stock prices

The theory of chi-square tests with data-dependent cells is applied to provide tests of fit to the family of p-variate normal distributions. The cells are bounded by hyperellipses (x-[Xbar])'S^-1 (x-[Xbar]) = c_i centered at the sample mean [Xbar] and having shape deter-mined by the sample covariance matrix S. The Pearson statistic with these cells is affine-invariant, has a null distribution not depending on the true mean and covariance, and has asymptotic critical points between those of x² (M-1) and x² (M-2) when M cells are employed. The test is insensitive to lack of symmetry, but peakedness, broad shoulders and heavy tails are easily discerned in the cell counts. Multivariate normality of logarithms of relative prices of common stocks, a common assumption in finan-cial markets theory, is studied using the statistic described here and a large data base.     

Analysis of binary data for the balanced one-way classification

A test is proposed for testing the equality of proportions based on the data available from a one-way classification having t treatment conditions and n binary observations per treatment. The test statistic B is a constant multiple of the F-statistic which results when the analysis of variance procedure for the one-way classification is applied to the data and, hence, is computationally simple. The statistic B from this binary analysis of variance (BIANOVA) is distributed asymptotically as a chi-square random variable. The proposed test is uniformly more powerful than either the F-test indicated above or the Pearson chi-square test; however, the attained empirical level of significance is frequently higher than for either of these competitors and usually higher than the stated level of significance for smaller values of n (say n ≤ 20).     

Goodness of fit tests with misclassified data

The most popular goodness of fit test for a multinomial distribution is the chi-square test. But this test is generally biased if observations are subject to misclassification, In this paper we shall discuss how to define a new test procedure when we have double sample data obtained from the true and fallible devices. An adjusted chi-square test based on the imputation method and the likelihood ratio test are considered, Asymptotically, these two procedures are equivalent. However, an example and simulation results show that the former procedure is not only computationally simpler but also more powerful under finite sample situations.     

Goodness-of-fit Tests for GEE with Correlated Binary Data

The marginal logistic regression, in combination with GEE, is an increasingly important method in dealing with correlated binary data. As for independent binary data, when the number of possible combinations of the covariate values in a logistic regression model is much larger than the sample size, such as when the logistic model contains at least one continuous covariate, many existing chi-square goodness-of-fit tests either are not applicable or have some serious drawbacks. In this paper two residual based normal goodness-of-fit test statistics are proposed: the Pearson chi-square and an unweighted sum of residual squares. Easy-to-calculate approximations to the mean and variance of either statistic are also given. Their performance, in terms of both size and power, was satisfactory in our simulation studies. For illustration we apply them to a real data set.     

Goodness of fit tests for the multiple logistic regression model

Several test statistics are proposed for the purpose of assessing the goodness of fit of the multiple logistic regression model. The test statistics are obtained by applying a chi-square test for a contingency table in which the expected frequencies are determined using two different grouping strategies and two different sets of distributional assumptions. The null distributions of these statistics are examined by applying the theory for chi-square tests of Moore Spruill (1975) and through computer simulations. All statistics are shown to have a chi-square distribution or a distribution which can be well approximated by a chi-square. The degrees of freedom are shown to depend on the particular statistic and the distributional assumptions.

The power of each of the proposed statistics is examined for the normal, linear, and exponential alternative models using computer simulations.     

On the distribution of quadratic forms in normal random variables

This paper provides necessary and sufficient conditions for a quadratic form in singular normal random variables to be distributed as a given linear combination of independent noncentral chi-square variables. Using this result, an extension of Cochran's theorem to quadratic forms of noncentral chi-square variables is derived.     

Complete moment convergence of weighted sums for arrays of negatively dependent random variables and its applications

For testing goodness-of-fit in a k cell multinomial distribution having very small frequencies, the usual chi-square approximation to the upper tail of the likelihood ratio statistic, G² is not satisfactory. A new adjustment to G² is determined on the basis of analytical investigation in terms of asymptotic bias and variance of the adjusted G² A Monte Carlo simulation is performed for several one-way tables to assess the adjustment of G² in order to obtain a closer approximation to the nomial level of significance.     

The Standard Error of the Mean and the Difference between Means for Finite Populations

This article discusses a representation of Pearson's chi-square for independence in two-way contingency tables in terms of conditional probabilities of two categorical random variables and proposes a functional interpretation of Pearson's chi-square. This representation is suggested for use in the teaching of statistical independence between categorical variables.     

A comment on mckay's approximation for the coefficient of variation

Some clarification of statistics based on McKay's x² approximation for the distribution of the sample coefficient of variation is presented. The conclusions of Warren (1982) are shown to result from the confusion of two definitions for the sample coefficient of variation.     

The chi-square controversy: what if Pearson had R?

One of the most famous controversies in the history of Statistics regards the number of the degrees of freedom of a chi-square test. In 1900, Pearson introduced the chi-square test for goodness of fit without recognizing that the degrees of freedom depend on the number of estimated parameters under the null hypothesis. Yule tried an ‘experimental’ approach to check the results by a short series of ‘experiments’. Nowadays, an open-source language such as R gives the opportunity to empirically check the adequateness of Pearson's arguments. Pearson paid crucial attention to the relative error, which he stated ‘will, as a rule, be small’. However, this point is fallacious, as is made evident by the simulations carried out with R. The simulations concentrate on 2×2 tables where the fallacy of the argument is most evident. Moreover, this is one of the most employed cases in the research field.