Tests of Symmetry in Three-dimensional Contingency Tables Based on Phi-divergence Statistics

In this paper we introduce a family of test statistics for testing complete symmetry in three-dimensional contingency tables based on phi- divergence families. These test statistics yield the likelihood ratio test and the Pearson test statistics as special cases. Asymptotic distribution for the new test statistics are derived under both the null and the alternative hypotheses. A simulation study is presented to show that some new statistics offer an attractive alternative to the classical Pearson and likelihood ratio test statistics for this problem of complete symmetry.     

Diagonal uniform association symmetry modelsfor cumulative probabilities in square tables

For the analysis of square contingency tables with ordered categories, Tomizawa (1991) considered the diagonal uniform association symmetry (DUS) model, which has a multiplicative form for cell probabilities and has the structure of uniform association in the tables constructed using two diagonals that are equidistant from the main diagonal. This paper proposes another DUS model which has a similar multiplicative form for cumulative probabilities. The model indicates that the odds that an observation will fall in row category i or below and column category i+k or above, instead of in column category i or below and row category i+k or above, increase (decrease) exponentially as the cutpoint i increases for a fixed k. Examples are given.     

Tests of independence in incomplete multi-way tables using likelihood functions

Kang (2006) and Kang and Larsen (in press) used the log likelihood function with Lagrangian multipliers for estimation of cell probabilities in two-way incomplete contingency tables. This paper extends results and simulations to three-way and multi-way tables. Numerous studies cross-classify subjects by three or more categorical factors. Constraints on cell probabilities are incorporated through Lagrangian multipliers. Variances of the MLEs are derived from the matrix of second derivatives of the log likelihood with respect to cell probabilities and the Lagrange multiplier. Wald and likelihood ratio tests of independence are derived using the estimates and estimated variances. In simulation results in Kang and Larsen (in press), for data missing at random, maximum likelihood estimation (MLE) produced more efficient estimates of population proportions than either multiple imputation (MI) based on data augmentation or complete case (CC) analysis. Neither MLE nor MI, however, lead to an improvement over CC analysis with respect to power of tests for independence in two-way tables. Results are extended to multidimensional tables with arbitrary patterns of missing data when the variables are recorded on individual subjects. In three-way and higher-way tables, however, there is information relevant for judging independence in partially classified information, as long as two or more variables are jointly observed. Simulations study three-dimensional tables with three patterns of association and two levels of missing information.     

General Saddlepoint Approximation for Testing Separate Location-Scale Families of Hypotheses

For testing separate families of hypotheses, the likelihood ratio test does not have the usual asymptotic properties. This paper considers the asymptotic distribution of the ratio of maximized likelihoods (RML) statistic in the special case of testing separate scale or location-scale families of distributions. We derive saddlepoint approximations to the density and tail probabilities of the log of the RML statistic. These approximations are based on the expansion of the log of the RML statistic up to the second order, which is shown not to depend on the location and scale parameters. The resulting approximations are applied in several cases, including normal versus Laplace, normal versus Cauchy, and Weibull versus log-normal. Our results show that the saddlepoint approximations are satisfactory, even for fairly small sample sizes, and are more accurate than normal approximations and Edgeworth approximations, especially for tail probabilities that are the values of main interest in hypothesis testing problems.     

Measure of Asymmetry for Square Contingency Tables Having Ordered Categories

For the analysis of square contingency tables with nominal categories, Tomizawa and coworkers have considered measures that represent the degree of departure from symmetry. This paper proposes a measure that represents the degree of asymmetry for square contingency tables with ordered categories (instead of those with nominal categories). The measure proposed is expressed using the Cressie–Read power-divergence or Patil–Taillie diversity index, defined for the cumulative probabilities that an observation falls in row (column) category i or below and column (row) category j (> i ) or above. The measure depends on the order of listing the categories. It should be useful for comparing the degree of asymmetry in several tables with ordered categories. The relationship between the measure and the normal distribution is shown.     

Measure of departure from conditional marginal homogeneity for square contingency tables with ordered categories

For the analysis of square contingency tables with ordered categories, Tomizawa et al. (S. Tomizawa, N. Miyamoto, and N. Ashihara, Measure of departure from marginal homogeneity for square contingency tables having ordered categories, Behaviormetrika 30 (2003), pp. 173–193.) and Tahata et al. (K. Tahata, T. Iwashita, and S. Tomizawa, Measure of departure from symmetry of cumulative marginal probabilities for square contingency tables with ordered categories, SUT J. Math., 42 (2006), pp. 7–29.) considered the measures which represent the degree of departure from the marginal homogeneity (MH) model. The present paper proposes a measure that represents the degree of departure from the conditional MH, given that an observation will fall in one of the off-diagonal cells of the table. The measure proposed is expressed by using the Cressie–Read power-divergence or the Patil–Taillie diversity index, which is applied for the conditional cumulative marginal probabilities given that an observation will fall in one of the off-diagonal cells of the table. When the MH model does not hold, the measure is useful for seeing how far the conditional cumulative marginal probabilities are from those with an MH structure and for comparing the degree of departure from MH in several tables. Examples are given.     

Maximum likelihood analysis of masked series system lifetime data

Component lifetime parameters of a series system are estimated from system lifetimes and masked cause of failure observations. The time and cause of system failures are assumed to follow a competing risks model. The masking probabilities of the minimum random subsets are not subjected to the symmetry assumption. Sufficient regularity conditions are provided, justifying the maximum likelihood analysis. Maximum likelihood estimates of both the lifetime parameters and masking probabilities are generically computed via an EM algorithm. An appropriate set of asymptotically pivotal quantities are also derived. Such maximum likelihood based estimates are further refined by bootstrap. The developed techniques are illustrated by numerical examples of independent Weibull component lifetimes with distinct scale and shape parameters.     

Bayesian estimation methods for contingency tables

Summary A method of inputting prior opinion in contingency tables is described. The method can be used to incorporate beliefs of independence or symmetry but extensions are straightforward. Logistic normal distributions that express such beliefs are used as priors of the cell probabilities and posterior estimates are derived. Empirical Bayes methods are also discussed and approximate posterior variances are provided. The methods are illustrated by a numerical example.     

Measure of departure from symmetry for the analysis of collapsed square contingency tables with ordered categories

For square contingency tables with ordered categories, there may be some cases that one wants to analyze them by considering collapsed tables with some adjacent categories combined in the original table. This paper considers the symmetry model for collapsed square contingency tables and proposes a measure to represent the degree of departure from symmetry. The proposed measure is defined as the arithmetic mean of submeasures each of which represents the degree of departure from symmetry for each collapsed 3×3 table. Each submeasure also represents the mean of power-divergence or diversity index for each collapsed table. Examples are given.     

Third order asymptotics: connections among test quantities

Saddlepoint methods, extended to distribution functions, can provide highly accurate tail probabilities for testing real parameters in exponential models. For extensions, asymptotic connections among various test quantities are needed. For five quantities, the maximum likelihood departure standardized by observed and expected information, the score function standardized by observed and expected information, and the signed square root of the likelihood ratio statistic, the needed connections to third order are recorded. Their use is illustrated by a simple integration proof of the Lugannani and Rice formula.     

Tests for symmetry of two-piece normal distribution

In this paper, classical optimum tests for symmetry of two-piece normal distribution is derived. Uniformly most powerful one-sided test for the skewness parameter is obtained when the location and scale parameters are known and is compared with sequential probability ratio test. An ad-hoc test for symmetry and likelihood ratio test for symmetry for large samples, can be found in literature for this distribution. But in this paper, we derive exact likelihood ratio test for symmetry, when location parameter is known. The exact power of the test is evaluated for different sample sizes.     

Multidimensional contingency tables with missing data

This paper is concerned wim ine maximum likelihood estimation and the likelihood ratio test for hierarchical loglinear models of multidimensional contingency tables with missing data. The problems of estimation and test for a high dimensional contingency table can be reduced into those for a class of low dimensional tables. In some cases, the incomplete data in the high dimensional table can become complete in the low dimensional tables through the reduction can indicate how much the incomplete data contribute to the estimation and the test.     

Independence in Contingency Tables Using Simplicial Geometry

Frequently, contingency tables are generated in a multinomial sampling. Multinomial probabilities are then organized in a table assigning probabilities to each cell. A probability table can be viewed as an element in the simplex. The Aitchison geometry of the simplex identifies independent probability tables as a linear subspace. An important consequence is that, given a probability table, the nearest independent table is obtained by orthogonal projection onto the independent subspace. The nearest independent table is identified as that obtained by the product of geometric marginals, which do not coincide with the standard marginals, except in the independent case. The original probability table is decomposed into orthogonal tables, the independent and the interaction tables. The underlying model is log-linear, and a procedure to test independence of a contingency table, based on a multinomial simulation, is developed. Its performance is studied on an illustrative example.     

Likelihood Ratio Test Against Stochastic Order in Three Way Contingency Tables

Trend tests in dose-response have been central problems in medicine. The likelihood ratio test is often used to test hypotheses involving a stochastic order. Stratified contingency tables are common in practice. The distribution theory of likelihood ratio test has not been full developed for stratified tables and more than two stochastically ordered distributions. Under c strata of m × r tables, for testing the conditional independence against simple stochastic order alternative, this article introduces a model-free test method and gives the asymptotic distribution of the test statistic, which is a chi-bar-squared distribution. A real data set concerning an ordered stratified table will be used to show the validity of this test method.     

Mutual information and redundancy for categorical data

Most methods for describing the relationship among random variables require specific probability distributions and some assumptions concerning random variables. Mutual information, based on entropy to measure the dependency among random variables, does not need any specific distribution and assumptions. Redundancy, which is an analogous version of mutual information, is also proposed as a method. In this paper, the concepts of redundancy and mutual information are explored as applied to multi-dimensional categorical data. We found that mutual information and redundancy for categorical data can be expressed as a function of the generalized likelihood ratio statistic under several kinds of independent log-linear models. As a consequence, mutual information and redundancy can also be used to analyze contingency tables stochastically. Whereas the generalized likelihood ratio statistic to test the goodness-of-fit of the log-linear models is sensitive to the sample size, the redundancy for categorical data does not depend on sample size but depends on its cell probabilities.     

On the exact calculation of cumulative F probabilities

Various approximate procedures have been employed in the tabulation of F distributions. These approximations generally perform poorly for small degrees of freedom and/or for extreme tail areas.

Closed form expressions are presented in this paper for the exact calculation of cumulative probabilities of F distributions. For small degrees of freedom, the probabilities may be calculated with the aid of standard mathematical tables and a calculator. An APL computer program, also presented in this paper, may be used in calculating the cumulative probabilities according to the exact expressions.     

Conditional symmetry models for three-way contingency tables

We generalize the classical conditional or triangular symmetry model for I×I$I\times I$ contingency tables to three-way I×I×I$I\times I\times I$ tables with commensurable ordinal classification variables. The construction of the new family of models is such that the desirable property that connects conditional symmetry to complete symmetry and marginal homogeneity models in two-way tables is retained in three-way tables. Furthermore, connections between our proposed models obey a coherent structure. We provide maximum likelihood estimation for the new models which is illustrated with a real data example.     

Non-parametric maximum likelihood estimation of interval-censored failure time data subject to misclassification

The paper considers non-parametric maximum likelihood estimation of the failure time distribution for interval-censored data subject to misclassification. Such data can arise from two types of observation scheme; either where observations continue until the first positive test result or where tests continue regardless of the test results. In the former case, the misclassification probabilities must be known, whereas in the latter case, joint estimation of the event-time distribution and misclassification probabilities is possible. The regions for which the maximum likelihood estimate can only have support are derived. Algorithms for computing the maximum likelihood estimate are investigated and it is shown that algorithms appropriate for computing non-parametric mixing distributions perform better than an iterative convex minorant algorithm in terms of time to absolute convergence. A profile likelihood approach is proposed for joint estimation. The methods are illustrated on a data set relating to the onset of cardiac allograft vasculopathy in post-heart-transplantation patients.     

Upper probabilities based only on the likelihood function

In the problem of parametric statistical inference with a finite parameter space, we propose some simple rules for defining posterior upper and lower probabilities directly from the observed likelihood function, without using any prior information. The rules satisfy the likelihood principle and a basic consistency principle ('avoiding sure loss'), they produce vacuous inferences when the likelihood function is constant, and they have other symmetry, monotonicity and continuity properties. One of the rules also satisfies fundamental frequentist principles. The rules can be used to eliminate nuisance parameters, and to interpret the likelihood function and to use it in making decisions. To compare the rules, they are applied to the problem of sampling from a finite population. Our results indicate that there are objective statistical methods which can reconcile three general approaches to statistical inference: likelihood inference, coherent inference and frequentist inference.     

Asymmetry models for square contingency tables: exact tests via algebraic statistics

Square contingency tables with the same row and column classification occur frequently in a wide range of statistical applications, e.g. whenever the members of a matched pair are classified on the same scale, which is usually ordinal. Such tables are analysed by choosing an appropriate loglinear model. We focus on the models of symmetry, triangular, diagonal and ordinal quasi symmetry. The fit of a specific model is tested by the chi-squared test or the likelihood-ratio test, where p-values are calculated from the asymptotic chi-square distribution of the test statistic or, if this seems unjustified, from the exact conditional distribution. Since the calculation of exact p-values is often not feasible, we propose alternatives based on algebraic statistics combined with MCMC methods.