A generalized analysis of the dependence structure by means of ANOVA

The multiple non-symmetric correspondence analysis (MNSCA) is a useful technique for analysing the prediction of a categorical variable through two or more predictor variables placed in a contingency table. In MNSCA framework, for summarizing the predictability between criterion and predictor variables, the Multiple-TAU index has been proposed. But it cannot be used to test association, and for overcoming this limitation, a relationship with C-Statistic has been recommended. Multiple-TAU index is an overall measure of association that contains both main effects and interaction terms. The main effects represent the change in the response variables due to the change in the level/categories of the predictor variables, considering the effects of their addition. On the other hand, the interaction effect represents the combined effect of predictor variables on the response variable. In this paper, we propose a decomposition of the Multiple-TAU index in main effects and interaction terms. In order to show this decomposition, we consider an empirical case in which the relationship between the demographic characteristics of the American people, such as race, gender and location (column variables), and their propensity to move (row variable) to a new town to find a job is considered.     

Visualizing main effects and interaction in multiple non-symmetric correspondence analysis

Non-symmetric correspondence analysis (NSCA) is a useful technique for analysing a two-way contingency table. Frequently, the predictor variables are more than one; in this paper, we consider two categorical variables as predictor variables and one response variable. Interaction represents the joint effects of predictor variables on the response variable. When interaction is present, the interpretation of the main effects is incomplete or misleading. To separate the main effects and the interaction term, we introduce a method that, starting from the coordinates of multiple NSCA and using a two-way analysis of variance without interaction, allows a better interpretation of the impact of the predictor variable on the response variable. The proposed method has been applied on a well-known three-way contingency table proposed by Bockenholt and Bockenholt in which they cross-classify subjects by person's attitude towards abortion, number of years of education and religion. We analyse the case where the variables education and religion influence a person's attitude towards abortion.     

Cumulative correspondence analysis using orthogonal polynomials

Taguchi's statistic has long been known to be a more appropriate measure of association of the dependence for ordinal variables compared to the Pearson chi-squared statistic. Therefore, there is some advantage in using Taguchi's statistic in the correspondence analysis context when a two-way contingency table consists at least of an ordinal categorical variable. The aim of this paper, considering the contingency table with two ordinal categorical variables, is to show a decomposition of Taguchi's index into linear, quadratic and higher-order components. This decomposition has been developed using Emerson's orthogonal polynomials. Moreover, two case studies to explain the methodology have been analyzed.     

Correspondence Analysis of Cumulative Frequencies Using a Decomposition of Taguchi's Statistic

Taguchi's statistic has long been known to be a more appropriate measure of association for ordinal variables than the Pearson chi-squared statistic. Therefore, there is some advantage in using Taguchi's statistic for performing correspondence analysis when a two-way contingency table consists of one ordinal categorical variable. This article will explore the development of correspondence analysis using a decomposition of Taguchi's statistic.     

Sources of heterogeneity in distributions with ordered categorical variables

The chi-squared statistic is used to test the homogeneity for several groups in a contingency table. However, it may be inappropriate to apply the test when ordinal categories are involved. If it can be assumed that the ordinal categorical variables are realizations of underlying continuous random variables, then it is possible to study the properties of different groups in a relative sense. Assuming that the distributions of the continuous variables are in the same family and that the thresholds that define the categories are invariant across groups, we propose a procedure to test homogeneity and to address the sources of heterogeneity in different groups. An example based on a real data set is used to demonstrate the practical applicability of the suggested method.     

Marginal Nested Interactions for Contingency Tables

We introduce a new definition of generalized marginal interactions, called marginal nested interactions, which includes baseline, local, continuation and reverse continuation logits and odds ratios as special cases. The significant aspect of this definition is the inclusion of new types of logits and odds ratios that can handle non-ordinal, ordinal and partially ordered categorical variables in a flexible and appropriate way. It is proved also that the marginal nested interactions define a saturated model of a multi-way contingency table.     

CATANOVA for two-way cross classified categorical data

In this article we develop an extension of categorical analysis of variance for one response and two factors, based on a partitioning of a measure of predictability for three-way contingency tables, known as Gray and Williams's index. At the first instance moment the decomposition of this multiple measure of association in partial association measures is shown. Finally, for ordinal-scale variables, we propose an extension of this decomposition using a particular set of orthogonal polynomials.     

Influence diagnostics for stratified ordinal contingency tables

Influence diagnostics are investigated in this study. In particular, an approach based on the generalized linear mixed model setting is presented for formulating ordered categorical counts in stratified contingency tables. Deletion diagnostics and their first-order approximations are developed for assessing the stratum-specific influence on parameter estimates in the models. To illustrate the proposed model diagnostic technique, the method is applied to analyze two sets of data: a clinical trial and a survey study. The two examples demonstrate that the presence of influential strata may substantially change the results in ordinal contingency table analysis.     

Nonparametric analysis of ordinal categorical response data with factorial structure

A simple nonparametric method of analysis for contingency tables with an ordinal response and factorial treatment structure is described. The method involves a partition of Pearson's X ²_P-statistic by using orthogonal polynomials so that location and dispersion effects are estimated for each level of the explanatory variable. Analyses of variance are then performed on these effects to determine the important factors. The methods are applied to two examples, where consumers rate their liking for a product on an ordered categorical scale, one of which highlights the need to look at dispersion as well as location effects.     

Partitioning Pearson's Chi-squared Statistic for Singly Ordered Two-way Contingency Tables

This paper presents a partition of Pearson's chi-squared statistic for singly ordered two-way contingency tables. The partition involves using orthogonal polynomials for the ordinal variable while generalized basic vectors are used for the non-ordinal variable. The benefit of this partition is that important information about the structure of the ordered variable can be identified in terms of locations, dispersion and higher order components. For the non-ordinal variable, it is shown that the squared singular values from the singular value decomposition of the transformed dataset can be partitioned into location, dispersion and higher order components. The paper also uses the chi-squared partition to present an alternative to the maximum likelihood technique of parameter estimation for the log-linear analysis of the contingency table.     

Latent variable models with ordinal categorical covariates

We propose a general latent variable model for multivariate ordinal categorical variables, in which both the responses and the covariates are ordinal, to assess the effect of the covariates on the responses and to model the covariance structure of the response variables. A?fully Bayesian approach is employed to analyze the model. The Gibbs sampler is used to simulate the joint posterior distribution of the latent variables and the parameters, and the parameter expansion and reparameterization techniques are used to speed up the convergence procedure. The proposed model and method are demonstrated by simulation studies and a real data example.     

Double linear diagonals-parameter symmetry and decomposition of double symmetry for square tables

For square contingency tables with ordered category, the present paper proposes the double linear diagonals-parameter symmetry (D-LDPS) model which implies the structure of both asymmetry with respect to the main diagonal and with respect to the reverse diagonal in the table. The D-LDPS model may be appropriate for a square ordinal table if it is reasonable to assume an underlying bivariate normal distribution with equal marginal variances. The present paper also gives the orthogonal decomposition of the double symmetry model into the D-LDPS model and the double marginal mean equality model. An example is given.     

Studying the dependence between ordinal-nominal categorical variables via orthogonal polynomials

In situations where the structure of one of the variables of a contingency table is ordered recent theory involving the augmentation of singular vectors and orthogonal polynomials has shown to be applicable for performing symmetric and non-symmetric correspondence analysis. Such an approach has the advantage of allowing the user to identify the source of variation between the categories in terms of components that reflect linear, quadratic and higher-order trends. The purpose of this paper is to focus on the study of two asymmetrically related variables cross-classified to form a two-way contingency table where only one of the variables has an ordinal structure.     

Bayesian inference for categorical data analysis

This article surveys Bayesian methods for categorical data analysis, with primary emphasis on contingency table analysis. Early innovations were proposed by Good (1953, 1956, 1965) for smoothing proportions in contingency tables and by Lindley (1964) for inference about odds ratios. These approaches primarily used conjugate beta and Dirichlet priors. Altham (1969, 1971) presented Bayesian analogs of small-sample frequentist tests for 2 x 2 tables using such priors. An alternative approach using normal priors for logits received considerable attention in the 1970s by Leonard and others (e.g., Leonard 1972). Adopted usually in a hierarchical form, the logit-normal approach allows greater flexibility and scope for generalization. The 1970s also saw considerable interest in loglinear modeling. The advent of modern computational methods since the mid-1980s has led to a growing literature on fully Bayesian analyses with models for categorical data, with main emphasis on generalized linear models such as logistic regression for binary and multi-category response variables.     

Smoothed categorical regression based on direct kernel estimates

A nonparametric method is considered which yields smoothed estimates of the response probabilities when the response variable is categorical. The method is based on Lauder's (1983) direct kernel estimates which are extended to allow for ordinal kernels. Thus one can make use of the ordinal scale of the response variable. A class of predictive loss functions is introduced on which the cross-validatory choice of smoothing parameters is based. Plots of the smoothed response probabilities may be used to uncover the form of covariate effects     

Exact tests for two-way symmetriccontingency tables

A two-way contingency table in which both variables have the same categories is termed a symmetric table. In many applications, because of the social processes involved, most of the observations lie on the main diagonal and the off-diagonal counts are small. For these tables, the model of independence is implausible and interest is then focussed on the off-diagonal cells and the models of quasi-independence and quasi-symmetry. For ordinal variables, a linear-by-linear association model can be used to model the interaction structure. For sparse tables, large-sample goodness-of-fit tests are often unreliable and one should use an exact test. In this paper, we review exact tests and the computing problems involved. We propose new recursive algorithms for exact goodness-of-fit tests of quasi-independence, quasi-symmetry, linear-by-linear association and some related models. We propose that all computations be carried out using symbolic computation and rational arithmetic in order to calculate the exact p-values accurately and describe how we implemented our proposals. Two examples are presented.     

Simple correspondence analysis using adjusted residuals

Correspondence analysis is a versatile statistical technique that allows the user to graphically identify the association that may exist between variables of a contingency table. For two categorical variables, the classical approach involves applying singular value decomposition to the Pearson residuals of the table. These residuals allow for one to use a simple test to determine those cells that deviate from what is expected under independence. However, the assumptions concerning these residuals are not always satisfied and so such results can lead to questionable conclusions.One may consider instead, an adjustment of the Pearson residual, which is known to have properties associated with the standard normal distribution. This paper explores the application of these adjusted residuals to correspondence analysis and determines how they impact upon the configuration of points in the graphical display.     

Positive association in a two-way contingency table:likelihood ratio tests

Given a two-way contingency table in which the rows and columns both define ordinal variables, there are many ways in which the informal idea of positive association between those variables might be defined. This paper considers a variety of definitions expressed as inequality constraints on cross-product ratios. Logical relationships between the definitions are explored. Each definition can serve as a composite alternative against which the null hypothesis of no association may be tested. For a broad class of such alternatives a decomposition of the log-likelihood gives both an explicit likelihood ratio statistic and its asymptotic null hypothesis distribution. Results are derived for multinomial sampling and for fully conditional sampling with row and column totals fixed.     

Catanova for multidimensional contingency tables: Nominal-scale response

This paper extends an analysis of variance for categorical data (CATANOVA) procedure to multidimensional contingency tables involving several factors and a response variable measured on a nominal scale. Using an appropriate measure of total variation for multinomial data, partial and multiple association measures are developed as R² quantities which parallel the analogous statistics in multiple linear regression for quantitative data. In addition, test statistics are derived in terms of these R² criteria. Finally, this CATANOVA approach is illustrated within the context of 2 three-way contingency table from a multicenter clinicaltrial.     

Indirect estimation of (latent) linear models with ordinal regressors A Monte Carlo study and some empirical illustrations

Summary This paper investigates the effects of ordinal regressors in linear regression models and in limited dependent variable models. Each ordered categorical variable is interpreted as a rough measurement of an underlying continuous variable as it is often done in microeconometrics for the dependent variable. It is shown that using ordinal indicators only leads to correct answers in a few special cases. In most situations, the usual estimators are biased. In order to estimate the parameters of the model consistently, the indirect estimation procedure suggested by Gourieroux et al. (1993) is applied. To demonstrate this method, first a simulation study is performed and then in a second step, two real data sets are used. In the latter case, continuous regressors are transformed into categorical variables to study the behavior of the estimation procedure. The method is extended to the case of limited dependent variable models. In general, the indirect estimators lead to adequate results. Received: March 27, 2000; revised version: March 6, 2001