Test of Association Between Two Ordinal Variables While Adjusting for Covariates

We propose a new set of test statistics to examine the association between two ordinal categorical variables X and Y after adjusting for continuous and/or categorical covariates Z. Our approach first fits multinomial (e.g., proportional odds) models of X and Y, separately, on Z. For each subject, we then compute the conditional distributions of X and Y given Z. If there is no relationship between X and Y after adjusting for Z, then these conditional distributions will be independent, and the observed value of (X, Y) for a subject is expected to follow the product distribution of these conditional distributions. We consider two simple ways of testing the null of conditional independence, both of which treat X and Y equally, in the sense that they do not require specifying an outcome and a predictor variable. The first approach adds these product distributions across all subjects to obtain the expected distribution of (X, Y) under the null and then contrasts it with the observed unconditional distribution of (X, Y). Our second approach computes "residuals" from the two multinomial models and then tests for correlation between these residuals; we define a new individual-level residual for models with ordinal outcomes. We present methods for computing p-values using either the empirical or asymptotic distributions of our test statistics. Through simulations, we demonstrate that our test statistics perform well in terms of power and Type I error rate when compared to proportional odds models which treat X as either a continuous or categorical predictor. We apply our methods to data from a study of visual impairment in children and to a study of cervical abnormalities in human immunodeficiency virus (HIV)-infected women. Supplemental materials for the article are available online.     

Testing Hypotheses in the Functional Linear Model

The functional linear model with scalar response is a regression model where the predictor is a random function defined on some compact set of R and the response is scalar. The response is modelled as Y =Ψ( X )+ ɛ , where Ψ is some linear continuous operator defined on the space of square integrable functions and valued in R . The random input X is independent from the noise ɛ . In this paper, we are interested in testing the null hypothesis of no effect, that is, the nullity of Ψ restricted to the Hilbert space generated by the random variable X . We introduce two test statistics based on the norm of the empirical cross-covariance operator of ( X , Y ). The first test statistic relies on a χ ² approximation and we show the asymptotic normality of the second one under appropriate conditions on the covariance operator of X . The test procedures can be applied to check a given relationship between X and Y . The method is illustrated through a simulation study.     

Negative exponential disparity based family of goodness-of-fit tests for multinomial models

This paper investigates a new family of goodness-of-fit tests based on the negative exponential disparities. This family includes the popular Pearson's chi-square as a member and is a subclass of the general class of disparity tests (Basu and Sarkar, 1994) which also contains the family of power divergence statistics. Pitman efficiency and finite sample power comparisons between different members of this new family are made. Three asymptotic approximations of the exact null distributions of the negative exponential disparity famiiy of tests are discussed. Some numerical results on the small sample perfomance of this family of tests are presented for the symmetric null hypothesis. It is shown that the negative exponential disparity famiiy, Like the power divergence family, produces a new goodness-of-fit test statistic that can be a very attractive alternative to the Pearson's chi-square. Some numerical results suggest that, application of this test statistic, as an alternative to Pearson's chi-square, could be preferable to the I ^2/3 statistic of Cressie and Read (1984) under the use of chi-square critical values.     

Tests for Bivariate Symmetry Against Ordered Alternatives in Square Contingency Tables

Let X and Y denote two ordinal response variables, each having I levels. When subjects are classified on both variables, there are I 2 possible combinations of classifications. Let pij = Pr (X = i, Y = j) . This paper introduces a family of tests based on φ –divergence measures for testing H₀: pij = pji against H1: pij ≥ pji (I≥ j) ; and for testing H1 against H2: pij unrestricted. A simulation study assesses some of the family of tests introduced in this paper in comparison to the likelihood ratio test.     

A NEW FAMILY OF DIVERGENCE MEASURES FOR TESTS OF FIT

The aim of this work is to investigate a new family of divergence measures based on the recently introduced Basu, Harris, Hjort and Jones (BHHJ) measure of divergence (Biometrika 85 , 549–559). The new family is investigated in connection with hypothesis testing problems, and new test statistics are proposed. Simulations are performed to check the appropriateness of the proposed test statistics.     

A Necessary Power Divergence Type Family Tests of Multivariate Normality

In a recent article, Cardoso de Oliveira and Ferreira have proposed a multivariate extension of the univariate chi-squared normality test, using a known result for the distribution of quadratic forms in normal variables. In this article, we propose a family of power divergence type test statistics for testing the hypothesis of multinormality. The proposed family of test statistics includes as a particular case the test proposed by Cardoso de Oliveira and Ferreira. We assess the performance of the new family of test statistics by using Monte Carlo simulation. In this context, the type I error rates and the power of the tests are studied, for important family members. Moreover, the performance of significant members of the proposed test statistics are compared with the respective performance of a multivariate normality test, proposed recently by Batsidis and Zografos. Finally, two well-known data sets are used to illustrate the method developed in this article as well as the specialized test of multivariate normality proposed by Batsidis and Zografos.     

Tests of Symmetry in Three-dimensional Contingency Tables Based on Phi-divergence Statistics

In this paper we introduce a family of test statistics for testing complete symmetry in three-dimensional contingency tables based on phi- divergence families. These test statistics yield the likelihood ratio test and the Pearson test statistics as special cases. Asymptotic distribution for the new test statistics are derived under both the null and the alternative hypotheses. A simulation study is presented to show that some new statistics offer an attractive alternative to the classical Pearson and likelihood ratio test statistics for this problem of complete symmetry.     

Testing Independence of Covariates and Errors in Non‐parametric Regression

Consider a non‐parametric regression model Y =m (X )+ϵ , where m is an unknown regression function, Y is a real‐valued response variable, X is a real covariate, and ϵ is the error term. In this article, we extend the usual tests for homoscedasticity by developing consistent tests for independence between X and ϵ . Further, we investigate the local power of the proposed tests using Le Cam's contiguous alternatives. An asymptotic power study under local alternatives along with extensive finite sample simulation study shows that the performance of the new tests is competitive with existing ones. Furthermore, the practicality of the new tests is shown using two real data sets.     

A new test for two-sample location problem based on empirical distribution function

We propose a new test for testing the equality of location parameter of two populations based on empirical distribution function (ECDF). The test statistics is obtained as a power divergence between two ECDFs. The test is shown to be distribution free, and its null distribution is obtained. We conducted empirical power comparison of the proposed test with several other available tests in the literature. We found that the proposed test performs better than its competitors considered here under several population structures. We also used two real datasets to illustrate the procedure.     

Joint analysis of longitudinal data comprising repeated measures and times to events

In biomedical and public health research, both repeated measures of biomarkers Y as well as times T to key clinical events are often collected for a subject. The scientific question is how the distribution of the responses [ T , Y | X ] changes with covariates X . [ T | X ] may be the focus of the estimation where Y can be used as a surrogate for T . Alternatively, T may be the time to drop-out in a study in which [ Y | X ] is the target for estimation. Also, the focus of a study might be on the effects of covariates X on both T and Y or on some underlying latent variable which is thought to be manifested in the observable outcomes. In this paper, we present a general model for the joint analysis of [ T , Y | X ] and apply the model to estimate [ T | X ] and other related functionals by using the relevant information in both T and Y . We adopt a latent variable formulation like that of Fawcett and Thomas and use it to estimate several quantities of clinical relevance to determine the efficacy of a treatment in a clinical trial setting. We use a Markov chain Monte Carlo algorithm to estimate the model's parameters. We illustrate the methodology with an analysis of data from a clinical trial comparing risperidone with a placebo for the treatment of schizophrenia.     

Divergence-based tests of homogeneity for spatial data

The problem of testing homogeneity in contingency tables when the data are spatially correlated is considered. We derive statistics defined as divergences between unrestricted and restricted estimated joint cell probabilities and we show that they are asymptotically distributed as linear combinations of chi-square random variables under the null hypothesis of homogeneity. Monte Carlo simulation experiments are carried out to investigate the behavior of the new divergence test statistics and to make comparisons with the statistics that do not take into account the spatial correlation. We show that some of the introduced divergence test statistics have a significantly better behavior than the classical chi-square test for the problem under consideration when we compare them on the basis of the simulated sizes and powers.     

The two-sample problem with multivariate censored data: a new rank test family

A new rank test family is proposed to test the equality of two multivariate failure times distributions with censored observations. The tests are very simple: they are based on a transformation of the multivariate rank vectors to a univariate rank score and the resulting statistics belong to the familiar class of the weighted logrank test statistics. The new procedure is also applicable to multivariate observations in general, such as repeated measures, some of which may be missing. To investigate the performance of the proposed tests, a simulation study was conducted with bivariate exponential models for various censoring rates. The size and power of these tests against Lehmann alternatives were compared to the size and power of two other tests (Wei and Lachin, 1984 and Wei and Knuiman, 1987). In all simulations the new procedures provide a relatively good power and an accurate control over the size of the test. A real example from the National Cooperative Gallstone Study is given     

Testing hypotheses in truncated samples by means of divergence statistics

In this paper we consider the problem of testing hypotheses in parametric models, when only the first r (of n) ordered observations are known.Using divergence measures, a procedure to test statistical hypotheses is proposed, Replacing the parameters by suitable estimators in the expresion of the divergence measure, the test statistics are obtained.Asymptotic distributions for these statistics are given in several cases when maximum likelihood estimators for truncated samples are considered.Applications of these results in testing statistical hypotheses, on the basis of truncated data, are presented.The small sample behavior of the proposed test statistics is analyzed in particular cases.A comparative study of power values is carried out by computer simulation.     

Exponentiality test based on alpha-divergence and gamma-divergence

In the present paper, we use the already defined alpha-divergence and gamma-divergence for constructing some goodness of fit tests for exponentiality. These divergence measures are very robust with respect to outliers. Since the existence of outliers among statistical data can be lead to misleading results, therefore utilizing these divergence measures can be of importance. In order to construct test statistics, two estimators are used for alpha-divergence and gamma-divergence. In the first one, we consider the alpha-divergence and gamma-divergence of the equilibrium distribution function, which is well defined on the empirical distribution function (EDF) and is proposed as an EDF-based goodness of fit test statistic. The second one is an estimator in manner of Vasicek entropy estimator. Simulation results indicate that in comparison with the other tests statistics, our mentioned test statistics almost in most of the cases have higher power. Finally, two examples containing outliers illustrate the importance and use of the proposed tests.     

Limit theorems for intermediate and central order statistics under nonlinear normalization

In this paper the work of Pancheva (1984) for extreme order statistics under nonlinear normalization is extended to order statistics with variable ranks. Two new results are proved. The first is that under nonlinear normalization, the nondegenerate type (family of types) of the distribution functions with two finite growth points is a possible weak limit of any central order statistic with regular rank sequence. The second result is that the possible nondegenerate weak limits of any central order statistic with regular rank under the traditionally linear normalization and under the power normalization are the same. Finally, the class of all possible weak limits for lower and upper intermediate order statistics is derived under power normalization from the corresponding weak limits of extremes under power normalization.     

Testing stochastic orders in tails of contingency tables

Testing for the difference in the strength of bivariate association in two independent contingency tables is an important issue that finds applications in various disciplines. Currently, many of the commonly used tests are based on single-index measures of association. More specifically, one obtains single-index measurements of association from two tables and compares them based on asymptotic theory. Although they are usually easy to understand and use, often much of the information contained in the data is lost with single-index measures. Accordingly, they fail to fully capture the association in the data. To remedy this shortcoming, we introduce a new summary statistic measuring various types of association in a contingency table. Based on this new summary statistic, we propose a likelihood ratio test comparing the strength of association in two independent contingency tables. The proposed test examines the stochastic order between summary statistics. We derive its asymptotic null distribution and demonstrate that the least favorable distributions are chi-bar distributions. We numerically compare the power of the proposed test to that of the tests based on single-index measures. Finally, we provide two examples illustrating the new summary statistics and the related tests.     

A comparison of chi-squared statistics for testing homogeneity of survey data:High School and Beyond survey

The performance of several test statistics for comparing vectors of propor tions from certain survey data was compared. The statistics were used to analyze a subsample of data from the 'High School and Beyond' survey. These tests include the Wald test statistic X2w and the modified Wald test statistic FW, the chi-squared test statistic X2rSB and its modification FRSB, a test X2dmb based on a probability model, and a method of moments approach, X2H. Data were also simulated based on two-stage cluster sampling design and the type I error level, and the power of these tests was obtained for selected combinations of parameter values. The statistics X2DMB XRSB, FRSB and X2H performed well both for a small number of clusters or a small number of units within clusters. The power performance of these tests is quite stable. Approximate intervals were constructed for design effect constants. Methods of estimating these constants based on a normality assumption worked best.     

Effect on probabilities and quantiles of adding a quantity with small variance

This paper gives simple approximations for the distribution function and quantiles of the sum X + Y when X is a continuous variable and Y is an independent variable with variance small compared to that of X . The approximations are based around the distribution function or quantiles of X and require only the first two or three moments of Y to be known. Example evaluations with X having a normal, Student's t or chi-squared distribution suggest that the approximations are good in unbounded tail regions when the ratio of variances is less than 0.2.     

A distribution free test to detect general dependence between a response variable and a covariate in the presence of heteroscedastic treatment effects

In this paper, we present a test of independence between the response variable, which can be discrete or continuous, and a continuous covariate after adjusting for heteroscedastic treatment effects. The method involves first augmenting each pair of the data for all treatments with a fixed number of nearest neighbours as pseudo‐replicates. Then a test statistic is constructed by taking the difference of two quadratic forms. The statistic is equivalent to the average lagged correlations between the response and nearest neighbour local estimates of the conditional mean of response given the covariate for each treatment group. This approach effectively eliminates the need to estimate the nonlinear regression function. The asymptotic distribution of the proposed test statistic is obtained under the null and local alternatives. Although using a fixed number of nearest neighbours pose significant difficulty in the inference compared to that allowing the number of nearest neighbours to go to infinity, the parametric standardizing rate for our test statistics is obtained. Numerical studies show that the new test procedure has robust power to detect nonlinear dependency in the presence of outliers that might result from highly skewed distributions. The Canadian Journal of Statistics 38: 408–433; 2010 © 2010 Statistical Society of Canada     

Score tests in the two - way layout of counts

For the balanced two-way layout of a count response variable Y classified by fixed or random factors A and B, we address the problems of (i) testing for individual and interactive effects on Y of two fixed factors, and (ii) testing for the effect of a fixed factor in the presence of a random factor and conversely. In case (i), we assume independent Poisson responses with µ_ij= E(Y| A=i,B=j) = α_iβ_jγ_ij corresponding respectively to the multiplicative

interactive and non-interactive cases. For case (ii) with factor A random, we derive a multivariate gamma-Poisson model by mixing on the random variable associated with each level of A. In each case Neyman C(α) score tests are derived. We present simulation results,and apply the interaction test to a data set, to evaluate and compare the size and power of the score test for interaction between two fixed factors, the competing Poisson-based likelihood ratio test, and the F-tests based on the assumptions that √Y+1 or log(Y+1) are approximately normal. Our results provide strong evidence that the normal-theory based F-tests typically are very far from nominal size, and that the likelihood ratio test is somewhat more liberal than the score test.