Asymptotic power comparison of T2-type test and likelihood ratio test for a mean vector based on two-step monotone missing data

Abstract

In a 2-step monotone missing dataset drawn from a multivariate normal population, T²-type test statistic (similar to Hotelling’s T² test statistic) and likelihood ratio (LR) are often used for the test for a mean vector. In complete data, Hotelling’s T² test and LR test are equivalent, however T²-type test and LR test are not equivalent in the 2-step monotone missing dataset. Then we interest which statistic is reasonable with relation to power. In this paper, we derive asymptotic power function of both statistics under a local alternative and obtain an explicit form for difference in asymptotic power function. Furthermore, under several parameter settings, we compare LR and T²-type test numerically by using difference in empirical power and in asymptotic power function. Summarizing obtained results, we recommend applying LR test for testing a mean vector.     

On testing the number of components in finite mixture models with known relevant component distributions

The limiting distribution of the log-likelihood-ratio statistic for testing the number of components in finite mixture models can be very complex. We propose two alternative methods. One method is generalized from a locally most powerful test. The test statistic is asymptotically normal, but its asymptotic variance depends on the true null distribution. Another method is to use a bootstrap log-likelihood-ratio statistic which has a uniform limiting distribution in [0,1]. When tested against local alternatives, both methods have the same power asymptotically. Simulation results indicate that the asymptotic results become applicable when the sample size reaches 200 for the bootstrap log-likelihood-ratio test, but the generalized locally most powerful test needs larger sample sizes. In addition, the asymptotic variance of the locally most powerful test statistic must be estimated from the data. The bootstrap method avoids this problem, but needs more computational effort. The user may choose the bootstrap method and let the computer do the extra work, or choose the locally most powerful test and spend quite some time to derive the asymptotic variance for the given model.     

Test for homogeneity in Hardy–Weinberg normal mixture model

The phenotype of a quantitative trait locus (QTL) is often modeled by a finite mixture of normal distributions. If the QTL effect depends on the number of copies of a specific allele one carries, then the mixture model has three components. In this case, the mixing proportions have a binomial structure according to the Hardy–Weinberg equilibrium. In the search for QTL, a significance test of homogeneity against the Hardy–Weinberg normal mixture model alternative is an important first step. The LOD score method, a likelihood ratio test used in genetics, is a favored choice. However, there is not yet a general theory for the limiting distribution of the likelihood ratio statistic in the presence of unknown variance. This paper derives the limiting distribution of the likelihood ratio statistic, which can be described by the supremum of a quadratic form of a Gaussian process. Further, the result implies that the distribution of the modified likelihood ratio statistic is well approximated by a chi-squared distribution. Simulation results show that the approximation has satisfactory precision for the cases considered. We also give a real-data example.     

Testing for equivalence of variances using Hartley's ratio

Hartley's test for homogeneity of k normal‐distribution variances is based on the ratio between the maximum sample variance and the minimum sample variance. In this paper, the author uses the same statistic to test for equivalence of k variances. Equivalence is defined in terms of the ratio between the maximum and minimum population variances, and one concludes equivalence when Hartley's ratio is small. Exact critical values for this test are obtained by using an integral expression for the power function and some theoretical results about the power function. These exact critical values are available both when sample sizes are equal and when sample sizes are unequal. One related result in the paper is that Hartley's test for homogeneity of variances is no longer unbiased when the sample sizes are unequal. The Canadian Journal of Statistics 38: 647–664; 2010 © 2010 Statistical Society of Canada     

On bootstrapping the number of components in finite mixtures of Poisson distributions

Finite mixture models arise in a natural way in that they are modeling unobserved population heterogeneity. It is assumed that the population consists of an unknown number k of subpopulations with parameters λ₁, ..., λ_k receiving weights p₁, ..., p_k. Because of the irregularity of the parameter space, the log-likelihood-ratio statistic (LRS) does not have a (χ²) limit distribution and therefore it is difficult to use the LRS to test for the number of components. These problems are circumvented by using the nonparametric bootstrap such that the mixture algorithm is applied B times to bootstrap samples obtained from the original sample with replacement. The number of components k is obtained as the mode of the bootstrap distribution of k. This approach is presented using the Times newspaper data and investigated in a simulation study for mixtures of Poisson data.     

Testing homogeneity in a multivariate mixture model

Testing homogeneity is a fundamental problem in finite mixture models. It has been investigated by many researchers and most of the existing works have focused on the univariate case. In this article, the authors extend the use of the EM‐test for testing homogeneity to multivariate mixture models. They show that the EM‐test statistic asymptotically has the same distribution as a certain transformation of a single multivariate normal vector. On the basis of this result, they suggest a resampling procedure to approximate the P‐value of the EM‐test. Simulation studies show that the EM‐test has accurate type I errors and adequate power, and is more powerful and computationally efficient than the bootstrap likelihood ratio test. Two real data sets are analysed to illustrate the application of our theoretical results. The Canadian Journal of Statistics 39: 218–238; 2011 © 2011 Statistical Society of Canada     

A LAN based Neyman smooth test for Pareto distributions

The Pareto distribution is found in a large number of real world situations and is also a well-known model for extreme events. In the spirit of Neyman [1937. Smooth tests for goodness of fit. Skand. Aktuarietidskr. 20, 149–199] and Thomas and Pierce [1979. Neyman's smooth goodness-of-fit test when the hypothesis is composite. J. Amer. Statist. Assoc. 74, 441–445], we propose a smooth goodness of fit test for the Pareto distribution family which is motivated by LeCam's theory of local asymptotic normality (LAN). We establish the behavior of the associated test statistic firstly under the null hypothesis that the sample follows a Pareto distribution and secondly under local alternatives using the LAN framework. Finally, simulations are provided in order to study the finite sample behavior of the test statistic.     

Estimation and goodness-of-fit procedures for Farlie–Gumbel–Morgenstern bivariate copula of order statistics

In this study, we provide the Farlie–Gumbel–Morgenstern bivariate copula of rth and sth order statistics. The main emphasis in this study is on the inference procedure which is based on the maximum pseudo-likelihood estimate for the copula parameter. As for the methodology, goodness-of-fit test statistic for copulas which is based on a Cramér–von Mises functional of the empirical copula process is applied for selecting an appropriate model by bootstrapping. An application of the methodology to simulated data set is also presented.     

The Likelihood Ratio Test for the Presence of Immunes in a Censored Sample

Models for populations with immune or cured individuals but with others subject to failure are important in many areas, such as medical statistics and criminology. One method of analysis of data from such populations involves estimating an immune proportion 1 ? p and the parameter(s) of a failure distribution for those individuals subject to failure. We use the exponential distribution with parameter λ for the latter and a mixture of this distribution with a mass 1 ? p at infinity to model the complete data. This paper develops the asymptotic theory of a test for whether an immune proportion is indeed present in the population, i.e., for H ₀:p = 1. This involves testing at the boundary of the parameter space for p. We use a likelihood ratio test for H ₀. and prove that minus twice the logarithm of the likelihood ratio has as an asymptotic distribution, not the chi-square distribution, but a 50–50 mixture of a chi-square distribution with 1 degree of freedom, and a point mass at 0. The result is proved under an independent censoring assumption with very mild restrictions.     

The limit distribution of a modified Shapiro–Wilk statistic for normality to Type II censored data

The Shapiro–Wilk statistic and modified statistics are widely used test statistics for normality. They are based on regression and correlation. The statistics for the complete data can be easily generalized to the censored data. In this paper, the distribution theory for the modified Shapiro–Wilk statistic is investigated when it is generalized to Type II right censored data. As a result, it is shown that the limit distribution of the statistic can be representable as the integral of a Brownian bridge. Also, the power comparison to the other procedure is performed.     

One-Sample One-Sided Student T-Test Under Contaminants

A paradoxical behavior of the t-test under ε-contamination is presented. The paradox consists in that under a fixed distribution of contaminants an increasing of the probability of the appearance of a contaminant may decrease the violation of the size of the test! A simple explanation of the phenomenon is given. It is revealed which contaminants make the test conservative and which make it liberal: it appears that, in spite of the established opinion, conservatism or liberalism of the test depends not so much on the tails of the contaminating distribution as on where its support is located.     

A distribution free test to detect general dependence between a response variable and a covariate in the presence of heteroscedastic treatment effects

In this paper, we present a test of independence between the response variable, which can be discrete or continuous, and a continuous covariate after adjusting for heteroscedastic treatment effects. The method involves first augmenting each pair of the data for all treatments with a fixed number of nearest neighbours as pseudo‐replicates. Then a test statistic is constructed by taking the difference of two quadratic forms. The statistic is equivalent to the average lagged correlations between the response and nearest neighbour local estimates of the conditional mean of response given the covariate for each treatment group. This approach effectively eliminates the need to estimate the nonlinear regression function. The asymptotic distribution of the proposed test statistic is obtained under the null and local alternatives. Although using a fixed number of nearest neighbours pose significant difficulty in the inference compared to that allowing the number of nearest neighbours to go to infinity, the parametric standardizing rate for our test statistics is obtained. Numerical studies show that the new test procedure has robust power to detect nonlinear dependency in the presence of outliers that might result from highly skewed distributions. The Canadian Journal of Statistics 38: 408–433; 2010 © 2010 Statistical Society of Canada     

Inference of non-centrality parameter of a truncated non-central chi-squared distribution

Non-central chi-squared distribution plays a vital role in statistical testing procedures. Estimation of the non-centrality parameter provides valuable information for the power calculation of the associated test. We are interested in the statistical inference property of the non-centrality parameter estimate based on one observation (usually a summary statistic) from a truncated chi-squared distribution. This work is motivated by the application of the flexible two-stage design in case–control studies, where the sample size needed for the second stage of a two-stage study can be determined adaptively by the results of the first stage. We first study the moment estimate for the truncated distribution and prove its existence, uniqueness, and inadmissibility and convergence properties. We then define a new class of estimates that includes the moment estimate as a special case. Among this class of estimates, we recommend to use one member that outperforms the moment estimate in a wide range of scenarios. We also present two methods for constructing confidence intervals. Simulation studies are conducted to evaluate the performance of the proposed point and interval estimates.     

A p-value for testing the equivalence of the variances of a bivariate normal distribution

A p-value is developed for testing the equivalence of the variances of a bivariate normal distribution. The unknown correlation coefficient is a nuisance parameter in the problem. If the correlation is known, the proposed p-value provides an exact test. For large samples, the p-value can be computed by replacing the unknown correlation by the sample correlation, and the resulting test is quite satisfactory. For small samples, it is proposed to compute the p-value by replacing the unknown correlation by a scalar multiple of the sample correlation. However, a single scalar is not satisfactory, and it is proposed to use different scalars depending on the magnitude of the sample correlation coefficient. In order to implement this approach, tables are obtained providing sub-intervals for the sample correlation coefficient, and the scalars to be used if the sample correlation coefficient belongs to a particular sub-interval. Once such tables are available, the proposed p-value is quite easy to compute since it has an explicit analytic expression. Numerical results on the type I error probability and power are reported on the performance of such a test, and the proposed p-value test is also compared to another test based on a rejection region. The results are illustrated with two examples: an example dealing with the comparability of two measuring devices, and an example dealing with the assessment of bioequivalence.     

A test of normality using nonparametrlic residuals

In this paper, we develop a test of the normality assumption of the errors using the residuals from a nonparametric kernel regression. Contrary to the existing tests based on the residuals from a parametric regression, our test is thus robust to misspecification of the regression function. The test statistic proposed here is a Bera-Jarque type test of skewness and kurtosis. We show that the test statistic has the usual x ²(2) limit distribution under the null hypothesis. In contrast to the results of Rilstone (1992), we provide a set of primitive assumptions that allow weakly dependent observations and data dependent bandwidth parameters. We also establish consistency property of the test. Monte Carlo experiments show that our test has reasonably good size and power performance in small samples and perfornu better than some of the alternative tests in various situations.     

Improved testing for the binomial distribution using chi-squared components with data-dependent cells

A power study suggests that a good test of fit analysis for the binomial distribution is provided by a data-dependent Chernoff–Lehmann X ² test with class expectations greater than unity, and its components. These data-dependent statistics involve arithmetically simple parameter estimation, convenient approximate distributions and provide a comprehensive assessment of how well the data agree with a binomial distribution. We suggest that a well-performed single test of fit statistic is the Anderson–Darling statistic.     

Likelihood ratio test against simple stochastic ordering among several multinomial populations

Stochastic ordering between probability distributions has been widely studied in the past 50 years. Because it is often easy to make valuable judgments when such orderings exist, it is desirable to recognize their existence and to model distributional structures under them. Likelihood ratio test is the most commonly used method to test hypotheses involving stochastic orderings. Among the various formally defined notions of stochastic ordering, the least stringent is simple stochastic ordering. In this paper, we consider testing the hypothesis that all multinomial populations are identically distributed against the alternative that they are in simple stochastic ordering. We construct likelihood ratio test statistic for this hypothesis test problem, provide limit form of the objective function corresponding to the test statistic and show that the test statistic is asymptotically distributed as a mixture of chi-squared distributions, i.e., a chi-bar-squared distribution.     

Data depth‐based nonparametric scale tests

Liu and Singh (1993, 2006) introduced a depth‐based d‐variate extension of the nonparametric two sample scale test of Siegel and Tukey (1960). Liu and Singh (2006) generalized this depth‐based test for scale homogeneity of k ≥ 2 multivariate populations. Motivated by the work of Gastwirth (1965), we propose k sample percentile modifications of Liu and Singh's proposals. The test statistic is shown to be asymptotically normal when k = 2, and compares favorably with Liu and Singh (2006) if the underlying distributions are either symmetric with light tails or asymmetric. In the case of skewed distributions considered in this paper the power of the proposed tests can attain twice the power of the Liu‐Singh test for d ≥ 1. Finally, in the k‐sample case, it is shown that the asymptotic distribution of the proposed percentile modified Kruskal‐Wallis type test is χ² with k ? 1 degrees of freedom. Power properties of this k‐sample test are similar to those for the proposed two sample one. The Canadian Journal of Statistics 39: 356–369; 2011 © 2011 Statistical Society of Canada     

An L-statistic approach to a test of exponentiality against IFR alternatives

In this note we consider the problem of testing exponentiality against IFR alternatives. A measure of deviation from exponentiality is developed and a test statistic constructed on the basis of this measure. It is shown that the test statistic is an L-statistic. The asymptotic as well as the exact distribution of the test statistic is obtained and the test is shown to be consistent.