Bootstrap tests for multivariate directional alternatives

Tests on multivariate means that are hypothesized to be in a specified direction have received attention from both theoretical and applied points of view. One of the most common procedures used to test this cone alternative is the likelihood ratio test (LRT) assuming a multivariate normal model for the data. However, the resulting test for an ordered alternative is biased in that the only usable critical values are bounds on the null distribution. The present paper provides empirical evidence that bootstrapping the null distribution of the likelihood ratio statistic results in a bootstrap test (BT) with comparable power properties without the additional burden of assuming multivariate normality. Additionally, the tests based on the LRT statistic can reject the null hypothesis in favor of the alternative even though the true means are far from the alternative region. The BT also has similar properties for normal and nonnormal data. This anomalous behavior is due to the formulation of the null hypothesis and a possible remedy is to reformulate the null to be the complement of the alternative hypothesis. We discuss properties of a BT for the modified set of hypotheses (MBT) based on a simulation study. The resulting test is conservative in general and in some specific cases has power estimates comparable to those for existing methods. The BT has higher sensitivity but relatively lower specificity, whereas the MBT has higher specificity but relatively lower sensitivity.     

Testing for a finite mixture model with two components

Summary.  We consider a finite mixture model with k components and a kernel distribution from a general one-parameter family. The problem of testing the hypothesis k =2 versus k 3 is studied. There has been no general statistical testing procedure for this problem. We propose a modified likelihood ratio statistic where under the null and the alternative hypotheses the estimates of the parameters are obtained from a modified likelihood function. It is shown that estimators of the support points are consistent. The asymptotic null distribution of the modified likelihood ratio test proposed is derived and found to be relatively simple and easily applied. Simulation studies for the asymptotic modified likelihood ratio test based on finite mixture models with normal, binomial and Poisson kernels suggest that the test proposed performs well. Simulation studies are also conducted for a bootstrap method with normal kernels. An example involving foetal movement data from a medical study illustrates the testing procedure.     

A test for bivariate symmetry based on the empirical distribution function

Hollander (1970) proposed a conditionally distribution-free test of bivariate symmetry based on the empirical distribution function. In this paper Hollander’s test statistic is examined In greater detail: in particular; its conditional asymptotic distribution is derived under the null hypothesis as well as under a sequence of local alternatives. Percentage points of the asymptotic distribution are presented; a power comparison between Hollander’s statistic and the likelihood ratio criterion in testing a variant of the sphericity hypothesis in multivariate analysis is made.     

Bayesian Estimation and Model Choice in Item Response Models

Item response models are essential tools for analyzing results from many educational and psychological tests. Such models are used to quantify the probability of correct response as a function of unobserved examinee ability and other parameters explaining the difficulty and the discriminatory power of the questions in the test. Some of these models also incorporate a threshold parameter for the probability of the correct response to account for the effect of guessing the correct answer in multiple choice type tests. In this article we consider fitting of such models using the Gibbs sampler. A data augmentation method to analyze a normal-ogive model incorporating a threshold guessing parameter is introduced and compared with a Metropolis-Hastings sampling method. The proposed method is an order of magnitude more efficient than the existing method. Another objective of this paper is to develop Bayesian model choice techniques for model discrimination. A predictive approach based on a variant of the Bayes factor is used and compared with another decision theoretic method which minimizes an expected loss function on the predictive space. A classical model choice technique based on a modified likelihood ratio test statistic is shown as one component of the second criterion. As a consequence the Bayesian methods proposed in this paper are contrasted with the classical approach based on the likelihood ratio test. Several examples are given to illustrate the methods.     

Testtesting for the equality of scale parameters of k(> 2) exponential populations based on complete and type ii censored samples

This paper is concerned with testing the equality of scale parameters of K(> 2) two-parameter exponential distributions in presence of unspecified location parameters based on complete and type II censored samples. We develop a marginal likelihood ratio statistic, a quadratic statistic (Qu) (Nelson, 1982) based on maximum marginal likelihood estimates of the scale parameters under the null and the alternative hypotheses, a C(a) statistic (CPL) (Neyman, 1959) based on the profile likelihood estimate of the scale parameter under the null hypothesis and an extremal scale parameter ratio statistic (ESP) (McCool, 1979). We show that the marginal likelihood ratio statistic is equivalent to the modified Bartlett test statistic. We use Bartlett's small sample correction to the marginal likelihood ratio statistic and call it the modified marginal likelihood ratio statistic (MLB). We then compare the four statistics, MLBi Qut CPL and ESP in terms of size and power by using Monte Carlo simulation experiments. For the variety of sample sizes and censoring combinations and nominal levels considered the statistic MLB holds nominal level most accurately and based on empirically calculated critical values, this statistic performs best or as good as others in most situations. Two examples are given.     

Testing equality of generalized variances of k multivariate normal populations

Generalized variance is a measure of dispersion of multivariate data. Comparison of dispersion of multivariate data is one of the favorite issues for multivariate quality control, generalized homogeneity of multidimensional scatter, etc. In this article, the problem of testing equality of generalized variances of k multivariate normal populations by using the Bartlett's modified likelihood ratio test (BMLRT) is proposed. Simulations to compare the Type I error rate and power of the BMLRT and the likelihood ratio test (LRT) methods are performed. These simulations show that the BMLRT method has a better chi-square approximation under the null hypothesis. Finally, a practical example is given.     

A robust test for testing the correlation coefficient

A test based on Tiku's MML (modified maximum likelihood) estimators is developed for testing that the population correlation coefficient is zero. The test is compared with various other tests and shown to have good Type I error robustness and power for numerous symmetric and skew bivariate populations.     

A likelihood ratio test of quasi-independence for sparse two-way contingency tables

We consider a likelihood ratio test of independence for large two-way contingency tables having both structural (non-random) and sampling (random) zeros in many cells. The solution of this problem is not available using standard likelihood ratio tests. One way to bypass this problem is to remove the structural zeroes from the table and implement a test on the remaining cells which incorporate the randomness in the sampling zeros; the resulting test is a test of quasi-independence of the two categorical variables. This test is based only on the positive counts in the contingency table and is valid when there is at least one sampling (random) zero. The proposed (likelihood ratio) test is an alternative to the commonly used ad hoc procedures of converting the zero cells to positive ones by adding a small constant. One practical advantage of our procedure is that there is no need to know if a zero cell is structural zero or a sampling zero. We model the positive counts using a truncated multinomial distribution. In fact, we have two truncated multinomial distributions; one for the null hypothesis of independence and the other for the unrestricted parameter space. We use Monte Carlo methods to obtain the maximum likelihood estimators of the parameters and also the p-value of our proposed test. To obtain the sampling distribution of the likelihood ratio test statistic, we use bootstrap methods. We discuss many examples, and also empirically compare the power function of the likelihood ratio test relative to those of some well-known test statistics.     

Testing equality of mean vectors in a one-way MANOVA with monotone missing data

In this study, testing the equality of mean vectors in a one-way multivariate analysis of variance (MANOVA) is considered when each dataset has a monotone pattern of missing observations. The likelihood ratio test (LRT) statistic in a one-way MANOVA with monotone missing data is given. Furthermore, the modified test (MT) statistic based on likelihood ratio (LR) and the modified LRT (MLRT) statistic with monotone missing data are proposed using the decomposition of the LR and an asymptotic expansion for each decomposed LR. The accuracy of the approximation for the Chi-square distribution is investigated using a Monte Carlo simulation. Finally, an example is given to illustrate the methods.     

A Simple Test For The Independence of Sets of Variables

A test for the mutual independence of subvectors of the p-dimensional random vector X , distributed as N( 0, S? ), is described. The test is based on the maximum likelihood estimates (MLEs) of the off-(block) diagonal elements of S?. It is shown that the resulting test statistic is much easier to compute than the likelihood ratio (LR) test statistic while retaining the same asymptotic power properties in view of the general properties of tests based on the MLEs (ML test) and the likelihood ratio (LR test).     

On bias reduction estimators of skew-normal and skew-t distributions

A particular concerns of researchers in statistical inference is bias in parameters estimation. Maximum likelihood estimators are often biased and for small sample size, the first order bias of them can be large and so it may influence the efficiency of the estimator. There are different methods for reduction of this bias. In this paper, we proposed a modified maximum likelihood estimator for the shape parameter of two popular skew distributions, namely skew-normal and skew-t, by offering a new method. We show that this estimator has lower asymptotic bias than the maximum likelihood estimator and is more efficient than those based on the existing methods.     

Testing the equality of location parameters of exponential populations from censored samples

The modified Tiku test and the modified likelihood ratio test proposed by Tiku and Vaughan (1991) for k=2 exponential populations are extended to . k > 2 populations. These tests are shown to be more powerful than the test proposed by Kambo and Awad (1985). Unlike the Kambo-Awad test, the proposed tests are shown to have almost symmetric power functions. Further, these tests can be applied when there is both left or right censoring present, in contrast to the tests of Sukhatme (1937), Bain and Englehardt (1991) and Elewa et al. (1992), who assume that there is no left censoring.     

Bootstrap Bartlett correction in inflated beta regression

The inflated beta regression model aims to enable the modeling of responses in the intervals (0, 1], [0, 1), or [0, 1]. In this model, hypothesis testing is often performed based on the likelihood ratio statistic. The critical values are obtained from asymptotic approximations, which may lead to distortions of size in small samples. In this sense, this article proposes the bootstrap Bartlett correction to the statistic of likelihood ratio in the inflated beta regression model. The proposed adjustment only requires a simple Monte Carlo simulation. Through extensive Monte Carlo simulations the finite sample performance (size and power) of the proposed corrected test is compared to the usual likelihood ratio test and the Skovgaard adjustment already proposed in the literature. The numerical results evidence that inference based on the proposed correction is much more reliable than that based on the usual likelihood ratio statistics and the Skovgaard adjustment. At the end of the work, an application to real data is also presented.     

ON TESTING THE EQUALITY OF LOCATION PARAMETERS IN k CENSORED EXPONENTIAL DISTRIBUTIONS

Kumar and Patel (1971) have considered the problem of testing the equality of location parameters of two exponential distributions on the basis of samples censored from above, when the scale parameters are the same and unknown. The test proposed by them is shown to be biased for n₁≠n₂, while for n₁=n₂ the test possesses the property of monotonicity and is equivalent to the likelihood ratio test, which is considered by Epstein and Tsao (1953) and Dubey (1963a, 1963b). Epstein and Tsao state that the test is unbiased. We may note that when the scale parameters of k exponential distributions are unknown the problem of testing the equality of location parameters is reducible to that of testing the equality of parameters in k rectangular populations for which a test and its power function were given by Khatri (1960, 1965); Jaiswal (1969) considered similar problems in his thesis. Here we extend the problem of testing the equality of k exponential distributions on the basis of samples censored from above when the scale parameters are equal and unknown, and we establish the likelihood ratio test (LET) and the union-intersection test (UIT) procedures. Using the results previously derived by Jaiswal (1969), we obtain the power function for the LET and for k= 2 show that the test possesses the property of monotonicity. The power function of the UIT is also given.     

Robust estimation and testing in one-way ANOVA for Type II censored samples: skew normal error terms

Censoring can be occurred in many statistical analyses in the framework of experimental design. In this study, we estimate the model parameters in one-way ANOVA under Type II censoring. We assume that the distribution of the error terms is Azzalini's skew normal. We use Tiku's modified maximum likelihood (MML) methodology which is a modified version of the well-known maximum likelihood (ML) in the estimation procedure. Unlike ML methodology, MML methodology is non-iterative and gives explicit estimators of the model parameters. We also propose new test statistics based on the proposed estimators. The performances of the proposed estimators and the test statistics based on them are compared with the corresponding normal theory results via Monte Carlo simulation study. A real life data is analysed to show the implementation of the methodology presented in this paper at the end of the study.     

Two-way ANOVA when the distribution of the error terms is skew t

In this article, we assume that the distribution of the error terms is skew t in two-way analysis of variance (ANOVA). Skew t distribution is very flexible for modeling the symmetric and the skew datasets, since it reduces to the well-known normal, skew normal, and Student's t distributions. We obtain the estimators of the model parameters by using the maximum likelihood (ML) and the modified maximum likelihood (MML) methodologies. We also propose new test statistics based on these estimators for testing the equality of the treatment and the block means and also the interaction effect. The efficiencies of the ML and the MML estimators and the power values of the test statistics based on them are compared with the corresponding normal theory results via Monte Carlo simulation study. Simulation results show that the proposed methodologies are more preferable. We also show that the test statistics based on the ML estimators are more powerful than the test statistics based on the MML estimators as expected. However, power values of the test statistics based on the MML estimators are very close to the corresponding test statistics based on the ML estimators. At the end of the study, a real life example is given to show the implementation of the proposed methodologies.     

Multivariate Two-Sided Tests for Normal Mean Vectors Based on Approximations of Likelihood Ratio Test

Assuming that all components of a normal mean vector are simultaneously non negative or non positive, we consider a multivariate two-sided test for testing whether the normal mean vector is equal to zero or not. Since the likelihood ratio test is accompanied with theoretical and computational complications, we discuss two kinds of approximations of the likelihood ratio test. One is based on a conservative critical value determined by a certain inequality. The other is constructed by the approximation of the likelihood ratio test proposed by Tang et al. (1989). We compare the likelihood ratio test and two kinds of approximations through numerical examples regarding critical values and the power of the test.     

Empirical phi-divergence test statistics for testing simple and composite null hypotheses

The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest is defined through a specific set of unbiased estimating functions. This family of test statistics is based on a distance between two probability vectors, with the first probability vector obtained by maximizing the empirical likelihood (EL) on the vector of parameters, and the second vector defined from the fixed vector of parameters under the simple null hypothesis. The distance considered for this purpose is the phi-divergence measure. The asymptotic distribution is then derived for this family of test statistics. The proposed methodology is illustrated through the well-known data of Newcomb's measurements on the passage time for light. A simulation study is carried out to compare its performance with that of the EL ratio test when confidence intervals are constructed based on the respective statistics for small sample sizes. The results suggest that the ‘empirical modified likelihood ratio test statistic’ provides a competitive alternative to the EL ratio test statistic, and is also more robust than the EL ratio test statistic in the presence of contamination in the data. Finally, we propose empirical phi-divergence test statistics for testing a composite null hypothesis and present some asymptotic as well as simulation results for evaluating the performance of these test procedures.     

Robust multivariate analysis of variability

A general testing procedure is proposed to multivariately test for equality of p variances among k groups. The procedure applies a multivariate analysis of variance on an appropriate measure of spread for the uncensored original observations. Three such measures of spread are compared in a simulation experiment which considered two and three variables with equal and unequal sample sizes for the null and alternative hypotheses for Gaussian, Student's t (8, 12, and 20 degrees of freedom) and gamma (α=2,4,6 and 10) distributions . The likelihood ratio test (Box, 1949) was included in the above simulations. The results suggest that if one chooses a measure of spread appropriate for the distribution of the original observations, the proposed MANOVA-based testing procedure is robust and reasonably powerful. Using this procedure for the normal distribution, similar power was observed to that of the likelihood ratio test when the variables were uncorrelated or had little positive correlation.     

Seme distributions and their implications for an internal pilot study with a univariate linear model

In planning a study, the choice of sample size may depend on a variance value based on speculation or obtained from an earlier study. Scientists may wish to use an internal pilot design to protect themselves against an incorrect choice of variance. Such a design involves collecting a portion of the originally planned sample and using it to produce a new variance estimate. This leads to a new power analysis and increasing or decreasing sample size. For any general linear univariate model, with fixed predictors and Gaussian errors, we prove that the uncorrected fixed sample F-statistic is the likelihood ratio test statistic. However, the statistic does not follow an F distribution. Ignoring the discrepancy may inflate test size. We derive and evaluate properties of the components of the likelihood ratio test statistic in order to characterize and quantify the bias. Most notably, the fixed sample size variance estimate becomes biased downward. The bias may inflate test size for any hypothesis test, even if the parameter being tested was not involved in the sample size re-estimation. Furthermore, using fixed sample size methods may create biased confidence intervals for secondary parameters and the variance estimate.