A likelihood ratio test of a homoscedastic normal mixture against a heteroscedastic normal mixture

It is generally assumed that the likelihood ratio statistic for testing the null hypothesis that data arise from a homoscedastic normal mixture distribution versus the alternative hypothesis that data arise from a heteroscedastic normal mixture distribution has an asymptotic χ ² reference distribution with degrees of freedom equal to the difference in the number of parameters being estimated under the alternative and null models under some regularity conditions. Simulations show that the χ ² reference distribution will give a reasonable approximation for the likelihood ratio test only when the sample size is 2000 or more and the mixture components are well separated when the restrictions suggested by Hathaway (Ann. Stat. 13:795–800, 1985) are imposed on the component variances to ensure that the likelihood is bounded under the alternative distribution. For small and medium sample sizes, parametric bootstrap tests appear to work well for determining whether data arise from a normal mixture with equal variances or a normal mixture with unequal variances.     

Hypotheses Testing on a Multivariate Null Intercept Errors-in-Variables Model

Considering the Wald, score, and likelihood ratio asymptotic test statistics, we analyze a multivariate null intercept errors-in-variables regression model, where the explanatory and the response variables are subject to measurement errors, and a possible structure of dependency between the measurements taken within the same individual are incorporated, representing a longitudinal structure. This model was proposed by Aoki et al. (2003b Aoki , R. , Bolfarine , H. , Achcar , J. A. , Pinto Jr. , D. L. ( 2003b ). Bayesian analysis of a multivariate null intercept errors-in-variables regression model . Journal of Biopharmaceutical Statistics 13 : 767 – 775 .[Taylor & Francis Online] , [Google Scholar]) and analyzed under the bayesian approach. In this article, considering the classical approach, we analyze asymptotic test statistics and present a simulation study to compare the behavior of the three test statistics for different sample sizes, parameter values and nominal levels of the test. Also, closed form expressions for the score function and the Fisher information matrix are presented. We consider two real numerical illustrations, the odontological data set from Hadgu and Koch (1999 Hadgu , A. , Koch , G. ( 1999 ). Application of generalized estimating equations to a dental randomized clinical trial . Journal of Biopharmaceutical Statistics 9 ( 1 ): 161 – 178 .[Taylor & Francis Online] , [Google Scholar]), and a quality control data set.     

Use of the Likelihood Ratio Test on the Inverse Gaussian Distribution

In the following article, the likelihood ratio test is determined for four tests of hypotheses involving the inverse Gaussian distribution. For three of the hypotheses, the test produces the same statistic as the uniformly most powerful unbiased test.     

Testing the Lack-of-Fit of Zero-Inflated Poisson Regression Models

A zero-inflated Poisson regression model has been widely used for the effect of a covariate in count data containing many zeros with a linear predictor. To assess the adequacy of the linear relationship, we approximate the covariate effect with cubic B-splines. The semiparametric model parameters are estimated by maximizing the likelihood function through an expectation-maximization algorithm. A log-likelihood ratio test is then used to evaluate the adequacy of the linear relation. A simulation study is conducted to study the power performance of the test. A real example is provided to demonstrate the practical use of the methodology.     

Testing symmetry under a skew Laplace model

We develop tests of hypothesis about symmetry based on samples from possibly asymmetric Laplace distributions and present exact and limiting distribution of the test statistics. We postulate that the test statistic derived under the Laplace model is a rational choice as a measure of skewness and can be used in testing symmetry for other, quite general classes of skew distributions. Our results are applied to foreign exchange rates for 15 currencies.     

Multivariate Life Testing in Variably Scaled Environments

This paper examines modeling and inference questions for experiments in which different subsets of a set of k possibly dependent components are tested in r different environments. In each environment, the failure times of the set of components on test is assumed to be governed by a particular type of multivariate exponential (MVE) distribution. For any given component tested in several environments, it is assumed that its marginal failure rate varies from one environment to another via a change of scale between the environments, resulting in a joint MVE model which links in a natural way the applicable MVE distributions describing component behavior in each fixed environment. This study thus extends the work of Proschan and Sullo (1976) to multiple environments and the work of Kvam and Samaniego (1993) to dependent data. The problem of estimating model parameters via the method of maximum likelihood is examined in detail. First, necessary and sufficient conditions for the identifiability of model parameters are established. We then treat the derivation of the MLE via a numerically-augmented application of the EM algorithm. The feasibility of the estimation method is demonstrated in an example in which the likelihood ratio test of the hypothesis of equal component failure rates within any given environment is carried out.     

Testing Normality Against the Logistic Distribution Using Saddlepoint Approximation

We consider the problem of testing normality against the logistic distribution, based on a random sample of observations. Since the two families are separate (non nested), the ratio of maximized likelihoods (RML) statistic does not have the usual asymptotic chi-square distribution. We derive the saddlepoint approximation to the distribution of the RML statistic and show that this approximation is more accurate than the normal and Edgeworth approximations, especially for tail probabilities that are the main values of interest in hypothesis testing. It is also shown that this test is almost identical to the most powerful invariant test.     

Exact Likelihood Ratio Testing for Homogeneity of the Exponential Distribution

The aim of this article is to discuss homogeneity testing of the exponential distribution. We introduce the exact likelihood ratio test of homogeneity in the subpopulation model, ELR, and the exact likelihood ratio test of homogeneity against the two-components subpopulation alternative, ELR2. The ELR test is asymptotically optimal in the Bahadur sense when the alternative consists of sampling from a fixed number of components. Thus, in some setups the ELR is superior to frequently used tests for exponential homogeneity which are based on the EM algorithm (like the MLRT, ADDS, and D-tests). One important example of superiority of ELR and ELR2 tests is the case of lower contamination. We demonstrate this fact by both theoretical comparisons and simulations.     

Simplified Likelihood Based Goodness-of-fit Tests for the Weibull Distribution

The aim of this paper is to present new likelihood based goodness-of-fit tests for the two-parameter Weibull distribution. These tests consist in nesting the Weibull distribution in three-parameter generalized Weibull families and testing the value of the third parameter by using the Wald, score, and likelihood ratio procedures. We simplify the usual likelihood based tests by getting rid of the nuisance parameters, using three estimation methods. The proposed tests are not asymptotic. A comprehensive comparison study is presented. Among a large range of possible GOF tests, the best ones are identified. The results depend strongly on the shape of the underlying hazard rate.     

Discordancy Tests Based on the Likelihood Ratio for the Bipolar Watson Distribution on the Hypersphere

As the Watson distribution is frequently used for modeling axial data, it is important to investigate the existence of possible outliers in samples from this distribution. Then, we develop for the bipolar Watson distribution defined on the hypersphere, some tests of discordancy of an outlier or several outliers en bloc based on the likelihood ratio, supposing an alternative model of contamination of slippage type. We evaluate the performance of these tests of discordancy of an outlier and we also compare some tests of discordancy of an outlier available for this distribution.     

Testing for the Presence of a Maverick Judge

Abstract

The presence of a maverick judge, one whose rankings differ greatly from the other members of a panel, can result in incorrect rankings and a sense of unfairness among contestants. We develop and explore the properties of a likelihood ratio test, assuming a Mallows type distribution, for the presence of a maverick judge when each judge selects his or her best k out of n objects, k ≤ n. Detection of a maverick judge, who may be viewed as a multivariate outlier, turns out to be very difficult unless the judges are very consistent and there are repeat observations on the panel.     

An Approximation for the Test of the Equality of the Smallest Eigenvalues of a Covariance Matrix

A limiting distribution of the likelihood ratio statistic for the test of the equality of the q smallest eigenvalues of a covariance matrix is obtained. This distribution can be used as an alternative to the chi-squared distribution which is usually used with this test. It is shown that this new method yields reasonable significance levels for those situations in which the chi-squared approximation is inadequate.     

A test of the missing data mechanism for repeated measures data

The occurrence of missing data is an often unavoidable consequence of repeated measures studies. Fortunately, multivariate general linear models such as growth curve models and linear mixed models with random effects have been well developed to analyze incomplete normally-distributed repeated measures data. Most statistical methods have assumed that the missing data occur at random. This assumption may include two types of missing data mechanism: missing completely at random (MCAR) and missing at random (MAR) in the sense of Rubin (1976). In this paper, we develop a test procedure for distinguishing these two types of missing data mechanism for incomplete normally-distributed repeated measures data. The proposed test is similar in spiril to the test of Park and Davis (1992). We derive the test for incomplete normally-distribrlted repeated measures data using linear mixed models. while Park and Davis (1992) cleirved thr test for incomplete repeatctl categorical data in the framework of Grizzle Starmer. and Koch (1969). Thr proposed procedure can be applied easily to any other multivariate general linear model which allow for missing data. The test is illustrated using the hip-replacernent patient.data from Crowder and Hand (1990).     

Testing homogeneity in a multivariate mixture model

Testing homogeneity is a fundamental problem in finite mixture models. It has been investigated by many researchers and most of the existing works have focused on the univariate case. In this article, the authors extend the use of the EM‐test for testing homogeneity to multivariate mixture models. They show that the EM‐test statistic asymptotically has the same distribution as a certain transformation of a single multivariate normal vector. On the basis of this result, they suggest a resampling procedure to approximate the P‐value of the EM‐test. Simulation studies show that the EM‐test has accurate type I errors and adequate power, and is more powerful and computationally efficient than the bootstrap likelihood ratio test. Two real data sets are analysed to illustrate the application of our theoretical results. The Canadian Journal of Statistics 39: 218–238; 2011 © 2011 Statistical Society of Canada     

Testing the equality of quantiles for several normal populations

Many procedures exist for testing equality of means or medians to compare several independent distributions. However, the mean or median do not determine the entire distribution. In this article, we propose a new small-sample modification of the likelihood ratio test for testing the equality of the quantiles of several normal distributions. The merits of the proposed test are numerically compared with the existing tests—a generalized p-value method and likelihood ratio test—with respect to their sizes and powers. The simulation results demonstrate that proposed method is satisfactory; its actual size is very close to the nominal level. We illustrate these approaches using two real examples.     

A New Discrete Distribution Related to Generalized Gamma Distribution and Its Properties

In this article, a new discrete distribution related to the generalized gamma distribution (Stacy, 1962) is derived from a statistical mechanical setup. This new distribution can be seen as generalization of two-parameter discrete gamma distribution (Chakraborty and Chakravarty, 2012) and encompasses discrete version of many important continuous distributions. Some basic distributional and reliability properties, parameter estimation by different methods, and their comparative performances using simulation are investigated. Two-real life data sets are considered for data modeling and likelihood ratio test for illustrating the advantages of the proposed distribution over two-parameter discrete gamma distribution.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

ABSTRACT

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993 Nawata , K. ( 1993 ). A note on the estimation of models with sample-selection biases . Economics Letters 42 : 15 – 24 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) is severe, (i) the t-test based on the Heckman–Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996 Leung , S. F. , Yu , S. ( 1996 ). On the choice between sample selection and two-part models . Journal of Econometrics 72 : 197 – 229 . [CSA] [CROSSREF] [Crossref], [Web of Science ®] , [Google Scholar]) that the standard regression-based t-test (Heckman, 1979 Heckman , J. J. ( 1979 ). Sample selection bias as a specification error . Econometrica 47 : 153 – 161 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982 Melino , A. ( 1982 ). Testing for sample selection bias . Review of Economic Studies 49 : 151 – 153 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]), are robust to nonnormality but have very little power.     

On Testing Sample Selection Bias Under the Multicollinearity Problem

This paper reviews and extends the literature on the finite sample behavior of tests for sample selection bias. Monte Carlo results show that, when the “multicollinearity problem” identified by Nawata (1993) is severe, (i) the t-test based on the Heckman-Greene variance estimator can be unreliable, (ii) the Likelihood Ratio test remains powerful, and (iii) nonnormality can be interpreted as severe sample selection bias by Maximum Likelihood methods, leading to negative Wald statistics. We also confirm previous findings (Leung and Yu, 1996) that the standard regression-based t-test (Heckman, 1979) and the asymptotically efficient Lagrange Multiplier test (Melino, 1982), are robust to nonnormality but have very little power.     

An alternative competing risk model to the Weibull distribution for modelling aging in lifetime data analysis

A simple competing risk distribution as a possible alternative to the Weibull distribution in lifetime analysis is proposed. This distribution corresponds to the minimum between exponential and Weibull distributions. Our motivation is to take account of both accidental and aging failures in lifetime data analysis. First, the main characteristics of this distribution are presented. Then, the estimation of its parameters are considered through maximum likelihood and Bayesian inference. In particular, the existence of a unique consistent root of the likelihood equations is proved. Decision tests to choose between an exponential, Weibull and this competing risk distribution are presented. And this alternative model is compared to the Weibull model from numerical experiments on both real and simulated data sets, especially in an industrial context.