The likelihood ratio test for homogeneity in finite mixture models

The authors study the asymptotic behaviour of the likelihood ratio statistic for testing homogeneity in the finite mixture models of a general parametric distribution family. They prove that the limiting distribution of this statistic is the squared supremum of a truncated standard Gaussian process. The autocorrelation function of the Gaussian process is explicitly presented. A re‐sampling procedure is recommended to obtain the asymptotic p‐value. Three kernel functions, normal, binomial and Poisson, are used in a simulation study which illustrates the procedure.     

Testing Homogeneity in Gamma Mixture Models

This paper characterizes the asymptotic behaviour of the likelihood ratio test statistic (LRTS) for testing homogeneity (i.e. no mixture) against gamma mixture alternatives. Under the null hypothesis, the LRTS is shown to be asymptotically equivalent to the square of Davies's Gaussian process test statistic and diverges at a log n rate to infinity in probability. Based on the asymptotic analysis, we propose and demonstrate a computationally efficient method to simulate the null distributions of the LRTS for small to moderate sample sizes.     

On the use of priors in goodness‐of‐fit tests

Priors are introduced into goodness‐of‐fit tests, both for unknown parameters in the tested distribution and on the alternative density. Neyman–Pearson theory leads to the test with the highest expected power. To make the test practical, we seek priors that make it likely a priori that the power will be larger than the level of the test but not too close to one. As a result, priors are sample size dependent. We explore this procedure in particular for priors that are defined via a Gaussian process approximation for the logarithm of the alternative density. In the case of testing for the uniform distribution, we show that the optimal test is of the U‐statistic type and establish limiting distributions for the optimal test statistic, both under the null hypothesis and averaged over the alternative hypotheses. The optimal test statistic is shown to be of the Cramér–von Mises type for specific choices of the Gaussian process involved. The methodology when parameters in the tested distribution are unknown is discussed and illustrated in the case of testing for the von Mises distribution. The Canadian Journal of Statistics 47: 560–579; 2019 © 2019 Statistical Society of Canada     

Test for homogeneity in Hardy–Weinberg normal mixture model

The phenotype of a quantitative trait locus (QTL) is often modeled by a finite mixture of normal distributions. If the QTL effect depends on the number of copies of a specific allele one carries, then the mixture model has three components. In this case, the mixing proportions have a binomial structure according to the Hardy–Weinberg equilibrium. In the search for QTL, a significance test of homogeneity against the Hardy–Weinberg normal mixture model alternative is an important first step. The LOD score method, a likelihood ratio test used in genetics, is a favored choice. However, there is not yet a general theory for the limiting distribution of the likelihood ratio statistic in the presence of unknown variance. This paper derives the limiting distribution of the likelihood ratio statistic, which can be described by the supremum of a quadratic form of a Gaussian process. Further, the result implies that the distribution of the modified likelihood ratio statistic is well approximated by a chi-squared distribution. Simulation results show that the approximation has satisfactory precision for the cases considered. We also give a real-data example.     

Change point analysis of a Gaussian model

In this paper, the testing and estimation of a single change point in means and variances of a sequence of independent Gaussian normal random variables are studied. The Schwarz Information Criterion, SIC, is used to search for the change point. The unbiased version of the SIC for this change point problem is also derived for the finite sample case. Other properties of the SIC test statistic are given as well. Finally, two examples are given at the end of this paper to illustrate the method proposed, and changes are successfully detected.     

Variables acceptance reliability sampling plan for items subject to inverse Gaussian degradation process

Until now, in the literature, a variety of acceptance reliability sampling plans have been developed based on different life test plans. In most of the reliability sampling plans, the decision procedures to accept or reject the corresponding lot are developed based on the lifetimes of the items observed on tests, or the number of failures observed during a pre-specified testing time. However, frequently, the items are subject to degradation phenomena and, in these cases, the observed degradation level of the item can be used as a decision statistic. In this paper, we develop a variables acceptance sampling plan based on the information on the degradation process of the items, assuming that the degradation process follows the inverse Gaussian process. It is shown that the developed sampling plan improves the reliability performance of the items conditional on the acceptance in the test and that the lifetimes of items after the reliability sampling test are stochastically larger than those before the test. A study comparing the proposed degradation-based sampling plan with the conventional sampling plan which is based on a life test is also performed.KEYWORDS: Variables sampling plan, degradation test, inverse Gaussian process, mixture distribution, stochastic ordering     

Change-Point Tests for the Error Distribution in Non-parametric Regression

Abstract.  Several testing procedures are proposed that can detect change-points in the error distribution of non-parametric regression models. Different settings are considered where the change-point either occurs at some time point or at some value of the covariate. Fixed as well as random covariates are considered. Weak convergence of the suggested difference of sequential empirical processes based on non-parametrically estimated residuals to a Gaussian process is proved under the null hypothesis of no change-point. In the case of testing for a change in the error distribution that occurs with increasing time in a model with random covariates the test statistic is asymptotically distribution free and the asymptotic quantiles can be used for the test. This special test statistic can also detect a change in the regression function. In all other cases the asymptotic distribution depends on unknown features of the data-generating process and a bootstrap procedure is proposed in these cases. The small sample performances of the proposed tests are investigated by means of a simulation study and the tests are applied to a data example.     

Generalized portmanteau statistics and tests of randomness

This paper considers the problem of testing the randomness of Gaussian and non–Gaussian time series. A general class of parametric portmanteau statistics, which include the Box–Pierce and the Ljung–Box statistics, is introduced. Using the exact first and second moments of the sample autocorrelations when the observations are i.i.d. normal with unknown mean, the exact expected value of any portmanteau statistics is obtained for this case. Two new portmanteau statistics, which exploit the exact moments of the sample autocorrelations, are studied. For the nonparametric case, a rank portmanteau statistic is introduced. The latter has the same distribution for any series of exchangeable random variables and uses the exact moments of the rank autocorrelations. We show that its asymptotic distribution is chi–squate. Simulation results indicate that the new portmanteau statistics are better approximated by the chi–square asymptotic distribution than the Ljung–Box statistics. Several analytical results presented in the paper were derived by usig a symbolic manipulation program.     

ON TESTING THE GOODNESS-OF-FIT OF NONLINEAR HETEROSCEDASTIC REGRESSION MODELS

For testing the adequacy of a parametric model in regression, various test statistics can be constructed on the basis of a marked empirical process of residuals. By using a discretized version of the decomposition of the corresponding Gaussian limiting process into its principal components, we obtain a test statistic with an asymptotic chi-squared distribution under the null hypothesis. We investigate the consistency of this test statistic and of the estimators needed to compute it. Numerical experiments indicate that the distributional approximations already work for small to moderate sample sizes and reveal that the test has good power properties against a variety of alternatives. The test has a simple implementation. We present an application to a real-data example for testing the adequacy of a possible heteroscedastic exponential model.     

On testing structure of mean vector of compound symmetric gaussian model

In this paper the moments of the likelihood ratio statistic for testing the structure of mean vector of a compound symmetric Gaussian model, have been derived by using the orthogonal transformation of variables. Then the distribution of the test statistic is studied.     

An affine‐invariant multivariate sign test for cluster correlated data

The author presents a multivariate location model for cluster correlated observations. He proposes an affine‐invariant multivariate sign statistic for testing the value of the location parameter. His statistic is an adaptation of that proposed by Randles (2000). The author shows, under very mild conditions, that his test statistic is asymptotically distributed as a chi‐squared random variable under the null hypothesis. In particular, the test can be used for skewed populations. In the context of a general multivariate normal model, the author obtains values of his test's Pitman asymptotic efficiency relative to another test based on the overall average. He shows that there is an improvement in the relative performance of the new test as soon as intra‐cluster correlation is present Even in the univariate case, the new test can be very competitive for Gaussian data. Furthermore, the statistic is easy to compute, even for large dimensional data. The author shows through simulations that his test performs well compared to the average‐based test. He illustrates its use with real data.     

Cressie–Read Power-Divergence Statistics for Non-Gaussian Vector Stationary Processes

Abstract.  For a class of vector-valued non-Gaussian stationary processes, we develop the Cressie–Read power-divergence (CR) statistic approach which has been proposed for the i.i.d. case. The CR statistic includes empirical likelihood as a special case. Therefore, by adopting this CR statistic approach, the theory of estimation and testing based on empirical likelihood is greatly extended. We use an extended Whittle likelihood as score function and derive the asymptotic distribution of the CR statistic. We apply this result to estimation of autocorrelation and the AR coefficient, and get narrower confidence intervals than those obtained by existing methods. We also consider the power properties of the test based on asymptotic theory. Under a sequence of contiguous local alternatives, we derive the asymptotic distribution of the CR statistic. The problem of testing autocorrelation is discussed and we introduce some interesting properties of the local power.     

Improved robust Bayes estimators of the error variance in linear models

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of Gaussians including the particularly important case of the multivariate-t distribution. Under Stein's loss, we construct a class of estimators that improve on the usual best unbiased (and best equivariant) estimator. Our class has the interesting double robustness property of being simultaneously generalized Bayes (for the same generalized prior) and minimax over the entire class of scale mixture of Gaussian distributions.     

Asymptotic test of mixture model and its applications to QTL interval mapping

Quantitative trait loci (QTL) mapping has been a standard means in identifying genetic regions harboring potential genes underlying complex traits. Likelihood ratio test (LRT) has been commonly applied to assess the significance of a genetic locus in a mixture model content. Given the time constraint in commonly used permutation tests to assess the significance of LRT in QTL mapping, we study the behavior of the LRT statistic in mixture model when the proportions of the distributions are unknown. We found that the asymptotic null distribution is stationary Gaussian process after suitable transformation. The result can be applied to one-parameter exponential family mixture model. Under certain condition, such as in a backcross mapping model, the tail probability of the supremum of the process is calculated and the threshold values can be determined by solving the distribution function. Simulation studies were performed to evaluate the asymptotic results.     

Finding Relevant Linear Manifolds in Classification by Gaussian Mixtures

In this article, we present a strategy for producing low-dimensional projections that maximally separate the classes in Gaussian Mixture Model classification. The most revealing linear manifolds are those along which the classes are maximally separable. Here we consider a particular probability product kernel as a measure of similarity or affinity between the class-conditional distributions. It takes an appealing closed analytical form in the case of Gaussian mixture components. The performance of the proposed strategy has been evaluated on real data.     

Likelihood ratio test against simple stochastic ordering among several multinomial populations

Stochastic ordering between probability distributions has been widely studied in the past 50 years. Because it is often easy to make valuable judgments when such orderings exist, it is desirable to recognize their existence and to model distributional structures under them. Likelihood ratio test is the most commonly used method to test hypotheses involving stochastic orderings. Among the various formally defined notions of stochastic ordering, the least stringent is simple stochastic ordering. In this paper, we consider testing the hypothesis that all multinomial populations are identically distributed against the alternative that they are in simple stochastic ordering. We construct likelihood ratio test statistic for this hypothesis test problem, provide limit form of the objective function corresponding to the test statistic and show that the test statistic is asymptotically distributed as a mixture of chi-squared distributions, i.e., a chi-bar-squared distribution.     

Bootstrap tests for variance components in generalized linear mixed models

In many applications of generalized linear mixed models to clustered correlated or longitudinal data, often we are interested in testing whether a random effects variance component is zero. The usual asymptotic mixture of chi‐square distributions of the score statistic for testing constrained variance components does not necessarily hold. In this article, the author proposes and explores a parametric bootstrap test that appears to be valid based on its estimated level of significance under the null hypothesis. Results from a simulation study indicate that the bootstrap test has a level much closer to the nominal one while the asymptotic test is conservative, and is more powerful than the usual asymptotic score test based on a mixture of chi‐squares. The proposed bootstrap test is illustrated using two sets of real‐life data obtained from clinical trials. The Canadian Journal of Statistics © 2009 Statistical Society of Canada     

Generalized likelihood-ratio test of the number of components in finite mixture models

The number of components is an important feature in finite mixture models. Because of the irregularity of the parameter space, the log-likelihood-ratio statistic does not have a chi-square limit distribution. It is very difficult to find a test with a specified significance level, and this is especially true for testing k — 1 versus k components. Most of the existing work has concentrated on finding a comparable approximation to the limit distribution of the log-likelihood-ratio statistic. In this paper, we use a statistic similar to the usual log likelihood ratio, but its null distribution is asymptotically normal. A simulation study indicates that the method has good power at detecting extra components. We also discuss how to improve the power of the test, and some simulations are performed.     

Large Deviation Results for Statistics of Short- and Long-memory Gaussian Processes

This paper discusses the large deviation principle of several important statistics for short- and long-memory Gaussian processes. First, large deviation theorems for the log-likelihood ratio and quadratic forms for a short-memory Gaussian process with mean function are proved. Their asymptotics are described by the large deviation rate functions. Since they are complicated, they are numerically evaluated and illustrated using the Maple V system (Char et al ., 1991a,b). Second, the large deviation theorem of the log-likelihood ratio statistic for a long-memory Gaussian process with constant mean is proved. The asymptotics of the long-memory case differ greatly from those of the short-memory case. The maximum likelihood estimator of a spectral parameter for a short-memory Gaussian stationary process is asymptotically efficient in the sense of Bahadur.     

Wald检验不一致性的微分几何解释及改进

Wald检验对于等价的零假设中不同形式的表达式在有限样本的情况下缺乏一致性,而从微分几何的角度来解释这一现象,并发现由于Wald统计量是一个混杂的不恰当的几何量,从而对不同的含参数的等价表达式不具有一致性。同时还展示了芬斯拉（Finsler）测地统计量如何能较为简便的计算出来、它在线性回归模型中的非线性约束条件下如何应用以及两者在什么情况下保持一致,并提出了一种解决Wald检验不一致性的思路。