Improved small sample inference in the mixed linear model: Bartlett correction and adjusted likelihood

The mixed linear model is a popular method for analysing unbalanced repeated measurement data. The classical statistical tests for parameters in this model are based on asymptotic theory that is unreliable in the small samples that are often encountered in practice. For testing a given fixed effect parameter with a small sample, we develop and investigate refined likelihood ratio (LR) tests. The refinements considered are the Bartlett correction and use of the Cox–Reid adjusted likelihood; these are examined separately and in combination. We illustrate the various LR tests on an actual data set and compare them in two simulation studies. The conventional LR test yields type I error rates that are higher than nominal. The adjusted LR test yields rates that are lower than nominal, with absolute accuracy similar to that of the conventional LR test in the first simulation study and better in the second. The Bartlett correction substantially improves the accuracy of the type I error rates with either the conventional or the adjusted LR test. In many cases, error rates that are very close to nominal are achieved with the refined methods.     

A monte carlo study of the wald,lm, and lr tests in a heteroscedastic linear model

In this paper, we examine by Monte Carlo experiments the small sample properties of the W (Wald), LM (Lagrange Multiplier) and LR (Likelihood Ratio) tests for equality between sets of coefficients in two linear regressions under heteroscedasticity. The small sample properties of the size-corrected W, LM and LR tests proposed by Rothenberg (1984) are also examined and it is shown that the performances of the size-corrected W and LM tests are very good. Further, we examine the two-stage test which consists of a test for homoscedasticity followed by the Chow (1960) test if homoscedasticity is indicated or one of the W, LM or LR tests if heteroscedasticity should be assumed. It is shown that the pretest does not reduce much the bias in the size when the sizecorrected citical values are used in the W, LM and LR tests.     

面板数据单位根似然比检验研究

本文采用似然比类检验统计量进行面板单位根检验（简称为LR检验）研究,在局部备择假设成立的条件下,推导了其在无确定项、仅含截距项以及存在线性时间趋势项三种模型下所对应的渐近分布与局部渐近势函数。Monte Carlo模拟结果显示,当面板数据中含确定项（截距项或时间趋势项）时,LR检验水平比LLC和IPS检验水平更接近于给定的显著性检验水平;此外,当面板数据中包含发散个体时,经水平修正后的LR检验势要远远高于经水平修正后的LLC与IPS检验势,其中,经水平修正后的LLC与IPS检验势接近于零。     

The effect of number of clusters and cluster size on statistical power and Type I error rates when testing random effects variance components in multilevel linear and logistic regression models

When using multilevel regression models that incorporate cluster-specific random effects, the Wald and the likelihood ratio (LR) tests are used for testing the null hypothesis that the variance of the random effects distribution is equal to zero. We conducted a series of Monte Carlo simulations to examine the effect of the number of clusters and the number of subjects per cluster on the statistical power to detect a non-null random effects variance and to compare the empirical type I error rates of the Wald and LR tests. Statistical power increased with increasing number of clusters and number of subjects per cluster. Statistical power was greater for the LR test than for the Wald test. These results applied to both the linear and logistic regressions, but were more pronounced for the latter. The use of the LR test is preferable to the use of the Wald test.     

Asymptotic power comparison of T2-type test and likelihood ratio test for a mean vector based on two-step monotone missing data

Abstract

In a 2-step monotone missing dataset drawn from a multivariate normal population, T²-type test statistic (similar to Hotelling’s T² test statistic) and likelihood ratio (LR) are often used for the test for a mean vector. In complete data, Hotelling’s T² test and LR test are equivalent, however T²-type test and LR test are not equivalent in the 2-step monotone missing dataset. Then we interest which statistic is reasonable with relation to power. In this paper, we derive asymptotic power function of both statistics under a local alternative and obtain an explicit form for difference in asymptotic power function. Furthermore, under several parameter settings, we compare LR and T²-type test numerically by using difference in empirical power and in asymptotic power function. Summarizing obtained results, we recommend applying LR test for testing a mean vector.     

Bootstrap LR tests of stationarity,common trends and cointegration

This paper considers the likelihood ratio (LR) tests of stationarity, common trends and cointegration for multivariate time series. As the distribution of these tests is not known, a bootstrap version is proposed via a state- space representation. The bootstrap samples are obtained from the Kalman filter innovations under the null hypothesis. Monte Carlo simulations for the Gaussian univariate random walk plus noise model show that the bootstrap LR test achieves higher power for medium-sized deviations from the null hypothesis than a locally optimal and one-sided Lagrange Multiplier (LM) test that has a known asymptotic distribution. The power gains of the bootstrap LR test are significantly larger for testing the hypothesis of common trends and cointegration in multivariate time series, as the alternative asymptotic procedure – obtained as an extension of the LM test of stationarity – does not possess properties of optimality. Finally, it is shown that the (pseudo-)LR tests maintain good size and power properties also for the non-Gaussian series. An empirical illustration is provided.     

Testing for normality in linear regression models

The importance of the normal distribution for fitting continuous data is well known. However, in many practical situations data distribution departs from normality. For example, the sample skewness and the sample kurtosis are far away from 0 and 3, respectively, which are nice properties of normal distributions. So, it is important to have formal tests of normality against any alternative. D'Agostino et al. [A suggestion for using powerful and informative tests of normality, Am. Statist. 44 (1990), pp. 316–321] review four procedures Z ²(g ₁), Z ²(g ₂), D and K ² for testing departure from normality. The first two of these procedures are tests of normality against departure due to skewness and kurtosis, respectively. The other two tests are omnibus tests. An alternative to the normal distribution is a class of skew-normal distributions (see [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]). In this paper, we obtain a score test (W) and a likelihood ratio test (LR) of goodness of fit of the normal regression model against the skew-normal family of regression models. It turns out that the score test is based on the sample skewness and is of very simple form. The performance of these six procedures, in terms of size and power, are compared using simulations. The level properties of the three statistics LR, W and Z ²(g ₁) are similar and close to the nominal level for moderate to large sample sizes. Also, their power properties are similar for small departure from normality due to skewness (γ₁≤0.4). Of these, the score test statistic has a very simple form and computationally much simpler than the other two statistics. The LR statistic, in general, has highest power, although it is computationally much complex as it requires estimates of the parameters under the normal model as well as those under the skew-normal model. So, the score test may be used to test for normality against small departure from normality due to skewness. Otherwise, the likelihood ratio statistic LR should be used as it detects general departure from normality (due to both skewness and kurtosis) with, in general, largest power.     

Testing for multivariate heteroscedasticity

In this article, we propose a testing technique for multivariate heteroscedasticity, which is expressed as a test of linear restrictions in a multivariate regression model. Four test statistics with known asymptotical null distributions are suggested, namely the Wald, Lagrange multiplier (LM), likelihood ratio (LR) and the multivariate Rao F-test. The critical values for the statistics are determined by their asymptotic null distributions, but bootstrapped critical values are also used. The size, power and robustness of the tests are examined in a Monte Carlo experiment. Our main finding is that all the tests limit their nominal sizes asymptotically, but some of them have superior small sample properties. These are the F, LM and bootstrapped versions of Wald and LR tests.     

Comparison of exact tests for association in unordered contingency tables using standard,mid-p,and randomized test versions

Pearson’s chi-square (Pe), likelihood ratio (LR), and Fisher (Fi)–Freeman–Halton test statistics are commonly used to test the association of an unordered r×c contingency table. Asymptotically, these test statistics follow a chi-square distribution. For small sample cases, the asymptotic chi-square approximations are unreliable. Therefore, the exact p-value is frequently computed conditional on the row- and column-sums. One drawback of the exact p-value is that it is conservative. Different adjustments have been suggested, such as Lancaster’s mid-p version and randomized tests. In this paper, we have considered 3×2, 2×3, and 3×3 tables and compared the exact power and significance level of these test’s standard, mid-p, and randomized versions. The mid-p and randomized test versions have approximately the same power and higher power than that of the standard test versions. The mid-p type-I error probability seldom exceeds the nominal level. For a given set of parameters, the power of Pe, LR, and Fi differs approximately the same way for standard, mid-p, and randomized test versions. Although there is no general ranking of these tests, in some situations, especially when averaged over the parameter space, Pe and Fi have the same power and slightly higher power than LR. When the sample sizes (i.e., the row sums) are equal, the differences are small, otherwise the observed differences can be 10% or more. In some cases, perhaps characterized by poorly balanced designs, LR has the highest power.     

Performance of the shrinkage preliminary test ridge regression estimators based on the conflicting of W,LR and LM tests

The shrinkage preliminary test ridge regression estimators (SPTRRE) based on the Wald (W), the likelihood ratio (LR) and the Lagrangian multiplier (LM) tests are considered in this paper. The bias and the risk functions of the proposed estimators are derived. The regions of optimality of the estimators are determined under the quadratic risk function. Under the null hypothesis, the SPTRRE based on LM test has the smallest risk, followed by the estimators based on LR and W tests. However, the SPTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimator for both ridge and departure parameters are discussed. The optimum choice of the level of significance becomes the traditional choice by using the W test for all non-negative ridge parameters.     

Tests for cointegration rank and choice of the alternative

This paper discusses likelihood-ratio (LR) tests on the cointegrating (CI) rank which consider any possible dimension of the CI rank under the alternative. The trace test and lambda-max test are obtained as special cases. Limit quantiles for all the tests in the class are derived. It is found that any of these tests can be used to construct an estimator of the CI rank, with no differences in asymptotic properties when the alternative is fixed. The properties of the class of tests are investigated by local asymptotic analysis, a simulation study and an empirical illustration. It is found that all the tests in the class have comparable power, which deteriorates substantially as the number of random walks increases. Tests constructed for a specific class of alternatives present minor power gains for alternatives in the class, and require the alternative to be far from the null. No test in this class is found to be asymptotically (in-)admissible. Some of the new tests in the class can also be arranged to give a constrained estimator of the CI rank, that restricts the minimum number of common trends. The power gains that these tests can obtain by constraining the minimum number of common trends appears to be limited and outweighted by the risk of inconsistency induced by the constrains. As a consequence, no value of the CI rank should be left untested, unless it can be excluded beyond any reasonable doubt.     

Multivariate testing and model-checking for generalized order statistics with applications

The exponential family structure of the joint distribution of generalized order statistics is utilized to establish multivariate tests on the model parameters. For simple and composite null hypotheses, the likelihood ratio test (LR test), Wald's test, and Rao's score test are derived and turn out to have simple representations. The asymptotic distribution of the corresponding test statistics under the null hypothesis is stated, and, in case of a simple null hypothesis, asymptotic optimality of the LR test is addressed. Applications of the tests are presented; in particular, we discuss their use in reliability, and to decide whether a Poisson process is homogeneous. Finally, a power study is performed to measure and compare the quality of the tests for both, simple and composite null hypotheses.     

Empirical Study of Six Tests for Equality of Populations with Zero-Inflated Continuous Distributions

We evaluated the properties of six statistical methods for testing equality among populations with zero-inflated continuous distributions. These tests are based on likelihood ratio (LR), Wald, central limit theorem (CLT), modified CLT (MCLT), parametric jackknife (PJ), and nonparametric jackknife (NPJ) statistics. We investigated their statistical properties using simulated data from mixed distributions with an unknown portion of non zero observations that have an underlying gamma, exponential, or log-normal density function and the remaining portion that are excessive zeros. The 6 statistical tests are compared in terms of their empirical Type I errors and powers estimated through 10,000 repeated simulated samples for carefully selected configurations of parameters. The LR, Wald, and PJ tests are preferred tests since their empirical Type I errors were close to the preset nominal 0.05 level and each demonstrated good power for rejecting null hypotheses when the sample sizes are at least 125 in each group. The NPJ test had unacceptable empirical Type I errors because it rejected far too often while the CLT and MCLT tests had low testing powers in some cases. Therefore, these three tests are not recommended for general use but the LR, Wald, and PJ tests all performed well in large sample applications.     

The use of temporally aggregated data on detecting a mean change of a time series process

In this article we investigate the effects of temporal aggregation on testing for a mean change of time series through a likelihood ratio (LR) test. We derive the functional relationship between non aggregate-model parameters and aggregate-model parameters. Using the relationship, we propose a modified LR test when aggregate data are used. Through the theory, Monte Carlo simulations, and empirical examples, we show that aggregation leads the null distribution of the LR test statistic being shifted to the left. Hence, the test power increases as the order of aggregation increases.     

Improved hypothesis testing in a general multivariate elliptical model

This paper investigates improved testing inferences under a general multivariate elliptical regression model. The model is very flexible in terms of the specification of the mean vector and the dispersion matrix, and of the choice of the error distribution. The error terms are allowed to follow a multivariate distribution in the class of the elliptical distributions, which has the multivariate normal and Student-t distributions as special cases. We obtain Skovgaard's adjusted likelihood ratio (LR) statistics and Barndorff-Nielsen's adjusted signed LR statistics and we compare the methods through simulations. The simulations suggest that the proposed tests display superior finite sample behaviour as compared to the standard tests. Two applications are presented in order to illustrate the methods.     

Likelihood Ratio Tests for the Non Equivalence of Means

We derive likelihood ratio (LR) tests for the null hypothesis of equivalence that the normal means fall into a practical indifference zone. The LR test can easily be constructed and applied to k ≥ 2 treatments. Simulation results indicate that the LR test might be slightly anticonservative statistically, but when the sample sizes are large, it always produces the nominal level for mean configurations under the null hypothesis. More powerful than the studentized range test, the LR test is a straightforward application that requires only current existing statistical tables, with no complicated computations.     

Extended complex error correction models for seasonal cointegration

In this paper, we extend the complex error correction model (ECM) of [Cubadda, G. (2001). Complex reduced rank models for seasonally cointegrated time series. Oxford Bulletin of Economics and Statistics, 63, 497–511] to models with two types of deterministic terms: (i) restricted seasonal dummies and constant; (ii) restricted seasonal dummies and unrestricted constant. These types of deterministic terms are most frequently adopted in the analysis of seasonal cointegration by many practitioners and researchers, because the other type–where all seasonal dummies and constant terms are unrestricted–may yield oscillating trends. We obtain the limiting distribution of the likelihood ratio (LR) test for the seasonal cointegrating (CI) rank in the extended models. We also provide asymptotic and finite critical values for the test.     

Behrens-fisher problem under the assumption of homogeneous coefficients of variation

The powers of the likelihood ratio (LR) test and an “asymptotically (in some sense) optimum” invariant test are examined and compared by simulation techniques with those of several other relevant tests for the problem of testing the equality of two univariate normal population means under the assumption of heterogeneous variances but homogeneous coefficients of variation. It is seen that the LR test is highly satisfactory for all values of the coefficient of variation and the “asymptotically optimum” invariant test, which is computationally much simpler than the LR test, is a reasonably good competitor for cases where the value of the coefficient of variation is greater than or equal to 3. Also, a     

Likelihood ratio test for testing equality of location parameters of two exponential distributions from doubly censored samples

The Likelihood Ratio (LR) test for testing equality of two exponential distributions with common unknown scale parameter is obtained. Samples are assumed to be drawn under a type II doubly censored sampling scheme. Effects of left and right censoring on the power of the test are studied. Further, the performance of the LR test is compared with the Tiku(1981) test.