Testing equality of mean vectors in a one-way MANOVA with monotone missing data

In this study, testing the equality of mean vectors in a one-way multivariate analysis of variance (MANOVA) is considered when each dataset has a monotone pattern of missing observations. The likelihood ratio test (LRT) statistic in a one-way MANOVA with monotone missing data is given. Furthermore, the modified test (MT) statistic based on likelihood ratio (LR) and the modified LRT (MLRT) statistic with monotone missing data are proposed using the decomposition of the LR and an asymptotic expansion for each decomposed LR. The accuracy of the approximation for the Chi-square distribution is investigated using a Monte Carlo simulation. Finally, an example is given to illustrate the methods.     

Improved small sample inference in the mixed linear model: Bartlett correction and adjusted likelihood

The mixed linear model is a popular method for analysing unbalanced repeated measurement data. The classical statistical tests for parameters in this model are based on asymptotic theory that is unreliable in the small samples that are often encountered in practice. For testing a given fixed effect parameter with a small sample, we develop and investigate refined likelihood ratio (LR) tests. The refinements considered are the Bartlett correction and use of the Cox–Reid adjusted likelihood; these are examined separately and in combination. We illustrate the various LR tests on an actual data set and compare them in two simulation studies. The conventional LR test yields type I error rates that are higher than nominal. The adjusted LR test yields rates that are lower than nominal, with absolute accuracy similar to that of the conventional LR test in the first simulation study and better in the second. The Bartlett correction substantially improves the accuracy of the type I error rates with either the conventional or the adjusted LR test. In many cases, error rates that are very close to nominal are achieved with the refined methods.     

Tests for a family of random-effects covariance structures in a multivariate growth curve model

In this paper we propose test statistics for a general hypothesis concerning the adequacy of multivariate random-effects covariance structures in a multivariate growth curve model with differing numbers of random effects (Lange, N., N.M. Laird, J. Amer. Statist. Assoc. 84 (1989) 241–247). Since the exact likelihood ratio (LR) statistic for the hypothesis is complicated, it is suggested to use a modified LR statistic. An asymptotic expansion of the null distribution of the statistic is obtained. The exact LR statistic is also discussed.     

A monte carlo study of the wald,lm, and lr tests in a heteroscedastic linear model

In this paper, we examine by Monte Carlo experiments the small sample properties of the W (Wald), LM (Lagrange Multiplier) and LR (Likelihood Ratio) tests for equality between sets of coefficients in two linear regressions under heteroscedasticity. The small sample properties of the size-corrected W, LM and LR tests proposed by Rothenberg (1984) are also examined and it is shown that the performances of the size-corrected W and LM tests are very good. Further, we examine the two-stage test which consists of a test for homoscedasticity followed by the Chow (1960) test if homoscedasticity is indicated or one of the W, LM or LR tests if heteroscedasticity should be assumed. It is shown that the pretest does not reduce much the bias in the size when the sizecorrected citical values are used in the W, LM and LR tests.     

Inference of Seasonal Long‐memory Time Series with Measurement Error

We consider the Whittle likelihood estimation of seasonal autoregressive fractionally integrated moving‐average models in the presence of an additional measurement error and show that the spectral maximum Whittle likelihood estimator is asymptotically normal. We illustrate by simulation that ignoring measurement errors may result in incorrect inference. Hence, it is pertinent to test for the presence of measurement errors, which we do by developing a likelihood ratio (LR) test within the framework of Whittle likelihood. We derive the non‐standard asymptotic null distribution of this LR test and the limiting distribution of LR test under a sequence of local alternatives. Because in practice, we do not know the order of the seasonal autoregressive fractionally integrated moving‐average model, we consider three modifications of the LR test that takes model uncertainty into account. We study the finite sample properties of the size and the power of the LR test and its modifications. The efficacy of the proposed approach is illustrated by a real‐life example.     

Multi - sample test of equal gamma distribution scale parameters in presence of unknown common shape parameter

Shiue and Bain proposed an approximate F statistic for testing equality of two gamma distribution scale parameters in presence of a common and unknown shape parameter. By generalizing Shiue and Bain's statistic we develop a new statistic for testing equality of L >= 2 gamma distribution scale parameters. We derive the distribution of the new statistic ESP for L = 2 and equal sample size situation. For other situations distribution of ESP is not known and test based on the ESP statistic has to be performed by using simulated critical values. We also derive a C(α) statistic CML and develop a likelihood ratio statistic, LR, two modified likelihood ratio statistics M and MLB and a quadratic statistic Q. The distribution of each of the statistics CML, LR, M, MLB and Q is asymptotically chi-square with L - 1 degrees of freedom. We then conducted a monte-carlo simulation study to compare the perfor- mance of the statistics ESP, LR, M, MLB, CML and Q in terms of size and power. The statistics LR, M, MLB and Q are in general liberal and do not show power advantage over other statistics. The statistic CML, based on its asymptotic chi-square distribution, in general, holds nominal level well. It is most powerful or nearly most powerful in most situations and is simple to use. Hence, we recommend the statistic CML for use in general. For better power the statistic ESP, based on its empirical distribution, is recommended for the special situation for which there is evidence in the data that λ₁ < … < λ_L and n₁ < … < n_L, where λ₁ …, λ_L are the scale parameters and n₁,…, n_L are the sample sizes.     

The use of temporally aggregated data on detecting a mean change of a time series process

In this article we investigate the effects of temporal aggregation on testing for a mean change of time series through a likelihood ratio (LR) test. We derive the functional relationship between non aggregate-model parameters and aggregate-model parameters. Using the relationship, we propose a modified LR test when aggregate data are used. Through the theory, Monte Carlo simulations, and empirical examples, we show that aggregation leads the null distribution of the LR test statistic being shifted to the left. Hence, the test power increases as the order of aggregation increases.     

Performance of the shrinkage preliminary test ridge regression estimators based on the conflicting of W,LR and LM tests

The shrinkage preliminary test ridge regression estimators (SPTRRE) based on the Wald (W), the likelihood ratio (LR) and the Lagrangian multiplier (LM) tests are considered in this paper. The bias and the risk functions of the proposed estimators are derived. The regions of optimality of the estimators are determined under the quadratic risk function. Under the null hypothesis, the SPTRRE based on LM test has the smallest risk, followed by the estimators based on LR and W tests. However, the SPTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimator for both ridge and departure parameters are discussed. The optimum choice of the level of significance becomes the traditional choice by using the W test for all non-negative ridge parameters.     

SCAD惩罚逻辑回归的财务预警模型

作为一种有监督学习算法,逻辑回归(Logistic Regression,LR)已广泛应用于财务危机建模分析,但其潜在地存在过拟合问题。鉴此,提出一种基于平滑削边绝对偏离(Smoothly Clipped Absolute Deviation,SCAD)惩罚逻辑回归的财务预警模型。该模型不仅能很好地解决模型过拟合问题,而且还可以同时实现变量选择和模型系数估计,并提高了模型的解释性。结合沪深股市A股制造业上市公司的财务数据进行实证研究,同时对比一般的L1正则化和L2正则化逻辑回归模型的预警效果进行实证分析,实验结果表明:SCAD惩罚逻辑回归模型具有较好的分类效果和较强的经济解释能力。     

Comparisons of decision tree methods using water data

This article demonstrates the application of classification trees (decision trees), logistic regression (LR), and linear discriminant function (LDR) to classify data of water quality (i.e., whether the water is fit for drinking on not fit for drinking). The data on water quality were obtained from Pakistan Council of Research in Water Resources (PCRWR) for two cities of Pakistan—one representing industrial environment (Sialkot) and the other one representing non-industrial environment (Narowal). To classify data on water quality, three statistical tools were employed—the Decision Tree methodology using Gini Index, LR, and LDA—using R software library. The results obtained by the said three techniques were compared using misclassification rates (a model with minimum value of misclassification rate is better). It was witnessed that LR performed well than the other two techniques while the Decision trees and LDA performed equally well. But for illustration purposes decision trees technique is comparatively easy to draw and interpret.     

The effect of number of clusters and cluster size on statistical power and Type I error rates when testing random effects variance components in multilevel linear and logistic regression models

When using multilevel regression models that incorporate cluster-specific random effects, the Wald and the likelihood ratio (LR) tests are used for testing the null hypothesis that the variance of the random effects distribution is equal to zero. We conducted a series of Monte Carlo simulations to examine the effect of the number of clusters and the number of subjects per cluster on the statistical power to detect a non-null random effects variance and to compare the empirical type I error rates of the Wald and LR tests. Statistical power increased with increasing number of clusters and number of subjects per cluster. Statistical power was greater for the LR test than for the Wald test. These results applied to both the linear and logistic regressions, but were more pronounced for the latter. The use of the LR test is preferable to the use of the Wald test.     

Maximal invariant likelihood based testing of semi-linear models

In this paper, we use a maximal invariant likelihood (MIL) to construct two likelihood ratio (LR) tests in the context of a semi-linear regression model. The first involves testing for the inclusion of a non-linear regressor and the second involves testing a linear regressor against the alternative of a non-linear regressor. We report the results of a Monte Carlo experiment that compares the size and power properties of the traditional LR tests with those of our proposed MIL based LR tests. Our simulation results show that in both cases, the MIL based tests have more accurate asymptotic critical values and better behaved (i.e., better centred) power curves than their classical counterparts.     

Likelihood ratio test for testing equality of location parameters of two exponential distributions from doubly censored samples

The Likelihood Ratio (LR) test for testing equality of two exponential distributions with common unknown scale parameter is obtained. Samples are assumed to be drawn under a type II doubly censored sampling scheme. Effects of left and right censoring on the power of the test are studied. Further, the performance of the LR test is compared with the Tiku(1981) test.     

Posterior likelihood ratios for evaluation of forensic trace evidence given a two-level model on the data

In forensic science, in order to determine whether sets of traces are from the same source or not, it is widely advocated to evaluate evidential value of similarity of the traces by likelihood ratios (LRs). If traces are expressed by measurements following a two-level model with random effects and known variances, closed LR formulas are available given normality, or kernel density distributions, on the effects. For the known variances estimators are used though, which leads to uncertainty on the resulting LRs which is hard to quantify. The above is analyzed in an approach in which both effects and variances are random, following standard prior distributions on univariate data, leading to posterior LRs. For non-informative and conjugate priors, closed LR formulas are obtained that are interesting in structure and generalize a known result given fixed variance. A semi-conjugate prior on the model seems usable in many applications. It is described how to obtain credible intervals using Monte Carlo Markov Chain and regular simulation, and an example is described for comparison of XTC tablets based on MDMA content. In this way, uncertainty on LR estimation is expressed more clearly which makes the evidential value more transparent in a judicial context.     

面板数据单位根似然比检验研究

本文采用似然比类检验统计量进行面板单位根检验（简称为LR检验）研究,在局部备择假设成立的条件下,推导了其在无确定项、仅含截距项以及存在线性时间趋势项三种模型下所对应的渐近分布与局部渐近势函数。Monte Carlo模拟结果显示,当面板数据中含确定项（截距项或时间趋势项）时,LR检验水平比LLC和IPS检验水平更接近于给定的显著性检验水平;此外,当面板数据中包含发散个体时,经水平修正后的LR检验势要远远高于经水平修正后的LLC与IPS检验势,其中,经水平修正后的LLC与IPS检验势接近于零。     

Bootstrap LR tests of stationarity,common trends and cointegration

This paper considers the likelihood ratio (LR) tests of stationarity, common trends and cointegration for multivariate time series. As the distribution of these tests is not known, a bootstrap version is proposed via a state- space representation. The bootstrap samples are obtained from the Kalman filter innovations under the null hypothesis. Monte Carlo simulations for the Gaussian univariate random walk plus noise model show that the bootstrap LR test achieves higher power for medium-sized deviations from the null hypothesis than a locally optimal and one-sided Lagrange Multiplier (LM) test that has a known asymptotic distribution. The power gains of the bootstrap LR test are significantly larger for testing the hypothesis of common trends and cointegration in multivariate time series, as the alternative asymptotic procedure – obtained as an extension of the LM test of stationarity – does not possess properties of optimality. Finally, it is shown that the (pseudo-)LR tests maintain good size and power properties also for the non-Gaussian series. An empirical illustration is provided.     

Likelihood Ratio Tests for the Non Equivalence of Means

We derive likelihood ratio (LR) tests for the null hypothesis of equivalence that the normal means fall into a practical indifference zone. The LR test can easily be constructed and applied to k ≥ 2 treatments. Simulation results indicate that the LR test might be slightly anticonservative statistically, but when the sample sizes are large, it always produces the nominal level for mean configurations under the null hypothesis. More powerful than the studentized range test, the LR test is a straightforward application that requires only current existing statistical tables, with no complicated computations.     

Behrens-fisher problem under the assumption of homogeneous coefficients of variation

The powers of the likelihood ratio (LR) test and an “asymptotically (in some sense) optimum” invariant test are examined and compared by simulation techniques with those of several other relevant tests for the problem of testing the equality of two univariate normal population means under the assumption of heterogeneous variances but homogeneous coefficients of variation. It is seen that the LR test is highly satisfactory for all values of the coefficient of variation and the “asymptotically optimum” invariant test, which is computationally much simpler than the LR test, is a reasonably good competitor for cases where the value of the coefficient of variation is greater than or equal to 3. Also, a     

Weak identification in probit models with endogenous covariates

Weak identification is a well-known issue in the context of linear structural models. However, for probit models with endogenous explanatory variables, this problem has been little explored. In this paper, we study by simulating the behavior of the usual z-test and the LR test in the presence of weak identification. We find that the usual asymptotic z-test exhibits large level distortions (over-rejections under the null hypothesis). The magnitude of the level distortions depends heavily on the parameter value tested. In contrast, asymptotic LR tests do not over-reject and appear to be robust to weak identification.