Mixture Distributions Based Methods of Calibration for the Empirical Log-Likelihood Ratio

Empirical likelihood ratio confidence regions based on the chi-square calibration suffer from an undercoverage problem in that their actual coverage levels tend to be lower than the nominal levels. The finite sample distribution of the empirical log-likelihood ratio is recognized to have a mixture structure with a continuous component on [0, + ∞) and a point mass at + ∞. The undercoverage problem of the Chi-square calibration is partly due to its use of the continuous Chi-square distribution to approximate the mixture distribution of the empirical log-likelihood ratio. In this article, we propose two new methods of calibration which will take advantage of the mixture structure; we construct two new mixture distributions by using the F and chi-square distributions and use these to approximate the mixture distributions of the empirical log-likelihood ratio. The new methods of calibration are asymptotically equivalent to the chi-square calibration. But the new methods, in particular the F mixture based method, can be substantially more accurate than the chi-square calibration for small and moderately large sample sizes. The new methods are also as easy to use as the chi-square calibration.     

Estimating the Population Coefficient of Variation by Confidence Intervals

Several researchers considered various interval estimators for estimating the population coefficient of variation (CV) of symmetric and skewed distributions. Since they considered at different times and under different simulation conditions, their performances are not comparable as a whole. In this article, an attempt has been made to review some existing estimators along with some proposed methods and compare them under the same simulation condition. In particular, we have considered Hendricks and Robey, Mckay, Miller, Sharma and Krishna, Curto and Pinto, and also some bootstrap proposed interval estimators for estimating the population CV. A simulation study has been conducted to compare the performance of the estimators. Both average widths and coverage probabilities are considered as a criterion of the good estimators. Two real life health related data sets are analyzed to illustrate the findings of the article. Based on the simulation study, some possible good interval estimators have been recommended for the practitioners.     

Testing spatial randomness based on empirical distribution function: A study on lattice data

In this article, we extended the empirical distribution function based test statistic _Ik$I_k$ of Skaug and Tjostheim [1993. Nonparametric test of serial independence based on the empirical distribution function. Biometrika 80, 591–602] in the time series setting to _Dn$D_n$ for spatial lattice data and derived the asymptotic distribution of the proposed test statistic _Dn$D_n$ under the null hypothesis of spatial independence. The size and power of the proposed test statistic under conditional autoregressive model (CAR) were simulated. We applied _Dn$D_n$, Moran's I and Geary's c   to the transformed and well-studied sudden infant death syndrome data from North Carolina and found that _Dn$D_n$ produced a much smaller p$p$-value in testing spatial independence.     

Simple and Exact Empirical Likelihood Ratio Tests for Normality Based on Moment Relations

The empirical likelihood (EL) technique is a powerful nonparametric method with wide theoretical and practical applications. In this article, we use the EL methodology in order to develop simple and efficient goodness-of-fit tests for normality based on the dependence between moments that characterizes normal distributions. The new empirical likelihood ratio (ELR) tests are exact and are shown to be very powerful decision rules based on small to moderate sample sizes. Asymptotic results related to the Type I error rates of the proposed tests are presented. We present a broad Monte Carlo comparison between different tests for normality, confirming the preference of the proposed method from a power perspective. A real data example is provided.     

Testing Chaos Based on Empirical Distribution Function: A Simulation Study

It is well known that many classical statistical tests of randomness generally fail to distinguish chaos generated by some lower-dimensional deterministic dynamical systems from independent and identically distributed (i.i.d.) random series. In this paper, we suggest a powerful statistical testing method based on empirical distribution function that can well detect chaos and i.i.d. random series.     

The Performance of Panel Cointegration Methods: Results from a Large Scale Simulation Study

This article presents results concerning the performance of both single equation and system panel cointegration tests and estimators. The study considers the tests developed in Pedroni (1999 Pedroni , P. ( 1999 ). Critical values for cointegration tests in heterogeneous panels with multiple regressors . Oxford Bulletin of Economics and Statistics 61 : 653 – 670 .[Crossref], [Web of Science ®] , [Google Scholar], 2004 Pedroni , P. ( 2004 ). Panel cointegration. Asymptotic and finite sample properties of pooled time series tests with an application to the PPP hypothesis . Econometric Theory 20 : 597 – 625 .[Crossref], [Web of Science ®] , [Google Scholar]), Westerlund (2005 Westerlund , J. ( 2005 ). New simple tests for panel cointegration . Econometric Reviews 24 : 297 – 316 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Larsson et al. (2001 Larsson , R. , Lyhagen , J. , Löthgren , M. ( 2001 ). Likelihood-based cointegration tests in heterogeneous panels . Econometrics Journal 4 : 109 – 142 .[Crossref] , [Google Scholar]), and Breitung (2005 Breitung , J. ( 2005 ). A parametric approach to the estimation of cointegration vectors in panel data . Econometric Reviews 24 : 151 – 173 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and the estimators developed in Phillips and Moon (1999 Phillips , P. C. B. , Moon , H. R. ( 1999 ). Linear regression limit theory for nonstationary panel data . Econometrica 67 : 1057 – 1111 .[Crossref], [Web of Science ®] , [Google Scholar]), Pedroni (2000 Pedroni , P. ( 2000 ). Fully modified OLS for heterogeneous cointegrated panels . In: Baltagi , B. H. , ed. Nonstationary Panels, Panel Cointegration, and Dynamic Panels . Amsterdam : Elsevier , pp. 93 – 130 .[Crossref] , [Google Scholar]), Kao and Chiang (2000 Kao , C. , Chiang , M.-H. ( 2000 ). On the estimation and inference of a cointegrated regression in panel data . In: Baltagi , B. H. , ed. Nonstationary Panels, Panel Cointegration, and Dynamic Panels . Amsterdam : Elsevier , pp. 179 – 222 .[Crossref] , [Google Scholar]), Mark and Sul (2003 Mark , N. C. , Sul , D. ( 2003 ). Cointegration vector estimation by panel dynamic OLS and long-run money demand . Oxford Bulletin of Economics and Statistics 65 : 655 – 680 .[Crossref], [Web of Science ®] , [Google Scholar]), Pedroni (2001 Pedroni , P. ( 2001 ). Purchasing power parity tests in cointegrated panels . Review of Economics and Statistics 83 : 1371 – 1375 . [Google Scholar]), and Breitung (2005 Breitung , J. ( 2005 ). A parametric approach to the estimation of cointegration vectors in panel data . Econometric Reviews 24 : 151 – 173 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). We study the impact of stable autoregressive roots approaching the unit circle, of I(2) components, of short-run cross-sectional correlation and of cross-unit cointegration on the performance of the tests and estimators. The data are simulated from three-dimensional individual specific VAR systems with cointegrating ranks varying from zero to two for fourteen different panel dimensions. The usual specifications of deterministic components are considered.     

An exact density-based empirical likelihood ratio test for paired data

The Wilcoxon rank-sum test and its variants are historically well-known to be very powerful nonparametric decision rules for testing no location difference between two groups given paired data versus a shift alternative. In this title, we propose a new alternative empirical likelihood (EL) ratio approach for testing the equality of marginal distributions given that sampling is from a continuous bivariate population. We show that in various shift alternative scenarios the proposed exact test is superior to the classic nonparametric procedures, which may break down completely or are frequently inferior to the density-based EL ratio test. This is particularly true in the cases where there is a nonconstant shift under the alternative or the data distributions are skewed. An extensive Monte Carlo study shows that the proposed test has excellent operating characteristics. We apply the density-based EL ratio test to analyze real data from two medical studies.     

Testing for the maximum mean in a mixture of normals

We consider the test of the null hypothesis that the largest mean in a mixture of an unknown number of normal components is less than or equal to a given threshold. This test is motivated by the problem of assessing whether the Soviet Union has been operating in compliance with the Nuclear Test Ban Treaty. In our analysis, the number of normal components is determined using Akaike's Information Criterion while the hypothesis test itself is based on asymptotic results given by Behboodian for a mixture of two normal components. A bootstrap approach is also considered for estimating the standard error of the largest estimated mean. The performance of the testa are examined through the use of simulation.     

Some New Results on Likelihood Ratio Orderings for Spacings of Heterogeneous Exponential Random Variables

Let X ₁, X ₂,…, X _n be independent exponential random variables with X _i having failure rate λ _i for i = 1,…, n. Denote by D _i:n  = X _i:n  ? X _i?1:n the ith spacing of the order statistics X _1:n  ≤ X _2:n  ≤ ··· ≤ X _n:n , i = 1,…, n, where X _0:n ≡ 0. It is shown that if λ _n+1 ≤ [≥] λ _k for k = 1,…, n then D _n:n  ≤ _lr D _n+1:n+1 and D _1:n  ≤ _lr D _2:n+1 [D _2:n+1 ≤ _lr D _2:n ], and that if λ _i  + λ _j  ≥ λ _k for all distinct i,j, and k then D _n?1:n  ≤ _lr D _n:n and D _n:n+1 ≤ _lr D _n:n , where ≤ _lr denotes the likelihood ratio order. We also prove that D _1:n  ≤ _lr D _2:n for n ≥ 2 and D _2:3 ≤ _lr D _3:3 for all λ _i 's.     

Separate Ratio Estimators for the Population Variance in Stratified Random Sampling

We propose separate ratio estimators for population variance in stratified random sampling. We obtain mean square error equations and compare proposed estimators about efficiency with each other. By these comparisons, we find the conditions which make proposed estimators more efficient than others. It has been shown that proposed classes of estimators are more efficient than usual unbiased estimator. We find that separate ratio estimators are more efficient than combined ratio estimators for population variance. The theoretical results are supported by a numerical illustration with original data. A simulation study is also carried out to investigate empirical performance of estimators.     

Testing for No Effect by Cosine Series Methods

The properties of three lack-of-fit tests that are related to non-parametric cosine regression analysis are examined in the context of testing for a constant mean function. Analytic power comparisons of these tests vs a most powerful test are made using intermediate asymptotic relative efficiency. In particular, a data-driven test is produced which is asymptotically as efficient as the most powerful test over a class of alternatives. A small scale simulation experiment is conducted to ascertain the extent that the large sample comparisons are applicable to finite samples.     

Likelihood Ratio Testing for Hidden Markov Models Under Non-standard Conditions

Abstract.  In practical applications, when testing parametric restrictions for hidden Markov models (HMMs), one frequently encounters non-standard situations such as testing for zero entries in the transition matrix, one-sided tests for the parameters of the transition matrix or for the components of the stationary distribution of the underlying Markov chain, or testing boundary restrictions on the parameters of the state-dependent distributions. In this paper, we briefly discuss how the relevant asymptotic distribution theory for the likelihood ratio test (LRT) when the true parameter is on the boundary extends from the independent and identically distributed situation to HMMs. Then we concentrate on discussing a number of relevant examples. The finite-sample performance of the LRT in such situations is investigated in a simulation study. An application to series of epileptic seizure counts concludes the paper.     

Exact Likelihood Ratio Testing for Homogeneity of the Exponential Distribution

The aim of this article is to discuss homogeneity testing of the exponential distribution. We introduce the exact likelihood ratio test of homogeneity in the subpopulation model, ELR, and the exact likelihood ratio test of homogeneity against the two-components subpopulation alternative, ELR2. The ELR test is asymptotically optimal in the Bahadur sense when the alternative consists of sampling from a fixed number of components. Thus, in some setups the ELR is superior to frequently used tests for exponential homogeneity which are based on the EM algorithm (like the MLRT, ADDS, and D-tests). One important example of superiority of ELR and ELR2 tests is the case of lower contamination. We demonstrate this fact by both theoretical comparisons and simulations.     

A Note on the Modified Likelihood Ratio Test for Homogeneity in Beta Mixture Models

This article presents a note on the modified likelihood ratio test for homogeneity in beta mixture models. Under consistency of the penalized maximum likelihood estimators, the limiting distribution of the test statistic converges to the chi-bar-squared distributions. The statistic degenerates to zero with a weight due to the negative definiteness of a complicated random matrix. The probability that this matrix is negative definite is related to the parameter values under the homogeneity hypothesis. The dependency pattern enables the introduction of an upper bound on the asymptotic null distribution. Simulation study is investigated to verify the accuracy of the results.     

Performance measures for asymmetric power loss functions

ABSTRACT

Robust parameter design, known as Taguchi’s design of experiments, are statistical optimization procedures designed to improve the quality of the functionality or quality characteristics of products or processes. In this article, we introduce a new performance measure based on asymmetric power loss functions for positive variables and discuss its applications to robust parameter design.     

Construction of Confidence Intervals for the IVIean of a Population Containing Many Zero Values

The likelihood ratio method is used to construct a confidence interval for a population mean when sampling from a population with certain characteristics found in many applications, such as auditing. Specifically, a sample taken from this type of population usually consists of a very large number of zero values, plus a small number of nonzero values that follow some continuous distribution. In this situation, the traditional confidence interval constructed for the population mean is known to be unreliable. This article derives confidence intervals based on the likelihood-ratio-test approach by assuming (1) a normal distribution (normal algorithm) and (2) an exponential distribution (exponential algorithm). Because the error population distribution is usually unknown, it is important to study the robustness of the proposed procedures. We perform an extensive simulation study to compare the percentage of confidence intervals containing the true population mean using the two proposed algorithms with the percentage obtained from the traditional method based on the central limit theorem. It is shown that the normal algorithm is the most robust procedure against many different distributional error assumptions.     

Testing for the Proportionality of Hazards in Two Samples Against the Increasing Cumulative Hazard Ratio Alternative

A number of tests of the proportional hazards hypothesis have been proposed in the past. In recent years, researchers have proposed tests geared specially for the alternative hypothesis of increasing hazard ratio, keeping in mind the case of crossing hazards. This alternative may be too restrictive in many situations. In this paper we develop a test of the proportional hazards model for the weaker increasing cumulative hazard ratio alternative. The work is motivated by a data analytic example given by Gill & Schumacher (1987) where their test fails to reject the null hypothesis even though the faster ageing of one group is quite apparent from a plot. The normalized test statistic proposed here has an asymptotically normal distribution under either hypothesis. We also present two graphical methods related to our analytical test.     

Likelihood Ratio Type Two‐Sample Tests for Current Status Data

Abstract. We introduce fully non‐parametric two‐sample tests for testing the null hypothesis that the samples come from the same distribution if the values are only indirectly given via current status censoring. The tests are based on the likelihood ratio principle and allow the observation distributions to be different for the two samples, in contrast with earlier proposals for this situation. A bootstrap method is given for determining critical values and asymptotic theory is developed. A simulation study, using Weibull distributions, is presented to compare the power behaviour of the tests with the power of other non‐parametric tests in this situation.     

A Goodness-of-Fit Test for Logistic Regression Models in Stratified Case-Control Studies via Empirical Likelihood

In the literature, there were only a few reports on goodness-of-fit tests on logistic regression models specifically derived for case-control studies. In this article, we propose a goodness-of-fit test for logistic regression models in stratified case-control studies using an empirical likelihood approach. The proposed statistic is an alternative to the statistic G _o , recently proposed by Arbigast and Lin (2005 Arbigast , P. G. , Lin , D. Y. ( 2005 ). Model-checking techniques for stratified case-control studies . Statist. Med. 24 : 229 – 247 . [Google Scholar]). Simulation results show that the proposed statistic is often slightly more powerful than G _o , although their performances are always close to each other. Moreover, implementation of our method is easy since the usual stratified logistic regression procedures in many statistical softwares can be employed. Some asymptotic results and application of the proposed statistic to two real datasets are also presented.     

Hypothesis Testing of Hazard Ratio Parameters in Marginal Models for Multivariate Failure Time Data

Marginal hazard models for multivariate failure time data have been studied extensively in recent literature. However, standard hypothesis test statistics based on the likelihood method are not exactly appropriate for this kind of model. In this paper, extensions of the three commonly used likelihood hypothesis test statistics are discussed. Generalized Wald, generalized score and generalized likelihood ratio tests for hazard ratio parameters in a marginal hazard model for multivariate failure time data are proposed and their asymptotic distributions examined. The finite sample properties of these statistics are studied through simulations. The proposed method is applied to data from Busselton Population Health Surveys.