Modified likelihood ratio tests for unit gamma regressions

Regression analyses are commonly performed with doubly limited continuous dependent variables; for instance, when modeling the behavior of rates, proportions and income concentration indices. Several models are available in the literature for use with such variables, one of them being the unit gamma regression model. In all such models, parameter estimation is typically performed using the maximum likelihood method and testing inferences on the model''s parameters are usually based on the likelihood ratio test. Such a test can, however, deliver quite imprecise inferences when the sample size is small. In this paper, we propose two modified likelihood ratio test statistics for use with the unit gamma regressions that deliver much more accurate inferences when the number of data points in small. Numerical (i.e. simulation) evidence is presented for both fixed dispersion and varying dispersion models, and also for tests that involve nonnested models. We also present and discuss two empirical applications.     

Empirical likelihood inference for general transformation models with right censored data

In this work, we consider empirical likelihood inference for general transformation models with right censored data. The models are a class of flexible semiparametric survival models and include many popular survival models as their special cases. Based on the marginal likelihood function, we define an empirical likelihood ratio statistic. Under some regularity conditions, we show that the empirical likelihood ratio statistic asymptotically follows a standard chi-squared distribution. Through some simulation studies and a real data application, we show that our proposed procedure can work fairly well even for relatively small sample size and high censoring.     

An F-type small sample simultaneous test for nested linear regression models

A small sample simultaneous testing method is proposed for nested linear regression model. The methodology is based on the generalized likelihood ratio test which is the large sample simultaneous testing method for general nested models. The proposed test is also used for model identification.     

Likelihood ratio tests in linear mixed models with one variance component

Summary.  We consider the problem of testing null hypotheses that include restrictions on the variance component in a linear mixed model with one variance component and we derive the finite sample and asymptotic distribution of the likelihood ratio test and the restricted likelihood ratio test. The spectral representations of the likelihood ratio test and the restricted likelihood ratio test statistics are used as the basis of efficient simulation algorithms of their null distributions. The large sample χ ² mixture approximations using the usual asymptotic theory for a null hypothesis on the boundary of the parameter space have been shown to be poor in simulation studies. Our asymptotic calculations explain these empirical results. The theory of Self and Liang applies only to linear mixed models for which the data vector can be partitioned into a large number of independent and identically distributed subvectors. One-way analysis of variance and penalized splines models illustrate the results.     

An extended cure model and model selection

We propose a novel interpretation for a recently proposed Box–Cox transformation cure model, which leads to a natural extension of the cure model. Based on the extended model, we consider an important issue of model selection between the mixture cure model and the bounded cumulative hazard cure model via the likelihood ratio test, score test and Akaike’s Information Criterion (AIC). Our empirical study shows that AIC is informative and both the score test and the likelihood ratio test have adequate power to differentiate between the mixture cure model and the bounded cumulative hazard cure model when the sample size is large. We apply the tests and AIC methods to leukemia and colon cancer data to examine the appropriateness of the cure models considered for them in the literature.     

On Small Samples Testing for Frailty Through Homogeneity Test

We derive a test in order to examine the need of modeling survival data using frailty models based on the likelihood ratio (LR) test for homogeneity. Test is developed for both complete and censored samples from a family of baseline distributions that satisfy a closure property. Approach motivated by I-divergence distance is used in order to determine “credible” regions for all parameters of baseline distribution for which homogeneity hypothesis is not rejected. Proposed test outperforms the usual asymptotic LR test both in very small samples with known frailty and for all small sample sizes under misspecified frailty.     

Testing for two states in a hidden Markov model

The authors consider hidden Markov models (HMMs) whose latent process has m ≥ 2 states and whose state‐dependent distributions arise from a general one‐parameter family. They propose a test of the hypothesis m = 2. Their procedure is an extension to HMMs of the modified likelihood ratio statistic proposed by Chen, Chen & Kalbfleisch (2004) for testing two states in a finite mixture. The authors determine the asymptotic distribution of their test under the hypothesis m = 2 and investigate its finite‐sample properties in a simulation study. Their test is based on inference for the marginal mixture distribution of the HMM. In order to illustrate the additional difficulties due to the dependence structure of the HMM, they show how to test general regular hypotheses on the marginal mixture of HMMs via a quasi‐modified likelihood ratio. They also discuss two applications.     

SIZE CHARACTERISTICS OF TESTS FOR SAMPLE SELECTION BIAS: A MONTE CARLO COMPARISON AND EMPIRICAL EXAMPLE

The t-test of an individual coefficient is used widely in models of qualitative choice. However, it is well known that the t-test can yield misleading results when the sample size is small. This paper provides some experimental evidence on the finite sample properties of the t-test in models with sample selection biases, through a comparison of the t-test with the likelihood ratio and Lagrange multiplier tests, which are asymptotically equivalent to the squared t-test. The finite sample problems with the t-test are shown to be alarming, and much more serious than in models such as binary choice models. An empirical example is also presented to highlight the differences in the calculated test statistics.     

Elliptical structural models

In this paper we consider structural measurement error models within the elliptical family of distributions. We consider dependent and independent el? liptical models, each of which requires special treatment methodology. We discuss in each case estimation and hypothesis testing using maximum likelihood theory. As shown, most of the developments obtained under normal theory carries through to the dependent case. In the independent case, emphasis is placed on the ^-distribution, an important member of the elliptical family. Correcting likelihood ratio statistics in both cases is also of major interest.     

Extending the empirical likelihood by domain expansion

We extend the empirical likelihood beyond its domain by expanding its contours nested inside the domain with a similarity transformation. The extended empirical likelihood achieves two objectives at the same time: escaping the “convex hull constraint” on the empirical likelihood and improving the coverage accuracy of the empirical likelihood ratio confidence region to $O(n^{-2})$ . The latter is accomplished through a special transformation which matches the extended empirical likelihood with the Bartlett corrected empirical likelihood. The extended empirical likelihood ratio confidence region retains the shape of the original empirical likelihood ratio confidence region. It also accommodates adjustments for dimension and small sample size, giving it good coverage accuracy in large and small sample situations. The Canadian Journal of Statistics 41: 257–274; 2013 © 2013 Statistical Society of Canada     

A comparison of two approaches for power and sample size calculations in logistic regression models

Whittemore (1981) proposed an approach for calculating the sample size needed to test hypotheses with specified significance and power against a given alternative for logistic regression with small response probability. Based on the distribution of covariate, which could be either discrete or continuous, this approach first provides a simple closed-form approximation to the asymptotic covariance matrix of the maximum likelihood estimates, and then uses it to calculate the sample size needed to test a hypothesis about the parameter. Self et al. (1992) described a general approach for power and sample size calculations within the framework of generalized linear models, which include logistic regression as a special case. Their approach is based on an approximation to the distribution of the likelihood ratio statistic. Unlike the Whittemore approach, their approach is not limited to situations of small response probability. However, it is restricted to models with a finite number of covariate configurations. This study compares these two approaches to see how accurate they would be for the calculations of power and sample size in logistic regression models with various response probabilities and covariate distributions. The results indicate that the Whittemore approach has a slight advantage in achieving the nominal power only for one case with small response probability. It is outperformed for all other cases with larger response probabilities. In general, the approach proposed in Self et al. (1992) is recommended for all values of the response probability. However, its extension for logistic regression models with an infinite number of covariate configurations involves an arbitrary decision for categorization and leads to a discrete approximation. As shown in this paper, the examined discrete approximations appear to be sufficiently accurate for practical purpose.     

Johansen cointegration rank tests under local alternative hypotheses when related drift or linear trend is not dependent upon sample size in VARs

Abstract

This paper discusses Johansen’s likelihood ratio tests to determine the cointegration rank under local alternative hypotheses in the vector autoregressive models (VARs) in which drift or linear trend related to the hypotheses is not dependent upon the sample size, and evaluates related asymptotic properties. We show that the test statistics diverge at the rate of the sample size even under one of local alternative hypotheses, owing to the existence of such a deterministic term. This implies that under our situations, the tests are far more powerful than those under the conventional local alternative hypotheses.     

Box‐Cox transformations in linear models: Large sample theory and tests of normality

The authors provide a rigorous large sample theory for linear models whose response variable has been subjected to the Box‐Cox transformation. They provide a continuous asymptotic approximation to the distribution of estimators of natural parameters of the model. They show, in particular, that the maximum likelihood estimator of the ratio of slope to residual standard deviation is consistent and relatively stable. The authors further show the importance for inference of normality of the errors and give tests for normality based on the estimated residuals. For non‐normal errors, they give adjustments to the log‐likelihood and to asymptotic standard errors.     

Asymptotic distributions of some test statistics for a linear functional relationship

We consider the testing problems of the structural parameters for the multivariate linear functional relationship model. We treat the likelihood ratio test statistics and the test statistics based on the asymptotic distributions of the maximum likelihood estimators. We derive their asymptotic distributions under each null hypothesis respectively. A simulation study is made to evaluate how we can trust our asymptotic results when the sample size is rather small.     

Robust minimum distance inference based on combined distances

The minimum disparity estimators proposed by Lindsay (1994) for discrete models form an attractive subclass of minimum distance estimators which achieve their robustness without sacrificing first order efficiency at the model. Similarly, disparity test statistics are useful robust alternatives to the likelihood ratio test for testing of hypotheses in parametric models; they are asymptotically equivalent to the likelihood ratio test statistics under the null hypothesis and contiguous alternatives. Despite their asymptotic optimality properties, the small sample performance of many of the minimum disparity estimators and disparity tests can be considerably worse compared to the maximum likelihood estimator and the likelihood ratio test respectively. In this paper we focus on the class of blended weight Hellinger distances, a general subfamily of disparities, and study the effects of combining two different distances within this class to generate the family of “combined” blended weight Hellinger distances, and identify the members of this family which generally perform well. More generally, we investigate the class of "combined and penal-ized" blended weight Hellinger distances; the penalty is based on reweighting the empty cells, following Harris and Basu (1994). It is shown that some members of the combined and penalized family have rather attractive properties     

Modified likelihood ratio statistics for inflated beta regressions

The class of inflated beta regression models generalizes that of beta regressions [S.L.P. Ferrari and F. Cribari-Neto, Beta regression for modelling rates and proportions, J. Appl. Stat. 31 (2004), pp. 799–815] by incorporating a discrete component that allows practitioners to model data on rates and proportions with observations that equal an interval limit. For instance, one can model responses that assume values in (0, 1]. The likelihood ratio test tends to be quite oversized (liberal, anticonservative) in inflated beta regressions estimated with a small number of observations. Indeed, our numerical results show that its null rejection rate can be almost twice the nominal level. It is thus important to develop alternative testing strategies. This paper develops small-sample adjustments to the likelihood ratio and signed likelihood ratio test statistics in inflated beta regression models. The adjustments do not require orthogonality between the parameters of interest and the nuisance parameters and are fairly simple since they only require first- and second-order log-likelihood cumulants. Simulation results show that the modified likelihood ratio tests deliver much accurate inference in small samples. An empirical application is presented and discussed.     

Sample Size Determination for Logistic Regression: A Simulation Study

This article considers the different methods for determining sample sizes for Wald, likelihood ratio, and score tests for logistic regression. We review some recent methods, report the results of a simulation study comparing each of the methods for each of the three types of test, and provide Mathematica code for calculating sample size. We consider a variety of covariate distributions, and find that a calculation method based on a first order expansion of the likelihood ratio test statistic performs consistently well in achieving a target level of power for each of the three types of test.     

A permutation test for multivariate data with grouped components

In this paper, we consider a nonparametric test procedure for multivariate data with grouped components under the two sample problem setting. For the construction of the test statistic, we use linear rank statistics which were derived by applying the likelihood ratio principle for each component. For the null distribution of the test statistic, we apply the permutation principle for small or moderate sample sizes and derive the limiting distribution for the large sample case. Also we illustrate our test procedure with an example and compare with other procedures through simulation study. Finally, we discuss some additional interesting features as concluding remarks.     

Robust multivariate transformations to normality: Constructed variables and likelihood ratio tests

The assumption of multivariate normality provides the customary powerful and convenient ways of analysing multivariate data: if the data are not normal, the analysis may often be simplified by an appropriate transformation. In this context, the most widely used test is the likelihood ratio, which requires the maximum likelihood estimate of the transformation parameter for each variable. Given that this estimate can only be found numerically, when the number of variables is large (> 20) it is impossible or infeasible to compute the test. In this paper we introduce alternative tests which do not require the maximum likelihood estimate of the transformation parameters and prove algebraically their relationships. We also give insights both using theoretical arguments and a robust simulation study, based on the forward search algorithm, about the distribution of the tests previously introduced.