Hypothesis testing in models using the box-cox transformation

The small sample powers of two statistics, the likelihood ratio test, and a test based on the asymptotic normality of maximum likelihood estimators (z-test) were compared in a simulation experiment. Two models were specified, one containing the Box-Cox transformation on the dependent variable only, and one containing the Box Cox transformation on both the dependent and independent variables. The transformation parameter,λ was estimated 200 times, for each of six different values of z in each of three sample sizes foi both models. At each replication. 17 hypotheses were tested using both a likelihood ratio test and a z-test. Results indicate that w hiic both likelihood ratio tests and z-tests are unbiased, in small samples the z-test is generally preferable to the likelihood ratio test.     

Pseudo‐likelihood ratio tests for semiparametric multivariate copula model selection

The authors propose pseudo‐likelihood ratio tests for selecting semiparametric multivariate copula models in which the marginal distributions are unspecified, but the copula function is parameterized and can be misspecified. For the comparison of two models, the tests differ depending on whether the two copulas are generalized nonnested or generalized nested. For more than two models, the procedure is built on the reality check test of White (2000). Unlike White (2000), however, the test statistic is automatically standardized for generalized nonnested models (with the benchmark) and ignores generalized nested models asymptotically. The authors illustrate their approach with American insurance claim data.     

Hypothesis Testing of Hazard Ratio Parameters in Marginal Models for Multivariate Failure Time Data

Marginal hazard models for multivariate failure time data have been studied extensively in recent literature. However, standard hypothesis test statistics based on the likelihood method are not exactly appropriate for this kind of model. In this paper, extensions of the three commonly used likelihood hypothesis test statistics are discussed. Generalized Wald, generalized score and generalized likelihood ratio tests for hazard ratio parameters in a marginal hazard model for multivariate failure time data are proposed and their asymptotic distributions examined. The finite sample properties of these statistics are studied through simulations. The proposed method is applied to data from Busselton Population Health Surveys.     

Small-sample properties of covariance-adjusted survivorship data tests for treatment effect

Monte Carlo methods are used to examine the small-sample properties of 11 test statistics that can be used for comparing several treatments with respect to their mortality experiences while adjusting for covariables. The test statistics are investigated from three distinct models: the parametric, semiparametric and rank analysis of covariance (Quade, 1967) models. Four tests (likelihood ratio, Wald, conditional and unconditional score tests) from each of the first two models and three tests (based on rank scores) from the last model are discussed. The empirical size and power of the tests are investigated under a proportional hazards model in three situations: (1) the baseline hazard is correctly assumed to be Exponential, (2) the baseline hazard is incorrectly assumed to be Exponential, and (3) a treatment-covariate interaction is omitted from the analysis.     

Evaluation of trace evidence in the form of multivariate data

Summary.  The evaluation of measurements on characteristics of trace evidence found at a crime scene and on a suspect is an important part of forensic science. Five methods of assessment for the value of the evidence for multivariate data are described. Two are based on significance tests and three on the evaluation of likelihood ratios. The likelihood ratio which compares the probability of the measurements on the evidence assuming a common source for the crime scene and suspect evidence with the probability of the measurements on the evidence assuming different sources for the crime scene and suspect evidence is a well-documented measure of the value of the evidence. One of the likelihood ratio approaches transforms the data to a univariate projection based on the first principal component. The other two versions of the likelihood ratio for multivariate data account for correlation among the variables and for two levels of variation: that between sources and that within sources. One version assumes that between-source variability is modelled by a multivariate normal distribution; the other version models the variability with a multivariate kernel density estimate. Results are compared from the analysis of measurements on the elemental composition of glass.     

On testing inference in beta regressions

This article deals with testing inference in the class of beta regression models with varying dispersion. We focus on inference in small samples. We perform a numerical analysis in order to evaluate the sizes and powers of different tests. We consider the likelihood ratio test, two adjusted likelihood ratio tests proposed by Ferrari and Pinheiro [Improved likelihood inference in beta regression, J. Stat. Comput. Simul. 81 (2011), pp. 431–443], the score test, the Wald test and bootstrap versions of the likelihood ratio, score and Wald tests. We perform tests on the parameters that index the mean submodel and also on the parameters in the linear predictor of the precision submodel. Overall, the numerical evidence favours the bootstrap tests. It is also shown that the score test is considerably less size-distorted than the likelihood ratio and Wald tests. An application that uses real (not simulated) data is presented and discussed.     

The equivalence between likelihood ratio test and F-test for testing variance component in a balanced one-way random effects model

In mixed linear models, it is frequently of interest to test hypotheses on the variance components. F-test and likelihood ratio test (LRT) are commonly used for such purposes. Current LRTs available in literature are based on limiting distribution theory. With the development of finite sample distribution theory, it becomes possible to derive the exact test for likelihood ratio statistic. In this paper, we consider the problem of testing null hypotheses on the variance component in a one-way balanced random effects model. We use the exact test for the likelihood ratio statistic and compare the performance of F-test and LRT. Simulations provide strong support of the equivalence between these two tests. Furthermore, we prove the equivalence between these two tests mathematically.     

Tests of independence in incomplete multi-way tables using likelihood functions

Kang (2006) and Kang and Larsen (in press) used the log likelihood function with Lagrangian multipliers for estimation of cell probabilities in two-way incomplete contingency tables. This paper extends results and simulations to three-way and multi-way tables. Numerous studies cross-classify subjects by three or more categorical factors. Constraints on cell probabilities are incorporated through Lagrangian multipliers. Variances of the MLEs are derived from the matrix of second derivatives of the log likelihood with respect to cell probabilities and the Lagrange multiplier. Wald and likelihood ratio tests of independence are derived using the estimates and estimated variances. In simulation results in Kang and Larsen (in press), for data missing at random, maximum likelihood estimation (MLE) produced more efficient estimates of population proportions than either multiple imputation (MI) based on data augmentation or complete case (CC) analysis. Neither MLE nor MI, however, lead to an improvement over CC analysis with respect to power of tests for independence in two-way tables. Results are extended to multidimensional tables with arbitrary patterns of missing data when the variables are recorded on individual subjects. In three-way and higher-way tables, however, there is information relevant for judging independence in partially classified information, as long as two or more variables are jointly observed. Simulations study three-dimensional tables with three patterns of association and two levels of missing information.     

Likelihood Asymptotics

The paper gives an overview of modern likelihood asymptotics with emphasis on results and applicability. Only parametric inference in well-behaved models is considered and the theory discussed leads to highly accurate asymptotic tests for general smooth hypotheses. The tests are refinements of the usual asymptotic likelihood ratio tests, and for one-dimensional hypotheses the test statistic is known as r *, introduced by Barndorff-Nielsen. Examples illustrate the applicability and accuracy as well as the complexity of the required computations. Modern likelihood asymptotics has developed by merging two lines of research: asymptotic ancillarity is the basis of the statistical development, and saddlepoint approximations or Laplace-type approximations have simultaneously developed as the technical foundation. The main results and techniques of these two lines will be reviewed, and a generalization to multi-dimensional tests is developed. In the final part of the paper further problems and ideas are presented. Among these are linear models with non-normal error, non-parametric linear models obtained by estimation of the residual density in combination with the present results, and the generalization of the results to restricted maximum likelihood and similar structured models.     

On bootstrap testing inference in cure rate models

Survival models deal with the time until the occurrence of an event of interest. However, in some situations the event may not occur in part of the studied population. The fraction of the population that will never experience the event of interest is generally called cure rate. Models that consider this fact (cure rate models) have been extensively studied in the literature. Hypothesis testing on the parameters of these models can be performed based on likelihood ratio, gradient, score or Wald statistics. Critical values of these tests are obtained through approximations that are valid in large samples and may result in size distortion in small or moderate sample sizes. In this sense, this paper proposes bootstrap corrections to the four mentioned tests and bootstrap Bartlett correction for the likelihood ratio statistic in the Weibull promotion time model. Besides, we present an algorithm for bootstrap resampling when the data presents cure fraction and right censoring time (random and non-informative). Simulation studies are conducted to compare the finite sample performances of the corrected tests. The numerical evidence favours the corrected tests we propose. We also present an application in an actual data set.     

Likelihood-based tests in zero-inflated power series models

We address the issue of performing testing inference in the class of zero-inflated power series models. These models provide a straightforward way of modelling count data and have been widely used in practical situations. The likelihood ratio, Wald and score statistics provide the basis for testing the parameter of inflation of zeros in this class of models. In this paper, in addition to the well-known test statistics, we also consider the recently proposed gradient statistic. We conduct Monte Carlo simulation experiments to evaluate the finite-sample performance of these tests for testing the parameter of inflation of zeros. The numerical results show that the new gradient test we propose is more reliable in finite samples than the usual likelihood ratio, Wald and score tests. An empirical application to real data is considered for illustrative purposes.     

Financial data modeling by Poisson mixture regression

In many financial applications, Poisson mixture regression models are commonly used to analyze heterogeneous count data. When fitting these models, the observed counts are supposed to come from two or more subpopulations and parameter estimation is typically performed by means of maximum likelihood via the Expectation–Maximization algorithm. In this study, we discuss briefly the procedure for fitting Poisson mixture regression models by means of maximum likelihood, the model selection and goodness-of-fit tests. These models are applied to a real data set for credit-scoring purposes. We aim to reveal the impact of demographic and financial variables in creating different groups of clients and to predict the group to which each client belongs, as well as his expected number of defaulted payments. The model's conclusions are very interesting, revealing that the population consists of three groups, contrasting with the traditional good versus bad categorization approach of the credit-scoring systems.     

Modified likelihood ratio tests for unit gamma regressions

Regression analyses are commonly performed with doubly limited continuous dependent variables; for instance, when modeling the behavior of rates, proportions and income concentration indices. Several models are available in the literature for use with such variables, one of them being the unit gamma regression model. In all such models, parameter estimation is typically performed using the maximum likelihood method and testing inferences on the model''s parameters are usually based on the likelihood ratio test. Such a test can, however, deliver quite imprecise inferences when the sample size is small. In this paper, we propose two modified likelihood ratio test statistics for use with the unit gamma regressions that deliver much more accurate inferences when the number of data points in small. Numerical (i.e. simulation) evidence is presented for both fixed dispersion and varying dispersion models, and also for tests that involve nonnested models. We also present and discuss two empirical applications.     

Semiparametric and parametric transformation models for comparing diagnostic markers with paired design

We develop semiparametric and parametric transformation models for estimation and comparison of ROC curves derived from measurements from two diagnostic tests on the same subjects. We assume the existence of transformed measurement scales, one for each test, on which the paired measurements have bivariate normal distributions. The resulting pair of ROC curves are estimated by maximum likelihood algorithms, using joint rank data in the semiparametric model with unspecified transformations and using Box-Cox transformations in the parametric transformation case. Several hypothesis tests for comparing the two ROC curves, or characteristics of them, are developed. Two clinical examples are presented and simulation results are provided.     

Testing equality of correlation coefficients for paired binary data from multiple groups

Paired binary data arise naturally when paired body parts are investigated in clinical trials. One of the widely used models for dealing with this kind of data is the equal correlation coefficients model. Before using this model, it is necessary to test whether the correlation coefficients in each group are actually equal. In this paper, three test statistics (likelihood ratio test, Wald-type test, and Score test) are derived for this purpose. The simulation results show that the Score test statistic maintains type I error rate and has satisfactory power, and therefore is recommended among the three methods. The likelihood ratio test is over conservative in most cases, and the Wald-type statistic is not robust with respect to empirical type I error. Three real examples, including a multi-centre Phase II double-blind placebo randomized controlled trial, are given to illustrate the three proposed test statistics.     

Likelihood ratio procedures and tests of fit in parametric and semiparametric copula models with censored data

Copula models for multivariate lifetimes have become widely used in areas such as biomedicine, finance and insurance. This paper fills some gaps in existing methodology for copula parameters and model assessment. We consider procedures based on likelihood and pseudolikelihood ratio statistics and introduce semiparametric maximum likelihood estimation leading to semiparametric versions. For cases where standard asymptotic approximations do not hold, we propose an efficient simulation technique for obtaining p-values. We apply these methods to tests for a copula model, based on embedding it in a larger copula family. It is shown that the likelihood and pseudolikelihood ratio tests are consistent even when the expanded copula model is misspecified. Power comparisons with two other tests of fit indicate that model expansion provides a convenient, powerful and robust approach. The methods are illustrated on an application concerning the time to loss of vision in the two eyes of an individual.     

Score test for testing zero-inflated Poisson regression against zero-inflated generalized Poisson alternatives

In several cases, count data often have excessive number of zero outcomes. This zero-inflated phenomenon is a specific cause of overdispersion, and zero-inflated Poisson regression model (ZIP) has been proposed for accommodating zero-inflated data. However, if the data continue to suggest additional overdispersion, zero-inflated negative binomial (ZINB) and zero-inflated generalized Poisson (ZIGP) regression models have been considered as alternatives. This study proposes the score test for testing ZIP regression model against ZIGP alternatives and proves that it is equal to the score test for testing ZIP regression model against ZINB alternatives. The advantage of using the score test over other alternative tests such as likelihood ratio and Wald is that the score test can be used to determine whether a more complex model is appropriate without fitting the more complex model. Applications of the proposed score test on several datasets are also illustrated.     

Influence Diagnostics on Testing Linear Hypothesis in Linear Models with Correlated Errors

To assess the influence of observations on the parameter estimates, case deletion diagnostics are commonly used in linear regression models. For linear models with correlated errors we study the influence of observations on testing a linear hypothesis using single and multiple case deletions. The change in likelihood ratio test and F test theoretically is derived and it is shown these tests to be completely determined by two proposed generalized externally studentized residuals. An illustrative example of a real data set is also reported.     

Likelihood ratio tests for variance components in linear mixed models

Although the asymptotic distributions of the likelihood ratio for testing hypotheses of null variance components in linear mixed models derived by Stram and Lee [1994. Variance components testing in longitudinal mixed effects model. Biometrics 50, 1171–1177] are valid, their proof is based on the work of Self and Liang [1987. Asymptotic properties of maximum likelihood estimators and likelihood tests under nonstandard conditions. J. Amer. Statist. Assoc. 82, 605–610] which requires identically distributed random variables, an assumption not always valid in longitudinal data problems. We use the less restrictive results of Vu and Zhou [1997. Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25, 897–916] to prove that the proposed mixture of chi-squared distributions is the actual asymptotic distribution of such likelihood ratios used as test statistics for null variance components in models with one or two random effects. We also consider a limited simulation study to evaluate the appropriateness of the asymptotic distribution of such likelihood ratios in moderately sized samples.     

Nonnull asymptotic distributions of the LR,Wald, score and gradient statistics in generalized linear models with dispersion covariates

The class of generalized linear models with dispersion covariates, which allows us to jointly model the mean and dispersion parameters, is a natural extension to the classical generalized linear models. In this paper, we derive the asymptotic expansions under a sequence of Pitman alternatives (up to order n ^?1/2) for the nonnull distribution functions of the likelihood ratio, Wald, Rao score and gradient statistics in this class of models. The asymptotic distributions of these statistics are obtained for testing a subset of regression parameters and for testing a subset of dispersion parameters. Based on these nonnull asymptotic expansions, the power of all four tests, which are equivalent to first order, are compared. Furthermore, we consider Monte Carlo simulations in order to compare the finite-sample performance of these tests in this class of models. We present two empirical applications to two real data sets for illustrative purposes.