Mean shift and influence measures in linear measurement error models with stochastic linear restrictions

We present influence diagnostics for linear measurement error models with stochastic linear restrictions using the corrected likelihood of Nakamura in 1990. The case deletion and mean shift outlier models are developed to identify outlying and influential observations. We derive a corrected score test statistic for outlier detection based on mean shift outlier models. The analogs of Cook's distance and likelihood distance are proposed to determine influential observations based on case deletion models. A parametric bootstrap procedure is used to obtain empirical distributions of the test statistics and a simulation study has been used to evaluate the performance of the proposed estimators based on the mean squares error criterion and the score test statistic. Finally, a numerical example is given to illustrate the theoretical results.     

Testing for varying zero-inflation and dispersion in generalized Poisson regression models

Homogeneity of dispersion parameters and zero-inflation parameters is a standard assumption in zero-inflated generalized Poisson regression (ZIGPR) models. However, this assumption may be not appropriate in some situations. This work develops a score test for varying dispersion and/or zero-inflation parameter in the ZIGPR models, and corresponding test statistics are obtained. Two numerical examples are given to illustrate our methodology, and the properties of score test statistics are investigated through Monte Carlo simulations.     

Testing for normality in linear regression models

The importance of the normal distribution for fitting continuous data is well known. However, in many practical situations data distribution departs from normality. For example, the sample skewness and the sample kurtosis are far away from 0 and 3, respectively, which are nice properties of normal distributions. So, it is important to have formal tests of normality against any alternative. D'Agostino et al. [A suggestion for using powerful and informative tests of normality, Am. Statist. 44 (1990), pp. 316–321] review four procedures Z ²(g ₁), Z ²(g ₂), D and K ² for testing departure from normality. The first two of these procedures are tests of normality against departure due to skewness and kurtosis, respectively. The other two tests are omnibus tests. An alternative to the normal distribution is a class of skew-normal distributions (see [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178]). In this paper, we obtain a score test (W) and a likelihood ratio test (LR) of goodness of fit of the normal regression model against the skew-normal family of regression models. It turns out that the score test is based on the sample skewness and is of very simple form. The performance of these six procedures, in terms of size and power, are compared using simulations. The level properties of the three statistics LR, W and Z ²(g ₁) are similar and close to the nominal level for moderate to large sample sizes. Also, their power properties are similar for small departure from normality due to skewness (γ₁≤0.4). Of these, the score test statistic has a very simple form and computationally much simpler than the other two statistics. The LR statistic, in general, has highest power, although it is computationally much complex as it requires estimates of the parameters under the normal model as well as those under the skew-normal model. So, the score test may be used to test for normality against small departure from normality due to skewness. Otherwise, the likelihood ratio statistic LR should be used as it detects general departure from normality (due to both skewness and kurtosis) with, in general, largest power.     

Heteroscedasticity diagnostics in two-phase linear regression models

In two-phase linear regression models, it is a standard assumption that the random errors of two phases have constant variances. However, this assumption is not necessarily appropriate. This paper is devoted to the tests for variance heterogeneity in these models. We initially discuss the simultaneous test for variance heterogeneity of two phases. When the simultaneous test shows that significant heteroscedasticity occurs in the whole model, we construct two individual tests to investigate whether or not both phases or one of them have/has significant heteroscedasticity. Several score statistics and their adjustments based on Cox and Reid [D. R. Cox and N. Reid, Parameter orthogonality and approximate conditional inference. J. Roy. Statist. Soc. Ser. B 49 (1987), pp. 1–39] are obtained and illustrated with Australian onion data. The simulated powers of test statistics are investigated through Monte Carlo methods.     

Asymptotic relative efficiency of wald tests in measurement error models

In this paper, asymptotic relative efficiency (ARE) of Wald tests for the Tweedie class of models with log-linear mean, is considered when the aux¬iliary variable is measured with error. Wald test statistics based on the naive maximum likelihood estimator and on a consistent estimator which is obtained by using Nakarnura's (1990) corrected score function approach are defined. As shown analytically, the Wald statistics based on the naive and corrected score function estimators are asymptotically equivalents in terms of ARE. On the other hand, the asymptotic relative efficiency of the naive and corrected Wald statistic with respect to the Wald statistic based on the true covariate equals to the square of the correlation between the unobserved and the observed co-variate. A small scale numerical Monte Carlo study and an example illustrate the small sample size situation.     

Score tests for independence in semiparametric competing risks models

A popular model for competing risks postulates the existence of a latent unobserved failure time for each risk. Assuming that these underlying failure times are independent is attractive since it allows standard statistical tools for right-censored lifetime data to be used in the analysis. This paper proposes simple independence score tests for the validity of this assumption when the individual risks are modeled using semiparametric proportional hazards regressions. It assumes that covariates are available, making the model identifiable. The score tests are derived for alternatives that specify that copulas are responsible for a possible dependency between the competing risks. The test statistics are constructed by adding to the partial likelihoods for the individual risks an explanatory variable for the dependency between the risks. A variance estimator is derived by writing the score function and the Fisher information matrix for the marginal models as stochastic integrals. Pitman efficiencies are used to compare test statistics. A simulation study and a numerical example illustrate the methodology proposed in this paper.     

Testing the Normality Assumption in the Tobit Model

This paper examines a number of statistics that have been proposed to test the normality assumption in the tobit (censored regression) model. It argues that a number of commonly proposed statistics can be interpreted as different versions of the Lagrange multiplier, or score, test for a common null hypothesis. This observation is useful in examining the Monte Carlo results presented in the paper. The Monte Carlo results suggest that the computational convenience of a number of statistics is obtained at the cost of poor finite sample performance under the null hypothesis.     

Conditional Score Tests for Heteroscedasticity in the Two-Way Error Components Model

This paper extends the one-way heteroskedasticity score test of Holly and Gardiol (2000, In: Krishnakumar, J, Ronchetti, E (Eds.), Panel Data Econometrics: Future Directions, North-Holland, Amsterdam, pp. 199–211) to two conditional Lagrange Multiplier (LM) tests of heteroskedasticity under contiguous alternatives within the two-way error components model framework. In each case, the derivation of Rao's efficient score statistics for testing heteroskedasticity is first obtained. Then, based on a specific set of assumptions, the asymptotic distribution of the score under contiguous alternatives is established. Finally, the expression for the score test statistic in the presence of heteroskedasticity and related asymptotic local powers of these score test statistics are derived and discussed.     

Likelihood-based tests in zero-inflated power series models

We address the issue of performing testing inference in the class of zero-inflated power series models. These models provide a straightforward way of modelling count data and have been widely used in practical situations. The likelihood ratio, Wald and score statistics provide the basis for testing the parameter of inflation of zeros in this class of models. In this paper, in addition to the well-known test statistics, we also consider the recently proposed gradient statistic. We conduct Monte Carlo simulation experiments to evaluate the finite-sample performance of these tests for testing the parameter of inflation of zeros. The numerical results show that the new gradient test we propose is more reliable in finite samples than the usual likelihood ratio, Wald and score tests. An empirical application to real data is considered for illustrative purposes.     

Robust testing with generalized partial linear models for longitudinal data

By approximating the nonparametric component using a regression spline in generalized partial linear models (GPLM), robust generalized estimating equations (GEE), involving bounded score function and leverage-based weighting function, can be used to estimate the regression parameters in GPLM robustly for longitudinal data or clustered data. In this paper, score test statistics are proposed for testing the regression parameters with robustness, and their asymptotic distributions under the null hypothesis and a class of local alternative hypotheses are studied. The proposed score tests reply on the estimation of a smaller model without the testing parameters involved, and perform well in the simulation studies and real data analysis conducted in this paper.     

Diagnosing explainable heterogeneity of variance in random‐effects models

Data‐analytic tools for models other than the normal linear regression model are relatively rare. Here we develop plots and diagnostic statistics for nonconstant variance for the random‐effects model (REM). REMs for longitudinal data include both within‐ and between‐subject variances. A basic assumption is that the two variance terms are constant across subjects. However, we often find that these variances are functions of covariates, and the data set has what we call explainable heterogeneity, which needs to be allowed for in the model. We characterize several types of heterogeneity of variance in REMs and develop three diagnostic tests using the score statistic: one for each of the two variance terms, and the third for a form of multivariate nonconstant variance. For each test we present an adjusted residual plot which can identify cases that are unusually influential on the outcome of the test.     

Testing the homogeneity of proportions for clustered binary data without knowing the correlation structure

A robust generalized score test for comparing groups of cluster binary data is proposed. This novel test is asymptotically valid for practically any underlying correlation configurations including the situation when correlation coefficients vary within or between clusters. This structure generally undermines the validity of the typical large sample properties of the method of maximum likelihood. Simulations and real data analysis are used to demonstrate the merit of this parametric robust method. Results show that our test is superior to two recently proposed test statistics advocated by other researchers.     

Diagnostics for elliptical linear mixed models with first-order autoregressive errors

For longitudinal time series data, linear mixed models that contain both random effects across individuals and first-order autoregressive errors within individuals may be appropriate. Some statistical diagnostics based on the models under a proposed elliptical error structure are developed in this work. It is well known that the class of elliptical distributions offers a more flexible framework for modelling since it contains both light- and heavy-tailed distributions. Iterative procedures for the maximum-likelihood estimates of the model parameters are presented. Score tests for the presence of autocorrelation and the homogeneity of autocorrelation coefficients among individuals are constructed. The properties of test statistics are investigated through Monte Carlo simulations. The local influence method for the models is also given. The analysed results of a real data set illustrate the values of the models and diagnostic statistics.     

Goodness-of-fit tests for general linear models with covariates missed at random

In this paper, we consider a model checking problem for general linear models with randomly missing covariates. Two types of score type tests with inverse probability weight, which is estimated by parameter and nonparameter methods respectively, are proposed to this goodness of fit problem. The asymptotic properties of the test statistics are developed under the null and local alternative hypothesis. Simulation study is carried out to present the performance of the sizes and powers of the tests. We illustrate the proposed method with a data set on monozygotic twins.     

Asymptotically refined score and GOF tests for inverse Gaussian models

ABSTRACT

The score test and the GOF test for the inverse Gaussian distribution, in particular the latter, are known to have large size distortion and hence unreliable power when referring to the asymptotic critical values. We show in this paper that with the appropriately bootstrapped critical values, these tests become second-order accurate, with size distortion being essentially eliminated and power more reliable. Two major generalizations of the score test are made: one is to allow the data to be right-censored, and the other is to allow the existence of covariate effects. A data mapping method is introduced for the bootstrap to be able to produce censored data that are conformable with the null model. Monte Carlo results clearly favour the proposed bootstrap tests. Real data illustrations are given.     

Testing variance components in balanced linear growth curve models

It is well known that the testing of zero variance components is a non-standard problem since the null hypothesis is on the boundary of the parameter space. The usual asymptotic chi-square distribution of the likelihood ratio and score statistics under the null does not necessarily hold because of this null hypothesis. To circumvent this difficulty in balanced linear growth curve models, we introduce an appropriate test statistic and suggest a permutation procedure to approximate its finite-sample distribution. The proposed test alleviates the necessity of any distributional assumptions for the random effects and errors and can easily be applied for testing multiple variance components. Our simulation studies show that the proposed test has Type I error rate close to the nominal level. The power of the proposed test is also compared with the likelihood ratio test in the simulations. An application on data from an orthodontic study is presented and discussed.     

A class of sequential tests for two‐sample composite hypotheses

The authors propose a class of statistics based on Rao's score for the sequential testing of composite hypotheses comparing two treatments (populations). Asymptotic approximations of the statistics lead them to propose sequential tests and to derive their monitoring boundaries. As special cases, they construct sequential versions of the two‐sample t‐test for normal populations and two‐sample z‐score tests for binomial populations. The proposed algorithms are simple and easy to compute, as no numerical integration is required. Furthermore, the user can analyze the data at any time regardless of how many inspections have been made. Monte Carlo simulations allow the authors to compare the power and the average stopping time (also known as average sample number) of the proposed tests to those of nonsequential and group sequential tests. A two‐armed comparative clinical trial in patients with adult leukemia allows them to illustrate the efficiency of their methods in the case of binary responses.     

Testing the homogeneity of several two‐parameter populations

The authors extend Fisher's method of combining two independent test statistics to test homogeneity of several two‐parameter populations. They explore two procedures combining asymptotically independent test statistics: the first pools two likelihood ratio statistics and the other, score test statistics. They then give specific results to test homogeneity of several normal, negative binomial or beta‐binomial populations. Their simulations provide evidence that in this context, Fisher's method performs generally well, even when the statistics to be combined are only asymptotically independent. They are led to recommend Fisher's test based on score statistics, since the latter have simple forms, are easy to calculate, and have uniformly good level properties.     

Tests for comparing a sequence of bernoulli random variables to a sequence of known probabilities

The problem of determining whether a sequence of observed Bernoulli variates is consistent with a hypothesized underlying sequence of known probabilities is considered. A family of asymptotically normal test statistics is proposed, members of which are shown to be asymptotically locally optimal against specific types of alternatives. For small samples, a skewness correction is shown to improve greatly the adequacy of the asymptotic approximations to the null distributions of the proposed test statistics. The application of testing for increased cancer risk in families is considered, and modifications to the test statistics which adjust for the method of family ascertainment are indicated     

Asymptotic relative efficiency of score tests in Weibull models with measurement errors

The main object of this paper is to discuss properties of the score statistics for testing the null hypothesis of no association in Weibull model with measurement errors. Three different score statistics are considered. The efficient score statistics, a naive score statistics obtained by replacing the unobserved true covariate with the observed one and a score statistics based on the corrected score statistics. It is shown that corrected and naive score statistics are equivalent and the asymptotic relative efficiency between naive and efficient score statistics is derived.