The size and power of analytical amd bootstrap corrections to score tests in regression models

The paper invsetigation the size and power of analyticaland computer-based (bootstrap) 8nite=saniple adjustments to score tests in a class of regression models. Our results show that score tests can display substantial size distortions and that small-sample adjustments can be quite effective. Bootstrap corrections typically perform slightly better than analytical ones     

The information matrix test in the linear regression with ARMA errors

Summary The paper shows that the informaton matrix test presented by White (1982) decomposes into the sum of quadratic forms in the case of a linear model with ARMA errors. By extending previous results, which analysed the information matrix test in the presence of serial correlation, the test allows detection of additional sources of misspecification.     

Bartlett-corrected tests for normal linear models when the error covariance matrix is nonscaiar

This paper provides Bartlett corrections to improve likelihood ratio tests for heteroskedastic normal linear models when the error covariance matrix is nonscaiar and depends on a set of unknown parameters. The Bartlett corrections are simple enough to be used algebraically to obtain several closed-form expressions in special cases. The corrections have also advantages for numerical purposes because they involve only simple operations on matrices and vectors.     

Saddlepoint approximations to exact tests and improved likelihood ratio tests for the gamma distribution

For the most common one-sample and two-sample tests in the gamma distribution we derive the log likelihood ratio tests and the improved versions obtained by a Bartlett adjustment. For most of these tests an exact test exists and we give the saddlepoint approximation to the latter. The tests are compared with previously published tests and a small simulation study is included.     

Asymptotic expansions of the distributions of the chi-square statistic based on the asymptotically distribution-free theory in covariance structures

An asymptotic expansion of the null distribution of the chi-square statistic based on the asymptotically distribution-free theory for general covariance structures is derived under non-normality. The added higher-order term in the approximate density is given by a weighted sum of those of the chi-square distributed variables with different degrees of freedom. A formula for the corresponding Bartlett correction is also shown without using the above asymptotic expansion. Under a fixed alternative hypothesis, the Edgeworth expansion of the distribution of the standardized chi-square statistic is given up to order O(1/n). From the intermediate results of the asymptotic expansions for the chi-square statistics, asymptotic expansions of the joint distributions of the parameter estimators both under the null and fixed alternative hypotheses are derived up to order O(1/n).     

Accurate tests for the equality of coefficients of variation

ABSTRACT

A frequently encountered statistical problem is to determine if the variability among k populations is heterogeneous. If the populations are measured using different scales, comparing variances may not be appropriate. In this case, comparing coefficient of variation (CV) can be used because CV is unitless. In this paper, a non-parametric test is introduced to test whether the CVs from k populations are different. With the assumption that the populations are independent normally distributed, the Miller test, Feltz and Miller test, saddlepoint-based test, log likelihood ratio test and the proposed simulated Bartlett-corrected log likelihood ratio test are derived. Simulation results show the extreme accuracy of the simulated Bartlett-corrected log likelihood ratio test if the model is correctly specified. If the model is mis-specified and the sample size is small, the proposed test still gives good results. However, with a mis-specified model and large sample size, the non-parametric test is recommended.     

Bootstrap methods for heteroskedastic regression models: evidence on estimation and testing

This paper uses Monte Carlo simulation analysis to study the finite-sample behavior of bootstrap estimators and tests in the linear heteroskedastic model. We consider four different bootstrapping schemes, three of them specifically tailored to handle heteroskedasticity. Our results show that weighted bootstrap methods can be successfully used to estimate the variances of the least squares estimators of the linear parameters both under normality and under nonnormality. Simulation results are also given comparing the size and power of the bootstrapped Breusch-Pagan test with that of the original test and of Bartlett and Edgeworth-corrected tests. The bootstrap test was found to be robust against unfavorable regression designs.     

On the wald,lagrangian multiplier and likelihood ratio tests when the information matrix is singular

Summary Modified formulas for the Wald and Lagrangian multiplier statistics are introduced and considered together with the likelihood ratio statistics for testing a typical null hypothesisH ₀ stated in terms of equality constraints. It is demonstrated, subject to known standard regularity conditions, that each of these statistics and the known Wald statistic has the asymptotic chi-square distribution with degrees of freedom equal to the number of equality constraints specified byH ₀ whether the information matrix is singular or nonsingular. The results of this paper include a generalization of the results of Sively (1959) concerning the equivalence of the Wald, Lagrange multiplier and likelihood ratio tests to the case of singular information matrices.     

Best linear unbiased quantile estimators of the logistic distribution using order statistics

This paper deals with the problem of estimating the Quantiles Q(ξ), with ξ=0.01, 0.05(0.05)0.95, 0.99 of the logistic distribution by using order statistics in small samples. Linear unbiased estimators with minimum variance BLUE based on ordered observations are constructed for sample size n = 2(1)10, 15 and 20.     

Numerical evaluation of tests based on different heteroskedasticity-consistent covariance matrix estimators

This article considers the issue of performing tests in linear heteroskedastic models when the test statistic employs a consistent variance estimator. Several different estimators are considered, namely: HC0, HC1, HC2, HC3, and their bias-adjusted versions. The numerical evaluation is performed using numerical integration methods; the Imhof algorithm is used to that end. The results show that bias-adjustment of variance estimators used to construct test statistics delivers more reliable tests when they are performed for the HC0 and HC1 estimators, but the same does not hold for the HC3 estimator. Overall, the most reliable test is the HC3-based one.     

Monte carlo evidence on the robustness of conditional moment tests in tobit and probit models

This paper numerically examines the size robustness of various conditional moment tests in misspecified tobit and probit models. The misspecifications considered include the incorrect exclusion of regressors, ignored heteroskedasticity and false distributional assumptions. An important feature of the experimental design is that it is based on an existing empirical study and is more realistic than many simulation studies. The tests are seen to have mixed performance depending on both the original null hypothesis being tested and type of misspecification encountered.     

Invariant tests for multivariate normality: a critical review

d -dimensional random vector X is some nondegenerate d-variate normal distribution, on the basis of i.i.d. copies X ₁, ..., X _x of X. Particular emphasis is given to progress that has been achieved during the last decade. Furthermore, we stress the typical diagnostic pitfall connected with purportedly ‘directed’ procedures, such as tests based on measures of multivariate skewness. Received: April 30, 2001; revised version: October 30, 2001     

On the theory of modified randomization tests for nonparametric hypotheses

A general randomization test for nonparametric hypotheses which is a modification of permutation tests in proposed. The exact level of the test is derived and under mild gegularity conditions, a general result on the consistency of the power function is obtained. Applications to several testing problems are considered. Asymptotic expansions of the power of this test are derived with respect to contiguous alternatives thus test are derived with respect to contiguous alternatives thus enabling us to make deficiency comparisons with permutation tests. The paper concludes with some Monte Carlo simulations verifying the theoretical results derived.     

On a measure of dependence based on fisher's information matrix

A class of measures of dependence between two random vectors is defined, in terms of the canonical correlations obtained from Fisher's information matrix. Some basic properties are proved for this class of measures. Examples are given to illustrate that the class gives good measures, under normal models. Interesting measures are also arise for bivariate models where the correlation coefficient does not exist for some values of the parameters of the model.     

Elliptical structural models

In this paper we consider structural measurement error models within the elliptical family of distributions. We consider dependent and independent el? liptical models, each of which requires special treatment methodology. We discuss in each case estimation and hypothesis testing using maximum likelihood theory. As shown, most of the developments obtained under normal theory carries through to the dependent case. In the independent case, emphasis is placed on the ^-distribution, an important member of the elliptical family. Correcting likelihood ratio statistics in both cases is also of major interest.     

Optimum invariant tests on discriminant coefficients or means of multinormal population with additional information

Some optimum invariant tests are derived for certain hypotheses on discriminant coefficients or means when some extra observations are available on some components of a random vector X, which is distributed as N(μ,Σ), where μ and Σ are unknown.     

On the comparison of the Fisher information of the log-normal and generalized Rayleigh distributions

Surles and Padgett recently considered two-parameter Burr Type X distribution by introducing a scale parameter and called it the generalized Rayleigh distribution. It is observed that the generalized Rayleigh and log-normal distributions have many common properties and both distributions can be used quite effectively to analyze skewed data set. In this paper, we mainly compare the Fisher information matrices of the two distributions for complete and censored observations. Although, both distributions may provide similar data fit and are quite similar in nature in many aspects, the corresponding Fisher information matrices can be quite different. We compute the total information measures of the two distributions for different parameter ranges and also compare the loss of information due to censoring. Real data analysis has been performed for illustrative purposes.     

On constant stress accelerated life tests terminated by Type II censoring at one of the stress levels

This paper considers constant stress accelerated life tests terminated by a Type II censoring regime at one of the stress levels. We consider a model based on Weibull distributions with constant shape and a log-linear link between scale and the stress factor. We obtain expectations associated with the likelihood function, and use these to obtain asymptotically valid variances and correlations for maximum likelihood estimates of model parameters. We illustrate their calculation, and assess agreement with observed counterparts for finite samples in simulation experiments. We then use moments to compare the information obtained from variants of the design, and show that, with an appropriate allocation of items to stress levels, the design yields better estimates of model parameters and related quantities than a single stress experiment.     

Estimation of the intercept parameter for linear regression model with uncertain non-sample prior information

This paper considers alternative estimators of the intercept parameter of the linear regression model with normal error when uncertain non-sample prior information about the value of the slope parameter is available. The maximum likelihood, restricted, preliminary test and shrinkage estimators are considered. Based on their quadratic biases and mean square errors the relative performances of the estimators are investigated. Both analytical and graphical comparisons are explored. None of the estimators is found to be uniformly dominating the others. However, if the non-sample prior information regarding the value of the slope is not too far from its true value, the shrinkage estimator of the intercept parameter dominates the rest of the estimators.