A Monte Carlo study of traditional and rank-based picked-points analyses

In analysis of covariance with heteroscedastic slopes a picked-points analysis is often performed. Least-squares based picked-points analyses often lose efficiency (at times substantial) for nonnormal error distributions. Robust rank-based picked-points analyses are developed which are optimizable for heavy-tailed and/or skewed error distributions. The results of a Monte Carlo investigation of these analyses are presented. The situations include the normal model and models which violate it in one or several ways. Empirically the rank-based analyses appear to be valid over all these situations and more powerful than the least squares analysis for all the nonnormal models, while losing little efficiency at the normal model.     

Comparison of nonparametric analysis of variance methods: A vote for van der Waerden

ABSTRACT

For two-way layouts in a between-subjects analysis of variance design, the parametric F-test is compared with seven nonparametric methods: rank transform (RT), inverse normal transform (INT), aligned rank transform (ART), a combination of ART and INT, Puri & Sen's L statistic, Van der Waerden, and Akritas and Brunners ANOVA-type statistics (ATS). The type I error rates and the power are computed for 16 normal and nonnormal distributions, with and without homogeneity of variances, for balanced and unbalanced designs as well as for several models including the null and the full model. The aim of this study is to identify a method that is applicable without too much testing for all the attributes of the plot. The Van der Waerden test shows the overall best performance though there are some situations in which it is disappointing. The Puri & Sen's and the ATS tests show generally very low power. These two and the other methods cannot keep the type I error rate under control in too many situations. Especially in the case of lognormal distributions, the use of any of the rank-based procedures can be dangerous for cell sizes above 10. As already shown by many other authors, nonnormal distributions do not violate the parametric F-test, but unequal variances do, and heterogeneity of variances leads to an inflated error rate more or less also for the nonparametric methods. Finally, it should be noted that some procedures show rising error rates with increasing cell sizes, the ART, especially for discrete variables, and the RT, Puri & Sen, and the ATS in the cases of heteroscedasticity.     

Control variates for monte carlo analysis of nonlinear statisticalmodels. IV

A Monte Carlo control variate method is used to study the estimators obtained in nonlinear regression under nonnormal error distributions. Two forms of the standard linear approximator are used as the control variates: a natural approximator using the nonnormal errors sampled, and a normalized approximator obtained by transformation of the errors. The natural approximator is shown to be most effective when the sampling distribution is itself nonnormal; its effectiveness is well approximated by a function of the Beale measure of nonlinearity. The normalized approximator is most effective when the estimator sampling distribution is approximately normal. A one-parameter model is used for illustration with uniform and gamma distributed errors     

Bootstrap Tests of Nonnested Hypotheses: Some Further Results

Nonnested models are sometimes tested using a simulated reference distribution for the uncentred log likelihood ratio statistic. This approach has been recommended for the specific problem of testing linear and logarithmic regression models. The general asymptotic validity of the reference distribution test under correct choice of error distributions is questioned. The asymptotic behaviour of the test under incorrect assumptions about error distributions is also examined. In order to complement these analyses, Monte Carlo results for the case of linear and logarithmic regression models are provided. The finite sample properties of several standard tests for testing these alternative functional forms are also studied, under normal and nonnormal error distributions. These regression-based variable-addition tests are implemented using asymptotic and bootstrap critical values.     

Bootstrap Tests of Nonnested Hypotheses: Some Further Results

Abstract

Nonnested models are sometimes tested using a simulated reference distribution for the uncentred log likelihood ratio statistic. This approach has been recommended for the specific problem of testing linear and logarithmic regression models. The general asymptotic validity of the reference distribution test under correct choice of error distributions is questioned. The asymptotic behaviour of the test under incorrect assumptions about error distributions is also examined. In order to complement these analyses, Monte Carlo results for the case of linear and logarithmic regression models are provided. The finite sample properties of several standard tests for testing these alternative functional forms are also studied, under normal and nonnormal error distributions. These regression-based variable-addition tests are implemented using asymptotic and bootstrap critical values.     

On the limiting distributions of the jackknife statistics for eigenvalues of a sample covariance matrix

The limiting distributions of jackknife statistics for eigenvalues of a sample covariance matrix are derived under the nonnormal situations. Also the numerical examples are given under normal and nonnormal populations.     

Expectation of quadratic forms in normal and nonnormal variables with applications

We derive some new results on the expectation of quadratic forms in normal and nonnormal variables. Using a nonstochastic operator, we show that the expectation of the product of an arbitrary number of quadratic forms in noncentral normal variables follows a recurrence formula. This formula includes the existing result for central normal variables as a special case. For nonnormal variables, while the existing results are available only for quadratic forms of limited order (up to 3), we derive analytical results to a higher order 4. We use the nonnormal results to study the effects of nonnormality on the finite sample mean squared error of the OLS estimator in an AR(1) model and the QMLE in an MA(1) model.     

A unified view on skewed distributions arising from selections

Parametric families of multivariate nonnormal distributions have received considerable attention in the past few decades. The authors propose a new definition of a selection distribution that encompasses many existing families of multivariate skewed distributions. Their work is motivated by examples that involve various forms of selection mechanisms and lead to skewed distributions. They give the main properties of selection distributions and show how various families of multivariate skewed distributions, such as the skew‐normal and skew‐elliptical distributions, arise as special cases. The authors further introduce several methods of constructing selection distributions based on linear and nonlinear selection mechanisms.     

A Monte Carlo study of some limited and full information simultaneous equation estimators with normal and nonnormal autocorrelated disturbances

The purpose of this paper is to examine the small sample properties of various limited and full information estimators of the structural coefficients of a system of two equations. Specifically, we consider a first-order autoregressive error structure under normal and nonnormal disturbances — for four different covariance structures — and report on a Monte Carlo study of the small sample behavior of limited and full information estimators according to the criteria of bias and dispersion. The results show that the differences in performance of the estimators for the alternative forms of the disturbance distributions are large. Moreover, none of the examined estimators is superior relative to the others, in the sense that its bias and dispersion are the smallest for at least one form of the disturbance distribution. Finally, no combination of highly or lowly autocorrelated disturbances favors some specific limited or full information estimator.     

A robust procedure for comparing several means under heteroscedasticity and nonnormality

By applying Tiku's MML robust procedure to Brown and Forsythe's (1974) statistic, this paper derives a robust and more powerful procedure for comparing several means under hetero-scedasticity and nonnormality. Some Monte Carlo studies indicate clearly that among five nonnormal distributions, except for the uniform distribution, the new test is more powerful than the Brown and Forsythe test under nonnormal distributions in all cases investigated and has substantially the same power as the Brown and Forsythe test under normal distribution.     

Bayesian Estimation Using Warner's Randomized Response Model through Simple and Mixture Prior Distributions

The linear discriminant function (LDF) is known to be optimal in the sense of achieving an optimal error rate when sampling from multivariate normal populations with equal covariance matrices. Use of the LDF in nonnormal situations is known to lead to some strange results. This paper will focus on an evaluation of misclassification probabilities when the power transformation could have been used to achieve at least approximate normality and equal covariance matrices in the sampled populations for the distribution of the observed random variables. Attention is restricted to the two-population case with bivariate distributions.     

Comparing the performance of normality tests with ROC analysis and confidence intervals

There are several statistical hypothesis tests available for assessing normality assumptions, which is an a priori requirement for most parametric statistical procedures. The usual method for comparing the performances of normality tests is to use Monte Carlo simulations to obtain point estimates for the corresponding powers. The aim of this work is to improve the assessment of 9 normality hypothesis tests. For that purpose, random samples were drawn from several symmetric and asymmetric nonnormal distributions and Monte Carlo simulations were carried out to compute confidence intervals for the power achieved, for each distribution, by two of the most usual normality tests, Kolmogorov–Smirnov with Lilliefors correction and Shapiro–Wilk. In addition, the specificity was computed for each test, again resorting to Monte Carlo simulations, taking samples from standard normal distributions. The analysis was then additionally extended to the Anderson–Darling, Cramer-Von Mises, Pearson chi-square Shapiro–Francia, Jarque–Bera, D'Agostino and uncorrected Kolmogorov–Smirnov tests by determining confidence intervals for the areas under the receiver operating characteristic curves. Simulations were performed to this end, wherein for each sample from a nonnormal distribution an equal-sized sample was taken from a normal distribution. The Shapiro–Wilk test was seen to have the best global performance overall, though in some circumstances the Shapiro–Francia or the D'Agostino tests offered better results. The differences between the tests were not as clear for smaller sample sizes. Also to be noted, the SW and KS tests performed generally quite poorly in distinguishing between samples drawn from normal distributions and t Student distributions.     

Durbin–Watson and Generalized Durbin–Watson Tests for Autocorrelations and Randomness

The Durbin–Watson (DW) test for lag 1 autocorrelation has been generalized (DWG) to test for autocorrelations at higher lags. This includes the Wallis test for lag 4 autocorrelation. These tests are also applicable to test for the important hypothesis of randomness. It is found that for small sample sizes a normal distribution or a scaled beta distribution by matching the first two moments approximates well the null distribution of the DW and DWG statistics. The approximations seem to be adequate even when the samples are from nonnormal distributions. These approximations require the first two moments of these statistics. The expressions of these moments are derived.     

A fiducial-based approach to the one-way ANOVA in the presence of nonnormality and heterogeneous error variances

In this study, we propose a new test for testing the equality of the treatment means in one-way ANOVA when the usual normality and the homogeneity of variances assumptions are not met. In developing the proposed test, we benefit from the Fisher's fiducial inference [1–3]. Distribution of the error terms is assumed to be long-tailed symmetric (LTS) which includes the normal distribution as a limiting case. Modified maximum likelihood (MML) estimators are used in the test statistics rather than the traditional least squares (LS) estimators, since LS estimators have very low efficiencies under nonnormal distributions, see Tiku [4] for the details of MML methodology. An extensive Monte Carlo simulation study is done to compare the efficiency of the proposed test with the corresponding test based on normal theory, see Li et al. [5]. Finally, we give a real life example to show the applicability of the proposed methodology.     

Semiparametric ARCH Models: An Estimating Function Approach

We introduce the method of estimating functions to study the class of autoregressive conditional heteroscedasticity (ARCH) models. We derive the optimal estimating functions by combining linear and quadratic estimating functions. The resultant estimators are more efficient than the quasi-maximum likelihood estimator. If the assumption of conditional normality is imposed, the estimator obtained by using the theory of estimating functions is identical to that obtained by using the maximum likelihood method in finite samples. The relative efficiencies of the estimating function (EF) approach in comparison with the quasi-maximum likelihood estimator are developed. We illustrate the EF approach using a univariate GARCH(1,1) model with conditional normal, Student-t, and gamma distributions. The efficiency benefits of the EF approach relative to the quasi-maximum likelihood approach are substantial for the gamma distribution with large skewness. Simulation analysis shows that the finite-sample properties of the estimators from the EF approach are attractive. EF estimators tend to display less bias and root mean squared error than the quasi-maximum likelihood estimator. The efficiency gains are substantial for highly nonnormal distributions. An example demonstrates that implementation of the method is straightforward.     

A Diagnostic Test for Normality Within the Power Exponential Family

This article develops the locally uniformly most powerful unbiased Lagrange multiplier test of normality of regression disturbances within the family of power exponential distributions. The small sample power properties of the test are compared in a Monte Carlo study with 6 well-known tests across 12 alternative nonnormal distributions. In addition, the finite sample power properties for nonnormal alternatives within the power exponential family are summarized by estimating response surfaces. The results suggest that the proposed text is computationally convenient and possesses relatively attractive power properties even against alternatives outside the power exponential family.     

A Note on parameter and standard error estimation in adaptive robust regression

This paper introduces practical methods of parameter and standard error estimation for adaptive robust regression where errors are assumed to be from a normal/independent family of distributions. In particular, generalized EM algorithms (GEM) are considered for the two cases of t and slash families of distributions. For the t family, a one step method is proposed to estimate the degree of freedom parameter. Use of empirical information is suggested for standard error estimation. It is shown that this choice leads to standard errors that can be obtained as a by-product of the GEM algorithm. The proposed methods, as discussed, can be implemented in most available nonlinear regression programs. Details of implementation in SAS NLIN are given using two specific examples.     

Use of reference distributions when dealing with unknown regression errors

A problem of estimating regression coefficients is considered when the distribution of error terms is unknown but symmetric. We propose the use of reference distributions having various kurtosis values. It is assumed that the true error distribution is one of the reference distributions, but the indicator variable for the true distribution is missing. The generalized expectation–maximization algorithm combined with a line search is developed for estimating regression coefficients. Simulation experiments are carried out to compare the performance of the proposed approach with some existing robust regression methods including least absolute deviation, Lp, Huber M regression and an approximation using normal mixtures under various error distributions. As the error distribution is far from a normal distribution, the proposed method is observed to show better performance than other methods.     

A simulation study of l1:estimation of a seasonal moving average time series model

A detailed simulation study is reported on the application of l₁:estimations to a seasonal moving average model. It is found that the asymptotic normal distribution is a nonapproximation to the finite sample distribution. However, the expected benefits of l₁:estimation relative to l₂:are partially realised for nonnormal innovative distributions.     

Nonlinear unbiased estimation in the linear regression model with nonnormal disturbances

In the application of the linear regression model there continues to be wide-spread use of the Least Squares Estimator (LSE) due to its theoretical optimality. For example, it is well known that the LSE is the best unbiased estimator under normality while it remains best linear unbiased estimator (BLUE) when the normality assumption is dropped. In this paper we extend an approach given in Knautz (1993) that allows improvement of the LSE in the context of nonnormal and nonsymmetric error distributions. It will be shown that there exist linear plus quadratic (LPQ) estimators, consisting of linear and quadratic terms in the dependent variable, which dominate the LS estimator, depending on second, third and fourth moments of the error distribution. A simulation study illustrates that this remains true if the moments have to be estimated from the data. Computation of confidence intervals using bootstrap methods reveal significant improvement compared with inference based on the LS especially for nonsymmetric distributions of the error term.