A robust test for autocorrelation in the presence of a structural break in variance

It has been known that when there is a break in the variance (unconditional heteroskedasticity) of the error term in linear regression models, a routine application of the Lagrange multiplier (LM) test for autocorrelation can cause potentially significant size distortions. We propose a new test for autocorrelation that is robust in the presence of a break in variance. The proposed test is a modified LM test based on a generalized least squares regression. Monte Carlo simulations show that the new test performs well in finite samples and it is especially comparable to other existing heteroskedasticity-robust tests in terms of size, and much better in terms of power.     

Rank‐based estimate of four‐parameter logistic model

During drug development, the calculation of inhibitory concentration that results in a response of 50% (IC₅₀) is performed thousands of times every day. The nonlinear model most often used to perform this calculation is a four‐parameter logistic, suitably parameterized to estimate the IC₅₀ directly. When performing these calculations in a high‐throughput mode, each and every curve cannot be studied in detail, and outliers in the responses are a common problem. A robust estimation procedure to perform this calculation is desirable. In this paper, a rank‐based estimate of the four‐parameter logistic model that is analogous to least squares is proposed. The rank‐based estimate is based on the Wilcoxon norm. The robust procedure is illustrated with several examples from the pharmaceutical industry. When no outliers are present in the data, the robust estimate of IC₅₀ is comparable with the least squares estimate, and when outliers are present in the data, the robust estimate is more accurate. A robust goodness‐of‐fit test is also proposed. To investigate the impact of outliers on the traditional and robust estimates, a small simulation study was conducted. Copyright © 2012 John Wiley & Sons, Ltd.     

The finite-sample performance of robust unit root tests

This paper investigates the relative small sample performance of several robust unit root tests by means of a simulation study. It is confirmed that the traditional least-squares based Dickey-Fuller test has substantially lower power than several robust alternatives if the error distribution is fat-tailed while its power gain is small at the normal model. Particularly good results are achieved by a quasi-maximum likelihood test. However, all robust tests under consideration exhibit severe size distortions if the disturbances follow a skewed distribution. Moreover, under additive outliers, robust tests fail to produce stable sizes and good power properties. Consequently, the value of using robust unit root tests depends heavily of the type of nonnormality at hand.     

Weighted Wilcoxon Estimators in Nonlinear Regression

In this paper, we consider the estimation of parameters of a general near regression model. An estimator that minimises the weighted Wilcoxon dispersion function is considered and its asymptotic properties established under mild regularity conditions similar to those used in least squares and least absolute deviations estimation. As in linear models, the procedure provides estimators that are robust and highly efficient. The estimates depend on the choice of a weight function and diagnostics which differentiate between nonlinear fits are provided along with appropriate benchmarks. The behavior of these estimates is discussed on a real data set. A simulation study verifies the robustness, efficiency and validity of these estimates over several error distributions including the normal and a family of contaminated normal distributions.     

Penalized Weighted Least Squares to Small Area Estimation

In this paper, a penalized weighted least squares approach is proposed for small area estimation under the unit level model. The new method not only unifies the traditional empirical best linear unbiased prediction that does not take sampling design into account and the pseudo‐empirical best linear unbiased prediction that incorporates sampling weights but also has the desirable robustness property to model misspecification compared with existing methods. The empirical small area estimator is given, and the corresponding second‐order approximation to mean squared error estimator is derived. Numerical comparisons based on synthetic and real data sets show superior performance of the proposed method to currently available estimators in the literature.     

Testing Covariate Effects in Aalen's Linear Hazard Model

The performance of tests in Aalen's linear regression model is studied using asymptotic power calculations and stochastic simulation. Aalen's original least squares test is compared to two modifications: a weighted least squares test with correct weights and a test where the variance is re-estimated under the null hypothesis. The test with re-estimated variance provides the highest power of the tests for the setting of this paper, and the gain is substantial for covariates following a skewed distribution like the exponential. It is further shown that Aalen's choice for weight function with re-estimated variance is optimal in the one-parameter case against proportional alternatives.     

Data Driven Rank Test for Two-Sample Problem

Traditional linear rank tests are known to possess low power for large spectrum of alternatives. In this paper we introduce a new rank test possessing a considerably larger range of sensitivity than linear rank tests. The new test statistic is a sum of squares of some linear rank statistics while the number of summands is chosen via a data-based selection rule. Simulations show that the new test possesses high and stable power in situations when linear rank tests completely break down, while simultaneously it has almost the same power under alternatives which can be detected by standard linear rank tests. Our approach is illustrated by some practical examples. Theoretical support is given by deriving asymptotic null distribution of the test statistic and proving consistency of the new test under essentially any alternative.     

Diagnostic Checking for GARCH-Type Models

The asymptotic distributions of squared and absolute residual autocorrelations for GARCH model estimated by M-estimators are derived. Two diagnostic tests are developed which can be used to check the adequacy of GARCH model fitted by using M-estimators. Simulation results show that the empirical sizes of both tests are close to the nominal size in most of the cases. The power of test based on absolute residual autocorrelation is found better than test based on squared residual autocorrelations. Our results reveal that there are estimators that can fit GARCH-type models better than the commonly used quasi-maximum likelihood estimator under non normal errors. An application to real data set is also presented.     

Testing equality of two beta binomial proportions in the presence of unequal extra-dispersion parameters

Data in the form of proportions with extra-dispersion (over/under) arise in many biomedical, epidemiological, and toxicological applications. In some situations, two samples of data in the form of proportions with extra-dispersion arise in which the problem is to test the equality of the proportions in the two groups with unspecified and possibly unequal extra-dispersion parameters. This problem is analogous to the traditional Behrens-Fisher problem in which two normal population means with possibly unequal variances are compared. To deal with this problem we develop eight tests and compare them in terms of empirical size and power, using a simulation study. Simulations show that a C(α) test based on extended quasi-likelihood estimates of the nuisance parameters holds nominal level most effectively (close to the nominal level) and it is at least as powerful as any other statistic that is not liberal. It has the simplest formula, is based on estimates of the nuisance parameters only under the null hypothesis, and is easiest to calculate. Also, it is robust in the sense that no distributional assumption is required to develop this statistic.     

Modified Wynn's Sequential Algorithm for Constructing D-Optimal Designs: Adding Two Points at a Time

Partial least squares (PLS) is a class of methods for modeling relations between sets of observed variables by using the latent components where the predictors are highly collinear. SIMPLS is a commonly used PLS algorithm that calculates the latent components directly as linear combinations of the original variables. However, SIMPLS is known to be very sensible to outliers since it is based on the empirical cross-covariance matrix. RoPLS is a recently proposed iterative method for robust SIMPLS. In this article, the influence function for the RoPLS coefficient estimator is derived. It is demonstrated that under certain conditions, the RoPLS estimator has infinitesimal robustness.     

Robust nonparametric tests for the two-sample location problem

We construct and investigate robust nonparametric tests for the two-sample location problem. A test based on a suitable scaling of the median of the set of differences between the two samples, which is the Hodges-Lehmann shift estimator corresponding to the Wilcoxon two-sample rank test, leads to higher robustness against outliers than the Wilcoxon test itself, while preserving its efficiency under a broad range of distributions. The good performance of the constructed test is investigated under different distributions and outlier configurations and compared to alternatives like the two-sample t-, the Wilcoxon and the median test, as well as to tests based on the difference of the sample medians or the one-sample Hodges-Lehmann estimators.     

Bootstrap methods for heteroskedastic regression models: evidence on estimation and testing

This paper uses Monte Carlo simulation analysis to study the finite-sample behavior of bootstrap estimators and tests in the linear heteroskedastic model. We consider four different bootstrapping schemes, three of them specifically tailored to handle heteroskedasticity. Our results show that weighted bootstrap methods can be successfully used to estimate the variances of the least squares estimators of the linear parameters both under normality and under nonnormality. Simulation results are also given comparing the size and power of the bootstrapped Breusch-Pagan test with that of the original test and of Bartlett and Edgeworth-corrected tests. The bootstrap test was found to be robust against unfavorable regression designs.     

A doubly robust goodness-of-fit test in general linear models with missing covariates

In this article, we utilize a form of general linear model where missing data occurred randomly on the covariates. We propose a test function based on the doubly robust method to investigate goodness of fit of the model. For this aim, kernel method is used to estimate unknown functions under estimating equation method. Doubly robustness and asymptotic properties of the test function are obtained under local and alternative hypotheses. Furthermore, we investigate the power of the proposed test function by means of some simulation studies and finally we apply this method on analyzing a real dataset.     

A new nonlinear asymmetric cointegration approach using error correction models

In this article, two new powerful tests for cointegration are proposed. The general idea is based on an intuitively appealing extension of the traditional, rather restrictive cointegration concept. In this article, we allow for a nonlinear, but most importantly a different, asymmetric convergence process to account for negative and positive changes in our cointegration approach. Using Monte Carlo simulations we verify, that the estimated size of the first test depends on the unknown value of a signal-to-noise ratio q. However, our second test—which is based on the original ideas of Kanioura and Turner—is more successful and robust in the sense that it works in all of the different evaluated situations. Furthermore it is shown to be more powerful than the traditional residual based Enders and Siklos method. The new optimal test is also applied in an empirical example in order to test for potential nonlinear asymmetric price transmission effects on the Swedish power market. We find that there is a higher propensity for power retailers to rapidly and systematically increase their retail electricity prices subsequent to increases in Nordpool's wholesale prices, than there is for them to reduce their prices subsequent to a drop in wholesale spot prices.     

Two-Stage Bounded-lnfluence Estimators for Simultaneous-Equations Models

This article presents a class of estimators for linear structural models that are robust to heavytailed disturbance distributions, gross errors in either the endogenous or exogenous variables, and certain other model failures. The class of estimators modifies ordinary two-stage least squares by replacing each least squares regression by a bounded-influence regression. Conditions under which the estimators are qualitatively robust, consistent, and asymptotically normal are established, and an empirical example is presented.     

JACKKNIFE TESTS FOR HETEROSCEDASTICITY IN THE GENERAL LINEAR MODEL

In this paper, tests based on the Jackknife technique are proposed to test for heteroscedasticity in the linear regression model when the errors are non-normal. These are the Jackknifed Goldfeld-Quandt (GQ), and jack-knife related variations of White (H), Lagrange multiplier (LM), Glejser (GL) and Bickel (B) tests. The power of the proposed tests is compared with that of GQ, H, LM, GL and B tests; and the robustness to the error distribution is analyzed under several heteroscedastic assumptions. The GQ test is by far the best test if the error distribution is close to normal, however, GQ test is not robust against non-normal errors. By applying the jackknife technique to the regression a more robust statistic (GQJRG) is produced but the cost is a loss in power. The GQJRG statistic generally is not M powerful as the Bickel (BlOLS) and Glejser (GLlOLS) statistics.     

OLS and IV estimation of regression models including endogenous interaction terms

We analyze a class of linear regression models including interactions of endogenous regressors and exogenous covariates. We show how to generate instrumental variables using the nonlinear functional form of the structural equation when traditional excluded instruments are unknown. We propose to use these instruments with identification robust IV inference. We furthermore show that, whenever functional form identification is not valid, the ordinary least squares (OLS) estimator of the coefficient of the interaction term is consistent and standard OLS inference applies. Using our alternative empirical methods we confirm recent empirical findings on the nonlinear causal relation between financial development and economic growth.     

Rank-based ridge estimation in multiple linear regression

Multicollinearity and model misspecification are frequently encountered problems in practice that produce undesirable effects on classical ordinary least squares (OLS) regression estimator. The ridge regression estimator is an important tool to reduce the effects of multicollinearity, but it is still sensitive to a model misspecification of error distribution. Although rank-based statistical inference has desirable robustness properties compared to the OLS procedures, it can be unstable in the presence of multicollinearity. This paper introduces a rank regression estimator for regression parameters and develops tests for general linear hypotheses in a multiple linear regression model. The proposed estimator and the tests have desirable robustness features against the multicollinearity and model misspecification of error distribution. Asymptotic behaviours of the proposed estimator and the test statistics are investigated. Real and simulated data sets are used to demonstrate the feasibility and the performance of the estimator and the tests.     

A Weighted Least Squares Approach to Levene's Test of Homogeneity of Variance

In 1960 Levene suggested a potentially robust test of homogeneity of variance based on an ordinary least squares analysis of variance of the absolute values of mean-based residuals. Levene's test has since been shown to have inflated levels of significance when based on the F-distribution, and tests a hypothesis other than homogeneity of variance when treatments are unequally replicated, but the incorrect formulation is now standard output in several statistical packages. This paper develops a weighted least squares analysis of variance of the absolute values of both mean-based and median-based residuals. It shows how to adjust the residuals so that tests using the F -statistic focus on homogeneity of variance for both balanced and unbalanced designs. It shows how to modify the F -statistics currently produced by statistical packages so that the distribution of the resultant test statistic is closer to an F-distribution than is currently the case. The weighted least squares approach also produces component mean squares that are unbiased irrespective of which variable is used in Levene's test. To complete this aspect of the investigation the paper derives exact second-order moments of the component sums of squares used in the calculation of the mean-based test statistic. It shows that, for large samples, both ordinary and weighted least squares test statistics are equivalent; however they are over-dispersed compared to an F variable.