Bootstrap Procedures for Online Monitoring of Changes in Autoregressive Models

We compare the behavior of several bootstrap procedures for monitoring changes in the error distribution of autoregressive time series. The proposed procedures are designed to control the overall significance level and include classical tests based on the empirical distribution function as well as Fourier-type methods that utilize the empirical characteristic function, both functions being computed on the basis of properly estimated residuals. The Monte Carlo study incorporates different estimators and a variety of sampling situations with and without outliers.     

Robust linear regression: A review and comparison

Ordinary least-square (OLS) estimators for a linear model are very sensitive to unusual values in the design space or outliers among y values. Even one single atypical value may have a large effect on the parameter estimates. This article aims to review and describe some available and popular robust techniques, including some recent developed ones, and compare them in terms of breakdown point and efficiency. In addition, we also use a simulation study and a real data application to compare the performance of existing robust methods under different scenarios.     

Bootstrap Confidence Intervals for Large-scale Multivariate Monotonic Regression Problems

Recently, the methods used to estimate monotonic regression (MR) models have been substantially improved, and some algorithms can now produce high-accuracy monotonic fits to multivariate datasets containing over a million observations. Nevertheless, the computational burden can be prohibitively large for resampling techniques in which numerous datasets are processed independently of each other. Here, we present efficient algorithms for estimation of confidence limits in large-scale settings that take into account the similarity of the bootstrap or jackknifed datasets to which MR models are fitted. In addition, we introduce modifications that substantially improve the accuracy of MR solutions for binary response variables. The performance of our algorithms is illustrated using data on death in coronary heart disease for a large population. This example also illustrates that MR can be a valuable complement to logistic regression.     

Jackknife-After-Bootstrap as Logistic Regression Diagnostic Tool

In this study, we propose using Jackknife-after-Bootstrap (JaB) method to detect influential observations in binary logistic regression model. Performance of the proposed method has been compared with the traditional method for standardized Pearson residuals, Cook's distance, change in the Pearson chi-square and change in the deviance statistics by both real world examples and simulation studies. The results reveal that under the various scenarios considered in this article, JaB performs better than the traditional method and is more robust to masking effect especially for Cook's distance.     

The Effect of Pseudo-Exogenous Instrumental Variables on Hausman Test

Hausman test is popularly used to examine the endogeneity of explanatory variables in a regression model. To derive a well-defined asymptotic distribution of Hausman test, the correlation between the instrumental variables and the error term needs to converge to zero. However, it is possible that there remains considerable correlation in finite samples between the instruments and the error, even though their correlation eventually converges to zero. This article investigates the potential problem that such “pseudo-exogenous” instruments may create. We show that the performance of Hausman test is deteriorated when the instruments are asymptotically exogenous but endogenous in finite samples, through Monte Carlo simulations.     

IV估计框架下模型设定检验问题的讨论

 IV估计框架下各种统计量的良好性质依赖于相应的模型设定,如果这些模型设定未能得到数据的支持,其统计推断结论将是不可靠的。如判定计量经济模型是否存在内生性的Hausman检验,实证研究中同一问题的检验结果可能大相径庭。如何通过合理的模型设定检验程序来获得模型参数科学、可靠的估计结果和检验结论呢？本文讨论了工具变量估计框架下的各种模型设定检验问题,明确了各个检验统计量的适用条件及其逻辑联系,给出了工具变量估计框架下模型设定检验的一般步骤。     

On Robustness of Model-Based Bootstrap Schemes in Nonparametric Time Series Analysis

Theory in time series analysis is often developed under the assumption of finite-dimensional models for the data generating process. Whereas corresponding estimators such as those of a conditional mean function are reasonable even if the true dependence mechanism is more complex, it is usually necessary to capture the whole dependence structure asymptotically for the bootstrap to be valid. In contrast, we show that certain simplified bootstrap schemes which imitate only some aspects of the time series are consistent for quantities arising in nonparametric statistics. To this end, we generalize the well-known "whitening by windowing" principle to joint distributions of nonparametric estimators of the autoregression function. Consequently, we obtain that model-based nonparametric bootstrap schemes remain valid for supremum-type functionals as long as they mimic those finite-dimensional joint distributions consistently which determine the quantity of interest. As an application, we show that simple regression-type bootstrap schemes can be applied for the determination of critical values for nonparametric tests of parametric or semiparametric hypotheses on the autoregression function in the context of a general process.     

Properties of Added Variable Plots in Cox's Regression Model

The added variable plot is useful for examining the effect of a covariate in regression models. The plot provides information regarding the inclusion of a covariate, and is useful in identifying influential observations on the parameter estimates. Hall et al. (1996) proposed a plot for Cox's proportional hazards model derived by regarding the Cox model as a generalized linear model. This paper proves and discusses properties of this plot. These properties make the plot a valuable tool in model evaluation. Quantities considered include parameter estimates, residuals, leverage, case influence measures and correspondence to previously proposed residuals and diagnostics.     

线性回归模型Bootstrap LM-Lag检验有效性研究

基于OLS估计残差,将Bootstrap方法用于空间滞后相关LM-Lag检验。在不同的误差结构和空间权重矩阵条件下,比较Bootstrap LM-Lag检验和渐近检验的水平扭曲和功效。通过Monte Carlo实验表明,当误差项不服从经典正态分布假设时,LM-Lag渐近检验存在严重的水平扭曲,Bootstrap检验能够有效地校正水平扭曲,并且Bootstrap LM-Lag检验的功效与渐近检验近似;无论误差项是否服从正态分布,从水平扭曲和功效角度看,线性回归模型Bootstrap LM-Lag检验有效。     

高相关性辅助变量择优回归插补法

调查数据无回答在抽样调查中经常出现.无回答项目插补法是处理无回答的最主要方法之一,而辅助变量对提高插补值准确度非常重要.因此,研究调查数据无回答项目的高相关性辅助变量择优回归插补法,先筛选与目标变量间相关系数高的辅助变量,再建立回归插补模型.该方法的辅助变量选择过程简单,插补值准确性高.模拟例子演示了该方法的优良性.     

Monotone Nonparametric Regression and Confidence Intervals

Several variations of monotone nonparametric regression have been developed over the past 30 years. One approach is to first apply nonparametric regression to data and then monotone smooth the initial estimates to “iron out” violations to the assumed order. Here, such estimators are considered, where local polynomial regression is first used, followed by either least squares isotonic regression or a monotone method using simple averages. The primary focus of this work is to evaluate different types of confidence intervals for these monotone nonparametric regression estimators through Monte Carlo simulation. Most of the confidence intervals use bootstrap or jackknife procedures. Estimation of a response variable as a function of two continuous predictor variables is considered, where the estimation is performed at the observed values of the predictors (instead of on a grid). The methods are then applied to data involving subjects that worked at plants that use beryllium metal who have developed chronic beryllium disease.     

Robustness of theil's mixed regression estimators

An efficient method for incorporating incomplete prior information in regression analysis was developed by Theil [1963]. In this paper we take up the estimator of coefficients given by this procedure and study its robustness to departures from normality of prior estimators of coefficients. The use of incomplete or biased prior information in regression analysis is also considered and a new estimator for the regression coefficient is suggested.     

The 50% breakdown point in simultaneous M-estimation of location and scale

Received: November 8, 1999; revised version: March 13, 2000     

Regression with outlier shrinkage

We propose a robust regression method called regression with outlier shrinkage (ROS) for the traditional n>p$n>p$ cases. It improves over the other robust regression methods such as least trimmed squares (LTS) in the sense that it can achieve maximum breakdown value and full asymptotic efficiency simultaneously. Moreover, its computational complexity is no more than that of LTS. We also propose a sparse estimator, called sparse regression with outlier shrinkage (SROS), for robust variable selection and estimation. It is proven that SROS can not only give consistent selection but also estimate the nonzero coefficients with full asymptotic efficiency under the normal model. In addition, we introduce a concept of nearly regression equivariant estimator for understanding the breakdown properties of sparse estimators, and prove that SROS achieves the maximum breakdown value of nearly regression equivariant estimators. Numerical examples are presented to illustrate our methods.     

Finite sample tail behaviour of hodges-lehmann type estimators

The tail behavior of Hodges-Lehmann type location estimators is studied with respect to a tail performance measure. The result obtained here generalizes and complements the corresponding work on R-estimators of JurecKova (1981a). The connection between the tail behavior and the breakdown point discovered in He, Jureckova Koenker and Portnoy (1990) for regression and monotone location estimators is extended to Hodges-Lehmann type location estimators, confirming the important role of the tail behavior as a measure of robustness of estimators.     

Calibration Intervals in Linear Regression Models

Many of the existing methods of finding calibration intervals in simple linear regression rely on the inversion of prediction limits. In this article, we propose an alternative procedure which involves two stages. In the first stage, we find a confidence interval for the value of the explanatory variable which corresponds to the given future value of the response. In the second stage, we enlarge the confidence interval found in the first stage to form a confidence interval called, calibration interval, for the value of the explanatory variable which corresponds to the theoretical mean value of the future observation. In finding the confidence interval in the first stage, we have used the method based on hypothesis testing and percentile bootstrap. When the errors are normally distributed, the coverage probability of resulting calibration interval based on hypothesis testing is comparable to that of the classical calibration interval. In the case of non normal errors, the coverage probability of the calibration interval based on hypothesis testing is much closer to the target value than that of the calibration interval based on percentile bootstrap.     

Bootstrap Bartlett correction in inflated beta regression

The inflated beta regression model aims to enable the modeling of responses in the intervals (0, 1], [0, 1), or [0, 1]. In this model, hypothesis testing is often performed based on the likelihood ratio statistic. The critical values are obtained from asymptotic approximations, which may lead to distortions of size in small samples. In this sense, this article proposes the bootstrap Bartlett correction to the statistic of likelihood ratio in the inflated beta regression model. The proposed adjustment only requires a simple Monte Carlo simulation. Through extensive Monte Carlo simulations the finite sample performance (size and power) of the proposed corrected test is compared to the usual likelihood ratio test and the Skovgaard adjustment already proposed in the literature. The numerical results evidence that inference based on the proposed correction is much more reliable than that based on the usual likelihood ratio statistics and the Skovgaard adjustment. At the end of the work, an application to real data is also presented.     

Instrumental variable estimation in ordinal probit models with mismeasured predictors

Researchers in the medical, health, and social sciences routinely encounter ordinal variables such as self‐reports of health or happiness. When modelling ordinal outcome variables, it is common to have covariates, for example, attitudes, family income, retrospective variables, measured with error. As is well known, ignoring even random error in covariates can bias coefficients and hence prejudice the estimates of effects. We propose an instrumental variable approach to the estimation of a probit model with an ordinal response and mismeasured predictor variables. We obtain likelihood‐based and method of moments estimators that are consistent and asymptotically normally distributed under general conditions. These estimators are easy to compute, perform well and are robust against the normality assumption for the measurement errors in our simulation studies. The proposed method is applied to both simulated and real data. The Canadian Journal of Statistics 47: 653–667; 2019 © 2019 Statistical Society of Canada     

空间滞后分位数回归模型的工具变量估计及参数检验

本文提出一种遵循空间数据分布特征的空间分位数回归模型,并着重探讨该模型的估计方法和参数检验问题。本文构建了上述模型的一个工具变量估计法,通过数理证明建立了估计量的大样本理论,并基于估计量的渐近分布构造了模型的参数检验方法。本文还通过数值模拟方法和应用实例考察估计方法和参数检验方法的实际应用效果,数值模拟结果显示,估计方法和参数检验方法在有限样本条件下均可以达到较高的精确度和稳定性。在应用实例中,本文利用所构建的理论方法重新检验我国“资源诅咒”效应的存在性,实证结果体现了理论方法的应用价值。     

A Parametric Bootstrap Test for Comparing Heteroscedastic Regression Models

Testing equality of regression coefficients in several regression models is a common problem encountered in many applied fields. This article presents a parametric bootstrap (PB) approach and compares its performance to that of another simulation-based approach, namely, the generalized variable approach. Simulation studies indicate that the PB approach controls the Type I error rates satisfactorily regardless of the number of regression models and sample sizes whereas the generalized variable approach tends to be very liberal as the number of regression models goes up. The proposed PB approach is illustrated using a data set from stability study.