Robust regression: an inferential method for determining which independent variables are most important

Consider the usual linear regression model consisting of two or more explanatory variables. There are many methods aimed at indicating the relative importance of the explanatory variables. But in general these methods do not address a fundamental issue: when all of the explanatory variables are included in the model, how strong is the empirical evidence that the first explanatory variable is more or less important than the second explanatory variable? How strong is the empirical evidence that the first two explanatory variables are more important than the third explanatory variable? The paper suggests a robust method for dealing with these issues. The proposed technique is based on a particular version of explanatory power used in conjunction with a modification of the basic percentile method.     

Correlation coefficient of response variances in compound noise and product array experiments

In robust parameter design, a compound noise experiment has been frequently used for reducing the number of experimental runs compared to a product array experiment. However, the results obtained by the compound noise experiment and the product array experiment are often much different. This paper derives an expression of the correlation coefficient of response variances in the compound noise and the product array experiments, which gives an explanation of that difference.     

A note on stable limit theory for the OLSE with non usual rates and the heteroskedasticity robust Wald test

We are occupied with an example concerning the limit theory of the ordinary least squares estimator (OLSE) when the innovation process of the regression has the form of a martingale transform the iid part of which lies in the domain of attraction of an α-stable distribution, the scaling sequence has a potentially diverging truncated α-moment, and the regressor process has a potentially divergent truncated second moment. We obtain matrix rates that reflect the stability parameter as well as the slow variations present in the aforementioned sequences, and stable limits. We also derive asymptotic exactness, consistency, and local asymptotic unbiasedness under appropriate local alternatives for a heteroskedasticity robust Wald test based on subsampling. The results could be useful for inference on the factor loadings in an instance of the APT model.     

WLAD-LASSO method for robust estimation and variable selection in partially linear models

This paper focuses on robust estimation and variable selection for partially linear models. We combine the weighted least absolute deviation (WLAD) regression with the adaptive least absolute shrinkage and selection operator (LASSO) to achieve simultaneous robust estimation and variable selection for partially linear models. Compared with the LAD-LASSO method, the WLAD-LASSO method will resist to the heavy-tailed errors and outliers in the parametric components. In addition, we estimate the unknown smooth function by a robust local linear regression. Under some regular conditions, the theoretical properties of the proposed estimators are established. We further examine finite-sample performance of the proposed procedure by simulation studies and a real data example.     

Robust Bayesian prediction under a general linear-exponential posterior risk function and its application in finite population

We consider robust Bayesian prediction of a function of unobserved data based on observed data under an asymmetric loss function. Under a general linear-exponential posterior risk function, the posterior regret gamma-minimax (PRGM), conditional gamma-minimax (CGM), and most stable (MS) predictors are obtained when the prior distribution belongs to a general class of prior distributions. We use this general form to find the PRGM, CGM, and MS predictors of a general linear combination of the finite population values under LINEX loss function on the basis of two classes of priors in a normal model. Also, under the general ε-contamination class of prior distributions, the PRGM predictor of a general linear combination of the finite population values is obtained. Finally, we provide a real-life example to predict a finite population mean and compare the estimated risk and risk bias of the obtained predictors under the LINEX loss function by a simulation study.     

Proportional hazards model for competing risks data with missing cause of failure

We consider the semiparametric proportional hazards model for the cause-specific hazard function in analysis of competing risks data with missing cause of failure. The inverse probability weighted equation and augmented inverse probability weighted equation are proposed for estimating the regression parameters in the model, and their theoretical properties are established for inference. Simulation studies demonstrate that the augmented inverse probability weighted estimator is doubly robust and the proposed method is appropriate for practical use. The simulations also compare the proposed estimators with the multiple imputation estimator of Lu and Tsiatis (2001). The application of the proposed method is illustrated using data from a bone marrow transplant study.     

A generalisation of T‐optimality for discriminating between competing models with an application to pharmacokinetic studies

The T‐optimality criterion is used in optimal design to derive designs for model selection. To set up the method, it is required that one of the models is considered to be true. We term this local T‐optimality. In this work, we propose a generalisation of T‐optimality (termed robust T‐optimality) that relaxes the requirement that one of the candidate models is set as true. We then show an application to a nonlinear mixed effects model with two candidate non‐nested models and combine robust T‐optimality with robust D‐optimality. Optimal design under local T‐optimality was found to provide adequate power when the a priori assumed true model was the true model but poor power if the a priori assumed true model was not the true model. The robust T‐optimality method provided adequate power irrespective of which model was true. The robust T‐optimality method appears to have useful properties for nonlinear models, where both the parameter values and model structure are required to be known a priori, and the most likely model that would be applied to any new experiment is not known with certainty. Copyright © 2012 John Wiley & Sons, Ltd.     

不确定需求下二级供应链中的鲁棒定价问题

对由一个制造商和一个零售商组成的单一产品二级供应链,在市场潜在需求和价格敏感系数不确定的情况下,分析制造商和零售商的鲁棒定价决策。首先考虑了零售商掌握完全信息而制造商仅已知各参数区间的不对称信息情形,建立Stackelberg鲁棒博弈模型并对模型的均衡解进行探讨,进一步通过对解的分析和对比讨论了不对称信息下零售商的决策优势。然后研究了制造商和零售商都仅已知各参数区间的不完全信息情形,给出Stackelberg鲁棒博弈模型,求得其均衡解并与完全信息下的情形以及不对称信息下的情形进行比较,分别得到制造商和零售商在不完全信息下所获得的利润比在完全信息下所获得利润高的条件,并证明了制造商在不完全信息下所获得的利润比在不对称信息下获得的利润高,而零售商则刚好相反。最后给出算例分析,对所得到的解和结论做一些补充。     

Between stability and higher-order asymptotics

We discuss the effects of model misspecifications on higher-order asymptotic approximations of the distribution of estimators and test statistics. In particular we show that small deviations from the model can wipe out the nominal improvements of the accuracy obtained at the model by second-order approximations of the distribution of classical statistics. Although there is no guarantee that the first-order robustness properties of robust estimators and tests will carry over to second-order in a neighbourhood of the model, the behaviour of robust procedures in terms of second-order accuracy is generally more stable and reliable than that of their classical counterparts. Finally, we discuss some related work on robust adjustments of the profile likelihood and outline the role of computer algebra in this type of research.     

Adaptive Estimation Using Weighted Least Squares

This paper proposes an adaptive estimator that is more precise than the ordinary least squares estimator if the distribution of random errors is skewed or has long tails. The adaptive estimates are computed using a weighted least squares approach with weights based on the lengths of the tails of the distribution of residuals. Smaller weights are assigned to those observations that have residuals in the tails of long-tailed distributions and larger weights are assigned to observations having residuals in the tails of short-tailed distributions. Monte Carlo methods are used to compare the performance of the proposed estimator and the performance of the ordinary least squares estimator. The estimates that were studied in this simulation include the difference between the means of two populations, the mean of a symmetric distribution, and the slope of a regression line. The adaptive estimators are shown to have lower mean squared errors than those for the ordinary least squares estimators for short-tailed, long-tailed, and skewed distributions, provided the sample size is at least 20. The ordinary least squares estimator has slightly lower mean squared error for normally distributed errors. The adaptive estimator is recommended for general use for studies having sample sizes of at least 20 observations unless the random errors are known to be normally distributed.