Optimal bounded influence regression and scale m-estimators in the context of experimental desing

The problem of simultaneous robust estimation of regression and scale parameters in the linear regression model is studied in the context of experimental design. Optimal M-estimates are given for a modified optimization problem of minimizing the asymptotic variances under bounded influence functions. This is done by reducing the multidimensional regression problem to the problem of estimating one-dimensional location and scale. For the location-scale case two subfamilies of optimal score functions are described in detail along with comparisons of the asymptotic variances and gross-error-sensitivities of the corresponding M-estimators. It turns out that, even for small gross-error-sensitivities, one of the subfamilies provides variances which are close to those of the nonrobust maximum likelihood estimators.     

A high breakdown,high efficiency and bounded influence modified GM estimator based on support vector regression

Regression analysis aims to estimate the approximate relationship between the response variable and the explanatory variables. This can be done using classical methods such as ordinary least squares. Unfortunately, these methods are very sensitive to anomalous points, often called outliers, in the data set. The main contribution of this article is to propose a new version of the Generalized M-estimator that provides good resistance against vertical outliers and bad leverage points. The advantage of this method over the existing methods is that it does not minimize the weight of the good leverage points, and this increases the efficiency of this estimator. To achieve this goal, the fixed parameters support vector regression technique is used to identify and minimize the weight of outliers and bad leverage points. The effectiveness of the proposed estimator is investigated using real and simulated data sets.     

A consistent estimator for the supremum of the projection index based on sliced inverse regression

To seek the nonlinear structure hidden in data points of high-dimension, a transformation related to projection pursuit method and a projection index were proposed by Li (1989, 1990 ). In this paper, we present a consistent estimator of the supremum of the projection index based sliced inverse regression technique. This estimator also suggests a method to obtain approximately the most interesting projection in the general case.     

Liu-type estimator in semiparametric regression models

In this paper, we introduced a Liu-type estimator for the vector of parameters β in a semiparametric regression model. We also obtained the semiparametric restricted Liu-type estimator for the parametric component in a semiparametric regression model. The ideas in the paper are illustrated in a real data example and in a Monte Carlo simulation study.     

A robust regression model for a first-order autoregressive time series with unequal spacing: application to water monitoring

Summary.  Time series arise often in environmental monitoring settings, which typically involve measuring processes repeatedly over time. In many such applications, observations are irregularly spaced and, additionally, are not distributed normally. An example is water monitoring data collected in Boston Harbor by the Massachusetts Water Resources Authority. We describe a simple robust approach for estimating regression parameters and a first-order autocorrelation parameter in a time series where the observations are irregularly spaced. Estimates are obtained from an estimating equation that is constructed as a linear combination of estimated innovation errors, suitably made robust by symmetric and possibly bounded functions. Under an assumption of data missing completely at random and mild regularity conditions, the proposed estimating equation yields consistent and asymptotically normal estimates. Simulations suggest that our estimator performs well in moderate sample sizes. We demonstrate our method on Secchi depth data collected from Boston Harbor.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

Feasible robust estimator in restricted semiparametric regression models based on the LTS approach

Under some nonstochastic linear restrictions based on either additional information or prior knowledge in a semiparametric regression model, a family of feasible generalized robust estimators for the regression parameter is proposed. The least trimmed squares (LTS) method proposed by Rousseeuw as a highly robust regression estimator is a statistical technique for fitting a regression model based on the subset of h observations (out of n) whose least-square fit possesses the smallest sum of squared residuals. The coverage h may be set between n/2 and n. The LTS estimator involves computing the hyperplane that minimizes the sum of the smallest h squared residuals. For practical purpose, it is assumed that the covariance matrix of the error term is unknown and thus feasible estimators are replaced. Then, we develop an algorithm for the LTS estimator based on feasible methods. Through the Monte Carlo simulation studies and a real data example, performance of the feasible type of robust estimators is compared with the classical ones in restricted semiparametric regression models.     

Robust ridge and robust Liu estimator for regression based on the LTS estimator

In the multiple linear regression analysis, the ridge regression estimator and the Liu estimator are often used to address multicollinearity. Besides multicollinearity, outliers are also a problem in the multiple linear regression analysis. We propose new biased estimators based on the least trimmed squares (LTS) ridge estimator and the LTS Liu estimator in the case of the presence of both outliers and multicollinearity. For this purpose, a simulation study is conducted in order to see the difference between the robust ridge estimator and the robust Liu estimator in terms of their effectiveness; the mean square error. In our simulations, the behavior of the new biased estimators is examined for types of outliers: X-space outlier, Y-space outlier, and X-and Y-space outlier. The results for a number of different illustrative cases are presented. This paper also provides the results for the robust ridge regression and robust Liu estimators based on a real-life data set combining the problem of multicollinearity and outliers.     

Mean square error matrix comparisons of estimators in linear regression

The aim of this paper is to provide criteria which allow to compare two estimators of the parameter vector in the linear regression model with respect to their mean square error matrices, where the main interest is focussed on the case when the difference of the covariance matrices is singular. The results obtained are applied to equality restricted and pretest estimators.     

A new estimator combining the ridge regression and the restricted least squares methods of estimation

It is well-known in the literature on multicollinearity that one of the major consequences of multicollinearity on the ordinary least squares estimator is that the estimator produces large sampling variances, which in turn might inappropriately lead to exclusion of otherwise significant coefficients from the model. To circumvent this problem, two accepted estimation procedures which are often suggested are the restricted least squares method and the ridge regression method. While the former leads to a reduction in the sampling variance of the estimator, the later ensures a smaller mean square error value for the estimator. In this paper we have proposed a new estimator which is based on a criterion that combines the ideas underlying these two estimators. The standard properties of this new estimator have been studied in the paper. It has also been shown that this estimator is superior to both the restricted least squares as well as the ordinary ridge regression estimators by the criterion of mean sauare error of the estimator of the regression coefficients when the restrictions are indeed correct. The conditions for superiority of this estimator over the other two have also been derived for the situation when the restrictions are not correct.     

A Wald-type test statistic based on robust modified median estimator in logistic regression models

In this paper a new robust estimator, modified median estimator, is introduced and studied for the logistic regression model. This estimator is based on the median estimator considered in Hobza et al. [Robust median estimator in logistic regression. J Stat Plan Inference. 2008;138:3822–3840]. Its asymptotic distribution is obtained. Using the modified median estimator, we also consider a Wald-type test statistic for testing linear hypotheses in the logistic regression model and we obtain its asymptotic distribution under the assumption of random regressors. An extensive simulation study is presented in order to analyse the efficiency as well as the robustness of the modified median estimator and Wald-type test based on it.     

Estimates of regression coefficients based on the sign covariance matrix

Summary. A new estimator of the regression parameters is introduced in a multivariate multiple-regression model in which both the vector of explanatory variables and the vector of response variables are assumed to be random. The affine equivariant estimate matrix is constructed using the sign covariance matrix (SCM) where the sign concept is based on Oja's criterion function. The influence function and asymptotic theory are developed to consider robustness and limiting efficiencies of the SCM regression estimate. The estimate is shown to be consistent with a limiting multinormal distribution. The influence function, as a function of the length of the contamination vector, is shown to be linear in elliptic cases; for the least squares (LS) estimate it is quadratic. The asymptotic relative efficiencies with respect to the LS estimate are given in the multivariate normal as well as the t -distribution cases. The SCM regression estimate is highly efficient in the multivariate normal case and, for heavy-tailed distributions, it performs better than the LS estimate. Simulations are used to consider finite sample efficiencies with similar results. The theory is illustrated with an example.     

A robust R control chart based on a two-step estimator of the process dispersion

ABSTRACT

Control charts are the frequently used tools for monitoring and controlling the processes. Classical control charts are sensitive to existing contaminated data which may be presented in the data collected from the processes. Thus, these charts are not able to control the processes precisely when the data are contaminated. Robust control charts are those which are less sensitive to contamination. Some robust control charts for monitoring the process variability were proposed in the past which are robust to some sorts of contamination. In this paper a new robust R control chart is proposed which is less sensitive to wide range of contaminations, i.e. general and local contaminations. Simulation studies are performed to compare the performance of the proposed control chart with some classical and robust control charts, using ARL and MSD as criteria for comparisons purposes. The simulation results show a very good performance of the proposed chart when both types of contaminations exist.     

Estimators of shift based on statistics of the Kolmogorov-Smirnov type

This paper is concerned with the estimation of a shift parameter δ_o, based on some nonnegative functional Hg₁ of the pair (D^δ_N(x), f?^δ_N(x)), where D^δ_N(x) = K_N/b {F_2,n(x)—F_1,m (x + δ)}, +^δ_N(x) = {mF_1,m (x + δ) + nF_2,n(x)}/N, where F_1,m and F_2,n are the empirical distribution functions of two independent random samples (N = m + n), and where K²_N = mn/N. First an estimator δ_N, is defined as a value of δ minimizing a functional H of the type of H₁. A second estimator δ¹_N is also defined which is a linearized version of the first. Finite and asymptotic properties of these estimators are considered. It is also shown that most well-known test statistics of the Kolmogorov-Smirnov type are particular cases of such functionals H₁. The asymptotic distribution and the asymptotic efficiency of some estimators are given.     

A note on non-negative mean square error estimation of regression estimators in randomized response surveys

Generalized regression estimators are considered for the survey population total of a quantitative sensitive variable based on randomized responses. Formulae are presented for ‘non-negative’ estimators of approximate mean square errors of these biased estimators when population and sample sizes are large.     

On a characterization of the dispersion matrix based on the properties of regression

This paper provides a partial solution to a problem posed by J. Neyman (1965) regarding the characterization of multivariate negative binomial distribution based on the properties of regression. It is shown that some of the properties of regression characterize the form of the nonsingular dispersion matrix of the parent distribution, which, interestingly enough, corresponds to only two types viz. those of positive and negative multivariate binomial distributions.     

Characterizations based on regression assumptions of order statistics

Let X₍₁₎≤X₍₂₎≤···≤X_(n) be the order statistics from independent and identically distributed random variables {X_i, 1≤i≤n} with a common absolutely continuous distribution function. In this work, first a new characterization of distributions based on order statistics is presented. Next, we review some conditional expectation properties of order statistics, which can be used to establish some equivalent forms for conditional expectations for sum of random variables based on order statistics. Using these equivalent forms, some known results can be extended immediately.     

Sensitivity measures of influence on the loading matrix in exploratory factor analysis

For the detection of influential observations on the loading matrix of the factor analysis model, we propose to use the infinitesimal version of two matrix coefficients, including Escoufier (1973)'s also discussed the application in factor analysis of some sensitivity measures used for similar purposes in principal component analysis.     

Robust Estimation of Multivariate Linear Model Based on Depth Weighted Mean and Scatter

Based on the projection depth weighted mean and scatter estimation of the joint distribution of (x, y), we introduce a robust estimator of the regression coefficients for the multivariate linear model. The new estimator possesses desirable properties including affine invariance, Fisher consistency, and asymptotic normality. Also, we study the robustness of the estimator in terms of breakdown point and influence function. Extensive simulation studies are performed to investigate the finite sample behavior of robustness and efficiency. The methodology is illustrated with a real data example.