A class of high-breakdown scale estimators based on subranges

We consider a new class of scale estimators with 50% breakdown point. The estimators are defined as order statistics of certain subranges. They all have a finite-sample breakdown point of [n/2]/n, which is the best possible value. (Here, [...] denotes the integer part.) One estimator in this class has the same influence function as the median absolute deviation and the least median of squares (LMS) scale estimator (i.e., the length of the shortest half), but its finite-sample efficiency is higher. If we consider the standard deviation of a subsample instead of its range, we obtain a different class of 50% breakdown estimators. This class contains the least trimmed squares (LTS) scale estimator. Simulation shows that the LTS scale estimator is nearly unbiased, so it does not need a small-sample correction factor. Surprisingly, the efficiency of the LTS scale estimator is less than that of the LMS scale estimator.     

Robust estimation for ordinal regression

Ordinal regression is used for modelling an ordinal response variable as a function of some explanatory variables. The classical technique for estimating the unknown parameters of this model is Maximum Likelihood (ML). The lack of robustness of this estimator is formally shown by deriving its breakdown point and its influence function. To robustify the procedure, a weighting step is added to the Maximum Likelihood estimator, yielding an estimator with bounded influence function. We also show that the loss in efficiency due to the weighting step remains limited. A diagnostic plot based on the Weighted Maximum Likelihood estimator allows to detect outliers of different types in a single plot.     

Robust Estimation of Multivariate Linear Model Based on Depth Weighted Mean and Scatter

Based on the projection depth weighted mean and scatter estimation of the joint distribution of (x, y), we introduce a robust estimator of the regression coefficients for the multivariate linear model. The new estimator possesses desirable properties including affine invariance, Fisher consistency, and asymptotic normality. Also, we study the robustness of the estimator in terms of breakdown point and influence function. Extensive simulation studies are performed to investigate the finite sample behavior of robustness and efficiency. The methodology is illustrated with a real data example.     

Partial breakdown in two-factor models

The usual (global) breakdown point describes the worst effect that a given number of gross errors can have. In a two-way layout, without interaction, one is frustrated by the small number of gross errors such a design can tolerate. However, neither the whole fit nor all parameter estimates need to be affected by such a breakdown. An example from molecular spectroscopy serves to illustrate such partial breakdown in a large, “sparse” two-factor model. Because the global finite sample breakdown point is zero for all usual estimators in this example, this concept does not make sense in such problems. The more appropriate concept of partial breakdown point is discussed in this paper. It also provides a crude quantification of the robustness properties of an estimator, yet for any linear combination of the estimated parameters. The maximum number of gross errors to which the linear combination of the estimated parameters can resist is related to the minimum number of observations that must be omitted to make the linear function a non-estimable function. In the example, we are mainly interested in differences of parameters. Then the maximal partial breakdown point for regression equivariant estimators is one half, and Huber-type regression M-estimators with bounded ψ-function reach this limit.     

Robust linear discriminant analysis using S‐estimators

The authors consider a robust linear discriminant function based on high breakdown location and covariance matrix estimators. They derive influence functions for the estimators of the parameters of the discriminant function and for the associated classification error. The most B‐robust estimator is determined within the class of multivariate S‐estimators. This estimator, which minimizes the maximal influence that an outlier can have on the classification error, is also the most B‐robust location S‐estimator. A comparison of the most B‐robust estimator with the more familiar biweight S‐estimator is made.     

Consistency and robustness properties of the S-nonnegative garrote estimator

This paper concerns a robust variable selection method in multiple linear regression: the robust S-nonnegative garrote variable selection method. In this paper the consistency of the method, both in terms of estimation and in terms of variable selection, is established. Moreover, the robustness properties of the method are further investigated by providing a lower bound for the breakdown point, and by deriving the influence function. The provided expressions nicely reveal the impact that the choice of an initial estimator has on the robustness properties of the variable selection method. Illustrative examples of influence functions for the S-nonnegative garrote as well as for the original (non-robust) nonnegative garrote variable selection method are provided.     

Asymptotic properties of a conditional maximum-likelihood estimator

Inference for a scalar interest parameter in the presence of nuisance parameters is considered in terms of the conditional maximum-likelihood estimator developed by Cox and Reid (1987). Parameter orthogonality is assumed throughout. The estimator is analyzed by means of stochastic asymptotic expansions in three cases: a scalar nuisance parameter, m nuisance parameters from m independent samples, and a vector nuisance parameter. In each case, the expansion for the conditional maximum-likelihood estimator is compared with that for the usual maximum-likelihood estimator. The means and variances are also compared. In each of the cases, the bias of the conditional maximum-likelihood estimator is unaffected by the nuisance parameter to first order. This is not so for the maximum-likelihood estimator. The assumption of parameter orthogonality is crucial in attaining this result. Regardless of parametrization, the difference in the two estimators is first-order and is deterministic to this order.     

Multivariate τ-estimators for location and scatter

We discuss the robustness and asymptotic behaviour of τ-estimators for multivariate location and scatter. We show that τ-estimators correspond to multivariate M-estimators defined by a weighted average of redescending ψ-functions, where the weights are adaptive. We prove consistency and asymptotic normality under weak assumptions on the underlying distribution, show that τ-estimators have a high breakdown point, and obtain the influence function at general distributions. In the special case of a location-scatter family, τ-estimators are asymptotically equivalent to multivariate S-estimators defined by means of a weighted ψ-function. This enables us to combine a high breakdown point and bounded influence with good asymptotic efficiency for the location and covariance estimator.     

Mode type quasi-range and its applications

Building from the consideration of closeness, we propose the mode quasi-range as an alternative scale parameter. Application of this scale parameter to formulate the population standard deviation is investigated leading to an efficient sample estimator of standard deviation from the point of asymptotic variance. Monte Carlo studies, in terms of finite sample efficiency and robustness of breakdown point, have been performed for the sample mode quasi-range. This study reveals that this closeness consideration-based mode, quasi-range, is satisfactory because these statistical procedures based on it are efficient and are less misleading for drawing conclusion from the sample results.     

On the Iteratively Reweighted Rank Regression Estimator

The finite sample performance of the rank estimator of regression coefficients obtained using the iteratively reweighted least squares (IRLS) of Sievers and Abebe (2004) is evaluated. Efficiency comparisons show that the IRLS method does quite well in comparison to least squares or the traditional rank estimates in cases of moderate-tailed error distributions; however, the IRLS method does not appear to be suitable for heavy-tailed data. Moreover, our results show that the IRLS estimator will have an unbounded influence function even if we use an initial estimator with a bounded influence function.     

Orthogonal series density estimation in a disaggregation scheme

In this paper we consider long-memory processes obtained by aggregation of independent random parameter AR(1) processes. We propose an estimator of the density of the underlying random parameter. This estimator is based on the expansion of the density function on the basis of Gegenbauer polynomials. Rate of convergence to zero of the mean integrated square error (MISE) and of the uniform error are obtained. The results are illustrated by Monte-Carlo simulations.     

Estimating the First- and Second-Order Parameters of a Heavy-Tailed Distribution

This paper suggests censored maximum likelihood estimators for the first‐ and second‐order parameters of a heavy‐tailed distribution by incorporating the second‐order regular variation into the censored likelihood function. This approach is different from the bias‐reduced maximum likelihood method proposed by Feuerverger and Hall in 1999. The paper derives the joint asymptotic limit for the first‐ and second‐order parameters under a weaker assumption. The paper also demonstrates through a simulation study that the suggested estimator for the first‐order parameter is better than the estimator proposed by Feuerverger and Hall although these two estimators have the same asymptotic variances.     

Estimation of common location parameter of several heterogeneous exponential populations based on generalized order statistics

In this article, several independent populations following exponential distribution with common location parameter and unknown and unequal scale parameters are considered. From these populations, several independent samples of generalized order statistics (gos) are drawn. Under the setup of gos, the problem of estimation of common location parameter is discussed and various estimators of common location parameter are derived. The authors obtained maximum likelihood estimator (MLE), modified MLE and uniformly minimum variance unbiased estimator of common location parameter. Furthermore, under scaled-squared error loss function, a general inadmissibility result of invariant estimator is proposed. The derived results are further reduced for upper record values which is a special case of gos. Finally, simulation study and real life example are reported to show the performances of various competing estimators in terms of percentage risk improvement.     

Comparisons of methods of estimation for a pareto distribution of the first kind

This paper compares methods of estimation for the parameters of a Pareto distribution of the first kind to determine which method provides the better estimates when the observations are censored, The unweighted least squares (LS) and the maximum likelihood estimates (MLE) are presented for both censored and uncensored data. The MLE's are obtained using two methods, In the first, called the ML method, it is shown that log-likelihood is maximized when the scale parameter is the minimum sample value. In the second method, called the modified ML (MML) method, the estimates are found by utilizing the maximum likelihood value of the shape parameter in terms of the scale parameter and the equation for the mean of the first order statistic as a function of both parameters. Since censored data often occur in applications, we study two types of censoring for their effects on the methods of estimation: Type II censoring and multiple random censoring. In this study we consider different sample sizes and several values of the true shape and scale parameters.

Comparisons are made in terms of bias and the mean squared error of the estimates. We propose that the LS method be generally preferred over the ML and MML methods for estimating the Pareto parameter γ for all sample sizes, all values of the parameter and for both complete and censored samples. In many cases, however, the ML estimates are comparable in their efficiency, so that either estimator can effectively be used. For estimating the parameter α, the LS method is also generally preferred for smaller values of the parameter (α ≤4). For the larger values of the parameter, and for censored samples, the MML method appears superior to the other methods with a slight advantage over the LS method. For larger values of the parameter α, for censored samples and all methods, underestimation can be a problem.     

Lag order selection for an optimal autoregressive covariance matrix estimator

A good parametric spectral estimator requires an accurate estimate of the sum of AR coefficients, however a criterion which minimizes the innovation variance not necessarily yields the best spectral estimate. This paper develops an alternative information criterion considering the bias in the sum of the parameters for the autoregressive estimator of the spectral density at frequency zero.     

Sensitive parameters

Notions such as robustness and resistance of an estimator are well known and useful. These ideas have not been fully extended to functional parameters, although it seems natural to do so. In this paper we define a sensitive parameter as one for which small changes in the underlying distribution cause large changes in the parameter value. It is demonstrated that no nontrivial, nonparametric confidence procedure can exist for such a parameter. This extends a result of Bahadur and Savage ( 1956 ). The relationship between this definition and some standard concepts in robustness theory are explored, and implications for parametric inference are studied.     

Robust estimating equation based on statistical depth

In this paper the estimating equation is constructed via statistical depth. The obtained estimating equation and parameter estimation have desirable robustness, which attain very high breakdown values close to 1/2. At the same time, the obtained parameter estimation still has ordinary asymptotic behaviours such as asymptotic normality. In particular, the robust quasi likelihood and depth-weighted LSE respectively for nonlinear and linear regression model are introduced. A suggestion for choosing weight function and a method of constructing depth-weighed quasi likelihood equation are given. This paper is supported by NNSF projects (10371059 and 10171051) of China.     

Simultaneous robust estimation of location and scale parameters: A minimum-distance approach

Simultaneous robust estimates of location and scale parameters are derived from minimizing a minimum-distance criterion function. The criterion function measures the squared distance between the pth power (p > 0) of the empirical distribution function and the pth power of the imperfectly determined model distribution function over the real line. We show that the estimator is uniquely defined, is asymptotically bivariate normal and for p > 0.3 has positive breakdown. If the scale parameter is known, when p = 0.9 the asymptotic variance (1.0436) of the location estimator for the normal model is smaller than the asymptotic variance of the Hodges-Lehmann (HL)estimator (1.0472). Efficiencies with respect to HL and maximum-likelihood estimators (MLE) are 1.0034 and 0.9582, respectively. Similarly, if the location parameter is known, when p = 0.97 the asymptotic variance (0.6158) of the scale estimator is minimum. The efficiency with respect to the MLE is 0.8119. We show that the estimator can tolerate more corrupted observations at oo than at – for p < 1, and vice versa for p > 1.     

The Gaussian rank correlation estimator: robustness properties

The Gaussian rank correlation equals the usual correlation coefficient computed from the normal scores of the data. Although its influence function is unbounded, it still has attractive robustness properties. In particular, its breakdown point is above 12%. Moreover, the estimator is consistent and asymptotically efficient at the normal distribution. The correlation matrix obtained from pairwise Gaussian rank correlations is always positive semidefinite, and very easy to compute, also in high dimensions. We compare the properties of the Gaussian rank correlation with the popular Kendall and Spearman correlation measures. A simulation study confirms the good efficiency and robustness properties of the Gaussian rank correlation. In the empirical application, we show how it can be used for multivariate outlier detection based on robust principal component analysis.     

The breakdown and influence properties of outlier rejection-plus-mean procedures

In a recent paper, Hampel (1985) studied the properties of rejection-plus-mean procedures as estimators of a location parameter. He reported that these procedures have low breakdown and high variance. In this article it is pointed out that these results are due to the outliers being rejected in a forwards-stepping manner, and when a more appropriate backwards-stepping approach is used, rejection-plus-mean procedures lead to estimators with high breakdown and high variance. In this article it is pointed out that these results are due to the outliers being rejected in a forwards-stepping manner, and when a more appropriate backwards-stepping approach is used, rejection-plus-mean procedures lead to estimator with high breakdown and redescending theoretical influence function.