Asymptotic Properties of M-estimators Based on Estimating Equations and Censored Data

Properties of Huber's M-estimators based on estimating equations have been studied extensively and are well understood for complete (i.i.d.) data. Although the concepts of M-estimators and influence curves have been extended for some time by Reid (1981) to incomplete data that are subject to right censoring, results on the general behavior of M-estimators based on incomplete data remain scattered and restrictive. This paper establishes a general large sample theory for M-estimators based on censored data. We show how to extend any asymptotic result available for M-estimators based on complete data to the case of censored data. The extensions are usually straightforward and include the multiparameter situation. Both the lifetime and censoring distributions may be discontinuous. We illustrate several extensions which provide simple and tractable sufficient conditions for an M-estimator to be strongly consistent and asymptotically normal. The influence curves and asymptotic variance of the M-estimators are also derived. The applicability of the new sufficient conditions is demonstrated through several examples, including location and scale M-estimators.     

Some robust two-sample test statistics based on m-estimators of location

This paper describes a simulation experiment that compares the performance, in terms of the size and a function of the power, of four two-sample test statistics based on M-estimators for location. M-esti-mates are chosen to ensure similar levels of breakdown point, gross error sensitivity and as far as possible, similar rejection point. Two pairs of sample size and six different distributions are involved. Matching 97.5% critical values for the statistics are determined.     

Robust statistical inference: weighted likelihoods or usual m-estimation?

We review the weighted likelihood estimating equations methodology introduced by Markatou, Basu and Lindsay (1995). and Basu, Markatou and Lindsay (1995) and compare it, in the case of symmetric and asymmetric contamination, with Huber's M-estimators of location. The simulation study shows that the weighted likelihood estimating equations estimator is at least as competitive as Huber's M-estimators in the case of symmetric contamination. In the case of asymmetric contamination it may be superior than Huber's M-estimators     

Recursive M-estimators of location

This paper deals with recursive M-estimators of a location parameter θ in stationary processes when scale is regarded as a nuisance parameter. For the nonrecursive M-estimators, the median absolute deviation is a useful estimator of scale. Two recursive variants of the median absolute deviation are proposed and the performance of the resulting recursive estimators is examined in a numerical study.     

Efficient bias-Robust M-Estimators of location in Kolmogorov normal neighbourhoods

We consider minimax-bias M-estimation of a location parameter in a Kolmogorov neighbourhood K() of a normal distribution. The maximum asymptotic bias of M-estimators for the Kolmogorov normal neighbourhood is derived, and its relation with the gross-error sensitivity of the estimator at the nominal model (the Gaussian case) is found. In addition, efficient bias-robust M-estimators T_i are constructed. Numerical results are also obtained to show the percentage of increase in maximum asymptotic bias and the efficiency we can achieve for some well-known -functions.     

An Iterative Weighted Least Squares Algorithm and Simulation Study for Censored Data M-Estimates

A popular linear regression estimator for censored data is the one proposed by Buckley and James (1979). However, this estimator is not robust to outliers, which is not surprising since it is a modified version of the uncensored data least squares estimator. Lai and Ying (1994) have proposed an M-estimator for censored data that is a generalization of the Buckley- James estimator. In this paper we discuss a weighted least squares algorithm for computing these M-estimates and compare the performance of two Huber M-estimators with the Buckley-James estimator in a simulation study. We find that the Huber M-estimators perform more robustly for a broad range of censoring and error distributions.     

ROBUST M-ESTIMATION OF THE INTRACLASS CORRELATION COEFFICIENT

Robust M-estimators of intraclass correlation coefficient, location and scale parameters are defined for familial data. It is shown that these estimators are strongly consistent. Also the asymptotic distributions of these estimators are derived when the underlying distribution is elliptically and permutationally symmetric.     

A Berry–Esséen Bound for M-estimators

We prove a Berry–Esséen bound for general M-estimators under optimal regularity conditions on the score function and the underlying distribution. As an application we obtain Berry–Esséen bounds for the sample median, the L_p -median, p > 1 and Huber's estimator of location     

Multiple comparisons based on a modified one-step M-estimator

Although many methods are available for performing multiple comparisons based on some measure of location, most can be unsatisfactory in at least some situations, in simulations when sample sizes are small, say less than or equal to twenty. That is, the actual Type I error probability can substantially exceed the nominal level, and for some methods the actual Type I error probability can be well below the nominal level, suggesting that power might be relatively poor. In addition, all methods based on means can have relatively low power under arbitrarily small departures from normality. Currently, a method based on 20% trimmed means and a percentile bootstrap method performs relatively well (Wilcox, in press). However, symmetric trimming was used, even when sampling from a highly skewed distribution and a rigid adherence to 20% trimming can result in low efficiency when a distribution is sufficiently heavy-tailed. Robust M-estimators are more flexible but they can be unsatisfactory in terms of Type I errors when sample sizes are small. This paper describes an alternative approach based on a modified one-step M-estimator that introduces more flexibility than a trimmed mean but provides better control over Type I error probabilities compared with using a one-step M-estimator.     

A note on james type robust estimators

M-estimation of a single parameter of the life time distribution is considered based on independent and identically distributed survival data which may be randomly censored. The most robust and the optimal robust M-estimators of the location parameters of the survival time distribution are derived within a class considered in James (1986) as well as for the general unrestricted class. The properties of the estimators corresponding to the above two classes are discussed. A data set is used to illustrate the usefulness of the optimal robust estimators for the parameter of extreme value distribution.     

Properties of robust m-estimators for poisson and negative binomial data ∗

We investigate robust M-estimators of location and over-dispersion for independent and identically distributed samples from Poisson and Negative Binomial (NB)distributions. We focus on asymptotic and small-sample efficiencies, outlier-induced biases, and biases caused by model mis-specification. This is important information for assessing the practical utility of the estimation method. Our results demonstrate that resonably efficient estimation of location and over-dispersion parameters for count data is possible with samples sizes as small as n=25. The sensitivity of these stimators, especially when the amount of over-dispersion is small. We aslo conclude that serious biases result when using robust Poisson M-estimation with NB data. The biases are less serious when using robust NB M-estimation with Poisson data.     

General m-esttmators and applications to bounded influence estimation for non-linear regression

In this paper, we study the M-estimators in the case that λ_F:(β)=E_F:(φ(Z,β))=0 has more than one solution, We show that the numerical iterative procedures converge and that the resulting estimators are consistent and asymptotically normal. We apply them to the non-linear regression models, and then, we find an optimal M-estimate among those that have bounded gross error sensitivity.     

M-estimators for isotonic regression

In this paper we propose a family of robust estimates for isotonic regression: isotonic M-estimators. We show that their asymptotic distribution is, up to an scalar factor, the same as that of Brunk's classical isotonic estimator. We also derive the influence function and the breakdown point of these estimates. Finally we perform a Monte Carlo study that shows that the proposed family includes estimators that are simultaneously highly efficient under Gaussian errors and highly robust when the error distribution has heavy tails.     

Fast and robust estimators of variance components in the nested error model

Usual fitting methods for the nested error linear regression model are known to be very sensitive to the effect of even a single outlier. Robust approaches for the unbalanced nested error model with proved robustness and efficiency properties, such as M-estimators, are typically obtained through iterative algorithms. These algorithms are often computationally intensive and require robust estimates of the same parameters to start the algorithms, but so far no robust starting values have been proposed for this model. This paper proposes computationally fast robust estimators for the variance components under an unbalanced nested error model, based on a simple robustification of the fitting-of-constants method or Henderson method III. These estimators can be used as starting values for other iterative methods. Our simulations show that they are highly robust to various types of contamination of different magnitude.     

Tukey’s M-estimator of the Poisson parameter with a special focus on small means

We treat robust M-estimators for independent and identically distributed Poisson data. We introduce modified Tukey M-estimators with bias correction and compare them to M-estimators based on the Huber function as well as to weighted likelihood and other estimators by simulation in case of clean data and data with outliers. In particular, we investigate the problem of combining robustness and high efficiencies at small Poisson means caused by the strong asymmetry of such Poisson distributions and propose a further estimator based on adaptive trimming. The advantages of the constructed estimators are illustrated by an application to smoothing count data with a time varying mean and level shifts.     

Estimation of Multiple Linear Regression Model with Twice-Censored Data

In this article, we propose three M-estimators for multiple regression model when response variable is subject to twice censoring. The consistency of the proposed M-estimators is established. A simulation study is conducted to investigate the performance of the proposed estimators. Furthermore, the simple bootstrap methods are used to construct interval estimators.     

Estimation in multiple linear regression model with doubly censored data

In this article, we propose three M-estimators for multiple regression model when response variable is subject to double censoring. The consistency of the proposed M-estimators is established. A simulation study is conducted to investigate the performance of the proposed estimators. Furthermore, the simple bootstrap methods are used to construct interval estimators.     

A Robust and Almost Fully Efficient M-Estimator

Simultaneous robust estimates of location and scale parameters are derived from a class of M-estimating equations. A coefficient p ( p > 0), which plays a role similar to that of a tuning constant in the theory of M-estimation, determines the estimating equations. These estimating equations may be obtained as the gradient of a strictly convex criterion function. This article shows that the estimators are uniquely defined, asymptotically bi-variate normal and have positive breakdown for some choices of p . When p = 0.12 and p = 0.3, the estimators are almost fully efficient for normal and exponential distributions: efficiencies with respect to the maximum likelihood estimators are 1.00 and 0.99, respectively. It is shown that the location estimator for known scale has the maximum breakdown point 0.5 independent of p , when the target model is symmetric. Also it is shown that the scale estimator has a positive breakdown point which depends on the choice of p . A simulation study finds that the proposed location estimator has smaller variance than the Hodges–Lehmann estimator, Huber's minimax and bisquare M-estimators.     

Sequential procedures based on M-estimators with discontinuous score functions

Bounded-width sequential confidence intervals and sequential tests for regression parameter based on M-estimators are extended to the case where the score-functions generating the M-estimators have jump-discontinuities. In the context of the asymptotic normality of the stopping variable, for the confidence interval problem, it is observed that the jump-discontinuities induce a slower rate of convergence. The proofs of the main theorems rest on the weak convergence of some related processes and this is also studied.     

Robust M- and L-Estimators of Scale Parameter

We consider first the class of M-estimators of scale that are location-scale equivariant and Fisher consistent at the error distribution of the shrinking contamination neighborhood and derive an expression for the maximal asymptotic mean-squared-error, for a suitably regular score function, followed by a lower bound on it. We next show that the minimax asymptotic mean-squzred-error is attained at an M-estimator of scale with the truncated MLE score function which, when specialized to the Standard Normal error distribution has the form of Huber's Proposal 2. The latter minimax property is also shown to hold for α-trimmed variance as an L-estimator of scale.