Asymptotic robustness of least median of squares for autoregressions with additive outliers

This paper considers the robustness properties in the time series context of the least median of squares (LMS) estimator. The influence function of the LMS estimator is derived under additive outlier contamination. This influence function is redescending and bounded for fixed values of the AR parameters. The gross-error sensitivity, however, is an unbounded function of the AR parameters. In order to asses the global robustness behavior of the LMS estimator, we consider several notions of breakdown. The breakdown points of the LMS estimator depend on the value of the underlying AR parameter. Generally, the breakdown point is below one half for high values of the AR parameter. The bias curves of the LMS estimator reveal, however, that the magnitude of outliers has to be considerable in order to cause breakdown.     

On the Iteratively Reweighted Rank Regression Estimator

The finite sample performance of the rank estimator of regression coefficients obtained using the iteratively reweighted least squares (IRLS) of Sievers and Abebe (2004) is evaluated. Efficiency comparisons show that the IRLS method does quite well in comparison to least squares or the traditional rank estimates in cases of moderate-tailed error distributions; however, the IRLS method does not appear to be suitable for heavy-tailed data. Moreover, our results show that the IRLS estimator will have an unbounded influence function even if we use an initial estimator with a bounded influence function.     

Assessing the Precision of Turning Point Estimates in Polynomial Regression Functions

Researchers often report point estimates of turning point(s) obtained in polynomial regression models but rarely assess the precision of these estimates. We discuss three methods to assess the precision of such turning point estimates. The first is the delta method that leads to a normal approximation of the distribution of the turning point estimator. The second method uses the exact distribution of the turning point estimator of quadratic regression functions. The third method relies on Markov chain Monte Carlo methods to provide a finite sample approximation of the exact distribution of the turning point estimator. We argue that the delta method may lead to misleading inference and that the other two methods are more reliable. We compare the three methods using two data sets from the environmental Kuznets curve literature, where the presence and location of a turning point in the income-pollution relationship is the focus of much empirical work.     

Assessing the Precision of Turning Point Estimates in Polynomial Regression Functions

Researchers often report point estimates of turning point(s) obtained in polynomial regression models but rarely assess the precision of these estimates. We discuss three methods to assess the precision of such turning point estimates. The first is the delta method that leads to a normal approximation of the distribution of the turning point estimator. The second method uses the exact distribution of the turning point estimator of quadratic regression functions. The third method relies on Markov chain Monte Carlo methods to provide a finite sample approximation of the exact distribution of the turning point estimator. We argue that the delta method may lead to misleading inference and that the other two methods are more reliable. We compare the three methods using two data sets from the environmental Kuznets curve literature, where the presence and location of a turning point in the income-pollution relationship is the focus of much empirical work.     

A Simple Approach to Inference in Random Coefficient Models

Random coefficient regression models have been used to analyze cross-sectional and longitudinal data in economics and growth-curve data from biological and agricultural experiments. In the literature several estimators, including the ordinary least squares and the estimated generalized least squares (EGLS), have been considered for estimating the parameters of the mean model. Based on the asymptotic properties of the EGLS estimators, test statistics have been proposed for testing linear hypotheses involving the parameters of the mean model. An alternative estimator, the simple mean of the individual regression coefficients, provides estimation and hypothesis-testing procedures that are simple to compute and teach. The large sample properties of this simple estimator are shown to be similar to that of the EGLS estimator. The performance of the proposed estimator is compared with that of the existing estimators by Monte Carlo simulation.     

Testing sphericity and intraclass covariance structures under a growth curve model in high dimension

In this article, we consider the problem of testing (a) sphericity and (b) intraclass covariance structure under a growth curve model. The maximum likelihood estimator (MLE) for the mean in a growth curve model is a weighted estimator with the inverse of the sample covariance matrix which is unstable for large p close to N and singular for p larger than N. The MLE for the covariance matrix is based on the MLE for the mean, which can be very poor for p close to N. For both structures (a) and (b), we modify the MLE for the mean to an unweighted estimator and based on this estimator we propose a new estimator for the covariance matrix. This new estimator leads to new tests for (a) and (b). We also propose two other tests for each structure, which are just based on the sample covariance matrix.

To compare the performance of all four tests we compute for each structure (a) and (b) the attained significance level and the empirical power. We show that one of the tests based on the sample covariance matrix is better than the likelihood ratio test based on the MLE.     

One-sided trimming in small samples with asymmetric contamination

An estimator for location, given a sample of only four or five observations, is proposed. The underlying distribution on of the sample may (with probability p) be contaminated by an outlier from a rightly-skewed distribution. The estimator minimizes the maximum mean squared error over all values of p. In fact, there exists an estimator which is unbiased in both the outlier - free and extreme-outlier cases, but its mean square error is substantially higher than the mean squared error for the minimax estimator. Mean squared errors for various underlying distributional situations are calculated and compared with those of other location estimators such as the mean and the median.     

Nonparametric Survival Estimation when Death is Reported with Delay

In disease registries there can be a delay between death of asubject and the reporting of this death to the data analyst.If researchers use the Kaplan-Meier estimator and implicitlyassumed that subjects who have yet to have death reported arestill alive, i.e. are censored at the time of analysis, the Kaplan-Meierestimator is typically inconsistent. Assuming censoring is independentof failure, we provide a simple estimator that is consistentand asymptotically efficient. We also provide estimates of theasymptotic variance of our estimator and simulations that demonstratethe favorable performance of these estimators. Finally, we demonstrateour methods by analyzing AIDS survival data. This analysis underscoresthe pitfalls of not accounting for delay when estimating thesurvival distribution and suggests a significant reduction inbias by using our estimator.     

Optimal and Robust Designs for Estimating the Concentration Curve and the AUC

The problem of interest is to estimate the concentration curve and the area under the curve (AUC) by estimating the parameters of a linear regression model with an autocorrelated error process. We introduce a simple linear unbiased estimator of the concentration curve and the AUC. We show that this estimator constructed from a sampling design generated by an appropriate density is asymptotically optimal in the sense that it has exactly the same asymptotic performance as the best linear unbiased estimator. Moreover, we prove that the optimal design is robust with respect to a minimax criterion. When repeated observations are available, this estimator is consistent and has an asymptotic normal distribution. Finally, a simulated annealing algorithm is applied to a pharmacokinetic model with correlated errors.     

Efficiency of nonparametric tests for scale shift at an unknown time point

Recently Hsieh considered three nonparametric tests for the scalechange problem and showed them to be asymptotically as efficient as their parametric competitors. Here the class of so called sum-type statistics is studied which contains the statistics of Hsieh. It is proved that max-type statistics can be constructed that are at least as efficient in the sense of Bahadur as the sum-type statistics.     

A robust and efficient estimation method for nonparametric models with jump points

Nonparametric models with jump points have been considered by many researchers. However, most existing methods based on least squares or likelihood are sensitive when there are outliers or the error distribution is heavy tailed. In this article, a local piecewise-modal method is proposed to estimate the regression function with jump points in nonparametric models, and a piecewise-modal EM algorithm is introduced to estimate the proposed estimator. Under some regular conditions, the large-sample theory is established for the proposed estimators. Several simulations are presented to evaluate the performances of the proposed method, which shows that the proposed estimator is more efficient than the local piecewise-polynomial regression estimator in the presence of outliers or heavy tail error distribution. What is more, the proposed procedure is asymptotically equivalent to the local piecewise-polynomial regression estimator under the assumption that the error distribution is a Gaussian distribution. The proposed method is further illustrated via the sea-level pressures.     

Efficiency of nonparametric tests for scale shift at an unknown time point

Recently Hsieh considered three nonparametric tests for the scale-change problem and showed them to be asymptotically as efficient as their parametric competitors. Here the class of so called sum-type statistics is studied which contains the statistics of Hsieh. It is proved that max-type statistics can be constructed that are at least as efficient in the sense of Bahadur as the sum-type statistics.     

Partially-adaptive robust estimators of location via exponential embedding

A general method is presented for constructing a location estimator which is asymptotically efficient at any two different location-scale families of symmetric distributions as well as at an appropriately defined class of distributions lying in between. The method works by embedding the two families in a comprehensive parametric model and identifying the estimator with the MLE. The case when the families are Normal and Double exponential is examined in detail.     

Optimal designs for accelerated life tests with multiple stress factors and heteroscedasticity

Accelerated life testing (ALT) provides a means of obtaining data on product lifetime and reliability relatively quickly by subjecting products to higher-than-usual levels of stress factors. We present methods for obtaining optimal designs for multiple-factor ALTs with time censoring and heteroscedasticity in order to estimate percentiles of product life at usage conditions. We assume a Weibull life distribution and log-linear life–stress relationships with non constant shape parameter for the ALT stress factors. The primary optimality criterion is the minimization of the asymptotic variance of maximum likelihood estimator of the percentile estimator at usage stress. We also consider a secondary criterion for our design optimization. The design construction methods are illustrated by two practical examples.     

On the estimation of the influence curve

We prove the asymptotic validity of bootstrap confidence bands for the influence curve from its usual estimator (the sensitivity curve). The proof is based on the use of Gill's generalized delta method for Hadamard differentiable operators. Some statistical applications, in particular to the estimation of asymptotic variance, are given.     

Minimum hellinger distance estimation for normal models

A robust estimator introduced by Beran (1977a, 1977b), which is based on the minimum Hellinger distance between a projection model density and a nonparametric sample density, is studied empirically. An extensive simulation provides an estimate of the small sample distribution and supplies empirical evidence of the estimator performance for a normal location-scale model. While the performance of the minimum Hellinger distance estimator is seen to be competitive with the maximum likelihood estimator at the true model, its robustness to deviations from normality is shown to be competitive in this setting with that obtained from the M-estimator and the Cramér-von Mises minimum distance estimator. Beran also introduced a goodness-of-fit statisticH ₂, based on the minimized Hellinger distance between a member of a parametric family of densities and a nonparametric density estimate. We investigate the statistic H (the square root of H ₂) as a test for normality when both location and scale are unspecified. Empirically derived critical values are given which do not require extensive tables. The power of the statistic H compares favorably with four other widely used tests for normality.     

Estimating density ratio with application to discriminant analysis

The estimator ? for the ratio of densities based on grade transformation is introduced. Under certain conditions the strong uniform consistency of ? is proved and its asymptotic law is determined. The result is applied to study the behaviour of divergence curve used in discriminant analysis.     

Estimating common parameters in heterogeneous random effects models

A question of fundamental importance for meta-analysis of heterogeneous multidimensional data studies is how to form a best consensus estimator of common parameters, and what uncertainty to attach to the estimate. This issue is addressed for a class of unbalanced linear designs which include classical growth curve models. The solution obtained is similar to the popular DerSimonian and Laird (1986) method for a simple meta-analysis model. By using almost unbiased variance estimators, an estimator of the covariance matrix of this procedure is derived. Combination of these methods is illustrated by two examples and are compared via simulation.     

An Estimator for the Survival Function on the Basis of Observable Censoring Times

Abstract

Chiu [Chiu, S. N. (1999 Chiu, S. N. 1999. An unbiased estimator for the survival function of censored data. Commun. Statist. - Theory Meth., 28(9): 2249–2260. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). An unbiased estimator for the survival function of censored data. Commun. Statist. - Theory Meth. 28(9):2249–2260.] proposed a nonparametric estimator for the survival function which is based on observable censoring times in the general censoring model. His estimator is less efficient than the Product-Limit estimator. Considering an informative censoring model this drawback can partially be overcome. This is shown by a nonparametric, uniformly consistent estimator based on observable censoring times within the simple Koziol–Green model. Some asymptotic properties of the new estimator are investigated and it is compared with the well-known ACL-estimator.     

Cumulative/dynamic ROC curve estimation

ABSTRACT

Receiver operating-characteristic (ROC) curve is a popular graphical method frequently used in order to study the diagnostic capacity of continuous (bio)markers. When the considered outcome is a time-dependent variable, the direct generalization is known as cumulative/dynamic ROC curve. For a fixed point of time, t, one subject is allocated into the positive group if the event happens before t and into the negative group if the event is not happened at t. The presence of censored subject, which can not be directly assigned into a group, is the main handicap of this approach. The proposed cumulative/dynamic ROC curve estimator assigns a probability to belong to the negative (positive) group to the subjects censored previously to t. The performance of the resulting estimator is studied from Monte Carlo simulations. Some real-world applications are reported. Results suggest that the new estimators provide a good approximation to the real cumulative/dynamic ROC curve.