Changepoint Estimation in a Segmented Linear Regression via Empirical Likelihood

For a segmented regression system with an unknown changepoint over two domains of a predictor, a new empirical likelihood ratio statistic is proposed to test the null hypothesis of no change. Under the null hypothesis of no change, the proposed test statistic is shown empirically to be Gumbel distributed with robust location and scale estimators against various parameter settings and error distributions. A power analysis is conducted to illustrate the performance of the test. Under the alternative hypothesis with a changepoint, the test statistic is utilized to estimate the changepoint between the two domains. A comparison of the frequency distributions between the proposed estimator and two parametric methods indicates that the proposed method is effective in capturing the true changepoint.     

Robust joint estimation of location and scale parameters in ranked set samples

A robust estimator is developed for the location and scale parameters of a location-scale family. The estimator is defined as the minimizer of a minimum distance function that measures the distance between the ranked set sample empirical cumulative distribution function and a possibly misspecified target model. We show that the estimator is asymptotically normal, robust, and has high efficiency with respect to its competitors in literature. It is also shown that the location estimator is consistent within the class of all symmetric distributions whereas the scale estimator is Fisher consistent at the true target model. The paper also considers an optimal allocation procedure that does not introduce any bias due to judgment error classification. It is shown that this allocation procedure is equivalent to Neyman allocation. A numerical efficiency comparison is provided.     

Linear rank tests under general alternatives,with application to summary statistics computed from repeated measures data

Linear rank tests are used extensively for comparing two or more groups of continuous outcomes. Tests in this class retain proper test size with minimal assumptions and can have high efficiency towards an alternative of interest. In recent years, these tests have been increasingly used in settings where an individual's observation is itself a scalar summary of several outcome measures. Here, simple distributional structures on the outcome variables can lead to complex differences between the distributions of summary statistics of the comparison groups. The local asymptotic power of linear rank tests when the groups are assumed to differ by a location or scale alternative has been studied in detail. However, not much is known about their behavior for other types of alternatives. To address this, we derive the asymptotic distribution of linear rank tests under a general contiguous alternative and then investigate the implications for location–scale families and more general settings, including an example drawn from an AIDS clinical trial where the continuous outcome is a summary statistic computed from repeated measures of a biological marker.     

Critical Values for the Robust Rank-Order Test

ABSTRACT

The nonparametric Wilcoxon–Mann–Whitney test is commonly used by practitioners for detecting differences in location (mean, median) between two samples. Earlier work has shown this test to have a number of disadvantages, most of which are remedied by use of the alternative robust rank-order test. Use of the robust rank-order test has been limited, perhaps partly because exact critical values have up to now been available for only a small number of sample-size values, and not for all of the commonly used levels of significance. This article expands what is known about the distribution of the robust rank-order test statistic; critical values are given for more sample sizes and for more levels of significance.     

Robust pairwise multiple comparisons under short-tailed symmetric distributions

In one-way ANOVA, most of the pairwise multiple comparison procedures depend on normality assumption of errors. In practice, errors have non-normal distributions so frequently. Therefore, it is very important to develop robust estimators of location and the associated variance under non-normality. In this paper, we consider the estimation of one-way ANOVA model parameters to make pairwise multiple comparisons under short-tailed symmetric (STS) distribution. The classical least squares method is neither efficient nor robust and maximum likelihood estimation technique is problematic in this situation. Modified maximum likelihood (MML) estimation technique gives the opportunity to estimate model parameters in closed forms under non-normal distributions. Hence, the use of MML estimators in the test statistic is proposed for pairwise multiple comparisons under STS distribution. The efficiency and power comparisons of the test statistic based on sample mean, trimmed mean, wave and MML estimators are given and the robustness of the test obtained using these estimators under plausible alternatives and inlier model are examined. It is demonstrated that the test statistic based on MML estimators is efficient and robust and the corresponding test is more powerful and having smallest Type I error.     

Minimum hellinger distance estimation for normal models

A robust estimator introduced by Beran (1977a, 1977b), which is based on the minimum Hellinger distance between a projection model density and a nonparametric sample density, is studied empirically. An extensive simulation provides an estimate of the small sample distribution and supplies empirical evidence of the estimator performance for a normal location-scale model. While the performance of the minimum Hellinger distance estimator is seen to be competitive with the maximum likelihood estimator at the true model, its robustness to deviations from normality is shown to be competitive in this setting with that obtained from the M-estimator and the Cramér-von Mises minimum distance estimator. Beran also introduced a goodness-of-fit statisticH ₂, based on the minimized Hellinger distance between a member of a parametric family of densities and a nonparametric density estimate. We investigate the statistic H (the square root of H ₂) as a test for normality when both location and scale are unspecified. Empirically derived critical values are given which do not require extensive tables. The power of the statistic H compares favorably with four other widely used tests for normality.     

The generalized Cucconi test statistic for the two-sample problem

When testing hypotheses in two-sample problem, the Lepage test statistic is often used to jointly test the location and scale parameters, and this test statistic has been discussed by many authors over the years. Since two-sample nonparametric testing plays an important role in biometry, the Cucconi test statistic is generalized to the location, scale, and location–scale parameters in two-sample problem. The limiting distribution of the suggested test statistic is derived under the hypotheses. Deriving the exact critical value of the test statistic is difficult when the sample sizes are increased. A gamma approximation is used to evaluate the upper tail probability for the proposed test statistic given finite sample sizes. The asymptotic efficiencies of the proposed test statistic are determined for various distributions. The consistency of the original Cucconi test statistic is shown on the specific cases. Finally, the original Cucconi statistic is discussed in the theory of ties.     

A Wald-type test statistic based on robust modified median estimator in logistic regression models

In this paper a new robust estimator, modified median estimator, is introduced and studied for the logistic regression model. This estimator is based on the median estimator considered in Hobza et al. [Robust median estimator in logistic regression. J Stat Plan Inference. 2008;138:3822–3840]. Its asymptotic distribution is obtained. Using the modified median estimator, we also consider a Wald-type test statistic for testing linear hypotheses in the logistic regression model and we obtain its asymptotic distribution under the assumption of random regressors. An extensive simulation study is presented in order to analyse the efficiency as well as the robustness of the modified median estimator and Wald-type test based on it.     

On the distribution of the estimated mean from nonstandard mixtures of distributions

The distribution of the estimated mean of the nonstandard mixture of distributions that has a discrete probability mass at zero and a gamma distribution for positive values is derived. Furthermore, for the studied nonstandard mixture of distributions, the distribution of the standardized statistic (estimator - true mean)/standard deviation of estimator is derived. The results are used to study the accuracy of the confidence interval for the mean based on a large sample approximation. Quantiles for the standardized statistic are also calculated.     

Comparison of Robust Estimators of Standard Deviation in Normal Distributions Within the Context of Quality Control

Pitman criterion is used in simulation to determine the “closer” estimator of the standard deviation among selected choices. The initial simulation utilizes a standard normal distribution from which samples are taken of specific sizes. Popular and commonly used estimators of standard deviation are compared with the known population standard deviation in this study. Closeness criterion is calculated for each comparison and sample size. A secondary simulation applies the findings to variables control charts, in order to verify the ability of each estimator to identify out-of-control conditions.     

Estimation of the population mean when the coefficient of variation is known

Theory has been developed to provide an optimum estimator of the population mean based on a “mean per unit” estimator and the estimated standard deviation, assuming that the form of the distribution as well as its coefficient of variation (c.v.) are known. Theory has been extended to the case when an estimate of c.v. is available from an independent sample drawn in the past; the case when the form of the distribution is not known is also discussed. It is shown that the relative efficiency of the estimator with respect to “mean per unit estimator” is generally high for normal or near normal populations. For log-normal populations, an increase in efficiency of about 17 percent can be achieved. The results have been illustrated with data from biological populations.     

Exponentiality test based on alpha-divergence and gamma-divergence

In the present paper, we use the already defined alpha-divergence and gamma-divergence for constructing some goodness of fit tests for exponentiality. These divergence measures are very robust with respect to outliers. Since the existence of outliers among statistical data can be lead to misleading results, therefore utilizing these divergence measures can be of importance. In order to construct test statistics, two estimators are used for alpha-divergence and gamma-divergence. In the first one, we consider the alpha-divergence and gamma-divergence of the equilibrium distribution function, which is well defined on the empirical distribution function (EDF) and is proposed as an EDF-based goodness of fit test statistic. The second one is an estimator in manner of Vasicek entropy estimator. Simulation results indicate that in comparison with the other tests statistics, our mentioned test statistics almost in most of the cases have higher power. Finally, two examples containing outliers illustrate the importance and use of the proposed tests.     

The total bootstrap median: a robust and efficient estimator of location and scale for small samples

We propose the total bootstrap median (TBM) as a robust and efficient estimator of location and scale for small samples. We demonstrate its performance by estimating the mean and variance of a variety of distributions. We also show that, if the underlying distribution is unknown and there is either no contamination or low to moderate contamination, the TBM provides a better estimate of the mean, in mean square terms, than the sample mean or the sample median. In addition, the TBM is a better estimator of the variance of the underlying distribution than the sample variance or the square of the bias-corrected median absolute deviation from the median estimator. We also show that the TBM is an explicit L-estimator, which allows a direct study of its properties.     

An empirical investigation of different operating characteristics of several estimators of the intraclass correlation in the analysis of binary data

This paper is concerned with properties (bias, standard deviation, mean square error and efficiency) of twenty six estimators of the intraclass correlation in the analysis of binary data. Our main interest is to study these properties when data are generated from different distributions. For data generation we considered three over-dispersed binomial distributions, namely, the beta-binomial distribution, the probit normal binomial distribution and a mixture of two binomial distributions. The findings regarding bias, standard deviation and mean squared error of all these estimators, are that (a) in general, the distributions of biases of most of the estimators are negatively skewed. The biases are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution; (b) the standard deviations are smallest when data are generated from the beta-binomial distribution; and (c) the mean squared errors are smallest when data are generated from the beta-binomial distribution and largest when data are generated from the mixture distribution. Of the 26, nine estimators including the maximum likelihood estimator, an estimator based on the optimal quadratic estimating equations of Crowder (1987), and an analysis of variance type estimator is found to have least amount of bias, standard deviation and mean squared error. Also, the distributions of the bias, standard deviation and mean squared error for each of these estimators are, in general, more symmetric than those of the other estimators. Our findings regarding efficiency are that the estimator based on the optimal quadratic estimating equations has consistently high efficiency and least variability in the efficiency results. In the important range in which the intraclass correlation is small (≤0 5), on the average, this estimator shows best efficiency performance. The analysis of variance type estimator seems to do well for larger values of the intraclass correlation. In general, the estimator based on the optimal quadratic estimating equations seems to show best efficiency performance for data from the beta-binomial distribution and the probit normal binomial distribution, and the analysis of variance type estimator seems to do well for data from the mixture distribution.     

Conditional tests for elliptical symmetry using robust estimators

This paper presents a procedure for testing the hypothesis that the underlying distribution of the data is elliptical when using robust location and scatter estimators instead of the sample mean and covariance matrix. Under mild assumptions that include elliptical distributions without first moments, we derive the test statistic asymptotic behavior under the null hypothesis and under special alternatives. Numerical experiments allow to compare the behavior of the tests based on the sample mean and covariance matrix with that based on robust estimators, under various elliptical distributions and different alternatives. We also provide a numerical comparison with other competing tests.     

Estimated confidence under ancillary statistic everywhere-valid constraint

Consider the problem of estimating the coverage function of an usual confidence interval for a randomly chosen linear combination of the elements of the mean vector of a p-dimensional normal distribution. The usual constant coverage probability estimator is shown to be admissible under the ancillary statistic everywhere-valid constraint. Note that this estimator is not admissible under the usual sense if p⩾5. Since the criterion of admissibility under the ancillary statistic everywhere-valid constraint is a reasonable one, that the constant coverage probability estimator has been commonly accepted is justified.     

A note on the Zhang omnibus test for normality based on the Q statistic

A discussion about the estimators proposed by Zhang (1999) for the true standard deviation σof a normal distribution is presented. Those estimators, called by Zhang q 1 and q 2 , are functions of the expected values of the order statistics from a standard normal distribution and they were the basis of the Q statistic used in the derivation of a new test for normality proposed by Zhang. Although the type I error and the power of the test was discussed by Zhang, no study was performed to test the reliability of q 1 and q 2 as estimators of σ. In this paper, it is shown that q 1 is a very poor estimator for σespecially when σis large. On the other hand, the estimator q 2 has a performance very similar to the well-known sample standard deviation S. When some correlation is introduced among the sample units it can be seen that the estimator q 1 is much more affected than the estimators q 2 and S.     

Robust analogs to the coefficient of variation

The coefficient of variation (CV) is commonly used to measure relative dispersion. However, since it is based on the sample mean and standard deviation, outliers can adversely affect it. Additionally, for skewed distributions the mean and standard deviation may be difficult to interpret and, consequently, that may also be the case for the CV. Here we investigate the extent to which quantile-based measures of relative dispersion can provide appropriate summary information as an alternative to the CV. In particular, we investigate two measures, the first being the interquartile range (in lieu of the standard deviation), divided by the median (in lieu of the mean), and the second being the median absolute deviation, divided by the median, as robust estimators of relative dispersion. In addition to comparing the influence functions of the competing estimators and their asymptotic biases and variances, we compare interval estimators using simulation studies to assess coverage.     

Maximum Test versus Adaptive Tests for the Two-Sample Location Problem

For the non-parametric two-sample location problem, adaptive tests based on a selector statistic are compared with a maximum and a sum test, respectively. When the class of all continuous distributions is not restricted, the sum test is not a robust test, i.e. it does not have a relatively high power across the different possible distributions. However, according to our simulation results, the adaptive tests as well as the maximum test are robust. For a small sample size, the maximum test is preferable, whereas for a large sample size the comparison between the adaptive tests and the maximum test does not show a clear winner. Consequently, one may argue in favour of the maximum test since it is a useful test for all sample sizes. Furthermore, it does not need a selector and the specification of which test is to be performed for which values of the selector. When the family of possible distributions is restricted, the maximin efficiency robust test may be a further robust alternative. However, for the family of t distributions this test is not as powerful as the corresponding maximum test.     

Tests of multinormality based on location vectors and scatter matrices

Classical univariate measures of asymmetry such as Pearson’s (mean-median)/σ or (mean-mode)/σ often measure the standardized distance between two separate location parameters and have been widely used in assessing univariate normality. Similarly, measures of univariate kurtosis are often just ratios of two scale measures. The classical standardized fourth moment and the ratio of the mean deviation to the standard deviation serve as examples. In this paper we consider tests of multinormality which are based on the Mahalanobis distance between two multivariate location vector estimates or on the (matrix) distance between two scatter matrix estimates, respectively. Asymptotic theory is developed to provide approximate null distributions as well as to consider asymptotic efficiencies. Limiting Pitman efficiencies for contiguous sequences of contaminated normal distributions are calculated and the efficiencies are compared to those of the classical tests by Mardia. Simulations are used to compare finite sample efficiencies. The theory is also illustrated by an example.