Estimates of regression coefficients based on the sign covariance matrix

Summary. A new estimator of the regression parameters is introduced in a multivariate multiple-regression model in which both the vector of explanatory variables and the vector of response variables are assumed to be random. The affine equivariant estimate matrix is constructed using the sign covariance matrix (SCM) where the sign concept is based on Oja's criterion function. The influence function and asymptotic theory are developed to consider robustness and limiting efficiencies of the SCM regression estimate. The estimate is shown to be consistent with a limiting multinormal distribution. The influence function, as a function of the length of the contamination vector, is shown to be linear in elliptic cases; for the least squares (LS) estimate it is quadratic. The asymptotic relative efficiencies with respect to the LS estimate are given in the multivariate normal as well as the t -distribution cases. The SCM regression estimate is highly efficient in the multivariate normal case and, for heavy-tailed distributions, it performs better than the LS estimate. Simulations are used to consider finite sample efficiencies with similar results. The theory is illustrated with an example.     

Simultaneous robust estimation of location and scale parameters: A minimum-distance approach

Simultaneous robust estimates of location and scale parameters are derived from minimizing a minimum-distance criterion function. The criterion function measures the squared distance between the pth power (p > 0) of the empirical distribution function and the pth power of the imperfectly determined model distribution function over the real line. We show that the estimator is uniquely defined, is asymptotically bivariate normal and for p > 0.3 has positive breakdown. If the scale parameter is known, when p = 0.9 the asymptotic variance (1.0436) of the location estimator for the normal model is smaller than the asymptotic variance of the Hodges-Lehmann (HL)estimator (1.0472). Efficiencies with respect to HL and maximum-likelihood estimators (MLE) are 1.0034 and 0.9582, respectively. Similarly, if the location parameter is known, when p = 0.97 the asymptotic variance (0.6158) of the scale estimator is minimum. The efficiency with respect to the MLE is 0.8119. We show that the estimator can tolerate more corrupted observations at oo than at – for p < 1, and vice versa for p > 1.     

Kruskal–Wallis, Multiple Comparisons and Efron Dice

The Kruskal–Wallis test is a rank–based one way ANOVA. Its test statistic is shown here to be a quadratic form among the Mann–Whitney or Kendall tau concordance measures between pairs of treatments. But the full set of such concordance measures has more degrees of freedom than the Kruskal–Wallis test uses, and the independent surplus is attributable to circularity, or non–transitive effects. The meaning of circularity is well illustrated by Efron dice. The cases of k = 3, 4 treatments are analysed thoroughly in this paper, which also shows how the full sum of squares among all concordance measures can be decomposed into uncorrelated transitive and non–transitive circularity effects. A multiple comparisons procedure based on patterns of transitive orderings among treatments is implemented. The testing of circularities involves non–standard asymptotic distributions. The asymptotic theory is deferred, but Monte Carlo permutation tests are easy to implement.     

Multi-sample inference for the simple-tree alternative based on one-sample confidence intervals

The problem of testing homogeneity of several group means is considered against some patterned alternatives for the one-way classified data. The patterns of interest include the simple-tree and the trend alternatives. The approach is to begin with some suitably defined one-sample confidence intervals for the groups in a graphical display. Depending on the pattern of interest, orientation features of the display are examined, more formally, using proposed overall tests or rules. In the classical setup under normality, the case of known common variance is treated in detail; extensions to the case of unknown variance are indicated. When normality is in doubt, a nonparametric procedure based on the sign test is proposed. The necessary critical values are percentiles of either a multivariate normal distribution or a multivariate t-distribution. Although some existing tables can be used for the critical values (or the P-values) in some special cases, in general, the use of simulations is recommended and the steps are detailed in the appendix. An illustrative numerical example is provided.     

Weighted least-squares rank estimates

In this paper rank estimates, called WLS rank estimates and computed using iteratively reweighted least squares, are studied. They do not require the estimation of auxilliary scale or slope parameters nor do they require numerical search techniques to minimize a convex surface. The price is a small asymptotic efficiency loss. In the location model, beginning with a resistant starting value such as the median, the WLS rank estimates have good robustness and computational properties. The WLS rank estimate is also extended to the regression model and an example is given.