Comparative Study of Robust Estimators Based on a Sensitivity Coefficient in Principal Component Analysis

This work is devoted to robust principal component analysis (PCA). We give a comparison between some multivariate estimators of location and scatter by computing the influence functions of the sensitivity coefficient ρ corresponding to these estimators, and the mean squared error (MSE) of estimators of ρ. The coefficient ρ measures the closeness between the subspaces spanned by the initial eigenvectors and their corresponding version derived from an infinitesimal perturbation of the data distribution.     

On principal points for location mixtures of spherically symmetric distributions

In this paper, we investigate some properties of 2-principal points for location mixtures of spherically symmetric distributions with focus on a linear subspace in which a set of 2-principal points must lie. Our results can be viewed as an extension of those of Yamamoto and Shinozaki [2000. Two principal points for multivariate location mixtures of spherically symmetric distributions. J. Japan Statist. Soc. 30, 53–63], where a finite location mixture of spherically symmetric distributions is treated. As an extension of their paper, this paper defines a wider class of distributions, and derives a linear subspace in which a set of 2-principal points must exist. A theorem useful for comparing the mean squared distances is also established.     

A Bayesian wavelet approach to estimation of a change-point in a nonlinear multivariate time series

ABSTRACT

We propose a semiparametric approach to estimate the existence and location of a statistical change-point to a nonlinear multivariate time series contaminated with an additive noise component. In particular, we consider a p-dimensional stochastic process of independent multivariate normal observations where the mean function varies smoothly except at a single change-point. Our approach involves conducting a Bayesian analysis on the empirical detail coefficients of the original time series after a wavelet transform. If the mean function of our time series can be expressed as a multivariate step function, we find our Bayesian-wavelet method performs comparably with classical parametric methods such as maximum likelihood estimation. The advantage of our multivariate change-point method is seen in how it applies to a much larger class of mean functions that require only general smoothness conditions.     

On General Multivariate Mixture Models

In this article, we focus our attention on the general multivariate mixture model. We drive the relationship between the conditional and the unconditional reliability measures such as the hazard gradient, reversed hazard gradient, multivariate mean residual life, and multivariate reversed mean residual life. We present some sufficient conditions under which we can stochastically compare those vectors of general multivariate mixture models in the senses of various stochastic orderings.     

La médiane simpliciale d'Oja: Existence,unicité et stabilité

Oja (1983) examined various ways of measuring location, scatter, skewness, and kurtosis for multivariate distributions. Among other measures of location, he introduced a generalised median known in this paper under the name of the Oja median. In our study of the existence of that median, we show that Oja's definition can only be applied to distributions having a mean. In dimension d θ 2, we establish that the usual method of extension breaks down, which raises the question of the validity of the concept as a notion of median. Two fundamental theoretical properties of that median are also considered: uniqueness and consistency.     

Tests of multinormality based on location vectors and scatter matrices

Classical univariate measures of asymmetry such as Pearson’s (mean-median)/σ or (mean-mode)/σ often measure the standardized distance between two separate location parameters and have been widely used in assessing univariate normality. Similarly, measures of univariate kurtosis are often just ratios of two scale measures. The classical standardized fourth moment and the ratio of the mean deviation to the standard deviation serve as examples. In this paper we consider tests of multinormality which are based on the Mahalanobis distance between two multivariate location vector estimates or on the (matrix) distance between two scatter matrix estimates, respectively. Asymptotic theory is developed to provide approximate null distributions as well as to consider asymptotic efficiencies. Limiting Pitman efficiencies for contiguous sequences of contaminated normal distributions are calculated and the efficiencies are compared to those of the classical tests by Mardia. Simulations are used to compare finite sample efficiencies. The theory is also illustrated by an example.     

Selected singular-generalized-hyperbolic distributions with applications to order statistics and reliability

In this paper, the truncated version of the selected multivariate generalized-hyperbolic distributions is introduced. Considering special truncations, the joint distribution of the consecutive order statistics from the multivariate generalized-hyperbolic (GH) distribution is derived. It is shown that this joint distribution can be expressed as mixtures of the truncated selected-GH distributions. All of these truncated distributions are expressed as the selected singular-GH distributions. These results are used to obtain some expressions for the reliability measures such as mean residual life time, mean inactivity time and regression mean residual life for k-out-of-n systems.     

A multivariate parallelogram and its application to multivariate trimmed means

This paper introduces a multivariate parallelogram that can play the role of the univariate quantile in the location model, and uses it to define a multivariate trimmed mean. It assesses the asymptotic efficiency of the proposed multivariate trimmed mean by its asymptotic variance and by Monte Carlo simulation.     

Some characterizations of multivariate distributions using products of the hazard gradient and mean residual life components

We give a general procedure to characterize multivariate distributions by using products of the hazard gradient and mean residual life components. This procedure is applied to characterize multivariate distributions as Gumbel exponential, Lomax, Burr, Pareto and generalized Pareto multivariate distributions. Our results extend the results of several authors and can be used to study how to extend univariate models to the multivariate set-up.     

Matrix variance inequalities for multivariate distributions

We derive generalizations of the Hoeffding identity for multivariate random vectors and study some measures of dependence in the multidimensional case. In addition, we derive bounds on the covariance matrix for some multivariate distributions in the sense of Loewner ordering.     

Multivariate trimmed means based on the Tukey depth

In univariate statistics, the trimmed mean has long been regarded as a robust and efficient alternative to the sample mean. A multivariate analogue calls for a notion of trimmed region around the center of the sample. Using Tukey's depth to achieve this goal, this paper investigates two types of multivariate trimmed means obtained by averaging over the trimmed region in two different ways. For both trimmed means, conditions ensuring asymptotic normality are obtained; in this respect, one of the main features of the paper is the systematic use of Hadamard derivatives and empirical processes methods to derive the central limit theorems. Asymptotic efficiency relative to the sample mean as well as breakdown point are also studied. The results provide convincing evidence that these location estimators have nice asymptotic behavior and possess highly desirable finite-sample robustness properties; furthermore, relative to the sample mean, both of them can in some situations be highly efficient for dimensions between 2 and 10.     

Bootstrapping Spatial Median for Location Problems

In multivariate location problems, the sample mean is most widely used, having various advantages. It is, however, very sensitive to outlying observations and inefficient for data from heavy tailed distributions. In this situation, the spatial median is more robust than the sample mean and could be a reasonable alternative. We reviewed several spatial median based testing methods for multivariate location and compared their significance level and power through Monte Carlo simulations. The results show that bootstrap method is efficient for the estimation of the covariance matrix of the sample spatial median. We also proposed bootstrap simultaneous confidence intervals based on the spatial median for multiple comparisons in the multi-sample case.     

On an adaptive transformation–retransformation estimate of multivariate location

An affine equivariant estimate of multivariate location based on an adaptive transformation and retransformation approach is studied. The work is primarily motivated by earlier work on different versions of the multivariate median and their properties. We explore an issue related to efficiency and equivariance that was originally raised by Bickel and subsequently investigated by Brown and Hettmansperger. Our estimate has better asymptotic performance than the vector of co-ordinatewise medians when the variables are substantially correlated. The finite sample performance of the estimate is investigated by using Monte Carlo simulations. Some examples are presented to demonstrate the effect of the adaptive transformation–retransformation strategy in the construction of multivariate location estimates for real data.     

Evaluation of multivariate surveillance

Multivariate surveillance is of interest in many areas such as industrial production, bioterrorism detection, spatial surveillance, and financial transaction strategies. Some of the suggested approaches to multivariate surveillance have been multivariate counterparts to the univariate Shewhart, EWMA, and CUSUM methods. Our emphasis is on the special challenges of evaluating multivariate surveillance methods. Some new measures are suggested and the properties of several measures are demonstrated by applications to various situations. It is demonstrated that zero-state and steady-state ARL, which are widely used in univariate surveillance, should be used with care in multivariate surveillance.     

Comparison of performance measures for multivariate discrete models

For multivariate probit models, Spiess and Tutz suggest three alternative performance measures, which are all based on the decomposition of the variation. The multivariate probit model can be seen as a special case of the discrete copula model. This paper proposes some new measures based on the value of the likelihood function and the prediction-realization table. In addition, it generalizes the measures from Spiess and Tutz for the discrete copula model. Results of a simulation study designed to compare the different measures in various situations are presented.     

Wavelet threshold based on Stein's unbiased risk estimators of restricted location parameter in multivariate normal

In this paper, the problem of estimating the mean vector under non-negative constraints on location vector of the multivariate normal distribution is investigated. The value of the wavelet threshold based on Stein''s unbiased risk estimators is calculated for the shrinkage estimator in restricted parameter space. We suppose that covariance matrix is unknown and we find the dominant class of shrinkage estimators under Balance loss function. The performance evaluation of the proposed class of estimators is checked through a simulation study by using risk and average mean square error values.     

Simultaneous estimation of restricted location parameters based on permutation and sign-change

The problem of simultaneously estimating location parameters is addressed, where the vector of location parameters belongs to a polyhedral cone including simple order, tree order and positive orthant restrictions and so forth. This paper proposes modified estimators based on orthogonal transformations such as sign-change and permutation and proves that, in a multivariate location family, the modified estimators are minimax under quadratic loss. Shrinkage minimax estimators improving on the modified estimators are obtained for a restricted mean vector of spherically symmetric distribution. An application of sign-change transformation is also given in estimation of a bounded normal mean.     

Symmetric maximum kernel likelihood estimation

We introduce an estimator for the population mean based on maximizing likelihoods formed from a symmetric kernel density estimate. Due to these origins, we have dubbed the estimator the symmetric maximum kernel likelihood estimate (smkle). A speedy computational method to compute the smkle based on binning is implemented in a simulation study which shows that the smkle at an optimal bandwidth is decidedly superior in terms of efficiency to the sample mean and other measures of location for heavy-tailed symmetric distributions. An empirical rule and a computational method to estimate this optimal bandwidth are developed and used to construct bootstrap confidence intervals for the population mean. We show that the intervals have approximately nominal coverage and have significantly smaller average width than the corresponding intervals for other measures of location.     

Robust weighted one-way ANOVA: Improved approximation and efficiency

A robust test for the one-way ANOVA model under heteroscedasticity is developed in this paper. The data are assumed to be symmetrically distributed, apart from some outliers, although the assumption of normality may be violated. The test statistic to be used is a weighted sum of squares similar to the Welch [1951. On the comparison of several mean values: an alternative approach. Biometrika 38, 330-336.] test statistic, but any of a variety of robust measures of location and scale for the populations of interest may be used instead of the usual mean and standard deviation. Under the commonly occurring condition that the robust measures of location and scale are asymptotically normal, we derive approximations to the distribution of the test statistic under the null hypothesis and to its distribution under alternative hypotheses. An expression for relative efficiency is derived, thus allowing comparison of the efficiency of the test as a function of the choice of the location and scale estimators used in the test statistic. As an illustration of the theory presented here, we apply it to three commonly used robust location–scale estimator pairs: the trimmed mean with the Winsorized standard deviation; the Huber Proposal 2 estimator pair; and the Hampel robust location estimator with the median absolute deviation.     

Identifying the time of a step change with multivariate single control charts

Change point estimation procedures simplify the efforts to search for and identify special causes in multivariate statistical process monitoring. After a signal is generated by the simultaneously used control charts or a single control chart, add-on change point procedure estimates the time of the change. In this study, multivariate joint change point estimation performance for simultaneous monitoring of both location and dispersion is compared under the assumption that various single charts are used to monitor the process. The change detection performance for several structural changes for the mean vector and covariance matrix is also discussed. It is concluded that choice of the control chart to obtain a signal may affect the change point detection performance.