High dimensional asymptotics for the naive Hotelling T2 statistic in pattern recognition

Abstract

This paper examines the high dimensional asymptotics of the naive Hotelling T² statistic. Naive Bayes has been utilized in high dimensional pattern recognition as a method to avoid singularities in the estimated covariance matrix. The naive Hotelling T² statistic, which is equivalent to the estimator of the naive canonical correlation, is a statistically important quantity in naive Bayes and its high dimensional behavior has been studied under several conditions. In this paper, asymptotic normality of the naive Hotelling T² statistic under a high dimension low sample size setting is developed using the central limit theorem of a martingale difference sequence.     

Ranked set sampling with concomitant variables

Ranked set sampling is a procedure which may be used to improve the precision of the estimator of the mean. It is useful in cases where the variable of interest is much more difficult to measure than to order. However, even if ordering is difficult, but there is an easily ranked concomitant variable available, then it may be used to “judgment order” the original variable. The amount of increase in the precision of the estimator is dependent upon the correlation between the 2 variables.     

Maximal Invariant and Weakly Equivariant Estimators

Equivariant functions can be useful for constructing of maximal invariant statistic. In this article, we discuss construction of maximal invariants based on a given weakly equivariant function under some additional conditions. The theory easily extends to the case of two or more weakly equivariant functions. Also, we derive a maximal invariant statistic when the group contains a sharply transitive and a characteristic subgroup. Finally, we consider the independence of invariant and weakly equivariant functions under some special conditions.     

A Compressive Sensing Based Analysis of Anomalies in Generalized Linear Models

In this article, we present a compressive sensing based framework for generalized linear model regression that employs a two-component noise model and convex optimization techniques to simultaneously detect outliers and determine optimally sparse representations of noisy data from arbitrary sets of basis functions. We then extend our model to include model order reduction capabilities that can uncover inherent sparsity in regression coefficients and achieve simple, superior fits. Second, we use the mixed ?₂/?₁ norm to develop another model that can efficiently uncover block-sparsity in regression coefficients. By performing model order reduction over all independent variables and basis functions, our algorithms successfully deemphasize the effect of independent variables that become uncorrelated with dependent variables. This desirable property has various applications in real-time anomaly detection, such as faulty sensor detection and sensor jamming in wireless sensor networks. After developing our framework and inheriting a stable recovery theorem from compressive sensing theory, we present two simulation studies on sparse or block-sparse problems that demonstrate the superior performance of our algorithms with respect to (1) classic outlier-invariant regression techniques like least absolute value and iteratively reweighted least-squares and (2) classic sparse-regularized regression techniques like LASSO.     

Nonparametric AMOC Changepoint Tests for Stochastically Ordered Alternatives

The problem considered is that of testing on the basis of a finite sequence of independent observations if all the observations have the same distribution versus the alternative that there is a unique change in the distribution and i.i.d. observations after the change are stochastically larger. The distributions before and after the possible change are continuous but not fully specified. We suggest a family of nonparametric tests based on ranks. Asymptotic approximations for the significance level of the test are obtained analytically. Monte Carlo experiments show that the rate of convergence of our asymptotics is fast.     

Detection and Interpretation of a Multivariate Signal Using Combined Charts

A control procedure is presented in this article that is based on jointly using two separate control statistics in the detection and interpretation of signals in a multivariate normal process. The procedure detects the following three situations: (i) a mean vector shift without a shift in the covariance matrix; (ii) a shift in process variation (covariance matrix) without a mean vector shift; and (iii) both a simultaneous shift in the mean vector and covariance matrix as the result of a change in the parameters of some key process variables. It is shown that, following the occurrence of a signal on either of the separate control charts, the values from both of the corresponding signaling statistics can be decomposed into interpretable elements. Viewing the two decompositions together helps one to specifically identify the individual components and associated variables that are being affected. These components may include individual means or variances of the process variables as well as the correlations between or among variables. An industrial data set is used to illustrate the procedure.     

On asymptotic non-normality of null distributions of mrpp statistics

Severe departures from normality occur frequently for null distributions of statistics associated with applications of mulLi-response permutation procedures (MRPP) for either small or large finite populations. This paper describes the commonly encountered situation associated with asymptotic non-normality for null distributions of MRPP statistics which does not depend on the underlying multivariate distribution. In addition, this paper establishes the existence of a non-degenerate underlying distribution for which the null distributions of MRPP statistics are asymptotically non-normal for essentially all size structure configurations. It is known that MRPP statistics are symmetric versions of a broader class of statistics, most of which are asymmetric. Because of the non-normality associated with null distributions of MRPP statistics, this paper includes necessary results for inferences based on the exact first three moments of anv statistic in this broader class (analogous to existing results for MRPP statistics).     

Robust test for means when population variances are unequal

We consider the problem of testing the equality of two population means when the population variances are not necessarily equal. We propose a Welch-type statistic, say T^* _c, based on Tiku!s ‘1967, 1980’ modified maximum likelihood estimators, and show that this statistic is robust to symmetric and moderately skew distributions. We investigate the power properties of the statistic T^* _c; T^* _c clearly seems to be more powerful than Yuen's ‘1974’ Welch-type robust statistic based on the trimmed sample means and the matching sample variances. We show that the analogous statistics based on the ‘adaptive’ robust estimators give misleading Type I errors. We generalize the results to testing linear contrasts among k population means     

Standard and goodness-of-fit parameter estimation methods for the three-parameter lognormal distribution

A class of goodness-of-fit estimators is found to provide a useful alternative in certain situations to the standard maximum likelihood method which has some undesirable estimation characteristics for estimation from the three-parameter lognormal distribution. The class of goodness-of-fit tests considered include the Shapiro-Wilk and Filliben tests which reduce to a weighted linear combination of the order statistics that can be maximized in estimation problems. The weighted order statistic estimators are compared to the standard procedures in Monte Carlo simulations. Robustness of the procedures are examined and example data sets analyzed.