Statistical Discrimination Analysis Using the Maximum Function

The maximum of k functions defined on R ⁿ , n ≥ 1, by f _max (x) = max{f ₁ (x),…, f _k (x)}, ? x ? R ⁿ , can have important roles in Statistics, particularly in Classification. Through its relation with the Bayes error, which is the reference error in classification, it can serve to compute numerical bounds for errors in other classification schemes. It can also serve to define the joint L¹-distance between more than two densities, which, in turn, will serve as a useful tool in Classification and Cluster Analyses. It has a vast potential application in digital image processing too. Finally, its versatile role can be seen in several numerical examples, related to the analysis of Fisher's classical iris data in multidimensional spaces.     

Another Cautionary Note about R 2: Its Use in Weighted Least-Squares Regression Analysis

A recent article in this journal presented a variety of expressions for the coefficient of determination (R ²) and demonstrated that these expressions were generally not equivalent. The article discussed potential pitfalls in interpreting the R ² statistic in ordinary least-squares regression analysis. The current article extends this discussion to the case in which regression models are fit by weighted least squares and points out an additional pitfall that awaits the unwary data analyst. We show that unthinking reliance on the R ² statistic can lead to an overly optimistic interpretation of the proportion of variance accounted for in the regression. We propose a modification of the estimator and demonstrate its utility by example.     

The Prediction Sum of Squares as a General Measure for Regression Diagnostics

Statistics that usually accompany the regression model do not provide insight into the quality of the data or the potential influence of the individual observations on the estimates. In this study, the Q² statistic is used as a criterion for detecting influential observations or outliers. The statistic is derived from the jackknifed residuals, the squared sum of which is generally known as the prediction sum of squares or PRESS. This article compares R ² with Q² and suggests that the latter be used as part of the data-quality check. It is shown, for two separate data sets obtained from regional cost of living and U.S. food industry studies, that in the presence of outliers the Q² statistic can be negative, because it is sensitive to the choice of regressors and the inclusion of influential observations. Once the outliers are dropped from the sample, the discrepancy between Q² and R ² values is negligible.     

Diagnosis of Multivariate Control Chart Signal Based on Dummy Variable Regression Technique

Abstract

It is common to monitor several correlated quality characteristics using the Hotelling's T ² statistic. However, T ² confounds the location shift with scale shift and consequently it is often difficult to determine the factors responsible for out of control signal in terms of the process mean vector and/or process covariance matrix. In this paper, we propose a diagnostic procedure called ‘D-technique’ to detect the nature of shift. For this purpose, two sets of regression equations, each consisting of regression of a variable on the remaining variables, are used to characterize the ‘structure’ of the ‘in control’ process and that of ‘current’ process. To determine the sources responsible for an out of control state, it is shown that it is enough to compare these two structures using the dummy variable multiple regression equation. The proposed method is operationally simpler and computationally advantageous over existing diagnostic tools. The technique is illustrated with various examples.     

Number of observations near the maximum in an F α-scheme

Let K _n (a) be the number of observations in the interval (M _n ,?a, M _n ), where M _n is the maximum value in a sequence of size n. We study the asymptotic properties of K _n (a) under the F ^α-scheme and discuss the influence of the associated sequence α _n on the limit behaviour of this random variable.     

A Unified Way to Represent and Compute the Cumulative Distribution Function for Noncentral t,F, and χ2

This short article shows an unified approach to representing and computing the cumulative distribution function for noncentral t, F, and χ². Unlike the existing algorithms, which involve different expansion and/or recurrence, the new approach consistently represents all the three noncentral cumulative distribution functions as the integral of the normal cumulative distribution function and χ² density function.     

Maximum Value of Hotelling's T 2 Statistics Based on the Successive Differences Covariance Matrix Estimator

In statistical process control applications, the multivariate T ² control chart based on Hotelling's T ² statistic is useful for detecting the presence of special causes of variation. In particular, use of the T ² statistic based on the successive differences covariance matrix estimator has been shown to be very effective in detecting the presence of a sustained step or ramp shift in the mean vector. However, the exact distribution of this statistic is unknown. In this article, we derive the maximum value of the T ² statistic based on the successive differences covariance matrix estimator. This distributional property is crucial for calculating an approximate upper control limit of a T ² control chart based on successive differences, as described in Williams et al. (2006 Williams , J. D. , Woodall , W. H. , Birch , J. B. , Sullivan , J. H. ( 2006 ). On the distribution of T ² statistics based on successive differences . J. Qual. Technol. 38 : 217 – 229 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]).     

Some Related Minima Stability and Minima Infinite Divisibility of the General Multivariate Pareto Distributions

This article studies the minima stable property of the general multivariate Pareto distributions MP^(k)(I), MP^(k)(II), MP^(k)(III), MP^(k)(IV) which can be applied to characterize the MP^(k) distribution via its weighted ordered coordinates minima and marginal distribution. Also, the multivariate semi-Pareto distribution (denoted by MSP) is discerned in the class of geometric minima infinite divisible and geometric minima stable distributions. If the exponent measure is satisfied by some functional equation, then the geometric minima stable property can be used to characterize the MSP distribution. Finally, the finite sample minima infinite divisible property of the MP^(k)(I), (II), and (IV) distributions is also discussed.     

On Two Types of Breakdown Points of Weighted L 2-median

Zuo (2004) investigated the simplified replacement finite sample breakdown point of weighted L ^p -depth and L ^p -median for some appropriate weight functions. The addition breakdown point of weighted L ^p -depth functions is studied firstly in this article. In addition, for some other weight functions different from those in Zuo (2004 Zuo , Y. ( 2004 ). Robustness of weighted L ^p -depth and L ^p -median . Allgemeines Statistics Archiv. 88 : 215 – 234 . [Google Scholar]), we establish the lower bounds of these two types of breakdown point of weighted L ²-median.     

Identifying Variables Contributing to Outliers in Phase I

When a process is monitored with a T ² control chart in a Phase II setting, the MYT decomposition is a valuable diagnostic tool for interpreting signals in terms of the process variables. The decomposition splits a signaling T ² statistic into independent components that can be associated with either individual variables or groups of variables. Since these components are T ² statistics with known distributions, they can be used to determine which of the process variable(s) contribute to the signal. However, this procedure cannot be applied directly to Phase I since the distributions of the individual components are unknown. In this article, we develop the MYT decomposition procedure for a Phase I operation, when monitoring a random sample of individual observations and identifying outliers. We use a relationship between the T ² statistic in Phase I with the corresponding T ² statistic resulting when an observation is omitted from this sample to derive the distributions of these components and demonstrate the Phase I application of the MYT decomposition.     

Generalized cochran-mantel-haenszel test statistics for correlated categorical data

Three new test statistics are introduced for correlated categorical data in stratified R×C tables. They are similar in form to the standard generalized Cochran-Mantel-Haenszel statistics but modified to handle correlated outcomes. Two of these statistics are asymptotically valid in both many-strata (sparse data) and large-strata limiting models. The third one is designed specifically for the many-strata case but is valid even with a small number of strata. This latter statistic is also appropriate when strata are assumed to be random.     

Estimation in noncentral distributions

This paper investigates alternatives to MIU estimators in noncentral X ² and F distributions. Two directions are pursued. In the first, a general approach for uniformly improving on MVU estimators is described and illustrated. In the second, Bayesian, procedures are characterized and illustrated as well. This effort extends earlier work of Perlman and Rasmussen and of Neff and Strawderman.     

On constructing T 2 control charts for retrospective examination

In this paper we consider the issue of constructing retrospective T ² control chart limits so as to control the overall probability of a false alarm at a specified value. We describe an exact method for constructing the control limits for retrospective examination. We then consider Bonferroni-adjustments to Alt's control limit and to the standard x ² control limit as alternatives to the exact limit since it is computationally cumbersome to find the exact limit. We present the results of some simulation experiments that are carried out to compare the performance of these control limits. The results indicate that the Bonferroni-adjusted Alt's control limit performs better that the Bonferroni-adjusted x ² control limit. Furthermore, it appears that the Bonferroni-adjusted Alt's control limit is more than adequate for controlling the overall false alarm probability at a specified value.     

On hsu's model in regression analysis

The paper examplifies with Hsu’s model a general pattern as how to derive results of variance component estimation from well known results on mean estimation, as far as linear model theory is concerned. This ’ dispersion-mean-correspondence‘provides new and short proofs for various theorems from the literature, concerning unbiased invariant quadratic estimators with minimum BAYES risk or minimum variance. For pure variance component models, unbiased non-negative quadratic estimability is characterized in terms of the design matrices.     

Comparison of Goodness-of-Fit Measures in Probit Regression Model

This article examines several goodness-of-fit measures in the binary probit regression model. Existing pseudo-R ² measures are reviewed, two modified and one new pseudo-R ² measure are proposed. For the probit regression model, empirical comparisons are made for different goodness-of-fit measures with the squared sample correlation coefficient of the observed response and the predicted probabilities. As an illustration, the goodness-of-fit measures are applied to a “paid labor force” data set.     

An Asymptotic Characterization of Finite Degree U-statistics With Sample Size-Dependent Kernels: Applications to Nonparametric Estimators and Test Statistics

We provide a simple result on the H-decomposition of a U-statistics that allows for easy determination of its magnitude when the statistic’s kernel depends on the sample size n. The result provides a direct and convenient method to characterize the asymptotic magnitude of semiparametric and nonparametric estimators or test statistics involving high dimensional sums. We illustrate the use of our result in previously studied estimators/test statistics and in a novel nonparametric R² test for overall significance of a nonparametric regression model.     

Modifying and using Yates' algorithm

It is well known that Yates' algorithm can be used to estimate the effects in a factorial design. We develop a modification of this algorithm and call it modified Yates' algorithm and its inverse. We show that the intermediate steps in our algorithm have a direct interpretation as estimated level-specific mean values and effects. Also we show how Yates' or our modified algorithm can be used to construct the blocks in a 2 ^k factorial design and to generate the layout sheet of a 2 ^k−p fractional factorial design and the confounding pattern in such a design. In a final example we put together all these methods by generating and analysing a 2^6-2 design with 2 blocks.     

Misspecified T2 tests. i. location and scale

Properties of Hotelling's (1931) T ² are studied under model misspecification in the model for a multivariate experiment. Stochastic bounds on T ² and further properties of the T ² test are studied under misspecified location and scale. The bounds are evaluated numerically in selected cases.     

A new test for the mean vector in large dimension and small samples

In this article, we consider the problem of testing the mean vector in the multivariate normal distribution, where the dimension p is greater than the sample size N. We propose a new test T_Block and obtain its asymptotic distribution. We also compare the proposed test with other two tests. The simulation results suggest that the performance of the new test is comparable to the existing two tests, and under some circumstances it may have higher power. Therefore, the new statistic can be employed in practice as an alternative choice.