A complete solution to the problem of robustness of Grubbs's test

Srivastava (1980) showed that Grubbs's test for detecting a univariate outlier is robust against the effect of intraclass correlation structure. Young, Pavur, and Marco (1989) extended this result by proving that both the significance level and the power of Grubbs's test remain unchanged within a wider family of dispersion matrices, introduced by Baldessari (1966) in a different context. In this note, we derive a complete solution of the problem by establishing that the characteristics of Grubbs's test are invariant with respect to a given dispersion matrix if and only if it has Baldessari's structure.     

A characterization of the independence - distribution - preserving covariance structure for the multivariate maximum squared - radii statistic

Necessary and sufficient conditions on the observation covariance structure and on the set of linear transformations are given for which the distribution of the multivariate maximum squared - radii statistic for detecting a single multivariate outlier is invariant from the distribution assuming the usual independence covariance structure. Thus, we extend the work of Baksalary and Puntanen (1990), who have given necessary and sufficient conditions for an independence-distribution-preserving covariance structure for Grubbs' statistic for detecting a univariate outlier. We also extend the work of Marco, Young, and Turner (1987) and Pavur and Young (1991), who have given sufficient conditions for an independence-distribution-preserving dependency structure for the multivariate squared - radii statistic.     

THE ANALYSIS OF MULTISTRATA DESIGNED EXPERIMENTS WITH INCOMPLETE DATA

Building upon early work of E. A. Cornish we show that G. N. Wilkinson's version of Yates' approach to the analysis of designed experiments with a single error stratum carries over completely to designs with an arbitrary non-singular covariance matrix, initially assumed known. We show that the equations, corrections, adjustments and algorithms all have their more general analogues and that these can be solved, computed or executed quite readily if the design has orthogonal block structure and satisfies Nelder's condition of general balance. The results are illustrated with a split-plot and a simple (square) lattice design.     

Testing a block exchangeable covariance matrix

Testing hypotheses about the structure of a covariance matrix for doubly multivariate data is often considered in the literature. In this paper the Rao's score test (RST) is derived to test the block exchangeable covariance matrix or block compound symmetry (BCS) covariance structure under the assumption of multivariate normality. It is shown that the empirical distribution of the RST statistic under the null hypothesis is independent of the true values of the mean and the matrix components of a BCS structure. A significant advantage of the RST is that it can be performed for small samples, even smaller than the dimension of the data, where the likelihood ratio test (LRT) cannot be used, and it outperforms the standard LRT in a number of contexts. Simulation studies are performed for the sample size consideration, and for the estimation of the empirical quantiles of the null distribution of the test statistic. The RST procedure is illustrated on a real data set from the medical studies.     

A characterization of nonnegative-definite independence distribution-preserving covariance structures for the maximum squared-radii statistic

The multivariate maximum squared-radii (MMSR) statistic is commonly used to detect multivariate outliers. We characterize the general form of the nonnegative-definite observation covariance structure for which the distribution of the MMSR statistic is the sameas the distribution resulting from the usual independence covariance structure. Thus, we extend the work of Young, Seaman, and Meaux (1992), who have characterized the general form of the positive-definite independence-distribution-preserving (IDP) dependency structure for the MMSR statistic. We also improve upon the results of Younget al (1992) in that we give a more complete and simple proof of the characterization of the general positive-definite IDP covariance structure for the MMSR statistic.     

A remark on testing covariance structure in a mixed model

Khuri (1989) tests for the intraclass covariance structure implied by the balanced two-way mixed analysis of variance model by computing wilks' likelihood ratio test statistic using the sample covariance matrix of the vectors of treatment means. In the unbalanced case he uses a linear transformation to augment the treatment-mean vectors to vectors which are expected to satisfy the intraclass structure, and then computes Wilks' statistic using these augmented vectors. We point out that the augmentation process is in fact equivalent to deleting observations until the design is balanced, so that the augmented test actually uses less information than that contained in the original sample means.     

Maximum likelihood mean and covariance matrix estimation constrained to general positive semi-definiteness

Maximum likelihood estimation of a mean and a covariance matrix whose structure is constrained only to general positive semi-definiteness is treated in this paper. Necessary and sufficient conditions for the local optimality of mean and covariance matrix estimates are given. Observations are assumed to be independent. When the observations are also assumed to be identically distributed, the optimality conditions are used to obtain the mean and covariance matrix solutions in closed form. For the nonidentically distributed observation case, a general numerical technique which integrates scoring and Newton's iterations to solve the optimality condition equations is presented, and convergence performance is examined.     

A monte carlo study on two methods of calculating the mle's covariance matrix in a seemingly unrelated nonlinear regression. *

Econometric techniques to estimate output supply systems, factor demand systems and consumer demand systems have often required estimating a nonlinear system of equations that have an additive error structure when written in reduced form. To calculate the ML estimate's covariance matrix of this nonlinear system one can either invert the Hessian of the concentrated log likelihood function, or invert the matrix calculated by pre-multiplying and post multiplying the inverted MLE of the disturbance covariance matrix by the Jacobian of the reduced form model. Malinvaud has shown that the latter of these methods is the actual limiting distribution's covariance matrix, while Barnett has shown that the former is only an approximation.

In this paper, we use a Monte Carlo simulation study to determine how these two covariance matrices differ with respect to the nonlinearity of the model, the number of observations in the dataet, and the residual process. We find that the covariance matrix calculated from the Hessian of the concentrated likelihood function produces Wald statistics that are distributed above those calculated with the other covariance matrix. This difference becomes insignificant as the sample size increases to one-hundred or more observations, suggesting that the asymptotics of the two covariance matrices are quickly reached.     

Effect of equicorrelation in detecting a spurious observation

This note examines the effect of equicorrelation of the observations on Grubbs' (1950) procedure of detecting an outlier in a sample of n independent observations. It is shown that the procedure is robust, in fact the significance level remains unchanged.     

Minimax powerful functional analysis of covariance tests with application to longitudinal genome-wide association studies

We model the Alzheimer's disease-related phenotype response variables observed on irregular time points in longitudinal Genome-Wide Association Studies as sparse functional data and propose nonparametric test procedures to detect functional genotype effects while controlling the confounding effects of environmental covariates. Our new functional analysis of covariance tests are based on a seemingly unrelated kernel smoother, which takes into account the within-subject temporal correlations, and thus enjoy improved power over existing functional tests. We show that the proposed test combined with a uniformly consistent nonparametric covariance function estimator enjoys the Wilks phenomenon and is minimax most powerful. Data used in the preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative database, where an application of the proposed test lead to the discovery of new genes that may be related to Alzheimer's disease.     

Test of linear trend in eigenvalues of k covariance matrices with applications in common principal components analysis

A test for linear trend among a set of eigenvalues of k covariance matrices is developed. A special case of this test is Flury's (1986) test for the equality of eigenvalues. The linear trend hypothesis appears to be more relevant to data analysis than the equality hypothesis. Examples show how the linear trend hypothesis can be acceptable while the equality hypothesis is rejected.     

A Note on Sufficient Conditions for Valid Unmodified t Testing in Correlation Analysis with Autocorrelated and Heteroscedastic Sample Data

Traditionally, sphericity (i.e., independence and homoscedasticity for raw data) is put forward as the condition to be satisfied by the variance–covariance matrix of at least one of the two observation vectors analyzed for correlation, for the unmodified t test of significance to be valid under the Gaussian and constant population mean assumptions. In this article, the author proves that the sphericity condition is too strong and a weaker (i.e., more general) sufficient condition for valid unmodified t testing in correlation analysis is circularity (i.e., independence and homoscedasticity after linear transformation by orthonormal contrasts), to be satisfied by the variance–covariance matrix of one of the two observation vectors. Two other conditions (i.e., compound symmetry for one of the two observation vectors; absence of correlation between the components of one observation vector, combined with a particular pattern of joint heteroscedasticity in the two observation vectors) are also considered and discussed. When both observation vectors possess the same variance–covariance matrix up to a positive multiplicative constant, the circularity condition is shown to be necessary and sufficient. “Observation vectors” may designate partial realizations of temporal or spatial stochastic processes as well as profile vectors of repeated measures. From the proof, it follows that an effective sample size appropriately defined can measure the discrepancy from the more general sufficient condition for valid unmodified t testing in correlation analysis with autocorrelated and heteroscedastic sample data. The proof is complemented by a simulation study. Finally, the differences between the role of the circularity condition in the correlation analysis and its role in the repeated measures ANOVA (i.e., where it was first introduced) are scrutinized, and the link between the circular variance–covariance structure and the centering of observations with respect to the sample mean is emphasized.     

Numerical testing of evolution theories †

Fisher's method of combining independent tests is used to construct tests of means of multivariate normal populations when the covariance matrix has intraclass correlation structure. Monte Carlo studies are reported which show that the tests are more powerful than Hotelling's T ²-test in both one and two sample situations.     

Scheffés mixed model for multivariate repeated measures:a relative efficiency evaluation

Scheffé’s mixed model, generalized for application to multivariate repeated measures, is known as the multivariate mixed model (MMM). The primary advantages the MMM are (1) the minimum sample size required to conduct an analysis is smaller than for competing procedures and (2) for certain covariance structures, the MMM analysis is more powerful than its competitors. The primary disadvantage is that the MMM makes a very restrictive covariance assumption; namely multivariate sphericity. This paper shows, first, that even minor departures from multivariate sphericity inflate the size of MMM based tests. Accordingly, MMM analyses, as computed in release 4.0 of SPSS MANOVA (SPSS Inc., 1990), can not be recommended unless it is known that multivariate sphericity is satisfied. Second, it is shown that a new Box-type (Box, 1954) Δ-corrected MMM test adequately controls test size unless departure from multivariate sphericity is severe or the covariance matrix departs substantially from a multiplicative-Kronecker structure. Third, power functions of adjusted MMM tests for selected covariance and noncentrality structures are compared to those of doubly multivariate methods that do not require multivariate sphericity. Based on relative efficiency evaluations, the adjusted MMM analyses described in this paper can be recommended only when sample sizes are very small or there is reason to believe that multivariate sphericity is nearly satisfied. Neither the e-adjusted analysis suggested in the SPSS MANOVA output (release 4.0) nor the adjusted analysis suggested by Boik (1988) can be recommended at all.     

Step-Down diagnostic analysis for monitoring the covariance matrix of bivariate normal processes

ABSTRACT

A comparison among VMIX, VMAX and the adapted step-down Sullivan et al. (SE) tests for covariance matrix under bivariate normal assumption is presented. The type I error and power estimates were obtained by using Monte Carlo simulation under different scenarios with respect to covariance and correlation structures. In general, VMIX was more powerful than VMAX being SE more powerful than both, with few exceptions. SE test is more general since it can be used for normal and non-normal data, with no restriction with respect to the pattern of the covariance matrix shifts, and for larger dimension than the bivariate case.     

On Hotelling’s T2 test in a special paired sample case

In a special paired sample case, Hotelling’s T² test based on the differences of the paired random vectors is the likelihood ratio test for testing the hypothesis that the paired random vectors have the same mean; with respect to a special group of affine linear transformations it is the uniformly most powerful invariant test for the general alternative of a difference in mean. We present an elementary straightforward proof of this result. The likelihood ratio test for testing the hypothesis that the covariance structure is of the assumed special form is derived and discussed. Applications to real data are given.     

Bayesian infermce about the reliability function foe the exponential distributions

The posterior distributions and the posterior bounds of the reliability functions have been derived for the one and twoparameter exponential distributions. Using Grubbs' (1971) data the posteriors are tabulated and plotted and their robustness studied     

A note on homogeneity tests of covariance matrices

In this note we propose two procedures for testing homogeneity of co-variance matrices that are both extensions of Hartley's (1940) test for equality of variances. The first is a two-stage procedure where the first step is a simple test for equality of the largest eigenvalues, and corresponding eigenvectors, of the covariance matrices. The second is based on projection pursuit and seems harder to apply in practice.     

Quasi-likelihood estimation for GLM with random scales

This paper uses random scales similar to random effects used in the generalized linear mixed models to describe “inter-location” population variation in variance components for modeling complicated data obtained from applications such as antenna manufacturing. Our distribution studies lead to a complicated integrated extended quasi-likelihood (IEQL) for parameter estimations and large sample inference derivations. Laplace's expansion and several approximation methods are employed to simplify the IEQL estimation procedures. Asymptotic properties of the approximate IEQL estimates are derived for general structures of the covariance matrix of random scales. Focusing on a few special covariance structures in simpler forms, the authors further simplify IEQL estimates such that typically used software tools such as weighted regression can compute the estimates easily. Moreover, these special cases allow us to derive interesting asymptotic results in much more compact expressions. Finally, numerical simulation results show that IEQL estimates perform very well in several special cases studied.     

Artificial neural networks for some macroeconomic series: A first report

There is a tendency for the true variability of feasible GLS estimators to be understated by asymptotic standard errors. For estimation of SUR models, this tendency becomes more severe in large equation systems when estimation of the error covariance matrix, C, becomes problematic. We explore a number of potential solutions involving the use of improved estimators for the disturbance covariance matrix and bootstrapping. In particular, Ullah and Racine (1992) have recently introduced a new class of estimators for SUR models that use nonparametric kernel density estimation techniques. The proposed estimators have the same structure as the feasible GLS estimator of Zellner (1962) differing only in the choice of estimator for C. Ullah and Racine (1992) prove that their nonparametric density estimator of C can be expressed as Zellner's original estimator plus a positive definite matrix that depends on the smoothing parameter chosen for the density estimation. It is this structure of the estimator that most interests us as it has the potential to be especially useful in large equation systems.

Atkinson and Wilson (1992) investigated the bias in the conventional and bootstrap estimators of coefficient standard errors in SUR models. They demonstrated that under certain conditions the former were superior, but they caution that neither estimator uniformly dominated and hence bootstrapping provides little improvement in the estimation of standard errors for the regression coefficients. Rilstone and Veal1 (1996) argue that an important qualification needs to be made to this somewhat negative conclusion. They demonstrated that bootstrapping can result in improvements in inferences if the procedures are applied to the t-ratios rather than to the standard errors. These issues are explored for the case of large equation systems and when bootstrapping is combined with improved covariance estimation.