Test of linear trend in eigenvalues of k covariance matrices with applications in common principal components analysis

A test for linear trend among a set of eigenvalues of k covariance matrices is developed. A special case of this test is Flury's (1986) test for the equality of eigenvalues. The linear trend hypothesis appears to be more relevant to data analysis than the equality hypothesis. Examples show how the linear trend hypothesis can be acceptable while the equality hypothesis is rejected.     

A note on homogeneity tests of covariance matrices

In this note we propose two procedures for testing homogeneity of co-variance matrices that are both extensions of Hartley's (1940) test for equality of variances. The first is a two-stage procedure where the first step is a simple test for equality of the largest eigenvalues, and corresponding eigenvectors, of the covariance matrices. The second is based on projection pursuit and seems harder to apply in practice.     

Testing the equality of variance-covariance matrices the robust way

The robust statistic T² _Dproposed by Tiku and Singh (1982) for testing the equality of mean vectors of two mu1 t ivariate populations is modified to test the equality of variance-covariance matrices.     

Testing equality of scale parameters against restricted alternatives for m≥3 gamma distributions with unknown common shape parameter

Shiue and Bain (1983) proposed an approximate F-test for the equality of the scale parameters of two gamma distributions with equal but unknown shape parameters. In this article, we propose a simple procedure to test equality of scale parameters of m≥3 gamma distributions against nonincreasing order. The test is based on Fisher's method of combining p-values. The actual size of the resulting test is investigated through Monte Carlo studies. Also asymptotic results are derived for the nominal test size. These can be used to obtain a test which achieves the desired size. The case of more general partial orders is discussed.     

Approximate transformation trimmed mean methods to the test of simple linear regression slope equality

To deal with the problem of non-normality and heteroscedasticity, the current study proposes applying approximate transformation trimmed mean methods to the test of simple linear regression slope equality. The distribution-free slope estimates are first trimmed on both sides and then the test statistic t is transformed by Johnson's method for each group to correct non-normality. Lastly, an approximate test such as the James second-order test, the Welch test, or the DeShon-Alexander test, which are robust for heterogeneous variances, is applied to test the equality of regression slopes. Bootstrap methods and Monte Carlo simulation results show that the proposed methods provide protection against both unusual y values, as well as unusual x values. The new methods are valid alternatives for testing the simple linear regression slopes when heteroscedastic variances and nonnormality are present.     

Methods to test for equality of two normal distributions

Statistical tests for two independent samples under the assumption of normality are applied routinely by most practitioners of statistics. Likewise, presumably each introductory course in statistics treats some statistical procedures for two independent normal samples. Often, the classical two-sample model with equal variances is introduced, emphasizing that a test for equality of the expected values is a test for equality of both distributions as well, which is the actual goal. In a second step, usually the assumption of equal variances is discarded. The two-sample t test with Welch correction and the F test for equality of variances are introduced. The first test is solely treated as a test for the equality of central location, as well as the second as a test for the equality of scatter. Typically, there is no discussion if and to which extent testing for equality of the underlying normal distributions is possible, which is quite unsatisfactorily regarding the motivation and treatment of the situation with equal variances. It is the aim of this article to investigate the problem of testing for equality of two normal distributions, and to do so using knowledge and methods adequate to statistical practitioners as well as to students in an introductory statistics course. The power of the different tests discussed in the article is examined empirically. Finally, we apply the tests to several real data sets to illustrate their performance. In particular, we consider several data sets arising from intelligence tests since there is a large body of research supporting the existence of sex differences in mean scores or in variability in specific cognitive abilities.     

Coefficients of lee-gurland two-sample test on normal means

The Behrens-Fisher problem in comparing means of two normal populations is revisited Lee and Gurland (1975) suggested a solution to the problem and provided the set of coefficients required in computing critical values for the case α=005, where α is the nominal level of significance This solution, called the Lee-Guiland Test in this article, has proven to be practical as far as calculation is involved, and more importantly, it maintains the actual size very close to α= 0.05 for possible values of the ratio of population variances This merit has not been attained by most of the Behrens-Fisher solutions in the literature. In this article, the coefficients for other values of α, namely 0 025, 0 01 and 0.005 are provided for wider applications of the test Moreover, careful and detailed comparisons are made in terms of size and power with the other practical solution:the Welch's Approximate t I est Due to a possible drawback of the Welch's Approximate t I est in controlling the actual size, especially for small a and small sample sizes, the Lee-Gurland lest presents itself as a slightly better' alternative in testing equality of two normal population means I he coefficients mentioned above are also fitted by the functions of the reciprocals of the degrees of freedom, so that the substantial amount of table-looking can be avoided Some discussions are also made in regarding the recent “Welch vs Gosset” argument: Should the Student's t Test be dispensed off’from the routine use in testing the equality of two normal means?.     

Test of equality of normal means in the absence of independent estimator of variance

Let X_l,…,X_n be normally and independently distributed with means θ_l,…,θ_nand a cornmorl variance. Thus there are n observations and n+i unknwon parameters. A test of the null hypothesis that, the θ_i's are all zero and the alternative that the vector (θ_l,…,θ_n) lies in a convex cone with its vertex a.t the origin is connsidered in this paper. It is shown that under a mild condition the likelihood ratio test is possible. The ordinary one sided t - test belongs to the class of tests considered in this paper. The hypothesis of equality of means against the simple order alternative can be tested in certain cases .     

A Test for the Equality of Parameters for Separate Regression Models in the Presence of Heteroskedasticity

Testing for the equality of regression coefficients across two regressions is a problem considered by analysts in a variety of fields. If the variances of the errors of the two regressions are not equal, then it is known that the standard large sample F-test used to test the equality of the coefficients is compromised by the fact that its actual size can differ substantially from the stated level of significance in small samples. This article addresses this problem and borrows from the literature on the Behrens-Fisher problem to provide some simple modifications of the large sample test which allows one to better control the probability of committing a Type I error. Empirical evidence is presented which indicates that the suggested modifications provide tests which are superior to well-known alternative tests over a wide range of the parameter space.     

Robust multivariate analysis of variability

A general testing procedure is proposed to multivariately test for equality of p variances among k groups. The procedure applies a multivariate analysis of variance on an appropriate measure of spread for the uncensored original observations. Three such measures of spread are compared in a simulation experiment which considered two and three variables with equal and unequal sample sizes for the null and alternative hypotheses for Gaussian, Student's t (8, 12, and 20 degrees of freedom) and gamma (α=2,4,6 and 10) distributions . The likelihood ratio test (Box, 1949) was included in the above simulations. The results suggest that if one chooses a measure of spread appropriate for the distribution of the original observations, the proposed MANOVA-based testing procedure is robust and reasonably powerful. Using this procedure for the normal distribution, similar power was observed to that of the likelihood ratio test when the variables were uncorrelated or had little positive correlation.     

Testing equality of several exponential distributions

Roy's union-intersection principle is used to develop a test procedure to test the equality of scale parameters of several exponential distributions. Upper five and one percent values of the test statistic for two and three exponential distributions are tabulated and an illustrative simulated example is qiven.     

An empirical comparison of several methods for testing the equality of dependent proportions

Three methods for testing the equality of nonindependent proportions were compared with, the use of Monte Carlo techniques. The three methods included Cochran's test, an ANOVA F test, and Hotelling's T² test. With respect to empirical significance levels, the ANOVA F test is recommended as the preferred method of analysis.

Oftentimes an experimenter is interested in testing the equality of several proportions. When the proportions are independent Kemp and Butcher (1972) and Butcher and Kemp (1974) compared several methods for analysing large sample binomial data for the case of a 3 x 3 factorial design without replication. In addition, Levy and Narula (1977) compared many of the same methods for analyzing binomial data; however, Levy and Narula investigated the relative utility of the methods for small sample sizes.     

Performance evaluation of likelihood-ratio tests for assessing similarity of the covariance matrices of two multivariate normal populations

Abstract

In analyzing two multivariate normal data sets, the assumption about equality of covariance matrices is usually used as a default for doing subsequence inferences. If this equality doesn’t hold, later inferences will be more complex and usually approximate. If one detects some identical components between two decomposed non equal covariance matrices and uses this extra information, one expects that subsequence inferences can be more accurately performed. For this purpose, in this article we consider some statistical tests about the equality of components of decomposed covariance matrices of two multivariate normal populations. Our emphasis is on the spectral decomposition of these matrices. Hypotheses about the equalities of sizes, shapes, and set of directions as components of these two covariance matrices are tested by the likelihood ratio test (LRT). Some simulation studies are carried out to investigate the accuracy and power of the LRT. Finally, analyses of two real data sets are illustrated.     

Characterizations of exponentiality within the HNBUE class and related tests

A harmonic new better than used in expectation (HNBUE) variable is a random variable which is dominated by an exponential distribution in the convex stochastic order. We use a recently obtained condition on stochastic equality under convex domination to derive characterizations of the exponential distribution and bounds for HNBUE variables based on the mean values of the order statistics of the variable. We apply the results to generate discrepancy measures to test if a random variable is exponential against the alternative that is HNBUE, but not exponential.     

A circular-cone test for testing homogeneity against a simple tree order

Several methods exist for the problem of testing the equality of several treatments against the one-sided alternative that the treatments are better than the control. These methods include Dunnett's test, Bartholomew's likelihood-ratio test, the Abelson-Tukey-Schaafsma-Smid optimal-contrast test, and the multiple-contrast test of Mukerjee, Robertson, and Wright. A new test is proposed based on an approximation of the likelihood-ratio test of Bartholomew. This test involves using a circular cone in place of the alternative-hypothesis cone. The circular-cone test has excellent power characteristics similar to those of Bartholomew's test. Moreover, it has the advantages of being simpler to compute and may be used with unequal sample sizes.     

Testing the equality of two high‐dimensional spatial sign covariance matrices

This paper is concerned with testing the equality of two high‐dimensional spatial sign covariance matrices with applications to testing the proportionality of two high‐dimensional covariance matrices. It is interesting that these two testing problems are completely equivalent for the class of elliptically symmetric distributions. This paper develops a new test for testing the equality of two high‐dimensional spatial sign covariance matrices based on the Frobenius norm of the difference between two spatial sign covariance matrices. The asymptotic normality of the proposed testing statistic is derived under the null and alternative hypotheses when the dimension and sample sizes both tend to infinity. Moreover, the asymptotic power function is also presented. Simulation studies show that the proposed test performs very well in a wide range of settings and can be allowed for the case of large dimensions and small sample sizes.     

Testing equality of two intercepts for the parallel regression model with non sample prior information

This paper proposes tests for equality of intercepts of two simple regression models when non sample prior information is available on the equality of two slopes. For three different scenarios on the values of the slope, namely (i) unknown (unspecified), (ii) known (specified), and (iii) suspected, we derive the unrestricted test (UT), restricted test (RT), and pre-test test (PTT) for testing the equality of intercepts. The test statistics, their sampling distributions, and power functions of the tests are obtained. Comparison of power function and size of the tests reveals that the PTT has a reasonable dominance over the UT and RT.     

A monte carlo study on the robustness of the two-sample sequential t test

The robustness of the two-sample sequentla1 t test was studied against departures from normality and equality of variances The effect of skewness and kurtosis of the underlying distribution on the test 1s relatively mild but the effect of heteroscedasticity serious.     

Analysis of binary data for the balanced one-way classification

A test is proposed for testing the equality of proportions based on the data available from a one-way classification having t treatment conditions and n binary observations per treatment. The test statistic B is a constant multiple of the F-statistic which results when the analysis of variance procedure for the one-way classification is applied to the data and, hence, is computationally simple. The statistic B from this binary analysis of variance (BIANOVA) is distributed asymptotically as a chi-square random variable. The proposed test is uniformly more powerful than either the F-test indicated above or the Pearson chi-square test; however, the attained empirical level of significance is frequently higher than for either of these competitors and usually higher than the stated level of significance for smaller values of n (say n ≤ 20).     

On testing homogeneity of variances for nonnormal models using entropy

This paper deals with testing equality of variances of observations in the different treatment groups assuming treatment effects are fixed. We study the distribution of a test statistic which is known to perform comparably well with other statistics for the same purpose under normality. The statistic we consider is based on Shannon’s entropy for a distribution function. We will derive the asymptotic expansion for the distribution of the test statistic based on Shannon’s entropy under nonnormality and numerically examine its performance in comparison with the modified likelihood ratio criteria for normal and some nonnormal populations.