Robust procedures for multi-sample location problems with unequal group variances

Robust procedures are proposed for testing the equality of several group means without assuming the equality of group variances. These statistics are obtained by modifying Welch's W and Brown-Forsythe's F^* using a trimmed mean and a sine-wave M estimator.Approximate distributions of these new statistics are obtained under normality. Their performances are evaluated by Monte Carlo sampling experiments under various long-tailed symmetric distributions     

Some tests with specified size for the behrens-fisher problem

For a given significance level α, Welch's approximate t-test for the Behrens-Fisher Problem is modified to get a test with size α. A useful result for carrying out the Berger and Boos test is provided. Simulation results give power comparisons of several size α tests.     

A fitted test for the behrens-fisher problem

In 1975, Lee and Gurland proposed a solution to the Behrens-Fisher problem. It had excellent control of size and power and was relatively simple to use. However it requires extensive special tables. This article proposes a modification of this approach. It replaces the tables with easily computed functions of the sample sizes and a standard t table. Control of size and power are equivalent to that obtained by Lee and Gurland. Furthermore, the test is also compared with the Welch's approximate t test and shows better control of size, with similar power curves when sample sizes are at least four from each of the two normal populations.     

The generalized likelihood ratio test for the Behrens-Fisher problem

A solution is suggested for the Behrens-Fisher problem of testing the equality of the means from two normal populations where variances are unknown and not assumed equal, by considering an adaption of the generalized likelihood ratio test. The test developed and called the adjusted likelihood ratio test has size close to the nominal significance level and compares favourably with regard to size and power to the Welch-Aspin test. An asymptotic result shows the connection between the generalized likelihood ratio test and the most commonly used test statistic for the Behrens-Fisher problem.     

Testing the equality of two normal percentiles

Two statistics are suggested for testing the equality of two normal percentiles where population means and variances are unknown. The first is based on the generalized likelihood ratio test (LRT), the second on Cochran's statistic used in the Behrens-Fisher problem. Size and power comparisons are made by using simulation and asympototic theory.     

A Test for the Equality of Parameters for Separate Regression Models in the Presence of Heteroskedasticity

Testing for the equality of regression coefficients across two regressions is a problem considered by analysts in a variety of fields. If the variances of the errors of the two regressions are not equal, then it is known that the standard large sample F-test used to test the equality of the coefficients is compromised by the fact that its actual size can differ substantially from the stated level of significance in small samples. This article addresses this problem and borrows from the literature on the Behrens-Fisher problem to provide some simple modifications of the large sample test which allows one to better control the probability of committing a Type I error. Empirical evidence is presented which indicates that the suggested modifications provide tests which are superior to well-known alternative tests over a wide range of the parameter space.     

One-way ANOVA with Unequal Variances

We consider the one-way ANOVA problem of testing the equality of several normal means when the variances are not assumed to be equal. This is a generalization of the Behrens-Fisher problem, but even in this special case there is no exact test and the actual size of any test depends on the values of the nuisance parameters. Therefore, controlling the actual size of the test is of main concern. In this article, we first consider a test using the concept of generalized p-value. Extensive simulation studies show that the actual size of this test does not exceed the nominal level, for practically all values of the nuisance parameters, but the test is not too conservative either, in the sense that the actual size of the test can be very close to the nominal level for some values of the nuisance parameters. We then use this test to propose a simple F-test, which has similar properties but avoids the computations associated with generalized p-values. Because of its simplicity, both conceptually as well as computationally, this F-test may be more useful in practice, since one-way ANOVA is widely used by practitioners who may not be familiar with the generalized p-value and its computational aspects.     

A new generalized p-value approach for testing equality of coefficients of variation in k normal populations

A new generalized p-value method is proposed for testing the equality of coefficients of variation in k normal populations. Simulation studies show that the type I error probabilities are close to the nominal level. The proposed test is also compared with likelihood ratio test, modified Bennett's test and score test through Monte Carlo simulation, the results demonstrate that the generalized p-value method has satisfactory performance in terms of sizes and powers.     

ROBUSTNESS OF PROCEDURES FOR THE BEHRENS-FISHER PROBLEMS: EXTENSION TO BIVARIATE NORMAL MIXTURES

In the applied sciences, it is often important to be able to compare the mean values of two populations. However, testing a hypothesis can be complex, if the two populations are heteroscedastic and exhibit non-normality in the data. This paper reviews currently available strategies for the multivariate Behrens-Fisher problem. It then carries out Monte Carlo comparisons of selected procedures to assess their robustness when applied to data from normal mixture distributions. The overall conclusion is that Johansen's procedure appears to work best for small sample data both in terms of empirical power and significance level. Johansen's procedure works reasonably well even with mixture data. The simulation also provides researchers with specific guidelines to follow at the early designing and planning stages of the investigation.     

Test for the equality of several correlation coefficients

We derive two C(α) statistics and the likelihood-ratio statistic for testing the equality of several correlation coefficients, from k ≥ 2 independent random samples from bivariate normal populations. The asymptotic relationship of the C(α) tests, the likelihood-ratio test, and a statistic based on the normality assumption of Fisher's Z-transform of the sample correlation coefficient is established. A comparative performance study, in terms of size and power, is then conducted by Monte Carlo simulations. The likelihood-ratio statistic is often too liberal, and the statistic based on Fisher's Z-transform is conservative. The performance of the two C(α) statistics is identical. They maintain significance level well and have almost the same power as the other statistics when empirically calculated critical values of the same size are used. The C(α) statistic based on a noniterative estimate of the common correlation coefficient (based on Fisher's Z-transform) is recommended.     

Selection and Ranking Procedures for Type I Extreme Value Populations and a Related Homogeneity Test

Consider k (≥2) independent Type I extreme value populations with unknown location parameters and common known scale parameter. With samples of same size, we study procedures based on the sample means for (1) selecting the population having the largest location parameter, (2) selecting the population having the smallest location parameter, and (3) testing for equality of all the location parameters. We use Bechhofer's indifference-zone and Gupta's subset selection formulations. Tables of constants for implemention are provided based on approximation for the distribution of the standardized sample mean by a generalized Tukey's lambda distribution. Examples are provided for all procedures.     

Testing the equality of quantiles for several normal populations

Many procedures exist for testing equality of means or medians to compare several independent distributions. However, the mean or median do not determine the entire distribution. In this article, we propose a new small-sample modification of the likelihood ratio test for testing the equality of the quantiles of several normal distributions. The merits of the proposed test are numerically compared with the existing tests—a generalized p-value method and likelihood ratio test—with respect to their sizes and powers. The simulation results demonstrate that proposed method is satisfactory; its actual size is very close to the nominal level. We illustrate these approaches using two real examples.     

Behrens-fisher problem under the assumption of homogeneous coefficients of variation

The powers of the likelihood ratio (LR) test and an “asymptotically (in some sense) optimum” invariant test are examined and compared by simulation techniques with those of several other relevant tests for the problem of testing the equality of two univariate normal population means under the assumption of heterogeneous variances but homogeneous coefficients of variation. It is seen that the LR test is highly satisfactory for all values of the coefficient of variation and the “asymptotically optimum” invariant test, which is computationally much simpler than the LR test, is a reasonably good competitor for cases where the value of the coefficient of variation is greater than or equal to 3. Also, a     

The Appropriateness of Some Common Procedures for Testing the Equality of Two Independent Binomial Populations

For testing the equality of two independent binomial populations the Fisher exact test and the chi-squared test with Yates's continuity correction are often suggested for small and intermediate size samples. The use of these tests is inappropriate in that they are extremely conservative. In this article we demonstrate that, even for small samples, the uncorrected chi-squared test (i.e., the Pearson chi-squared test) and the two-independent-sample t test are robust in that their actual significance levels are usually close to or smaller than the nominal levels. We encourage the use of these latter two tests.     

On the Skew-Normal-Cauchy Distribution

A fixed effects one-way layout model of analysis of variance is considered where the variances are taken to be possibly unequal. Conservative single-stage procedures based on Banerjee’s method for the solution of the Behrens-Fisher problem are proposed for the following multiple comparisons problems: 1) all pairwise comparisons with a control population mean, and 2) all pairwise comparisons and all linear contrasts among the means. Since these procedures are likely to be very conservative in practice, approximate procedures based on Welch’s method for the solution of the Behrens-Fisher problem are suggested as alternatives. Monte Carlo studies indicate that the latter are much less conservative and hence may be better in practice. Both these sets of procedures need only the tables of the Student’s t-distribution for their application and are very simple to use. Exact two-stage procedures are proposed for the following multiple comparisons problems: 1) all pairwise comparisons and all linear contrasts among the means, and 2) all linear combinations of the means.     

Robust Two-Sample Statistics for Testing Equality of Means: a Simulation Study

When testing the equality of the means from two independent normally distributed populations given that the variances of the two populations are unknown but assumed equal, the classical two-sample t-test is recommended. If the underlying population distributions are normal with unequal and unknown variances, either Welch's t-statistic or Satterthwaite's Approximate F-test is suggested. However, Welch's procedure is non-robust under most non-normal distributions. There is a variable tolerance level around the strict assumptions of data independence, homogeneity of variances and normality of the distributions. Few textbooks offer alternatives when one or more of the underlying assumptions are not defensible.     

Inferences on regression coefficients in a regression model under heteroscedasticity and robustness with respect to departure from normality

In this paper we consider a simple linear regression model under heteroscedasticity and nonnormality. A statistical test for testing the regression coefficient is then derived by assuming normality for the random disturbances and by applying Welch's method. Some Monte Carlo studies are generated for assessing robustness of this test. By combining Tiku's robust procedure with the new test, a robust but more powerful test is developed.     

A bivariate noncentral T-disttrtoution with applications

The particular bivariate noncentral t-distribution associated with two univariate noncentral t variates having a correlation coefficient of one is considered. Some applications and properties are presented together with tables in the same form as Johnson and Welch's tables for a univariate noncentral t-distribution.     

An adjusted likelihood-ratio approach to the behrens-fisher problem

In many situations it is necessary to test the equality of the means of two normal populations when the variances are unknown and unequal. This paper studies the celebrated and controversial Behrens-Fisher problem via an adjusted likelihood-ratio test using the maximum likelihood estimates of the parameters under both the null and the alternative models. This procedure allows the significance level to be adjusted in accordance with the degrees of freedom to balance the risk due to the bias in using the maximum likelihood estimates and the risk due to the increase of variance. A large scale Monte Carlo investigation is carried out to show that -2 InA has an empirical chi-square distribution with fractional degrees of freedom instead of a chi-square distribution with one degree of freedom. Also Monte Carlo power curves are investigated under several different conditions to evaluate the performances of several conventional procedures with that of this procedure with respect to control over Type I errors and power.     

Linear generalizations of various matric-t distributions

The concept of a matric-t variate is extended to cases where the positive (definite) part of the variate, which is usually Wishart distributed independently of the normal part, is a linear sum of positive (definite) variates with positive coefficients. These distributions and their quadratic forms are of importance i.a, for the exact solution to the multi¬variate Behrens-Fisher problem. A few useful identities con¬cerning the invariant polynomials with matrix arguments are derived