Omnibus test of normality using the Q statistic

A new statistical procedure for testing normality is proposed. The Q statistic is derived as the ratio of two linear combinations of the ordered random observations. The coefficients of the linear combinations are utilizing the expected values of the order statistics from the standard normal distribution. This test is omnibus to detect the deviations from normality that result from either skewness or kurtosis. The statistic is independent of the origin and the scale under the null hypothesis of normality, and the null distribution of Q can be very well approximated by the Cornish-Fisher expansion. The powers for various alternative distributions were compared with several other test statistics by simulations.     

On similarity and independence properties of composite edf goodness-of-fit tests

Many test statistics for classical simple goodness-of-fit hypothesis testing problems are distancemeasures between the distribution function of the null hypothesis distributipn and the empirical distribution function sometimes called EDF tests. If a composite parametric null hypothesis is considered in place of the simple null hypothesis, then a test statistic can be obtained from each EDF test by replacing the known distribution function of the simple problem by the Rao-Blackwell estimating distribution function. In this note we use known results to show that these Rao-Blackwell-EDF test statistics have distributions that do not depend upon parameter values, and hence that these tests are independent of a complete sufficient statistic for the parameters.     

Correlation type gogdness-of-fit statistics with censored sampling

Some comments are made concerning the possible forms of a correlation coefficient type goodness-of-fit statistic, and their relationship with other goodness-of-fit statistics, Critical values for a correlation goodness-of-fit statistic and for the Cramer-von Mises statistic are provided for testing a completely-specified null hypothesis for both complete and censored sampling, Critical values for a correlation test statistic are provided for complete and censored sampling for testing the hypothesis of normality, two parameter exponentiality, Weibull (or, extreme value) and an exponential-power distribution, respectively. Critical values are also provided for a test of one-parameter exponentiality based on the Cramer-von Mises statistic     

Union-Intersection testing for outliers in multivariate normal data

The union-intersection approach to multivariate test construction is used to develop an alternative to Wilks' likelihood ratio test statistic for testing for two or more outliers in multivariate normal data. It is shown that critical values of both statistics are poorly approximated by Bonferroni bounds. Simulated critical values are presented for both statistics for significance levels 1% and 5%, for sample sizes 10(5)30, 40, 50, 75 and 100 for 2, 3, 4 and 5 dimensions. A power comparison of the two tests in the slippage of the mean model for generating outliers indicates that the union-intersection test is the more powerful when the slippages are close to collinear. Although Wilks' test remains the preference for general use, the union-intersection test could be valuable when such special structure in the data is suspected.     

Kolmogorov–Smirnov test for life test data with hybrid censoring

This work considers goodness-of-fit for the life test data with hybrid censoring. An alternative representation of the Kolmogorov–Smirnov (KS) statistics is provided under Type-I censoring. The alternative representation leads us to approximate the limiting distributions of the KS statistic as a functional of the Brownian bridge for Type-II, Type-I hybrid, and Type-II hybrid censored data. The approximated distributions are used to obtain the critical values of the tests in this context. We found that the proposed KS test procedure for Type-II censoring has more power than the available one(s) in literature.     

Goodness of fit tests for the multiple logistic regression model

Several test statistics are proposed for the purpose of assessing the goodness of fit of the multiple logistic regression model. The test statistics are obtained by applying a chi-square test for a contingency table in which the expected frequencies are determined using two different grouping strategies and two different sets of distributional assumptions. The null distributions of these statistics are examined by applying the theory for chi-square tests of Moore Spruill (1975) and through computer simulations. All statistics are shown to have a chi-square distribution or a distribution which can be well approximated by a chi-square. The degrees of freedom are shown to depend on the particular statistic and the distributional assumptions.

The power of each of the proposed statistics is examined for the normal, linear, and exponential alternative models using computer simulations.     

A continuously adaptive nonparametric two–sample test

A two–sample test statistic for detecting shifts in location is developed for a broad range of underlying distributions using adaptive techniques. The test statistic is a linear rank statistics which uses a simple modification of the Wilcoxon test; the scores are Winsorized ranks where the upper and lower Winsorinzing proportions are estimated in the first stage of the adaptive procedure using sample the first stage of the adaptive procedure using sample measures of the distribution's skewness and tailweight. An empirical relationship between the Winsorizing proportions and the sample skewness and tailweight allows for a ‘continuous’ adaptation of the test statistic to the data. The test has good asymptotic properties, and the small sample results are compared with other populatr parametric, nonparametric, and two–stage tests using Monte Carlo methods. Based on these results, this proposed test procedure is recommended for moderate and larger sample sizes.     

A two-sample distribution-free scale test of the smirnov type

The two-sample, distribution-free statistics of Smirnov (1939) are used to define a new statistic. While the Smirnov statistics are used as a general goodness-of-fit test, a distribution-free scale test based on this new statistic is developed. It is shown that this new test has higher power than the two-sided Smirnov statistic in detecting differences in scale for some symmetric distributions with equal means/medians. The critical values of the proposed test statistic and its limiting distribution are given     

Finite sample distributions of statistics in change point analysis

This paper is concerned with derivation of finite sampling distributions of some statistics which appear frequently in change point analysis. The exact distribution of cusum test statistic is approximated by two methods. Approximations are presented and their accuracies are measured. We first consider the change point in mean problem and we study the exact distribution of change point estimator. Finally, we consider the change point in variance case.     

A bayesian test for a two-way contingency table using independence priors

One method of testing for independence in a two-way table is based on the Bayes factor, the ratio of the likelihoods under the independence hypothesis H and the alternative hypothesis H. The main difficulty in this approach is the specification of prior distributions on the composite hypotheses H and H. A new Bayesian test statistic is constructed by using a prior distribution on H that is concentrated about the “independence surface” H. Approximations are proposed which simplify the computation of the test statistic. The values of the Bayes factor are compared with values of statistics proposed by Gunel and Dickey (1974), Good and Crook (1987), and Spiegelhalter and Smith (1982) for a number of two-way tables. This investigation suggests a strong relationship between the new statistic and the p-value.     

A note on Cochran test for homogeneity in one-way ANOVA and meta-analysis

In this paper we provide a formal yet simple and straightforward proof of the asymptotic χ² distribution for Cochran test statistic. Then, we show that the general form of this type of test statistics is invariant for the choice of weights. This fact is important since in practice many such test statistics are constructed with more complicated forms which usually require calculating generalized inverse matrices. Based on our results, we can simplify the construction of the test statistics. More importantly, properties such as anti-conservativeness of this type of test statistics can be drawn from Cochran test statistic. Furthermore, one can improve the performance of the tests by using some modified statistics with correction for small sample size situations.     

A Class of Permutation Tests for the Equality of Two Marginal Survival Functions Using Paired Censored Data

We studied several test statistics for testing the equality of marginal survival functions of paired censored data. The null distribution of the test statistics was approximated by permutation. These tests do not require explicit modeling or estimation of the within-pair correlation, accommodate both paired data and singletons, and the computation is straightforward with most statistical software. Numerical studies showed that these tests have competitive size and power performance. One test statistic has higher power than previously published test statistics when the two survival functions under comparison cross. We illustrate use of these tests in a propensity score matched dataset.     

A Simple Derivation of r* for Curved Exponential Families

For curved exponential families we consider modified likelihood ratio statistics of the form r_L=r+ log( u/r)/r , where r is the signed root of the likelihood ratio statistic. We are testing a one-dimensional hypothesis, but in order to specify approximate ancillary statistics we consider the test as one in a series of tests. By requiring asymptotic independence and asymptotic normality of the test statistics in a large deviation region there is a particular choice of the statistic u which suggests itself. The derivation of this result is quite simple, only involving a standard saddlepoint approximation followed by a transformation. We give explicit formulas for the statistic u , and include a discussion of the case where some coordinates of the underlying variable are lattice.     

Outlier detection in linear models: a comparative study in simple linear regression

Five widely used test statistics for detecting outliers and influential observations were studied using Monte Carlo method . The test statistic based on Studentized residuals, with critical values given by Tietjen, Moore and Beckman (1973), appears to be the best procedure for detecting a single outlier in simple linear regression.     

A comparative study on a permutation statistic

We studied asymptotic distribution and finite sample properties of a randomly weighted permutation statistic. The asymptotic normality and the finite sample simulations derived from our studies provided theoretical and numerical justifications for distributional assumption of many useful test statistics used in identifying spatial autocorrelations of mapped data. We compared a new method in computing the mean and the approximated variance of the randomly weighted D statistic, a special permutation statistic, with the Walter’s conditional method. In the numerical illustration of the method, we calculated the standardized values of the D statistic by subtracting the mean from the D statistic and dividing the difference by the standard deviation for the standardized mortality ratios (SMRs) and the life expectancies among the 48 states of the continental USA. Spatial autocorrelations of the SMRs and the life expectancies were found to be statistically significant.     

Empirical phi-divergence test statistics for testing simple and composite null hypotheses

The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest is defined through a specific set of unbiased estimating functions. This family of test statistics is based on a distance between two probability vectors, with the first probability vector obtained by maximizing the empirical likelihood (EL) on the vector of parameters, and the second vector defined from the fixed vector of parameters under the simple null hypothesis. The distance considered for this purpose is the phi-divergence measure. The asymptotic distribution is then derived for this family of test statistics. The proposed methodology is illustrated through the well-known data of Newcomb's measurements on the passage time for light. A simulation study is carried out to compare its performance with that of the EL ratio test when confidence intervals are constructed based on the respective statistics for small sample sizes. The results suggest that the ‘empirical modified likelihood ratio test statistic’ provides a competitive alternative to the EL ratio test statistic, and is also more robust than the EL ratio test statistic in the presence of contamination in the data. Finally, we propose empirical phi-divergence test statistics for testing a composite null hypothesis and present some asymptotic as well as simulation results for evaluating the performance of these test procedures.     

Robust likelihood inference for public policy

Issues of public policy are typically decided by non‐specialists who are increasingly informed by statistical methods. In order to be influential, inferential techniques must be widely understood and accepted. This motivates the author to propose likelihood‐based methods that prove relatively insensitive to the choice of underlying distribution because they exploit a peculiarly stable relation between two standard errors and a 95% coverage probability. The author also notes that bootstrap and jackknife estimates of variance can sometimes be strongly biased. In fact, symbolic computations in R suggest that they are reliable only for statistics that are well approximated by averages whose distributions are roughly symmetric. The author thus proposes to transform the classical likelihood ratio into a statistic whose variance can be estimated robustly. He shows that the signed root of the log‐likelihood is well approximated by an average with a roughly symmetric distribution. This leads to Cox‐Tukey intervals for a Student‐like statistic and to simple confidence intervals for most models used in public policy.     

Multi - sample test of equal gamma distribution scale parameters in presence of unknown common shape parameter

Shiue and Bain proposed an approximate F statistic for testing equality of two gamma distribution scale parameters in presence of a common and unknown shape parameter. By generalizing Shiue and Bain's statistic we develop a new statistic for testing equality of L >= 2 gamma distribution scale parameters. We derive the distribution of the new statistic ESP for L = 2 and equal sample size situation. For other situations distribution of ESP is not known and test based on the ESP statistic has to be performed by using simulated critical values. We also derive a C(α) statistic CML and develop a likelihood ratio statistic, LR, two modified likelihood ratio statistics M and MLB and a quadratic statistic Q. The distribution of each of the statistics CML, LR, M, MLB and Q is asymptotically chi-square with L - 1 degrees of freedom. We then conducted a monte-carlo simulation study to compare the perfor- mance of the statistics ESP, LR, M, MLB, CML and Q in terms of size and power. The statistics LR, M, MLB and Q are in general liberal and do not show power advantage over other statistics. The statistic CML, based on its asymptotic chi-square distribution, in general, holds nominal level well. It is most powerful or nearly most powerful in most situations and is simple to use. Hence, we recommend the statistic CML for use in general. For better power the statistic ESP, based on its empirical distribution, is recommended for the special situation for which there is evidence in the data that λ₁ < … < λ_L and n₁ < … < n_L, where λ₁ …, λ_L are the scale parameters and n₁,…, n_L are the sample sizes.     

OPTIMAL TESTS OF SIGNIFICANCE

To perform a test of significance of a null hypothesis, a test statistic is chosen which is expected to be small if the hypothesis is false. Then the significance level of the test for an observed sample is the probability that the test statistic, under the assumptions of the hypothesis, is as small, or smaller than, its observed value. A "good" test statistic is taken to be one which is stochastically small when the null hypothesis is false. Optimal test statistics are defined using this criterion and the relationship of these methods to the Neyman-Pearson theory of hypothesis testing is considered.     

Which Measure Should be Used for Testing in a Paired Design: Simple Difference,Percent Change,or Symmetrized Percent Change?

We aimed to determine the most proper change measure among simple difference, percent, or symmetrized percent changes in simple paired designs. For this purpose, we devised a computer simulation program. Since distributions of percent and symmetrized percent change values are skewed and bimodal, paired t-test did not give good results according to Type I error and the test power. To be to able use percent change or symmetrized percent change as change measure, either the distribution of test statistics should be transformed to a known theoretical distribution by transformation methods or a new test statistic for these values should be developed.