Validation of qualitative microbiological test methods

This paper considers a statistical model for the detection mechanism of qualitative microbiological test methods with a parameter for the detection proportion (the probability to detect a single organism) and a parameter for the false positive rate. It is demonstrated that the detection proportion and the bacterial density cannot be estimated separately, not even in a multiple dilution experiment. Only the product can be estimated, changing the interpretation of the most probable number estimator. The asymptotic power of the likelihood ratio statistic for comparing an alternative method with the compendial method, is optimal for a single dilution experiment. The bacterial density should either be close to two CFUs per test unit or equal to zero, depending on differences in the model parameters between the two test methods. The proposed strategy for method validation is to use these two dilutions and test for differences in the two model parameters, addressing the validation parameters specificity and accuracy. Robustness of these two parameters might still be required, but all other validation parameters can be omitted. A confidence interval‐based approach for the ratio of the detection proportions for the two methods is recommended, since it is most informative and close to the power of the likelihood ratio test. Copyright © 2014 John Wiley & Sons, Ltd.     

Asymptotic test statistics for coefficients of variation

A one-sample asymptotically normal test statistic Is derived for testing the hypothesis that the coefficient of variation of a normal population is equal to a specified value. Based on this derivation, an asymptotically noraml two-sample test statistic and an asymptotically chi-square k-sample test statistic are derived for testing the hypothesis that the coefficients of variation of k ≥2 normal populations are equal. The two and k-sample test statistics allow for unequal sample sizes. Results of a simulation study which evaluate the size and power of the test statistics and compare the test statistics to earlier ones developed by McKay (1932) and Bennett (1976) are presented.     

A multiple test for comparing two treatments with control: Interval hypotheses approach

In biological experiments, multiple comparison test procedures may lead to a statistically significant difference in means. However, sometimes the difference is not worthy of attention considering the inherent variation in the characteristic. This may be due to the fact that the magnitude of the change in the characteristic under study after receiving the treatment is small, less than the natural biological variation. It then becomes the job of the statistician to design a test that will remove this paradox, such that the statistical significance will coincide with the biological one. The present paper develops a multiple comparison test for comparing two treatments with control by incorporating within-person variation in forming interval hypotheses. Assuming common variance (unknown) for the three groups (control and two treatments) and the width of the interval as intra-individual variation (known), the distribution of the test statistic is obtained as bivariate non-central t . A level f test procedure is designed. A table of critical values for carrying out the test is constructed for f = 0.05. The exact powers are computed for various values of small sample sizes and parameters. The test is powerful for all values of the parameters. The test was used to detect differences in zinc absorption for two cereal diets compared with a control diet. After application of our test, we arrived at the conclusion of homogeneity of diets with the control diet. Dunnett's procedure, when applied to the same data, concluded otherwise. The new test can also be applied to other data situations in biology, medicine and agriculture.     

A test for bivariate two sample location problem

A consistent test for difference in locations between two bivariate populations is proposed, The test is similar as the Mann-Whitney test and depends on the exceedances of slopes of the two samples where slope for each sample observation is computed by taking the ratios of the observed values. In terms of the slopes, it reduces to a univariate problem, The power of the test has been compared with those of various existing tests by simulation. The proposed test statistic is compared with Mardia's(1967) test statistics, Peters-Randies(1991) test statistic, Wilcoxon's rank sum test. statistic and Hotelling' T² test statistic using Monte Carlo technique. It performs better than other statistics compared for small differences in locations between two populations when underlying population is population 7(light tailed population) and sample size 15 and 18 respectively. When underlying population is population 6(heavy tailed population) and sample sizes are 15 and 18 it performas better than other statistic compared except Wilcoxon's rank sum test statistics for small differences in location between two populations. It performs better than Mardia's(1967) test statistic for large differences in location between two population when underlying population is bivariate normal mixture with probability p=0.5, population 6, Pearson type II population and Pearson type VII population for sample size 15 and 18 .Under bivariate normal population it performs as good as Mardia' (1967) test statistic for small differences in locations between two populations and sample sizes 15 and 18. For sample sizes 25 and 28 respectively it performs better than Mardia's (1967) test statistic when underlying population is population 6, Pearson type II population and Pearson type VII population     

Use of the squared ranks test to test for the equality of the coefficients of variation

A distribution-free test for the equality of the coefficients of variation from k populations is obtained by using the squared ranks test for variances, as presented by Conover and Iman (1978) and Conover (1980), on the original observations divided by their respective expected values. Substitution of the sample mean in place of the expected value results in the test being only asymptotically distribution-free. Results of a simulation study evaluating the size of the test for various coefficient of variation values and probability distributions are presented.     

A simulation study of the Bennett test and Miller test for coefficients of variation

In the article, properties of the Bennett test and Miller test are analyzed. Assuming that the sample size is the same for each sample and considering the null hypothesis that the coefficients of variation for k populations are equal against the hypothesis that k ? 1 coefficients of variation are the same but differ from the coefficient of variation for the kth population, the empirical significance level and the power of the test are studied. Moreover, the dependence of the test statistic and the power of the test on the ratio of coefficients of variation are considered. The analyses are performed on simulated data.     

Assessing cumulative logit models via a score test in random effect models

The purpose of this article is to develop a goodness-of-fit test based on score test statistics for cumulative logit models with extra variation of random effects. Two main theorems for the proposed score test statistics are derived. In simulation studies, the powers of the proposed tests are discussed and the power curve against a variety of dispersion parameters and bandwidths is depicted. The proposed method is illustrated by an ordinal data set from Mosteller and Tukey [23].     

Bayesian goodness-of-fit test for censored data

We propose a Bayesian computation and inference method for the Pearson-type chi-squared goodness-of-fit test with right-censored survival data. Our test statistic is derived from the classical Pearson chi-squared test using the differences between the observed and expected counts in the partitioned bins. In the Bayesian paradigm, we generate posterior samples of the model parameter using the Markov chain Monte Carlo procedure. By replacing the maximum likelihood estimator in the quadratic form with a random observation from the posterior distribution of the model parameter, we can easily construct a chi-squared test statistic. The degrees of freedom of the test equal the number of bins and thus is independent of the dimensionality of the underlying parameter vector. The test statistic recovers the conventional Pearson-type chi-squared structure. Moreover, the proposed algorithm circumvents the burden of evaluating the Fisher information matrix, its inverse and the rank of the variance–covariance matrix. We examine the proposed model diagnostic method using simulation studies and illustrate it with a real data set from a prostate cancer study.     

A test for randomness based on a complexity measure

A test for randomness based on a statistic related to the complexity of finite sequences is presented. Simulation of binary sequences under different stochastic models provides estimates of the power of the test. The results show that the test is sensitive to a variety of alternatives to randomness and suggest that the proposed test statistic is a reasonable measure of the stochastic complexity of a finite sequence of discrete random variables.     

Homogeneity tests among groups for microsatellite data

We propose a homogeneity test among groups on a quadratic distance measure. The underlying mutation process in the microsatellite loci is studied using the stepwise mutation model. Asymptotic normality of the test statistic is proved under very mild regularity conditions. Resampling methods, such as jackknife, are used in the application to build confidence intervals for the difference in allelic variation between and within groups. The method is applied in a real data to test whether there are differences in the distribution of the repeated sequence among groups defined by ethnicity and alcoholism index (ALDX1).     

A jackknife-based versatile test for two-sample problems with right-censored data

For testing the equality of two survival functions, the weighted logrank test and the weighted Kaplan–Meier test are the two most widely used methods. Actually, each of these tests has advantages and defects against various alternatives, while we cannot specify in advance the possible types of the survival differences. Hence, how to choose a single test or combine a number of competitive tests for indicating the diversities of two survival functions without suffering a substantial loss in power is an important issue. Instead of directly using a particular test which generally performs well in some situations and poorly in others, we further consider a class of tests indexed by a weighted parameter for testing the equality of two survival functions in this paper. A delete-1 jackknife method is implemented for selecting weights such that the variance of the test is minimized. Some numerical experiments are performed under various alternatives for illustrating the superiority of the proposed method. Finally, the proposed testing procedure is applied to two real-data examples as well.     

A statistical test for detecting discordance in rankings between k groups

In several research areas such as psychology, social science, and medicine, studies are conducted in which objects should be ranked by different judges/raters and the concordance of the different rankings is then analyzed. In such studies, it is also frequently of interest to compare the rankings between different groups of judges, e.g. female vs. male judges or judges from different professions. In the two-group case, the two-group concordance test of Schucany & Frawley can be employed for such a comparison. In this article, we propose an extension of this test enabling the comparison of rankings from more than two groups of judges. This test aims to detect disagreement in the average rankings of the objects between k groups with an at least moderate intra-group concordance. We evaluate this test in an extensive simulation study and in an application to data from an aesthetics study. This simulation study shows that the proposed test is able to detect differences between average rankings and performs well even in situations in which the disagreement is comparably small or the intra-group concordance is inhomogeneous.     

A powerful test for Balaam's design

The crossover trial design (AB/BA design) is often used to compare the effects of two treatments in medical science because it performs within‐subject comparisons, which increase the precision of a treatment effect (i.e., a between‐treatment difference). However, the AB/BA design cannot be applied in the presence of carryover effects and/or treatments‐by‐period interaction. In such cases, Balaam's design is a more suitable choice. Unlike the AB/BA design, Balaam's design inflates the variance of an estimate of the treatment effect, thereby reducing the statistical power of tests. This is a serious drawback of the design. Although the variance of parameter estimators in Balaam's design has been extensively studied, the estimators of the treatment effect to improve the inference have received little attention. If the estimate of the treatment effect is obtained by solving the mixed model equations, the AA and BB sequences are excluded from the estimation process. In this study, we develop a new estimator of the treatment effect and a new test statistic using the estimator. The aim is to improve the statistical inference in Balaam's design. Simulation studies indicate that the type I error of the proposed test is well controlled, and that the test is more powerful and has more suitable characteristics than other existing tests when interactions are substantial. The proposed test is also applied to analyze a real dataset. Copyright © 2015 John Wiley & Sons, Ltd.     

A simple test procedure in standardizing the power of Hosmer–Lemeshow test in large data sets

The Hosmer–Lemeshow (H–L) test is a widely used method when assessing the goodness-of-fit of a logistic regression model. However, the H–L test is sensitive to the sample sizes and the number of groups in H–L test. Cautions need to be taken for interpreting an H–L test with a large sample size. In this paper, we propose a simple test procedure to evaluate the model fit of logistic regression model with a large sample size, in which a bootstrap method is used and the test result is determined by the power of H–L test at the target sample size. Simulation studies show that the proposed method can effectively standardize the power of the H–L test under the pre-specified level of type I error. Application to the two datasets illustrates the usefulness of the proposed model.     

Testing for mean and variance differences with samples from distributions that may be non-normal with unequal variances

The problem of comparing several samples to decide whether the means and/or variances are significantly different is considered. It is shown that with very non-normal distributions even a very robust test to compare the means has poor properties when the distributions have different variances, and therefore a new testing scheme is proposed. This starts by using an exact randomization test for any significant difference (in means or variances) between the samples. If a non-significant result is obtained then testing stops. Otherwise, an approximate randomization test for mean differences (but allowing for variance differences) is carried out, together with a bootstrap procedure to assess whether this test is reliable. A randomization version of Levene's test is also carried out for differences in variation between samples. The five possible conclusions are then that (i) there is no evidence of any differences, (ii) evidence for mean differences only, (iii) evidence for variance differences only, (iv) evidence for mean and variance differences, or (v) evidence for some indeterminate differences. A simulation experiment to assess the properties of the proposed scheme is described. From this it is concluded that the scheme is useful as a robust, conservative method for comparing samples in cases where they may be from very non-normal distributions.     

A partial score test for difference among heterogeneous populations

In event time data analysis, comparisons between distributions are made by the logrank test. When the data appear to contain crossing hazards phenomena, nonparametric weighted logrank statistics are usually suggested to accommodate different-weighted functions to increase the power. However, the gain in power by imposing different weights has its limits since differences before and after the crossing point may balance each other out. In contrast to the weighted logrank tests, we propose a score-type statistic based on the semiparametric-, heteroscedastic-hazards regression model of Hsieh [2001. On heteroscedastic hazards regression models: theory and application. J. Roy. Statist. Soc. Ser. B 63, 63–79.], by which the nonproportionality is explicitly modeled. Our score test is based on estimating functions derived from partial likelihood under the heteroscedastic model considered herein. Simulation results show the benefit of modeling the heteroscedasticity and power of the proposed test to two classes of weighted logrank tests (including Fleming–Harrington's test and Moreau's locally most powerful test), a Renyi-type test, and the Breslow's test for acceleration. We also demonstrate the application of this test by analyzing actual data in clinical trials.     

A new two-sample test for choosing between log-rank and Wilcoxon tests with right-censored data

When differences of survival functions are located in early time, a Wilcoxon test is the best test, but when differences of survival functions are located in late time, using a log-rank test is better. Therefore, a researcher needs a stable test in these situations. In this paper, a new two-sample test is proposed and considered. This test is distribution-free. This test is useful for choosing between log-rank and Wilcoxon tests. Its power is roughly the maximal power of the log-rank test and Wilcoxon test.     

A pooled Bayes test of independence for sparse contingency tables from small areas

We study the association between bone mineral density (BMD) and body mass index (BMI) when contingency tables are constructed from the several U.S. counties, where BMD has three levels (normal, osteopenia and osteoporosis) and BMI has four levels (underweight, normal, overweight and obese). We use the Bayes factor (posterior odds divided by prior odds or equivalently the ratio of the marginal likelihoods) to construct the new test. Like the chi-squared test and Fisher's exact test, we have a direct Bayes test which is a standard test using data from each county. In our main contribution, for each county techniques of small area estimation are used to borrow strength across counties and a pooled test of independence of BMD and BMI is obtained using a hierarchical Bayesian model. Our pooled Bayes test is computed by performing a Monte Carlo integration using random samples rather than Gibbs samples. We have seen important differences among the pooled Bayes test, direct Bayes test and the Cressie-Read test that allows for some degree of sparseness, when the degree of evidence against independence is studied. As expected, we also found that the direct Bayes test is sensitive to the prior specifications but the pooled Bayes test is not so sensitive. Moreover, the pooled Bayes test has competitive power properties, and it is superior when the cell counts are small to moderate.     

An empirical likelihood goodness-of-fit test for time series

Summary. Standard goodness-of-fit tests for a parametric regression model against a series of nonparametric alternatives are based on residuals arising from a fitted model. When a parametric regression model is compared with a nonparametric model, goodness-of-fit testing can be naturally approached by evaluating the likelihood of the parametric model within a nonparametric framework. We employ the empirical likelihood for an α -mixing process to formulate a test statistic that measures the goodness of fit of a parametric regression model. The technique is based on a comparison with kernel smoothing estimators. The empirical likelihood formulation of the test has two attractive features. One is its automatic consideration of the variation that is associated with the nonparametric fit due to empirical likelihood's ability to Studentize internally. The other is that the asymptotic distribution of the test statistic is free of unknown parameters, avoiding plug-in estimation. We apply the test to a discretized diffusion model which has recently been considered in financial market analysis.     

A goodness-of-fit test for overdispersed binomial (or multinomial) models

Overdispersion or extra variation is a common phenomenon that occurs when binomial (multinomial) data exhibit larger variances than that permitted by the binomial (multinomial) model. This arises when the data are clustered or when the assumption of independence is violated. Goodness-of-fit (GOF) tests available in the overdispersion literature have focused on testing for the presence of overdispersion in the data and hence they are not applicable for choosing between the several competing overdispersion models. In this paper, we consider a GOF test proposed by Neerchal and Morel [1998. Large cluster results for two parametric multinomial extra variation models. J. Amer. Statist. Assoc. 93(443), 1078–1087], and study its distributional properties and performance characteristics. This statistic is a direct analogue of the usual Pearson chi-squared statistic, but is also applicable when the clusters are not necessarily of the same size. As this test statistic is for testing model adequacy against the alternative that the model is not adequate, it is applicable in testing two competing overdispersion models.