The Benard-Van Elteren statistic and nonparametric computation

A general computer program which generates either the Wilcoxon, Kruskal-Wallis, Friedman, or extended Friedman statistic (where the numbers of cell observations n_ij may be any positive integer or zero) can be formulated simply by using the computational algorithm for the Benard-Van Elteren statistic. It is shown that the Benard-Van Elteren statistic can be computed using matrix algebra subroutines including multiplication and inverse or g-inverse computational algorithms in the case where the rank of the matrix V of the variances and covariances of the column totals is k-1. For the case where the rank of V is less than k-1 the use of the g-inverse is shown to greatly reduce the labors of calculation. In addition, the use of the Benard-Van Elteren statistic in testing against ordered alternatives is indicated.     

A Modification on the Friedman Test Statistic

A modification on the well-known, nonparametric Friedman test statistic is suggested in this article. Probability distributions of the suggested test statistic under the null hypothesis are tabulated for some small sample cases. In addition to an example, simulation results for various sample sizes are presented. The simulation indicates that the modified test statistic performs better than the Friedman test in detecting treatment effects of small differences especially when the sample size is small.     

A changepoint statistic with uniform type I error probabilities

ABSTRACT

Likelihood ratio tests for a change in mean in a sequence of independent, normal random variables are based on the maximum two-sample t-statistic, where the maximum is taken over all possible changepoints. The maximum t-statistic has the undesirable characteristic that Type I errors are not uniformly distributed across possible changepoints. False positives occur more frequently near the ends of the sequence and occur less frequently near the middle of the sequence. In this paper we describe an alternative statistic that is based upon a minimum p-value, where the minimum is taken over all possible changepoints. The p-value at any particular changepoint is based upon both the two-sample t-statistic at that changepoint and the probability that the maximum two-sample t-statistic is achieved at that changepoint. The new statistic has a more uniform distribution of Type I errors across potential changepoints and it compares favorably with respect to statistical power, false discovery rates, and the mean square error of changepoint estimates.     

Comparing mean ranks for repeated measures data

Rank tests are considered that compare t treatments in repeated measures designs. A statistic is given that contains as special cases several that have been proposed for this problem, including one that corresponds to the randomized block ANOVA statistic applied to the rank transformed data. Another statistic is proposed, having a null distribution holding under more general conditions, that is the rank transform of the Hotelling statistic for repeated measures. A statistic of this type is also given for data that are ordered categorical rather than fully rankedo Unlike the Friedman statistic, the statistics discussed in this article utilize a single ranking of the entire sample. Power calculations for an underlying normal distribution indicate that the rank transformed ANOVA test can be substantially more powerful than the Friedman test.     

How many ways can you look at a proportion?: cross-community vote transfers in Northern Ireland after the Belfast Agreement

Summary.  The single transferable vote is a method of election that allows voters to mark candidates in order of preference. Votes that are not required to elect a candidate are passed to the next candidate in the voter's order of preference. Results of this kind of election give us data about the degree to which voters of a given persuasion are willing to pass their vote to a candidate of a different persuasion. Measures of voters' willingness to pass a vote to a candidate of a different persuasion are of particular interest in places such as Northern Ireland, where communities differ by religion and national aspiration, and agreed new political institutions are based on cross-community power-sharing. How we quantify this voting data may depend on the questions that we want to answer, of course. But, to understand changes in how the voter orders her or his preference, one may need to ask several questions, and to quantify the results of the election in more than one way.     

On the power of durbin-watson statistic against fractionally integrated processes

This paper provides the theoretical explanation and Monte Carlo experiments of using a modified version of Durbin-Watson ( D W ) statistic to test an 1 ( 1 ) process against I ( d ) alternatives, that is, integrated process of order d, where d is a fractional number. We provide the exact order of magnitude of the modified D W test when the data generating process is an I ( d ) process with d E (0. 1.5). Moreover, the consistency of the modified DW statistic as a unit root test against I ( d ) alternatives with d E ( 0 , l ) U ( 1 , 1.5) is proved in this paper. In addition to the theoretical analysis, Monte Carlo experiments show that the performance of the modified D W statistic reveals that it can be used as a unit root test against I ( d ) alternatives.     

Correspondence Analysis of Cumulative Frequencies Using a Decomposition of Taguchi's Statistic

Taguchi's statistic has long been known to be a more appropriate measure of association for ordinal variables than the Pearson chi-squared statistic. Therefore, there is some advantage in using Taguchi's statistic for performing correspondence analysis when a two-way contingency table consists of one ordinal categorical variable. This article will explore the development of correspondence analysis using a decomposition of Taguchi's statistic.     

Transforming linear functions to normality:optimal component powers

This paper considers the analysis of linear models where the response variable is a linear function of observable component variables. For example, scores on two or more psychometric measures (the component variables) might be weighted and summed to construct a single response variable in a psychological study. A linear model is then fit to the response variable. The question addressed in this paper is how to optimally transform the component variables so that the response is approximately normally distributed. The transformed component variables, themselves, need not be jointly normal. Two cases are considered; in both cases, the Box-Cox power family of transformations is employed. In Case I, the coefficients of the linear transformation are known constants. In Case II, the linear function is the first principal component based on the matrix of correlations among the transformed component variables. For each case, an algorithm is described for finding the transformation powers that minimize a generalized Anderson-Darling statistic. The proposed transformation procedure is compared to likelihood-based methods by means of simulation. The proposed method rarely performed worse than likelihood-based methods and for many data sets performed substantially better. As an illustration, the algorithm is applied to a problem from rural sociology and social psychology; namely scaling family residences along an urban-rural dimension.     

Partitioning Anderson's statistic for tied data

Anderson (Biometrics 15 (1959) 582) proposed a χ²-type statistic for the nonparametric analysis of a randomized blocks design with no ties in the data. In this paper, we propose an Anderson statistic that allows for ties in the data. We show that the asymptotic distribution of the statistic under the null hypothesis of no treatment effect is a χ² distribution. Under weak assumptions on the tie structure it is shown that the degrees of freedom for the asymptotic distribution is unchanged compared to the untied case. An extended analysis based on a partition of the statistic into independent components is suggested. The first component is shown to equal the Friedman rank statistic corrected for ties. The subsequent components allow for the detection of dispersion effects, higher order effects and differences in distribution. A simulation study is given and the new analysis is applied to a sensory evaluation data set.     

Exact null distributions of quadratic distribution-free statistics for two-way classification

We present new techniques for computing exact distributions of ‘Friedman-type’ statistics. Representing the null distribution by a generating function allows for the use of general, not necessarily integer-valued rank scores. Moreover, we use symmetry properties of the multivariate generating function to accelerate computations. The methods also work for cases with ties and for permutation statistics. We discuss some applications: the classical Friedman rank test, the normal scores test, the Friedman permutation test, the Cochran–Cox test and the Kepner–Robinson test. Finally, we shortly discuss self-made software for computing exact p-values.     

A Bayesian analysis for the Wilcoxon signed-rank statistic

A Bayesian analysis is provided for the Wilcoxon signed-rank statistic (T⁺). The Bayesian analysis is based on a sign-bias parameter φ on the (0, 1) interval. For the case of a uniform prior probability distribution for φ and for small sample sizes (i.e., 6 ? n ? 25), values for the statistic T⁺ are computed that enable probabilistic statements about φ. For larger sample sizes, approximations are provided for the asymptotic likelihood function P(T⁺|φ) as well as for the posterior distribution P(φ|T⁺). Power analyses are examined both for properly specified Gaussian sampling and for misspecified non Gaussian models. The new Bayesian metric has high power efficiency in the range of 0.9–1 relative to a standard t test when there is Gaussian sampling. But if the sampling is from an unknown and misspecified distribution, then the new statistic still has high power; in some cases, the power can be higher than the t test (especially for probability mixtures and heavy-tailed distributions). The new Bayesian analysis is thus a useful and robust method for applications where the usual parametric assumptions are questionable. These properties further enable a way to do a generic Bayesian analysis for many non Gaussian distributions that currently lack a formal Bayesian model.     

Looking at Markov samplers through cusum path plots: a simple diagnostic idea

In this paper, we propose to monitor a Markov chain sampler using the cusum path plot of a chosen one-dimensional summary statistic. We argue that the cusum path plot can bring out, more effectively than the sequential plot, those aspects of a Markov sampler which tell the user how quickly or slowly the sampler is moving around in its sample space, in the direction of the summary statistic. The proposal is then illustrated in four examples which represent situations where the cusum path plot works well and not well. Moreover, a rigorous analysis is given for one of the examples. We conclude that the cusum path plot is an effective tool for convergence diagnostics of a Markov sampler and for comparing different Markov samplers.     

An Optimal Semiparametric Method for Two‐group Classification

In the classical discriminant analysis, when two multivariate normal distributions with equal variance–covariance matrices are assumed for two groups, the classical linear discriminant function is optimal with respect to maximizing the standardized difference between the means of two groups. However, for a typical case‐control study, the distributional assumption for the case group often needs to be relaxed in practice. Komori et al. (Generalized t ‐statistic for two‐group classification. Biometrics 2015, 71: 404–416) proposed the generalized t ‐statistic to obtain a linear discriminant function, which allows for heterogeneity of case group. Their procedure has an optimality property in the class of consideration. We perform a further study of the problem and show that additional improvement is achievable. The approach we propose does not require a parametric distributional assumption on the case group. We further show that the new estimator is efficient, in that no further improvement is possible to construct the linear discriminant function more efficiently. We conduct simulation studies and real data examples to illustrate the finite sample performance and the gain that it produces in comparison with existing methods.     

A semi-analytical solution to the maximum-likelihood fit of Poisson data to a linear model using the Cash statistic

The Cash statistic, also known as the C statistic, is commonly used for the analysis of low-count Poisson data, including data with null counts for certain values of the independent variable. The use of this statistic is especially attractive for low-count data that cannot be combined, or re-binned, without loss of resolution. This paper presents a new maximum-likelihood solution for the best-fit parameters of a linear model using the Poisson-based Cash statistic. The solution presented in this paper provides a new and simple method to measure the best-fit parameters of a linear model for any Poisson-based data, including data with null counts. In particular, the method enforces the requirement that the best-fit linear model be non-negative throughout the support of the independent variable. The method is summarized in a simple algorithm to fit Poisson counting data of any size and counting rate with a linear model, by-passing entirely the use of the traditional χ2 statistic.     

A TEST FOR THE NONPARAMETRIC TWO SAMPLE SCALE PROBLEM

We propose a distribution-free test for the nonparametric two sample scale problem. Unlike the other tests for this problem, we do not assume that the two distribution functions have a common median. We assume that they have a common quantile of order a (not necessarily 1/2). The test statistic is a modification of the Sukhatme statistic for the scale problem and the Wilcoxon-Mann-Whitney statistic for stochastic dominance. It is shown that the new test is uniformly more efficient (in the Pitman sense) than the Sukhatme test and has very good efficiency when compared to the Mood test.     

Monitoring Variation in a Multivariate Process When the Dimension is Large Relative to the Sample Size

A control procedure is presented for monitoring changes in variation for a multivariate normal process in a Phase II operation where the subgroup size, m, is less than p, the number of variates. The methodology is based on a form of Wilk' statistic, which can be expressed as a function of the ratio of the determinants of two separate estimates of the covariance matrix. One estimate is based on the historical data set from Phase I and the other is based on an augmented data set including new data obtained in Phase II. The proposed statistic is shown to be distributed as the product of independent beta distributions that can be approximated using either a chi-square or F-distribution. An ARL study of the statistic is presented for a range of conditions for the population covariance matrix. Cases are considered where a p-variate process is being monitored using a sample of m observations per subgroup and m < p. Data from an industrial multivariate process is used to illustrate the proposed technique.     

A New STATISTIC FOR DETECTING INFLUENTIAL OBSERVATIONS IN A SCHEFFE' TYPE CALIBRATION CURVE

A statistic for identifying influential observations in calibration is given. The statistic is easy to interpret, and provides a useful measure of influence for Scheffé type calibration curves.     

Multi - sample test of equal gamma distribution scale parameters in presence of unknown common shape parameter

Shiue and Bain proposed an approximate F statistic for testing equality of two gamma distribution scale parameters in presence of a common and unknown shape parameter. By generalizing Shiue and Bain's statistic we develop a new statistic for testing equality of L >= 2 gamma distribution scale parameters. We derive the distribution of the new statistic ESP for L = 2 and equal sample size situation. For other situations distribution of ESP is not known and test based on the ESP statistic has to be performed by using simulated critical values. We also derive a C(α) statistic CML and develop a likelihood ratio statistic, LR, two modified likelihood ratio statistics M and MLB and a quadratic statistic Q. The distribution of each of the statistics CML, LR, M, MLB and Q is asymptotically chi-square with L - 1 degrees of freedom. We then conducted a monte-carlo simulation study to compare the perfor- mance of the statistics ESP, LR, M, MLB, CML and Q in terms of size and power. The statistics LR, M, MLB and Q are in general liberal and do not show power advantage over other statistics. The statistic CML, based on its asymptotic chi-square distribution, in general, holds nominal level well. It is most powerful or nearly most powerful in most situations and is simple to use. Hence, we recommend the statistic CML for use in general. For better power the statistic ESP, based on its empirical distribution, is recommended for the special situation for which there is evidence in the data that λ₁ < … < λ_L and n₁ < … < n_L, where λ₁ …, λ_L are the scale parameters and n₁,…, n_L are the sample sizes.     

Wald检验不一致性的微分几何解释及改进

Wald检验对于等价的零假设中不同形式的表达式在有限样本的情况下缺乏一致性,而从微分几何的角度来解释这一现象,并发现由于Wald统计量是一个混杂的不恰当的几何量,从而对不同的含参数的等价表达式不具有一致性。同时还展示了芬斯拉（Finsler）测地统计量如何能较为简便的计算出来、它在线性回归模型中的非线性约束条件下如何应用以及两者在什么情况下保持一致,并提出了一种解决Wald检验不一致性的思路。     

On the sufficient statistics for multivariate ARMA models: approximate approach

This paper is an investigation on the sufficient statistic for the parameters of the vector-valued (multivariate) ARMA models, when a finite sample is available. In the simplest case ARMA(1,1), by using the factorization theorem, we present a sufficient statistic whose dimension depends on the sample size and this dimension is even larger than the sample size. In this case and under some restrictions, we have solved this problem and have presented a sufficient statistic whose dimension does not depend on the sample size. In the general case, due to the complexity of the problem, we will use the modified versions of the likelihood function to find an approximate sufficient statistic in terms of the periodogram. The dimension of this sufficient statistic depends on the sample size; however, this dimension is much lower than the sample size.