A new distribution-free k-sample test: Analysis of kernel density functionals

A novel distribution-free k-sample test of differences in location shifts based on the analysis of kernel density functional estimation is introduced and studied. The proposed test parallels one-way analysis of variance and the Kruskal–Wallis (KW) test aiming at testing locations of unknown distributions. In contrast to the rank (score)-transformed non-parametric approach, such as the KW test, the proposed F-test uses the measurement responses along with well-known kernel density estimation (KDE) to estimate the locations and construct the test statistic. A practical optimal bandwidth selection procedure is also provided. Our simulation studies and real data example indicate that the proposed analysis of kernel density functional estimate (ANDFE) test is superior to existing competitors for fat-tailed or heavy-tailed distributions when the k groups differ mainly in location rather than shape, especially with unbalanced data. ANDFE is also highly recommended when it is unclear whether test groups differ mainly in shape or location. The Canadian Journal of Statistics 48: 167–186; 2020 © 2019 Statistical Society of Canada     

Modifications of the Mack-Wolfe umbrella tests for a generalized Behrens-Fisher problem

We are concerned with testing procedures for umbrella alternatives in the k-sample location problem without making the assumption that the underlying populations have the same shape. Modifications of the Mack-Wolfe tests are proposed for the cases when the peak of the umbrella is known or unknown. The proposed procedures are exactly distribution-free when the continuous populations have the same shape. The modified test for peak-known umbrella alternatives remains asymptotically distribution-free when the continuous populations are symmetric, but not necessarily with the same shape.     

Conditional inference under simultaneous stochastic ordering constraints

Testing for stochastic ordering is of considerable importance when increasing does of a treatment are being compared, but in applications involving multivariate responses has received much less attention. We propose a permutation test for testing against multivariate stochastic ordering. This test is distribution-free and no assumption is made about the dependence relations among variables. A comparative simulation study shows that the proposed solution exhibits a good overall performance when compared with existing tests that can be used for the same problem.     

Unbiased goodness-of-fit tests

Familiar distribution-free goodness-of-fit tests like the Kolmogorov–Smirnov test are all biased tests. In this paper, we show how to compute the bias of any distribution-free goodness-of-fit test that corresponds to a distribution-free confidence band for the cumulative distribution function (CDF). The bias of the Kolmogorov–Smirnov test turns out to be smaller than the biases of other distribution-free goodness-of-fit tests. We also develop a method for obtaining unbiased goodness-of-fit tests, which can then be inverted to obtain unbiased confidence bands for the CDF. Interestingly, only a discrete set of levels are available for the unbiased tests. Our power comparisons show that while removing bias improves the power of a test at some alternatives, it does not improve the overall power properties of the test.     

Use of the squared ranks test to test for the equality of the coefficients of variation

A distribution-free test for the equality of the coefficients of variation from k populations is obtained by using the squared ranks test for variances, as presented by Conover and Iman (1978) and Conover (1980), on the original observations divided by their respective expected values. Substitution of the sample mean in place of the expected value results in the test being only asymptotically distribution-free. Results of a simulation study evaluating the size of the test for various coefficient of variation values and probability distributions are presented.     

The limit test statistic distribution of the maximum value test for right-censored data

ABSTRACT

In this paper, the maximum value test is proposed and considered for two-sample problem solving with lifetime data. This test is a distribution-free test under non-censoring and is a not distribution-free test under censoring. The formula of the limit distribution of the proposed maximal value test is represented in the general case. The distribution of the test statistic has been studied experimentally. Also, we propose the estimate of a p-value calculation of the maximum value test instead of the Monte-Carlo simulation. This test is useful and applicable in case of choosing among the logrank test, the Cox–Mantel test, the Q test and Generalized Wilcoxon tests, for instance, the Gehan's Generalized Wilcoxon test and the Peto and Peto's Generalized Wilcoxon test.     

A Prediction-Oriented Criterion for Choosing the Biasing Parameter in Liu Estimation

Distribution-free tests have been proposed in the literature for comparing the hazard rates of two probability distributions when the available samples are complete. In this article, we generalize the test of Kochar (1981 Kochar , S. C. ( 1981 ). A new distribution-free test for the equality of two failure rates . Biometrika 68 : 423 – 426 .[Crossref], [Web of Science ®] , [Google Scholar]) to the case when the available sample is Type-II censored, and then examine its power properties.     

Tests for the multivariate two-sample problem based on empirical probability measures

Nonparametric tests are proposed for the equality of two unknown p-variate distributions. Empirical probability measures are defined from samples from the two distributions and used to construct test statistics as the supremum of the absolute differences between empirical probabilities, the supremum being taken over all possible events. The test statistics are truly multivariate in not requiring the artificial ranking of multivariate observations, and they are distribution-free in the general p-variate case. Asymptotic null distributions are obtained. Powers of the proposed tests and a competitor are examined by Monte Carlo techniques.     

KENDALL'S TAU AND CONTINGENCY TABLES

Kendall's tau is a coefficient of concordance between two rankings of n objects. Its definition and large sample normal approximation are easily extended to the case where one of the rankings contains ties. In this paper, definition and normal approximation are extended further to the case where both rankings contain ties. The results are applied to give a fully distribution-free test for two-way contingency tables with ordered categories.     

A DISTRIBUTION-FREE TEST FOR TWO-WAY LAYOUT1

Many nonparametric tests have been proposed for the hypothesis of no row (treatment) effect in a one-way layout design. Examples of such tests are Kruskal-Wallis H-test, Bhapkar's (1961) V-test and Deshpande's (1965) L-test. However not many tests are available for testing the same hypothesis in a two-way layout design without interaction. Perhaps the only “established” test is the one due to Friedman (1937). However, it applies to the case of one observation per cell only. In this paper, a new distribution-free test is proposed for the hypothesis of row effect in a two-way layout design. It applies to the case of several observations per cell, not necessarily equal. The asymptotic efficiency of the proposed test relative to other tests is studied.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

Asymptotic optimality of rank tests for randomized blocks

Both the method of ranking after alignment and the Tukey-Quade method of weighted rankings for the analysis of complete blocks are generalized so as to give rise to classes of tests containing a conditionally distribution-free test and strictly distribution-free tests that are asymptotically optimal in the sense that, when the number of blocks tends to infinity, their asymptotic local power reaches the one of the asymptotically minimax test based on block-location-free statistics.     

Paradoxes in nonparametric tests

This paper is a continuation of one (1992) in which the author studied the paradoxes that can arise when a nonparametric statistical test is used to give an ordering of k samples and the subsets of those samples. This article characterizes the projection paradoxes that can occur when using contingency tables, complete block designs, and tests of dichotomous behaviour of several samples. This is done by examining the “dictionaries” of possible orderings of each of these procedures. Specifically, it is shown that contingency tables and complete block designs, like the Kruskal-Wallis nonparametric test on k samples, minimize the number and kinds of projection paradoxes that can occur; however, using a test of dichotomous behaviour of several samples does not. An analysis is given of two procedures used to determine the ordering of a pair of samples from a set of k samples. It is shown that these two procedures may not have anything in common.     

A modification of the kruskal-wallis statistic for the generalized behrens-fisher problem

The problem of testing the equality of the medians of several populations is considered. Standard distribution-free procedures for this problem require that the populations have the same shape in order to maintain their nominal significance level, ever asymptotically, under the null hypothesis of equal medians , A modification of the Kruskal-Wallis test statistic is proposed which is exactly distribution-free under the usual nonparanetric asswnption that the continuous populations are identical with any shape. It is asymptotically distribution-free when the Continuous populations are asswned to be syrmnetric with equal medians.     

A two-sample distribution-free scale test of the smirnov type

The two-sample, distribution-free statistics of Smirnov (1939) are used to define a new statistic. While the Smirnov statistics are used as a general goodness-of-fit test, a distribution-free scale test based on this new statistic is developed. It is shown that this new test has higher power than the two-sided Smirnov statistic in detecting differences in scale for some symmetric distributions with equal means/medians. The critical values of the proposed test statistic and its limiting distribution are given     

Multivariate Tests of Mean-Variance Efficiency and Spanning With a Large Number of Assets and Time-Varying Covariances

We develop a finite-sample procedure to test the mean-variance efficiency and spanning hypotheses, without imposing any parametric assumptions on the distribution of model disturbances. In so doing, we provide an exact distribution-free method to test uniform linear restrictions in multivariate linear regression models. The framework allows for unknown forms of nonnormalities as well as time-varying conditional variances and covariances among the model disturbances. We derive exact bounds on the null distribution of joint F statistics to deal with the presence of nuisance parameters, and we show how to implement the resulting generalized nonparametric bounds tests with Monte Carlo resampling techniques. In sharp contrast to the usual tests that are not even computable when the number of test assets is too large, the power of the proposed test procedure potentially increases along both the time and cross-sectional dimensions.     

DISTRIBUTION-FREE CONFIDENCE PROCEDURE FOR UMBRELLA ORDERINGS

Responses in a one-factor experiment with A; ordered treatments follow an umbrella, ordering if they consist of two piecewise monotone segments, i.e. increasing and then decreasing, or the converse. This paper proposes a non-parametric distribution-free confidence procedure for umbrella orderings, the aim being to identify the treatments that correspond to the optimal effects. It uses a method that joins the seemingly unrelated theories of U-statistics and isotonic regression. A random confidence subset of the ordered treatments is constructed, such that it contains all the unknown peaks (optimal treatments) of an umbrella ordering with any prespecified confidence level. The paper demonstrates that the proposed confidence procedure is nonparametric distribution-free and, further, that the proposed procedure naturally implies a test for umbrella alternatives. Since the proposed confidence procedure is always more informative than tests for umbrella alternatives, it should be used in their place in practice. An example illustrates the proposed procedure.     

Rank tests in the two-sample scale problem with unequal and unknown locations

The two-sample scale problem is studied in the case of unequal and unknown location parameters. The method proposed is based on the idea of Moses (1963) and it is distribution-free. The two samples are separated into random subgroups of the same sizek. It is proposed to choosek=4 and to apply the Wilconxon test or the Savage test to the ranges or sample variances of the subgroups. The asymptotic power functions of the tests are compared. For small and moderate sample sizes simulations are carried out. Relations to some other procedures, especially to the method of Compagnone and Denker (1996) are briefly discussed.     

Some distribution-free rane-like statistics having the mann-whitney-wilcoxon null distribution

In this note we suggest a class of two-sample test statistics iich have, as their null distribution,the Mann-Whitney-Wilcoxon

ill distribution. An interesting property of these statistics is lat many are not rank statistics; that is, they cannot be coumplited from, the ranks of the original observations. However, they %e still distribution-free when the two populations are identi-il. This class contains the Mann-Whitney-Wilcoxon test for the niality of location parameters of two distributions and a two-aiaple test for equality of spreads of two distributions recently ivestigated by Fligner and Killeen (1976)     

Permutation Approaches for Stochastic Ordering

In many application problems, when dealing with comparisons between two or more groups, the classical parametric inferential statistical methods are used, although in real problems the quite stringent assumptions required by such methods are rarely satisfied. In particular a parametric approach to the test on ordering of C > 2 populations is very difficult. In order to tackle this problem two alternative methods are proposed in the present paper. Both the methods consist in permutation combination based tests: the first is supposed to be more powerful and it is suitable when the main goal of the study is related to the global ordering of the populations; the second is useful when the interest is in the pairwise comparisons between the populations.