Permutation Tests for Comparing Inequality Measures

ABSTRACT

Asymptotic and bootstrap tests for inequality measures are known to perform poorly in finite samples when the underlying distribution is heavy-tailed. We propose Monte Carlo permutation and bootstrap methods for the problem of testing the equality of inequality measures between two samples. Results cover the Generalized Entropy class, which includes Theil’s index, the Atkinson class of indices, and the Gini index. We analyze finite-sample and asymptotic conditions for the validity of the proposed methods, and we introduce a convenient rescaling to improve finite-sample performance. Simulation results show that size correct inference can be obtained with our proposed methods despite heavy tails if the underlying distributions are sufficiently close in the upper tails. Substantial reduction in size distortion is achieved more generally. Studentized rescaled Monte Carlo permutation tests outperform the competing methods we consider in terms of power.     

Bivariate symmetry tests for complete and competing risks data: a saddlepoint approach

A class of bivariate symmetry tests for complete data and competing risks data is considered. Saddlepoint approximation for the exact p-values of the underlying permutation distribution of these tests is derived. Several simulation studies are conducted to evaluate the performance of the saddlepoint approximation and the asymptotic approximation. The saddlepoint approximation was found to be highly accurate and superior to the asymptotic approximations in replicating the exact permutation significance.     

BAHADUR SLOPES FOR COMPARISONS OF TESTS BASED ON RESAMPLING

Let X₁,…, X_n be random variables symmetric about θ from a common unknown distribution F_θ(x) =F(x–θ). To test the null hypothesis H₀:θ= 0 against the alternative H₁:θ > 0, permutation tests can be used at the cost of computational difficulties. This paper investigates alternative tests that are computationally simpler, notably some bootstrap tests which are compared with permutation tests. Of these the symmetrical bootstrap-f test competes very favourably with the permutation test in terms of Bahadur asymptotic efficiency, so it is a very attractive alternative.     

Large sample results for tests of association ii. multinomial and stratified sampling

This paper deals with the asymptotics of a class of tests for association in 2-way contingency tables based on square forms in cell frequencies, given the total number of observations (multinomial sampling) or one set of marginal totals (stratified sampling). The case when both row and column marginal totals are fixed (hypergeometric sampling) was studied in Kulinskaya (1994), The class of tests under consideration includes a number of classical measures for association, Its two subclasses are the tests based on statistics using centralized cell frequencies (asymptotically distributed as weighted sums of central chi-squares) and those using the non-centralized cell frequencies (asymptotically normal). The parameters of asymptotic distributions depend on the sampling model and on true marginal probabilities. Maximum efficiency for asymptotically normal statistics is achieved under hypergeometric sampling, If the cell frequencies or the statistic as a whole are centralized using marginal proportions as estimates for marginal probabilities, the asymptotic distribution does not differ much between models and it is equivalent to that under hypergeometric sampling. These findings give an extra justification for the use of permutation tests for association (which are based on hypergeometric sampling). As an application, several well known measures of association are analysed.     

On Non-Normal Invariance Principles for Multi-Response Permutation Procedures

A non-normal invariance principle is established for a restricted class of univariate multi-response permutation procedures whose distance measure is the square of Euclidean distance. For observations from a distribution with finite second moment, the test statistic is found asymptotically to have a centered chi-squared distribution. Spectral expansions are used to determine the asymptotic distribution for more general distance measures d, and it is shown that if d(x, y) = |x — y|^u, u? 2, the asymptotic distribution is not invariant (i.e. it is dependent on the distribution of the observations).     

A note on the asymptotic distribution of the process capability index C pmk

Process capability indices have been widely used to evaluate the process performance to the continuous improvement of quality and productivity. The distribution of the estimator of the process capability index C _pmk is very complicated and the asymptotic distribution is proposed by Chen and Hsu [The asymptotic distribution of the processes capability index C _pmk , Comm. Statist. Theory Methods 24(5) (1995), pp. 1279–1291]. However, we found a critical error for the asymptotic distribution when the population mean is not equal to the midpoint of the specification limits. In this paper, a correct version of the asymptotic distribution is given. An asymptotic confidence interval of C _pmk by using the correct version of asymptotic distribution is proposed and the lower bound can be used to test if the process is capable. A simulation study of the coverage probability of the proposed confidence interval is shown to be satisfactory. The relation of six sigma technique and the index C _pmk is also discussed in this paper. An asymptotic testing procedure to determine if a process is capable based on the index of C _pmk is also given in this paper.     

Permuiation tesis for k-sample binomial data with comparisons of exact and approximate P-levels

Exact ksample permutation tests for binary data for three commonly encountered hypotheses tests are presented,, The tests are derived both under the population and randomization models . The generating function for the number of cases in the null distribution is obtained, The asymptotic distributions of the test statistics are derived . Actual significance levels are computed for the asymptotic test versions , Random sampling of the null distribution is suggested as a superior alternative to the asymptotics and an efficient computer technique for implementing the random sampling is described., finally, some numerical examples are presented and sample size guidelines given for computer implementation of the exact tests.     

A resampling procedure for nonparametric combination of several dependent tests

Summary This paper deals with nonparametric methods for combining dependent permutation or randomization tests. Particularly, they are nonparametric with respect to the underlying dependence structure. The methods are based on a without replacement resampling procedure (WRRP) conditional on the observed data, also called conditional simulation, which provide suitable estimates, as good as computing time permits, of the permutational distribution of any statistic. A class C of combining functions is characterized in such a way that all its members, under suitable and reasonable conditions, are found to be consistent and unbiased. Moreover, for some of its members, their almost sure asymptotic equivalence with respect to best tests, in particular cases, is shown. An applicational example to a multivariate permutationalt-paired test is also discussed.     

TESTS FOR DETECTING MORE NBU-NESS AT A SPECIFIC AGE

This paper proposes a class of non‐parametric test procedures for testing the null hypothesis that two distributions, F and G, are equal versus the alternative hypothesis that F is ‘more NBU (new better than used) at specified age t₀’ than G. Using Hoeffding's two‐sample U‐statistic theorem, it establishes the asymptotic normality of the test statistics and produces a class of asymptotically distribution‐free tests. Pitman asymptotic efficacies of the proposed tests are calculated with respect to the location and shape parameters. A numerical example is provided for illustrative purposes.     

Significance levels and confidence intervals for permutation tests

A computational algorithm is given which calculates exact significance levels of a wide class of permutation tests in the one and two sample problems. This class includes the permutation test based on the means, locally most powerful permutation tests and linear rank tests. When a shift model is assumed confidence intervals can also be obtained. Approximate methods, based on asymptotic expansions, are also presented.     

The weighted log-rank class under truncated binomial design: saddlepoint p-values and confidence intervals

The randomization design used to collect the data provides basis for the exact distributions of the permutation tests. The truncated binomial design is one of the commonly used designs for forcing balance in clinical trials to eliminate experimental bias. In this article, we consider the exact distribution of the weighted log-rank class of tests for censored data under the truncated binomial design. A double saddlepoint approximation for p-values of this class is derived under the truncated binomial design. The speed and accuracy of the saddlepoint approximation over the normal asymptotic facilitate the inversion of the weighted log-rank tests to determine nominal 95% confidence intervals for treatment effect with right censored data.     

Bootstrapping Noncausal Autoregressions: With Applications to Explosive Bubble Modeling

In this article, we develop new bootstrap-based inference for noncausal autoregressions with heavy-tailed innovations. This class of models is widely used for modeling bubbles and explosive dynamics in economic and financial time series. In the noncausal, heavy-tail framework, a major drawback of asymptotic inference is that it is not feasible in practice as the relevant limiting distributions depend crucially on the (unknown) decay rate of the tails of the distribution of the innovations. In addition, even in the unrealistic case where the tail behavior is known, asymptotic inference may suffer from small-sample issues. To overcome these difficulties, we propose bootstrap inference procedures using parameter estimates obtained with the null hypothesis imposed (the so-called restricted bootstrap). We discuss three different choices of bootstrap innovations: wild bootstrap, based on Rademacher errors; permutation bootstrap; a combination of the two (“permutation wild bootstrap”). Crucially, implementation of these bootstraps do not require any a priori knowledge about the distribution of the innovations, such as the tail index or the convergence rates of the estimators. We establish sufficient conditions ensuring that, under the null hypothesis, the bootstrap statistics estimate consistently particular conditionaldistributions of the original statistics. In particular, we show that validity of the permutation bootstrap holds without any restrictions on the distribution of the innovations, while the permutation wild and the standard wild bootstraps require further assumptions such as symmetry of the innovation distribution. Extensive Monte Carlo simulations show that the finite sample performance of the proposed bootstrap tests is exceptionally good, both in terms of size and of empirical rejection probabilities under the alternative hypothesis. We conclude by applying the proposed bootstrap inference to Bitcoin/USD exchange rates and to crude oil price data. We find that indeed noncausal models with heavy-tailed innovations are able to fit the data, also in periods of bubble dynamics. Supplementary materials for this article are available online.     

On testing exponentiality against new better than used of specified age

R.M. Hollander, D.H. Park and F. Proschan [A class of life distributions for aging, J. Amer. Statist. Assoc. 81 (1986) 91–95] introduced the concept of the larger class of life distributions called new better than used of specified age. In practice, one might be interested in the new better than used behaviour at an unknown but estimable age t₀. Here, we investigate the testing of new better than used of specified age t₀ (NBU-t₀) alternatives. A class of test statistics for testing NBU-t₀ (t₀ is known) based on a U-statistic whose kernel depends on sub-sample minima is proposed. A member of the class of tests proposed by N. Ebrahimi and M. Habbibullah [Testing whether the survival distribution is new better than used of specified age, Biometrika 77 (1990) 212–215] for this problem belongs to the class of tests proposed here. The distributional properties of the class of test statistics are studied. The performances of a few members of the proposed class of tests are studied in terms of Pitman asymptotic relative efficiency. The Pitman ARE values show that the members of the class perform well in comparison with the N. Ebrahimi and M. Habbibullah [Testing whether the survival distribution is new better than used of specified age, Biometrika 77 (1990) 212–215] tests. The proposed class of tests is shown to be consistent for NBU-t₀ alternatives.     

Log‐rank permutation tests for trend: saddlepoint p‐values and survival rate confidence intervals

Suppose p + 1 experimental groups correspond to increasing dose levels of a treatment and all groups are subject to right censoring. In such instances, permutation tests for trend can be performed based on statistics derived from the weighted log‐rank class. This article uses saddlepoint methods to determine the mid‐P‐values for such permutation tests for any test statistic in the weighted log‐rank class. Permutation simulations are replaced by analytical saddlepoint computations which provide extremely accurate mid‐P‐values that are exact for most practical purposes and almost always more accurate than normal approximations. The speed of mid‐P‐value computation allows for the inversion of such tests to determine confidence intervals for the percentage increase in mean (or median) survival time per unit increase in dosage. The Canadian Journal of Statistics 37: 5‐16; 2009 © 2009 Statistical Society of Canada     

Testing the Equality and Exchangeability of Bivariate Distributions

We consider three methods (oments, cut-points, and ranks) for testing the hypotheses of equality of two bivariate distribution functions (H _0a ) and exchangeability (H _0b ). To test H _0a , the asymptotic normality of the vector of mixed moments provides a statistic with an asymptotic chi-square distribution. With every observation, method of cut-points associates three 2 × 2 tables to record the proportions of the X, Y, and the combined samples that fall in the four regions around the observation. We measure the total squared deviations of the proportions in the combined sample from X and Y samples. The two methods are compared with the method of ranks based on the Puri and Sen (1971 Puri , M. L. , Sen , P. K. ( 1971 ). Nonparametric Methods in Multivariate Analysis . New York : John Wiley and Sons . [Google Scholar]) multivariate two-sample rank test for location.

To test H _0b we identify two bivariate distributions, one above and the other below the line of symmetry X = Y, to which a test of H _0a is applied. Under H _0b , matrix of mixed moments is symmetric and a quadratic form in differences of (r,s)-th and (s, r)-th mixed moments provides an asymptotic chi-square distribution. A permutation test is devised to apply the method of cut-points to the observations above and below the line of symmetry after they are folded. We also describe an adaption of the Puri-Sen rank test to assess H _0b . To estimate the power of the above methods under different types of alternatives and compare them to existing tests, we report on a Monte Carlo experiment that evaluates the finite-sample performance of these methods under the Plackett's family of bivariate distributions.     

A toolbox of permutation tests for structural change

The sup $LM$ test for structural change is embedded into a permutation test framework for a simple location model. The resulting conditional permutation distribution is compared to the usual (unconditional) asymptotic distribution, showing that the power of the test can be clearly improved in small samples. Furthermore, the permutation test is embedded into a general framework that encompasses tools for binary and multivariate dependent variables as well as model-based permutation testing for structural change. It is also demonstrated that the methods can not only be employed for analyzing structural changes in time series data but also for recursive partitioning of cross-section data. The procedures suggested are illustrated using both artificial data and empirical applications (number of youth homicides, employment discrimination data, carbon flux in tropical forests, stock returns, and demand for economics journals).     

Non Null Asymptotic Distributions of Some Criteria in Censored Exponential Regression

In this article, we consider the class of censored exponential regression models which is very useful for modeling lifetime data. Under a sequence of Pitman alternatives, the asymptotic expansions up to order n^{? 1/2} of the non null distribution functions of the likelihood ratio, Wald, Rao score, and gradient statistics are derive in this class of models. The non null asymptotic distribution functions of these statistics are obtained for testing a composite null hypothesis in the presence of nuisance parameters. The power of all four tests, which are equivalent to first order, are compared based on these non null asymptotic expansions. Furthermore, in order to compare the finite-sample performance of these tests in this class of models, we consider Monte Carlo simulations. We also present an empirical application for illustrative purposes.     

Distribution-free tests for cluster samples of ordinal responses

A simulation comparison is done of Mann–Whitney U test extensions recently proposed for simple cluster samples or for repeated ordinal responses. These are based on two approaches: the permutation approach of Fay and Gennings (four tests, two exact), and Edwardes’ approach (two asymptotic tests, one new). Edwardes’ approach permits confidence interval estimation, unlike the permutation approach. An appropriate parameter for estimation is P(X<Y)−P(X>Y), where X is the rank of a response from group 1 and Y is from group 2. The permutation tests are shown to be unsuitable for some survey data, since they are sensitive to a difference in cluster intra-correlations when there is no distribution difference between groups at the individual level. The exact permutation tests are of little use for less than seven clusters, precisely where they are most needed. Otherwise, the permutation tests perform well.     

Estimation of a Conditional Copula and Association Measures

Abstarct. This paper is concerned with studying the dependence structure between two random variables Y ₁ and Y ₂ conditionally upon a covariate X. The dependence structure is modelled via a copula function, which depends on the given value of the covariate in a general way. Gijbels et al. (Comput. Statist. Data Anal., 55, 2011, 1919) suggested two non‐parametric estimators of the ‘conditional’ copula and investigated their numerical performances. In this paper we establish the asymptotic properties of the proposed estimators as well as conditional association measures derived from them. Practical recommendations for their use are then discussed.     

Asymptotic properties of Bayes risk for one-sided tests

Consider a given sequence {T_n} of estimators for a real-valued parameter θ. This paper studies asymptotic properties of restricted Bayes tests of the following form: reject H₀:θ ≤ θ₀ in favour of the alternative θ > θ₀ if T_n ≤ C_n, where the critical point C_n is determined to minimize among all tests of this form the expected probability of error with respect to the prior distribution. Such tests may or may not be fully Bayes tests, and so are called T_n-Bayes. Under fairly broad conditions it is shown that and the T_n-Bayes risk where a_n is the order of the standard error of T_n, - is the prior density, and μ is the median of F, the limit distribution of (T_n – θ)/a_nb(θ). Several examples are given.