An Adaptive Test for the Two-Sample Location Problem Based on U-Statistics

For the two-sample location problem with continuous data we consider a general class of tests, all members of it are based on U-statistics. The asymptotic efficacies are investigated in detail. We construct an adaptive test where all statistics involved are suitably chosen U-statistics. It is shown that the proposed adaptive test has good asymptotic and finite sample power properties.     

On the Gini Mean Difference Test for Circular Data

We introduce a new test of isotropy or uniformity on the circle, based on the Gini mean difference of the sample arc-lengths and obtain both the exact and asymptotic distributions under the null hypothesis of circular uniformity. We also provide a table of upper percentile values of the exact distribution for small to moderate sample sizes. Illustrative examples in circular data analysis are also given. It is shown that a “generalized” Gini mean difference test has better asymptotic efficiency than a corresponding “generalized” Rao's test in the sense of Pitman asymptotic relative efficiency.     

Asymptotic spacings theory with applications to the two-sample problem

The asymptotic distribution theory of test statistics which are functions of spacings is studied here. Distribution theory under appropriate close alternatives is also derived and used to find the locally most powerful spacing tests. For the two-sample problem, which is to test if two independent samples are from the same population, test statistics which are based on “spacing-frequencies” (i.e., the numbers of observations of one sample which fall in between the spacings made by the other sample) are utilized. The general asymptotic distribution theory of such statistics is studied both under the null hypothesis and under a sequence of close alternatives.     

Testing homogeneity of several covariance matrices and multi-sample sphericity for high-dimensional data under non-normality

A test for homogeneity of g ? 2 covariance matrices is presented when the dimension, p, may exceed the sample size, n_i, i = 1, …, g, and the populations may not be normal. Under some mild assumptions on covariance matrices, the asymptotic distribution of the test is shown to be normal when n_i, p → ∞. Under the null hypothesis, the test is extended for common covariance matrix to be of a specified structure, including sphericity. Theory of U-statistics is employed in constructing the tests and deriving their limits. Simulations are used to show the accuracy of tests.     

Theory and methods for partitioned Gini coefficients computed on post-stratified data

The Gini coefficient is used to measure inequality in populations. However, shifts in the population distribution may affect subgroups differently. Consequently, it can be informative to examine inequality separately for these segments. Consider an independently and identically distributed sample split based on ranking and compute the Gini coefficient for each partition. These coefficients, calculated from post-stratified data, are not functions of U-statistics. Therefore, previous theoretical and methodological results cannot be applied. In this article, the asymptotic joint distribution is derived for the partitioned coefficients and bootstrap methods for inference are developed. Finally, an application to per capita income across census tracts is examined.     

A class of k-sample distribution-free tests for location against ordered alternatives

This paper introduces a new class of distribution-free tests for testing the homogeneity of several location parameters against ordered alternatives. The proposed class of test statistics is based on a linear combination of two-sample U-statistics based on subsample extremes. The mean and variance of the test statistic are obtained under the null hypothesis as well as under the sequence of local alternatives. The optimal weights are also determined. It is shown via Pitman ARE comparisons that the proposed class of test statistics performs better than its competitor tests in case of heavy-tailed and long-tailed distributions     

Distributed inference for two-sample U-statistics in massive data analysis

This paper considers distributed inference for two-sample U-statistics under the massive data setting. In order to reduce the computational complexity, this paper proposes distributed two-sample U-statistics and blockwise linear two-sample U-statistics. The blockwise linear two-sample U-statistic, which requires less communication cost, is more computationally efficient especially when the data are stored in different locations. The asymptotic properties of both types of distributed two-sample U-statistics are established. In addition, this paper proposes bootstrap algorithms to approximate the distributions of distributed two-sample U-statistics and blockwise linear two-sample U-statistics for both nondegenerate and degenerate cases. The distributed weighted bootstrap for the distributed two-sample U-statistic is new in the literature. The proposed bootstrap procedures are computationally efficient and are suitable for distributed computing platforms with theoretical guarantees. Extensive numerical studies illustrate that the proposed distributed approaches are feasible and effective.     

Multivariate goodness-of-fit tests based on statistically equivalent blocks

Various nonparametric procedures are known for the goodness-of-fit test in the univariate case. The distribution-free nature of these procedures does not extend to the multivariate case. In this paper, we consider an application of the theory of statistically equivalent blocks(SEB)to obtain distribution-free procedures for the multivariate case. The sample values are transformed to random variables which are distributed as sample spacings from a uniform distribution on [0, 1], under the null hypothesis. Various test statistics are known, based on the spacings, which are used for testing uniformity in the univariate case. Any of these statistics can be used in the multivariate situation, based on the spacings generated from the SEB. This paper gives an expository development of the theory of SEB and a review of tests for goodness-of-fit, based on sample spacings. To show an application of the SEB, we consider a test of bivariate normality.     

Laws of large numbers for bootstrappedU-statistics

For the bootstrapped mean, a strong law of large numbers is obtained under the assumption of finiteness of the rth moment, for some r>1, and a weak law of large numbers is obtained under the finiteness of the first moment. The results are then extended to bootstrapped U-statistics under parallel conditions. Stochastic convergence of the jackknifed estimator of the variance of a bootstrapped U-statistic is proved. The asymptotic normality of the bootstrapped pivot and the bias of the bootstrapped U-statistic are indicated.     

Correctings tests for trend in proportions for skewness

We develop the score test for the hypothesis that a parameter of a Markov sequence is constant over time, against the alternatives that it varies over time, i.e., θ_t = θ + U_t; t = 1,2,…, where {U_t; t = 1,2,...} is a sequence of independently and identically distributed random variables with mean zero and variance σ^z _u and θ is a fixed constant. The asymptotic null distribution of the test statistic is proved to be normal. We illustrate our procedure by examples and a real life data analysis.     

An Application of U-Statistics to Nonparametric Functional Data Analysis

Functional regression functions, with explanatory variables taking values in some abstract function space, have been studied extensively. In this article, we aim to investigate the multivariate functional regression function, and propose a nonparametric estimator for the multivariate case. By applying some properties of U-statistics, some asymptotic distributions of such estimator are obtained under different cases.     

Measuring Social Tension from Income Class Segregation

We develop an index that effectively measures the level of social tension generated by income class segregation. We adopt the basic concepts of between-group difference (or alienation) and within-group similarity (or identification) from the income [bi]polarization literature; but we allow for asymmetric degrees of between-group antagonism in the alienation function, and construct a more effective identification function using both the relative degree of within-group clustering and the group size. To facilitate statistical inference, we derive the asymptotic distribution of the proposed measure using results from U-statistics. As the new measure is general enough to include existing income polarization indices as well as the Gini index as special cases, the asymptotic result can be readily applied to these popular indices. Evidence from the Panel Study of Income Dynamics data suggests that, while the level of social tension shows an upward trend over the sample period of 1981 to 2005, government’s taxes and transfers have been effective in reducing the level of social tension significantly.     

Asymptotic expansions of the distributions of the chi-square statistic based on the asymptotically distribution-free theory in covariance structures

An asymptotic expansion of the null distribution of the chi-square statistic based on the asymptotically distribution-free theory for general covariance structures is derived under non-normality. The added higher-order term in the approximate density is given by a weighted sum of those of the chi-square distributed variables with different degrees of freedom. A formula for the corresponding Bartlett correction is also shown without using the above asymptotic expansion. Under a fixed alternative hypothesis, the Edgeworth expansion of the distribution of the standardized chi-square statistic is given up to order O(1/n). From the intermediate results of the asymptotic expansions for the chi-square statistics, asymptotic expansions of the joint distributions of the parameter estimators both under the null and fixed alternative hypotheses are derived up to order O(1/n).     

The asymptotic distributions of maximum likelihood ratio test and maximally selected χ2-test in binomial observations

We considered binomial distributed random variables whose parameters are unknown and some of those parameters need to be estimated. We studied the maximum likelihood ratio test and the maximally selected χ²-test to detect if there is a change in the distributions among the random variables. Their limit distributions under the null hypothesis and their asymptotic distributions under the alternative hypothesis were obtained when the number of the observations is fixed. We discussed the properties of the limit distribution and found an efficient way to calculate the probability of multivariate normal random variables. Finally, those results for both tests have been applied to examples of Lindisfarne's data, the Talipes Data. Our conclusions are consistent with other researchers' findings.     

Testing linear hypotheses in high-dimensional regressions

For a multivariate linear model, Wilk's likelihood ratio test (LRT) constitutes one of the cornerstone tools. However, the computation of its quantiles under the null or the alternative hypothesis requires complex analytic approximations, and more importantly, these distributional approximations are feasible only for moderate dimension of the dependent variable, say p≤20. On the other hand, assuming that the data dimension p as well as the number q of regression variables are fixed while the sample size n grows, several asymptotic approximations are proposed in the literature for Wilk's Λ including the widely used chi-square approximation. In this paper, we consider necessary modifications to Wilk's test in a high-dimensional context, specifically assuming a high data dimension p and a large sample size n. Based on recent random matrix theory, the correction we propose to Wilk's test is asymptotically Gaussian under the null hypothesis and simulations demonstrate that the corrected LRT has very satisfactory size and power, surely in the large p and large n context, but also for moderately large data dimensions such as p=30 or p=50. As a byproduct, we give a reason explaining why the standard chi-square approximation fails for high-dimensional data. We also introduce a new procedure for the classical multiple sample significance test in multivariate analysis of variance which is valid for high-dimensional data.     

Weak identification in probit models with endogenous covariates

Weak identification is a well-known issue in the context of linear structural models. However, for probit models with endogenous explanatory variables, this problem has been little explored. In this paper, we study by simulating the behavior of the usual z-test and the LR test in the presence of weak identification. We find that the usual asymptotic z-test exhibits large level distortions (over-rejections under the null hypothesis). The magnitude of the level distortions depends heavily on the parameter value tested. In contrast, asymptotic LR tests do not over-reject and appear to be robust to weak identification.     

Powerful Parametric Tests Based on Sum‐Functions of Spacings

Assume that we have a sequence of n independent and identically distributed random variables with a continuous distribution function F, which is specified up to a few unknown parameters. In this paper, tests based on sum‐functions of sample spacings are proposed, and large sample theory of the tests are presented under simple null hypotheses as well as under close alternatives. Tests, which are optimal within this class, are constructed, and it is noted that these tests have properties that closely parallel those of the likelihood ratio test in regular parametric models. Some examples are given, which show that the proposed tests work also in situations where the likelihood ratio test breaks down. Extensions to more general hypotheses are discussed.     

Non-Gaussian limit distributions for U-statistics based on trimmed and Winsorized samples

Conditions ensuring the asymptotic normality of U-statistics based on either trimmed samples or Winsorized samples are well known [P. Janssen, R. Serfling, and N. Veraverbeke, Asymptotic normality of U-statistics based on trimmed samples, J. Statist. Plann. Inference 16 (1987), pp. 63–74; U-statistics on Winsorized and trimmed samples, Statist. Probab. Lett. 9 (1990), pp. 439–447]. However, the class of U-statistics has a much richer family of limiting distributions. This paper complements known results by providing general limit theorems for U-statistics based on trimmed or Winsorized samples where the limiting distribution is given in terms of multiple Ito–Wiener stochastic integrals.     

Asymptotics for tests on mean profiles,additional information and dimensionality under non-normality

We consider the comparison of mean vectors for k groups when k is large and sample size per group is fixed. The asymptotic null and non-null distributions of the normal theory likelihood ratio, Lawley–Hotelling and Bartlett–Nanda–Pillai statistics are derived under general conditions. We extend the results to tests on the profiles of the mean vectors, tests for additional information (provided by a sub-vector of the responses over and beyond the remaining sub-vector of responses in separating the groups) and tests on the dimension of the hyperplane formed by the mean vectors. Our techniques are based on perturbation expansions and limit theorems applied to independent but non-identically distributed sequences of quadratic forms in random matrices. In all these four MANOVA problems, the asymptotic null and non-null distributions are normal. Both the null and non-null distributions are asymptotically invariant to non-normality when the group sample sizes are equal. In the unbalanced case, a slight modification of the test statistics will lead to asymptotically robust tests. Based on the robustness results, some approaches for finite approximation are introduced. The numerical results provide strong support for the asymptotic results and finiteness approximations.     

A simple test for comparing regression curves versus one-sided alternatives

In this article we present a simple procedure to test for the null hypothesis of equality of two regression curves versus one-sided alternatives in a general nonparametric and heteroscedastic setup. The test is based on the comparison of the sample averages of the estimated residuals in each regression model under the null hypothesis. The test statistic has asymptotic normal distribution and can detect any local alternative of rate n^-1/2. Some simulations and an application to a data set are included.