A new family of random graphs for testing spatial segregation

The authors discuss a graph‐based approach for testing spatial point patterns. This approach falls under the category of data‐random graphs, which have been introduced and used for statistical pattern recognition in recent years. The authors address specifically the problem of testing complete spatial randomness against spatial patterns of segregation or association between two or more classes of points on the plane. To this end, they use a particular type of parameterized random digraph called a proximity catch digraph (PCD) which is based on relative positions of the data points from various classes. The statistic employed is the relative density of the PCD, which is a U‐statistic when scaled properly. The authors derive the limiting distribution of the relative density, using the standard asymptotic theory of U‐statistics. They evaluate the finite‐sample performance of their test statistic by Monte Carlo simulations and assess its asymptotic performance via Pitman's asymptotic efficiency, thereby yielding the optimal parameters for testing. They further stress that their methodology remains valid for data in higher dimensions.     

New Tests of Spatial Segregation Based on Nearest Neighbour Contingency Tables

Abstract.  The spatial clustering of points from two or more classes (or species) has important implications in many fields and may cause segregation or association, which are two major types of spatial patterns between the classes. These patterns can be studied using a nearest neighbour contingency table (NNCT) which is constructed using the frequencies of nearest neighbour types. Three new multivariate clustering tests are proposed based on NNCTs using the appropriate sampling distribution of the cell counts in a NNCT. The null patterns considered are random labelling (RL) and complete spatial randomness (CSR) of points from two or more classes. The finite sample performance of these tests are compared with other tests in terms of empirical size and power. It is demonstrated that the newly proposed NNCT tests perform relatively well compared with their competitors and the tests are illustrated using two example data sets.     

Two classes of divergence statistics for testing uniform association

The problem of testing uniform association in cross-classifications having ordered categories is considered. Two families of test statistics, both based on divergences between certain functions of the observed data, are studied and compared. Our theoretical study is based on asymptotic properties. For each family, two consistent approximations to the null distribution of the test statistic are studied: the asymptotic null distribution and a bootstrap estimator; all the tests considered are consistent against fixed alternatives; finally, we do a local power study. Surprisingly, both families detect the same local alternatives. The finite sample performance of the tests in these two classes is numerically investigated through some simulation experiments. In the light of the obtained results, some practical recommendations are given.     

A family of test statistics for trend change in mean residual life with unknown turning point using censored data

In this paper, we develop a family of test statistics for testing exponentiality against increasing then decreasing mean residual life alternatives to accommodate the randomly censored data when neither the change point nor the proportion is known. We establish the asymptotic null distribution of test statistics. Monte Carlo simulations are conducted to investigate the speed of convergence of test statistics to the asymptotic null distribution and study the performance of test statistics by the power of tests.     

Penalized Independence Rule for Testing High-Dimensional Hypotheses

We consider a challenging problem of testing any possible association between a response variable and a set of predictors, when the dimensionality of predictors is much greater than the number of observations. In the context of generalized linear models, a new approach is proposed for testing against high-dimensional alternatives. Our method uses soft-thresholding to suppress stochastic noise and applies the independence rule to borrow strength across the predictors. Moreover, the method can provide a ranked predictor list and automatically select “important” features to retain in the test statistic. We compare the performance of this method with some competing approaches via real data and simulation studies, demonstrating that our method maintains relatively higher power against a wide family of alternatives.     

Tests for a Multiple-Sample Problem in High Dimensions

In this article, we consider the problem of testing the hypothesis on mean vectors in multiple-sample problem when the number of observations is smaller than the number of variables. First we propose an independence rule test (IRT) to deal with high-dimensional effects. The asymptotic distributions of IRT under the null hypothesis as well as under the alternative are established when both the dimension and the sample size go to infinity. Next, using the derived asymptotic power of IRT, we propose an adaptive independence rule test (AIRT) that is particularly designed for testing against sparse alternatives. Our AIRT is novel in that it can effectively pick out a few relevant features and reduce the effect of noise accumulation. Real data analysis and Monte Carlo simulations are used to illustrate our proposed methods.     

An LM-type test for idiosyncratic unit roots in the exact factor model with integrated factors

We consider an exact factor model with integrated factors and propose an LM-type test for unit roots in the idiosyncratic component. We show that, for a fixed number of panel individuals (N) and when the number of time points (T) tends to infinity, the limiting distribution of the LM-type statistic is a weighted sum of independent Chi-square variables with one degree of freedom, and when T tends to infinity followed by N tending to infinity, the limiting distribution is standard normal. The results should contribute to the challenging task of deriving likelihood-based unit-root tests in dynamic factor models.     

Asymptotically Optimal Design Points for Rejection Algorithms

ABSTRACT

Very fast automatic rejection algorithms were developed recently which allow us to generate random variates from large classes of unimodal distributions. They require the choice of several design points which decompose the domain of the distribution into small sub-intervals. The optimal choice of these points is an important but unsolved problem. Therefore, we present an approach that allows us to characterize optimal design points in the asymptotic case (when their number tends to infinity) under mild regularity conditions. We describe a short algorithm to calculate these asymptotically optimal points in practice. Numerical experiments indicate that they are very close to optimal even when only six or seven design points are calculated.     

Testing of two sample proportional intensity assumption for non-homogeneous Poisson processes

For two independent non-homogeneous Poisson processes with unknown intensities we propose a test for testing the hypothesis that the ratio of the intensities is constant versus it is increasing on (0,t]. The existing test procedures for testing such relative trends are based on conditioning on the number of failures observed in (0,t] from the two processes. Our test is unconditional and is based on the original time truncated data which enables us to have meaningful asymptotics. We obtain the asymptotic null distribution (as t becomes large) of the proposed test statistic and show that the proposed test is consistent against several large classes of alternatives. It was observed by Park and Kim (IEEE. Trans. Rehab. 40 (1), 1992, 107–111) that it is difficult to distinguish between the power-law and log-linear processes for certain parameter values. We show that our test is consistent for such alternatives also.     

Asymptotic Optimality of Sparse Linear Discriminant Analysis with Arbitrary Number of Classes

Many sparse linear discriminant analysis (LDA) methods have been proposed to overcome the major problems of the classic LDA in high‐dimensional settings. However, the asymptotic optimality results are limited to the case with only two classes. When there are more than two classes, the classification boundary is complicated and no explicit formulas for the classification errors exist. We consider the asymptotic optimality in the high‐dimensional settings for a large family of linear classification rules with arbitrary number of classes. Our main theorem provides easy‐to‐check criteria for the asymptotic optimality of a general classification rule in this family as dimensionality and sample size both go to infinity and the number of classes is arbitrary. We establish the corresponding convergence rates. The general theory is applied to the classic LDA and the extensions of two recently proposed sparse LDA methods to obtain the asymptotic optimality.     

A nonparametric hypothesis test for heteroscedasticity

In this paper, a hypothesis test for heteroscedasticity is proposed in a nonparametric regression model. The test statistic, which uses the residuals from a nonparametric fit of the mean function, is based on an adaptation of the well-known Levene's test. Using the recent theory for analysis of variance when the number of factor levels goes to infinity, the asymptotic distribution of the test statistic is established under the null hypothesis of homocedasticity and under local alternatives. Simulations suggest that the proposed test performs well in several situations, especially when the variance is a nonlinear function of the predictor.     

Two-stage tests of hypotheses in the general linear model

Two-stage (double sample) tests of hypotheses are presented for testing linear hypotheses in the general linear model. General and one-sided alternatives are considered. Computational techniques for computing critical points are discussed. Tables of critical points are presented. An example suggests that two-stage tests can achieve the same power as a fixed sample size test while reducing considerably the expected number of observations required for the test     

Rényi statistics for testing composite hypotheses in general exponential models

We introduce a family of Rényi statistics of orders r?∈?R for testing composite hypotheses in general exponential models, as alternatives to the previously considered generalized likelihood ratio (GLR) statistic and generalized Wald statistic. If appropriately normalized exponential models converge in a specific sense when the sample size (observation window) tends to infinity, and if the hypothesis is regular, then these statistics are shown to be χ²-distributed under the hypothesis. The corresponding Rényi tests are shown to be consistent. The exact sizes and powers of asymptotically α-size Rényi, GLR and generalized Wald tests are evaluated for a concrete hypothesis about a bivariate Lévy process and moderate observation windows. In this concrete situation the exact sizes of the Rényi test of the order r?=?2 practically coincide with those of the GLR and generalized Wald tests but the exact powers of the Rényi test are on average somewhat better.     

The limiting bound of Efron's W-formula for hypothesis testing when a nuisance parameter is present only under the alternative

When testing a hypothesis with a nuisance parameter present only under the alternative, the maximum of a test statistic over the nuisance parameter space has been proposed. Different upper bounds for the one-sided tail probabilities of the maximum tests were provided. Davies (1977. Biometrika 64, 247–254) studied the problem when the parameter space is an interval, while Efron (1997. Biometrika 84, 143–157) considered the problem with some finite points of the parameter space and obtained a W-formula. We study the limiting bound of Efron's W-formula when the number of points in the parameter space goes to infinity. The conditions under which the limiting bound of the W-formula is identical to that of Davies are given. The results are also extended to two-sided tests. Examples are used to illustrate the conditions, including case-control genetic association studies. Efficient calculations of upper bounds for the tail probability with finite points in the parameter space are described.     

An efficient correction to the density-based empirical likelihood ratio goodness-of-fit test for the inverse Gaussian distribution

The inverse Gaussian (IG) distribution is widely used to model positively skewed data. An important issue is to develop a powerful goodness-of-fit test for the IG distribution. We propose and examine novel test statistics for testing the IG goodness of fit based on the density-based empirical likelihood (EL) ratio concept. To construct the test statistics, we use a new approach that employs a method of the minimization of the discrimination information loss estimator to minimize Kullback–Leibler type information. The proposed tests are shown to be consistent against wide classes of alternatives. We show that the density-based EL ratio tests are more powerful than the corresponding classical goodness-of-fit tests. The practical efficiency of the tests is illustrated by using real data examples.     

A Powerful Method of Assessing the Fit of the Lognormal Distribution

When faced with the problem of goodness-of-fit to the Lognormal distribution, testing methods typically reduce to comparing the empirical distribution function of the corresponding logarithmic data to that of the normal distribution. In this article, we consider a family of test statistics which make use of the moment structure of the Lognormal law. In particular, a continuum of moment conditions is employed in the construction of a new statistic for this distribution. The proposed test is shown to be consistent against fixed alternatives, and a simulation study shows that it is more powerful than several classical procedures, including those utilizing the empirical distribution function. We conclude by applying the proposed method to some, not so typical, data sets.     

Rényi statistics for testing hypotheses in mixed linear regression models

Rényi divergences are used to propose some statistics for testing general hypotheses in mixed linear regression models. The asymptotic distribution of these tests statistics, of the Kullback–Leibler and of the likelihood ratio statistics are provided, assuming that the sample size and the number of levels of the random factors tend to infinity. A simulation study is carried out to analyze and compare the behavior of the proposed tests when the sample size and number of levels are small.     

Modified likelihood ratio tests for unit gamma regressions

Regression analyses are commonly performed with doubly limited continuous dependent variables; for instance, when modeling the behavior of rates, proportions and income concentration indices. Several models are available in the literature for use with such variables, one of them being the unit gamma regression model. In all such models, parameter estimation is typically performed using the maximum likelihood method and testing inferences on the model''s parameters are usually based on the likelihood ratio test. Such a test can, however, deliver quite imprecise inferences when the sample size is small. In this paper, we propose two modified likelihood ratio test statistics for use with the unit gamma regressions that deliver much more accurate inferences when the number of data points in small. Numerical (i.e. simulation) evidence is presented for both fixed dispersion and varying dispersion models, and also for tests that involve nonnested models. We also present and discuss two empirical applications.     

Sample size calculation for testing non-inferiority and equivalence under Poisson distribution

When counting the number of chemical parts in air pollution studies or when comparing the occurrence of congenital malformations between a uranium mining town and a control population, we often assume Poisson distribution for the number of these rare events. Some discussions on sample size calculation under Poisson model appear elsewhere, but all these focus on the case of testing equality rather than testing equivalence. We discuss sample size and power calculation on the basis of exact distribution under Poisson models for testing non-inferiority and equivalence with respect to the mean incidence rate ratio. On the basis of large sample theory, we further develop an approximate sample size calculation formula using the normal approximation of a proposed test statistic for testing non-inferiority and an approximate power calculation formula for testing equivalence. We find that using these approximation formulae tends to produce an underestimate of the minimum required sample size calculated from using the exact test procedure. On the other hand, we find that the power corresponding to the approximate sample sizes can be actually accurate (with respect to Type I error and power) when we apply the asymptotic test procedure based on the normal distribution. We tabulate in a variety of situations the minimum mean incidence needed in the standard (or the control) population, that can easily be employed to calculate the minimum required sample size from each comparison group for testing non-inferiority and equivalence between two Poisson populations.     

Percentage points for directional anderson-darling goodness-of-fit tests

This paper discusses the problem of assessing the asymptotic distribution when parameters of the hypothesized distribution are estimated from a sample, pointing out a common mistake included in the paper by Sinclair, Spurr, and Ahmad (1990) which introduced two modifications of the Anderson-Darling goodness-of-fit test statistic. Their two test statistics modify the popular Anderson-Darling test statistic to be sensitive to departures of the fitted distribution from the true distribution in one or the other of the tails. This paper uses these new test statistics to develop tests of fit for the normal and exponential distributions. Easy to use formulas are given so the reader can perform these tests at any sample size without consulting exhaustive tables of percentage points. Finally a power study is given to demonstrate the test statistics’ viability against a broad range of alternatives.