A Mann–Whitney scan statistic for continuous data

ABSTRACT

A new method is proposed for identifying clusters in continuous data indexed by time or by space. The scan statistic we introduce is derived from the well-known Mann–Whitney statistic. It is completely non parametric as it relies only on the ranks of the marks. This scan test seems to be very powerful against any clustering alternative. These results have applications in various fields, such as the study of climate data or socioeconomic data.     

Testing multivariate uniformity: The distance‐to‐boundary method

Given a random sample taken on a compact domain S ? ^d, the authors propose a new method for testing the hypothesis of uniformity of the underlying distribution. The test statistic is based on the distance of every observation to the boundary of S. The proposed test has a number of interesting properties. In particular, it is feasible and particularly suitable for high dimensional data; it is distribution free for a wide range of choices of 5; it can be adapted to the case that the support of S is unknown; and it also allows for one‐sided versions. Moreover, the results suggest that, in some cases, this procedure does not suffer from the well‐known curse of dimensionality. The authors study the properties of this test from both a theoretical and practical point of view. In particular, an extensive Monte Carlo simulation study allows them to compare their methods with some alternative procedures. They conclude that the proposed test provides quite a satisfactory balance between power, computational simplicity, and adaptability to different dimensions and supports.     

Prospective time periodic geographical disease surveillance using a scan statistic

Most disease registries are updated at least yearly. If a geographically localized health hazard suddenly occurs, we would like to have a surveillance system in place that can pick up a new geographical disease cluster as quickly as possible, irrespective of its location and size. At the same time, we want to minimize the number of false alarms. By using a space–time scan statistic, we propose and illustrate a system for regular time periodic disease surveillance to detect any currently 'active' geographical clusters of disease and which tests the statistical significance of such clusters adjusting for the multitude of possible geographical locations and sizes, time intervals and time periodic analyses. The method is illustrated on thyroid cancer among men in New Mexico 1973–1992.     

Testing for two states in a hidden Markov model

The authors consider hidden Markov models (HMMs) whose latent process has m ≥ 2 states and whose state‐dependent distributions arise from a general one‐parameter family. They propose a test of the hypothesis m = 2. Their procedure is an extension to HMMs of the modified likelihood ratio statistic proposed by Chen, Chen & Kalbfleisch (2004) for testing two states in a finite mixture. The authors determine the asymptotic distribution of their test under the hypothesis m = 2 and investigate its finite‐sample properties in a simulation study. Their test is based on inference for the marginal mixture distribution of the HMM. In order to illustrate the additional difficulties due to the dependence structure of the HMM, they show how to test general regular hypotheses on the marginal mixture of HMMs via a quasi‐modified likelihood ratio. They also discuss two applications.     

Testing homogeneity in a mixture of von mises distributions with a structural parameter

The modified likelihood ratio statistic can be used to test the homogeneity in a variety of mixture models. Here, the authors propose the use of the modified and the iterative modified likelihood ratio for testing homogeneity against a two‐component von Mises mixture with a structural parameter. They derive the limiting distributions of the test statistics and propose methods to improve the accuracy of the asymptotic approximation in finite samples. Their simulations show that the tests maintain their nominal level and that they have adequate power. Data on movements of turtles are used as an illustration     

Analyzing multivariate longitudinal binary data: A generalized estimating equations approach

The authors consider regression analysis for binary data collected repeatedly over time on members of numerous small clusters of individuals sharing a common random effect that induces dependence among them. They propose a mixed model that can accommodate both these structural and longitudinal dependencies. They estimate the parameters of the model consistently and efficiently using generalized estimating equations. They show through simulations that their approach yields significant gains in mean squared error when estimating the random effects variance and the longitudinal correlations, while providing estimates of the fixed effects that are just as precise as under a generalized penalized quasi‐likelihood approach. Their method is illustrated using smoking prevention data.     

Parameter Estimation for Inhomogeneous Space‐Time Shot‐Noise Cox Point Processes

We consider the problem of parameter estimation for inhomogeneous space‐time shot‐noise Cox point processes. We explore the possibility of using a stepwise estimation method and dimensionality‐reducing techniques to estimate different parts of the model separately. We discuss the estimation method using projection processes and propose a refined method that avoids projection to the temporal domain. This remedies the main flaw of the method using projection processes – possible overlapping in the projection process of clusters, which are clearly separated in the original space‐time process. This issue is more prominent in the temporal projection process where the amount of information lost by projection is higher than in the spatial projection process. For the refined method, we derive consistency and asymptotic normality results under the increasing domain asymptotics and appropriate moment and mixing assumptions. We also present a simulation study that suggests that cluster overlapping is successfully overcome by the refined method.     

Testing for lack of dependence in the functional linear model

The authors consider the linear model Y_n = ψX_n + ?_n relating a functional response with explanatory variables. They propose a simple test of the nullity of ψ based on the principal component decomposition. The limiting distribution of their test statistic is chi‐squared, but this distribution is also an excellent approximation in finite samples. The authors illustrate their method using data from terrestrial magnetic observatories.     

A spatial scan statistic for survival data based on generalized life distribution

ABSTRACT

For many years, detection of clusters has been of great public health interest and widely studied. Several methods have been developed to detect clusters and their performance has been evaluated in various contexts. Spatial scan statistics are widely used for geographical cluster detection and inference. Different types of discrete or continuous data can be analyzed using spatial scan statistics for Bernoulli, Poisson, ordinal, exponential, and normal models. In this paper, we propose a scan statistic for survival data which is based on generalized life distribution model that provides three important life distributions, viz. Weibull, exponential, and Rayleigh. The proposed method is applied to the survival data of tuberculosis patients in Nainital district of Uttarakhand, India, for the year 2004–05. The Monte Carlo simulation studies reveal that the proposed method performs well for different survival distributions.     

Forecasting mortality rates via density ratio modeling

The authors propose a semiparametric approach to modeling and forecasting age‐specific mortality in the United States. Their method is based on an extension of a class of semiparametric models to time series. It combines information from several time series and estimates the predictive distribution conditional on past data. The conditional expectation, which is the most commonly used predictor in practice, is the first moment of this distribution. The authors compare their method to that of Lee and Carter.     

A nonparametric test for interaction in two‐way layouts

The authors present a new nonparametric approach to test for interaction in two‐way layouts. Based on the concept of composite linear rank statistics, they combine the correlated row and column ranking information to construct the test statistic. They determine the limiting distributions of the proposed test statistic under the null hypothesis and Pitman alternatives. They also propose consistent estimators for the limiting covariance matrices associated with the test. They illustrate the application of their test in practical settings using a microarray data set.     

A new family of random graphs for testing spatial segregation

The authors discuss a graph‐based approach for testing spatial point patterns. This approach falls under the category of data‐random graphs, which have been introduced and used for statistical pattern recognition in recent years. The authors address specifically the problem of testing complete spatial randomness against spatial patterns of segregation or association between two or more classes of points on the plane. To this end, they use a particular type of parameterized random digraph called a proximity catch digraph (PCD) which is based on relative positions of the data points from various classes. The statistic employed is the relative density of the PCD, which is a U‐statistic when scaled properly. The authors derive the limiting distribution of the relative density, using the standard asymptotic theory of U‐statistics. They evaluate the finite‐sample performance of their test statistic by Monte Carlo simulations and assess its asymptotic performance via Pitman's asymptotic efficiency, thereby yielding the optimal parameters for testing. They further stress that their methodology remains valid for data in higher dimensions.     

A J‐function for Inhomogeneous Spatio‐temporal Point Processes

We propose a new summary statistic for inhomogeneous intensity‐reweighted moment stationarity spatio‐temporal point processes. The statistic is defined in terms of the n‐point correlation functions of the point process, and it generalizes the J‐function when stationarity is assumed. We show that our statistic can be represented in terms of the generating functional and that it is related to the spatio‐temporal K‐function. We further discuss its explicit form under some specific model assumptions and derive ratio‐unbiased estimators. We finally illustrate the use of our statistic in practice. © 2014 Board of the Foundation of the Scandinavian Journal of Statistics     

Tests of serial independence based on Kendall's process

The authors propose new rank statistics for testing the white noise hypothesis in a time series. These statistics are Cramér‐von Mises and Kolmogorov‐Smirnov functionals of an empirical distribution function whose mean is related to a serial version of Kendall's tau through a linear transform. The authors determine the asymptotic behaviour of the underlying serial process and the large‐sample distribution of the proposed statistics under the null hypothesis of white noise. They also present simulation results showing the power of their tests.     

On population‐based measures of agreement for binary classifications

The authors describe a model‐based kappa statistic for binary classifications which is interpretable in the same manner as Scott's pi and Cohen's kappa, yet does not suffer from the same flaws. They compare this statistic with the data‐driven and population‐based forms of Scott's pi in a population‐based setting where many raters and subjects are involved, and inference regarding the underlying diagnostic procedure is of interest. The authors show that Cohen's kappa and Scott's pi seriously underestimate agreement between experts classifying subjects for a rare disease; in contrast, the new statistic is robust to changes in prevalence. The performance of the three statistics is illustrated with simulations and prostate cancer data.     

Inference for general parametric functions in box‐Cox‐type transformation models

The authors propose a simple but general method of inference for a parametric function of the Box‐Cox‐type transformation model. Their approach is built upon the classical normal theory but takes parameter estimation into account. It quickly leads to test statistics and confidence intervals for a linear combination of scaled or unsealed regression coefficients, as well as for the survivor function and marginal effects on the median or other quantité functions of an original response. The authors show through simulations that the finite‐sample performance of their method is often superior to the delta method, and that their approach is robust to mild departures from normality of error distributions. They illustrate their approach with a numerical example.     

A bayesian signal detection procedure for scale‐space random fields

The authors consider the problem of searching for activation in brain images obtained from functional magnetic resonance imaging and the corresponding functional signal detection problem. They develop a Bayesian procedure to detect signals existing within noisy images when the image is modeled as a scale space random field. Their procedure is based on the Radon‐Nikodym derivative, which is used as the Bayes factor for assessing the point null hypothesis of no signal. They apply their method to data from the Montreal Neurological Institute.     

Non‐Parametric Change‐Point Tests for Long‐Range Dependent Data

Abstract. We propose a non‐parametric change‐point test for long‐range dependent data, which is based on the Wilcoxon two‐sample test. We derive the asymptotic distribution of the test statistic under the null hypothesis that no change occurred. In a simulation study, we compare the power of our test with the power of a test which is based on differences of means. The results of the simulation study show that in the case of Gaussian data, our test has only slightly smaller power minus.3pt than the ‘difference‐of‐means’ test. For heavy‐tailed data, our test outperforms the ‘difference‐of‐means’ test.     

Testing for error cross-sectional uncorrelatedness in a two-way error components panel data model

This paper proposes a new test for the error cross-sectional uncorrelatedness in a two-way error components panel data model based on large panel data sets. By virtue of an existing statistic under the raw data circumstance, an analogous test statistic using the within residuals of the model is constructed. We show that the resulting statistic needs bias correction to make valid inference, and then propose a method to implement feasible correction. Simulation shows that the test based on the feasible bias-corrected statistic performs well. Additionally, we employ a real data set to illustrate the use of the new test.     

Testing for a Change of the Innovation Distribution in Nonparametric Autoregression: The Sequential Empirical Process Approach

We consider a nonparametric autoregression model under conditional heteroscedasticity with the aim to test whether the innovation distribution changes in time. To this end, we develop an asymptotic expansion for the sequential empirical process of nonparametrically estimated innovations (residuals). We suggest a Kolmogorov–Smirnov statistic based on the difference of the estimated innovation distributions built from the first ?ns?and the last n ? ?ns? residuals, respectively (0 ≤ s ≤ 1). Weak convergence of the underlying stochastic process to a Gaussian process is proved under the null hypothesis of no change point. The result implies that the test is asymptotically distribution‐free. Consistency against fixed alternatives is shown. The small sample performance of the proposed test is investigated in a simulation study and the test is applied to a data example.