Second-order and resampling approximation of finite population U-statistics based on stratified samples

We construct one-term Edgeworth expansions to distributions of U statistics and Studentized U-statistics, based on stratified samples drawn without replacement. Replacing the cumulants defining the expansions by consistent jackknife estimators, we obtain empirical Edgeworth expansions. The expansions provide second-order approximations that improve upon the normal approximation. Theoretical results are illustrated by a simulation study where we compare various approximations to the distribution of the commonly used Gini's mean difference estimator.     

Non Null Asymptotic Distributions of Some Criteria in Censored Exponential Regression

In this article, we consider the class of censored exponential regression models which is very useful for modeling lifetime data. Under a sequence of Pitman alternatives, the asymptotic expansions up to order n^{? 1/2} of the non null distribution functions of the likelihood ratio, Wald, Rao score, and gradient statistics are derive in this class of models. The non null asymptotic distribution functions of these statistics are obtained for testing a composite null hypothesis in the presence of nuisance parameters. The power of all four tests, which are equivalent to first order, are compared based on these non null asymptotic expansions. Furthermore, in order to compare the finite-sample performance of these tests in this class of models, we consider Monte Carlo simulations. We also present an empirical application for illustrative purposes.     

Small sample approximations for spacing statistics

Edgeworth expansions as well as saddle-point methods are used to approximate the distributions of some spacing statistics for small to moderate sample sizes. By comparing with the exact values when available, it is shown that a particular form of Edgeworth expansion produces extremely good results even for fairly small sample sizes. However, this expansion suffers from negative tail probabilities and an accurate approximation without this disadvantage, is shown to be the one based on saddle-point method. Finally, quantiles of some spacing statistics whose exact distributions are not known, are tabulated, making them available in a variety of testing contexts.     

Two-Term Edgeworth Expansions for the Classes of U- and V-statistics

Much effort has been devoted to deriving Edgeworth expansions for various classes of statistics that are asymptotically normally distributed, with derivations tailored to the individual structure of each class. Expansions with smaller error rates are needed for more accurate statistical inference. Two such Edgeworth expansions are derived analytically in this paper. One is a two-term expansion for the standardized U-statistic of order m, m ? 3, with an error rate o(n^{? 1}). The other is an expansion with the same error rate for the distribution of the standardized V-statistic of the same order. In deriving the Edgeworth expansion, we made use of the close connection between the V- and U-statistics, which permits to first derive the needed expansion for the related U-statistic, then extend it to the V-statistic, taking into consideration the estimation of all difference terms between the two statistics.     

Sensitivity of Rao's score test,the Wald test and the likelihood ratio test to nuisance parameters

The purpose of this paper is to compare the sensitivity of the likelihood ratio test, Rao's score test, and the Wald test to the change of the nuisance parameters. The main result is that, with an error of magnitude O(n⁻¹), the null distributions and the local alternative distributions of these tests are equally sensitive to nuisance parameter. We will also give accurate factorizations of these test statistics as quadratic forms, which are themselves useful for asymptotic analyses.     

On the validity of the perturbation method in asymptotic theory

The perturbation methods and the Taylor expansions are very often used to obtain test statistics approximations in multivariate analysis (Specially in Principal Component and Canonical Analyses). These approximations are then used to obtain formal Edgeworth expransions of the distribution functions of the statistics. BHATTACHARYA and GHOSH 1978 have justified these practices under suitable assumptions. In this paper a non classical perturbation problem is solved in order to obtain almost surely expansions of test statistics     

Local power properties of some asymptotic tests in symmetric linear regression models

In this paper we obtain asymptotic expansions, up to order n^−1/2 and under a sequence of Pitman alternatives, for the nonnull distribution functions of the likelihood ratio, Wald, score and gradient test statistics in the class of symmetric linear regression models. This is a wide class of models which encompasses the t model and several other symmetric distributions with longer-than normal tails. The asymptotic distributions of all four statistics are obtained for testing a subset of regression parameters. Furthermore, in order to compare the finite-sample performance of these tests in this class of models, Monte Carlo simulations are presented. An empirical application to a real data set is considered for illustrative purposes.     

Local power of some tests in exponential family nonlinear models

In this paper we obtain asymptotic expansions up to order n^−1/2 for the nonnull distribution functions of the likelihood ratio, Wald, score and gradient test statistics in exponential family nonlinear models (Cordeiro and Paula, 1989), under a sequence of Pitman alternatives. The asymptotic distributions of all four statistics are obtained for testing a subset of regression parameters and for testing the dispersion parameter, thus generalising the results given in Cordeiro et al. (1994) and Ferrari et al. (1997). We also present Monte Carlo simulations in order to compare the finite-sample performance of these tests.     

A Goodness-of-Fit Test for a Class of Autoregressive Conditional Duration Models

This article develops a method for testing the goodness-of-fit of a given parametric autoregressive conditional duration model against unspecified nonparametric alternatives. The test statistics are functions of the residuals corresponding to the quasi maximum likelihood estimate of the given parametric model, and are easy to compute. The limiting distributions of the test statistics are not free from nuisance parameters. Hence, critical values cannot be tabulated for general use. A bootstrap procedure is proposed to implement the tests, and its asymptotic validity is established. The finite sample performances of the proposed tests and several other competing ones in the literature, were compared using a simulation study. The tests proposed in this article performed well consistently throughout, and they were either the best or close to the best. None of the tests performed uniformly the best. The tests are illustrated using an empirical example.     

Simple and accurate one‐sided inference from signed roots of likelihood ratios

The authors propose two methods based on the signed root of the likelihood ratio statistic for one‐sided testing of a simple null hypothesis about a scalar parameter in the présence of nuisance parameters. Both methods are third‐order accurate and utilise simulation to avoid the need for onerous analytical calculations characteristic of competing saddlepoint procedures. Moreover, the new methods do not require specification of ancillary statistics. The methods respect the conditioning associated with similar tests up to an error of third order, and conditioning on ancillary statistics to an error of second order.     

Maximizing a Family of Optimal Statistics over a Nuisance Parameter with Applications to Genetic Data Analysis

In this article, a simple algorithm is used to maximize a family of optimal statistics for hypothesis testing with a nuisance parameter not defined under the null hypothesis. This arises from genetic linkage and association studies and other hypothesis testing problems. The maximum of optimal statistics over the nuisance parameter space can be used as a robust test in this situation. Here, we use the maximum and minimum statistics to examine the sensitivity of testing results with respect to the unknown nuisance parameter. Examples from genetic linkage analysis using affected sub pairs and a candidate-gene association study in case-parents trio design are studied.     

Nonnull asymptotic distributions of the LR,Wald, score and gradient statistics in generalized linear models with dispersion covariates

The class of generalized linear models with dispersion covariates, which allows us to jointly model the mean and dispersion parameters, is a natural extension to the classical generalized linear models. In this paper, we derive the asymptotic expansions under a sequence of Pitman alternatives (up to order n ^?1/2) for the nonnull distribution functions of the likelihood ratio, Wald, Rao score and gradient statistics in this class of models. The asymptotic distributions of these statistics are obtained for testing a subset of regression parameters and for testing a subset of dispersion parameters. Based on these nonnull asymptotic expansions, the power of all four tests, which are equivalent to first order, are compared. Furthermore, we consider Monte Carlo simulations in order to compare the finite-sample performance of these tests in this class of models. We present two empirical applications to two real data sets for illustrative purposes.     

Adjusted Supremum Score‐Type Statistics for Evaluating Non‐Standard Hypotheses

Supremum score test statistics are often used to evaluate hypotheses with unidentifiable nuisance parameters under the null hypothesis. Although these statistics provide an attractive framework to address non‐identifiability under the null hypothesis, little attention has been paid to their distributional properties in small to moderate sample size settings. In situations where there are identifiable nuisance parameters under the null hypothesis, these statistics may behave erratically in realistic samples as a result of a non‐negligible bias induced by substituting these nuisance parameters by their estimates under the null hypothesis. In this paper, we propose an adjustment to the supremum score statistics by subtracting the expected bias from the score processes and show that this adjustment does not alter the limiting null distribution of the supremum score statistics. Using a simple example from the class of zero‐inflated regression models for count data, we show empirically and theoretically that the adjusted tests are superior in terms of size and power. The practical utility of this methodology is illustrated using count data in HIV research.     

Exact Statistical Tests for Heterogeneity of Frequencies Based on Extreme Values

Sophisticated statistical analyses of incidence frequencies are often required for various epidemiologic and biomedical applications. Among the most commonly applied methods is the Pearson's χ² test, which is structured to detect non specific anomalous patterns of frequencies and is useful for testing the significance for incidence heterogeneity. However, the Pearson's χ² test is not efficient for assessing the significance of frequency in a particular cell (or class) to be attributed to chance alone. We recently developed statistical tests for detecting temporal anomalies of disease cases based on maximum and minimum frequencies; these tests are actually designed to test of significance for a particular high or low frequency. The purpose of this article is to demonstrate merits of these tests in epidemiologic and biomedical studies. We show that our proposed methods are more sensitive and powerful for testing extreme cell counts than is the Pearson's χ² test. This feature could provide important and valuable information in epidemiologic or biomeidcal studies. We elucidated and illustrated the differences in sensitivity among our tests and the Pearson's χ² test by analyzing a data set of Langerhans cell histiocytosis cases and its hypothetical sets. We also computed and compared the statistical power of these methods using various sets of cell numbers and alternative frequencies. The investigation of statistical sensitivity and power presented in this work will provide investigators with useful guidelines for selecting the appropriate tests for their studies.     

Testing stochastic orders in tails of contingency tables

Testing for the difference in the strength of bivariate association in two independent contingency tables is an important issue that finds applications in various disciplines. Currently, many of the commonly used tests are based on single-index measures of association. More specifically, one obtains single-index measurements of association from two tables and compares them based on asymptotic theory. Although they are usually easy to understand and use, often much of the information contained in the data is lost with single-index measures. Accordingly, they fail to fully capture the association in the data. To remedy this shortcoming, we introduce a new summary statistic measuring various types of association in a contingency table. Based on this new summary statistic, we propose a likelihood ratio test comparing the strength of association in two independent contingency tables. The proposed test examines the stochastic order between summary statistics. We derive its asymptotic null distribution and demonstrate that the least favorable distributions are chi-bar distributions. We numerically compare the power of the proposed test to that of the tests based on single-index measures. Finally, we provide two examples illustrating the new summary statistics and the related tests.     

A tuning parameter free test for properties of space–time covariance functions

We propose a new nonparametric test to test for symmetry and separability of space–time covariance functions. Unlike the existing nonparametric tests, our test has the attractive convenience of being free of choosing any user-chosen number or smoothing parameter. The asymptotic null distributions of the test statistics are free of nuisance parameters and the critical values have been tabulated in the literature. From a practical point of view, our test is easy to implement and can be readily used by the practitioner. A Monte-Carlo experiment and real data analysis illustrate the finite sample performance of the new test.     

On optimal testing for the equality of equicorrelation: An example of loss in power

Sen Gupta (1988) considered a locally most powerful (LMP) test for testing nonzero values of the equicorrelation coefficient of a standard symmetric multivariate normal distribution. This paper constructs analogous tests for the symmetric multivariate normal distribution. It shows that the new test is uniformly most powerful invariant even in the presence of a nuisance parameter, σ². Further applications of LMP invariant tests to several equicorrelated populations have been considered and an extension to panel data modeling has been suggested.     

Monte carlo approximation to edgeworth expansions

Since the 1930s, empirical Edgeworth expansions have been employed to develop techniques for approximate, nonparametric statistical inference. The introduction of bootstrap methods has increased the potential usefulness of Edgeworth approximations. In particular, a recent paper by Lee & Young introduced a novel approach to approximating bootstrap distribution functions, using first an empirical Edgeworth expansion and then a more traditional bootstrap approximation to the remainder. In principle, either direct calculation or computer algebra could be used to compute the Edgeworth component, but both methods would often be difficult to implement in practice, not least because of the sheer algebraic complexity of a general Edgeworth expansion. In the present paper we show that a simple but nonstandard Monte Carlo technique is a competitive alternative. It exploits properties of Edgeworth expansions, in particular their parity and the degrees of their polynomial terms, to develop particularly accurate approximations.     

Statistical analysis of non-inferiority via non-zero risk difference in stratified matched-pair studies

A stratified study is often designed for adjusting several independent trials in modern medical research. We consider the problem of non-inferiority tests and sample size determinations for a nonzero risk difference in stratified matched-pair studies, and develop the likelihood ratio and Wald-type weighted statistics for testing a null hypothesis of non-zero risk difference for each stratum in stratified matched-pair studies on the basis of (1) the sample-based method and (2) the constrained maximum likelihood estimation (CMLE) method. Sample size formulae for the above proposed statistics are derived, and several choices of weights for Wald-type weighted statistics are considered. We evaluate the performance of the proposed tests according to type I error rates and empirical powers via simulation studies. Empirical results show that (1) the likelihood ratio and the Wald-type CMLE test based on harmonic means of the stratum-specific sample size (SSIZE) weight (the Cochran's test) behave satisfactorily in the sense that their significance levels are much closer to the prespecified nominal level; (2) the likelihood ratio test is better than Nam's [2006. Non-inferiority of new procedure to standard procedure in stratified matched-pair design. Biometrical J. 48, 966–977] score test; (3) the sample sizes obtained by using SSIZE weight are smaller than other weighted statistics in general; (4) the Cochran's test statistic is generally much better than other weighted statistics with CMLE method. A real example from a clinical laboratory study is used to illustrate the proposed methodologies.     

A likelihood ratio test for goodness‐of‐fit of recessive and dominant models for case–control studies

Testing goodness‐of‐fit of commonly used genetic models is of critical importance in many applications including association studies and testing for departure from Hardy–Weinberg equilibrium. Case–control design has become widely used in population genetics and genetic epidemiology, thus it is of interest to develop powerful goodness‐of‐fit tests for genetic models using case–control data. This paper develops a likelihood ratio test (LRT) for testing recessive and dominant models for case–control studies. The LRT statistic has a closed‐form formula with a simple $\chi^{2}(1)$ null asymptotic distribution, thus its implementation is easy even for genome‐wide association studies. Moreover, it has the same power and optimality as when the disease prevalence is known in the population. The Canadian Journal of Statistics 41: 341–352; 2013 © 2013 Statistical Society of Canada