Asymptotic Expansion and Conditional Robustness for the Sample Multiple Correlation Coefficient Under Nonnormality

ABSTRACT

Asymptotic distributions of the standardized estimators of the squared and non squared multiple correlation coefficients under nonnormality were obtained using Edgeworth expansion up to O(1/n). Conditions for the normal-theory asymptotic biases and variances to hold under nonnormality were derived with respect to the parameter values and the weighted sum of the cumulants of associated variables. The condition for the cumulants indicates a compensatory effect to yield the robust normal-theory lower-order cumulants. Simulations were performed to see the usefulness of the formulas of the asymptotic expansions using the model with the asymptotic robustness under nonnormality, which showed that the approximations by Edgeworth expansions were satisfactory.     

Monte carlo approximation to edgeworth expansions

Since the 1930s, empirical Edgeworth expansions have been employed to develop techniques for approximate, nonparametric statistical inference. The introduction of bootstrap methods has increased the potential usefulness of Edgeworth approximations. In particular, a recent paper by Lee & Young introduced a novel approach to approximating bootstrap distribution functions, using first an empirical Edgeworth expansion and then a more traditional bootstrap approximation to the remainder. In principle, either direct calculation or computer algebra could be used to compute the Edgeworth component, but both methods would often be difficult to implement in practice, not least because of the sheer algebraic complexity of a general Edgeworth expansion. In the present paper we show that a simple but nonstandard Monte Carlo technique is a competitive alternative. It exploits properties of Edgeworth expansions, in particular their parity and the degrees of their polynomial terms, to develop particularly accurate approximations.     

Two-Term Edgeworth Expansions for the Classes of U- and V-statistics

Much effort has been devoted to deriving Edgeworth expansions for various classes of statistics that are asymptotically normally distributed, with derivations tailored to the individual structure of each class. Expansions with smaller error rates are needed for more accurate statistical inference. Two such Edgeworth expansions are derived analytically in this paper. One is a two-term expansion for the standardized U-statistic of order m, m ? 3, with an error rate o(n^{? 1}). The other is an expansion with the same error rate for the distribution of the standardized V-statistic of the same order. In deriving the Edgeworth expansion, we made use of the close connection between the V- and U-statistics, which permits to first derive the needed expansion for the related U-statistic, then extend it to the V-statistic, taking into consideration the estimation of all difference terms between the two statistics.     

Second-order approximations of finite population L-statistics

We construct Edgeworth and empirical Edgeworth approximations to distribution functions of finite population L-statistics and compare their accuracy with that of the normal approximation and the bootstrap approximation in a simulation study.     

Empirical approximations for Hoeffding’s test of bivariate independence using two Weibull extensions

The sampling distributions are generally unavailable in exact form and are approximated either in terms of the asymptotic distributions, or their correction using expansions such as Edgeworth, Laguerre or Cornish–Fisher; or by using transformations analogous to that of Wilson and Hilferty. However, when theoretical routes are intractable, in this electronic age, the sampling distributions can be reasonably approximated using empirical methods. The point is illustrated using the null distribution of Hoeffding’s test of bivariate independence which is important because of its consistency against all dependence alternatives. For constructing the approximations we employ two Weibull extensions, the generalized Weibull and the exponentiated Weibull families, which contain a rich variety of density shapes and tail lengths, and have their distribution functions and quantile functions available in closed form, making them convenient for obtaining the necessary percentiles and p-values. Both approximations are seen to be excellent in terms of accuracy, but that based on the generalized Weibull is more portable.     

An asymptotic representation of a ratio of two statistics and its applications

Some statistics in common use take a form of a ratio of two statistics.In this paper, we will discuss asymptotic properties of the ratio statistic.We obtain an asymptotic representation of the ratio with remainder term o _p(n ^-1) and a Edgeworth expansion with remainder term o(n ^-1/2) And as example, the asymptotic representation and the Edgeworth expansion of the jackknife skewness estimator for U-statistics are established and we discuss the biases of the skewness estimator theoretically.We also apply the result to an estimator of Pearson’s coefficient of variation and the sample correlation coefficient.     

Evaluating the Accuracy of Small P‐Values In Genetic Association Studies Using Edgeworth Expansions

The asymptotic distributions of many classical test statistics are normal. The resulting approximations are often accurate for commonly used significance levels, 0.05 or 0.01. In genome‐wide association studies, however, the significance level can be as low as 1×10⁻⁷, and the accuracy of the p‐values can be challenging. We study the accuracies of these small p‐values are using two‐term Edgeworth expansions for three commonly used test statistics in GWAS. These tests have nuisance parameters not defined under the null hypothesis but estimable. We derive results for this general form of testing statistics using Edgeworth expansions, and find that the commonly used score test, maximin efficiency robust test and the chi‐squared test are second order accurate in the presence of the nuisance parameter, justifying the use of the p‐values obtained from these tests in the genome‐wide association studies.     

On the validity of the perturbation method in asymptotic theory

The perturbation methods and the Taylor expansions are very often used to obtain test statistics approximations in multivariate analysis (Specially in Principal Component and Canonical Analyses). These approximations are then used to obtain formal Edgeworth expransions of the distribution functions of the statistics. BHATTACHARYA and GHOSH 1978 have justified these practices under suitable assumptions. In this paper a non classical perturbation problem is solved in order to obtain almost surely expansions of test statistics     

PROBABILITY APPROXIMATIONS FOR DIVISIBLE DISCRETE DISTRIBUTIONS

If an integer-valued random variable can be represented as a sum of independent random variables, then powerful tools exist to derive approximations to its distribution. We apply this idea to examples in some of which it is not clear how to give a physical interpretation to the independent sum-mands. We consider bounds on the accuracy of single term approximations, Edgeworth expansions and saddlepoint approximations for both individual probabilities and cumulative probabilities.     

Edgeworth Corrections for Realized Volatility

The quality of the asymptotic normality of realized volatility can be poor if sampling does not occur at very high frequencies. In this article we consider an alternative approximation to the finite sample distribution of realized volatility based on Edgeworth expansions. In particular, we show how confidence intervals for integrated volatility can be constructed using these Edgeworth expansions. The Monte Carlo study we conduct shows that the intervals based on the Edgeworth corrections have improved properties relatively to the conventional intervals based on the normal approximation. Contrary to the bootstrap, the Edgeworth approach is an analytical approach that is easily implemented, without requiring any resampling of one's data. A comparison between the bootstrap and the Edgeworth expansion shows that the bootstrap outperforms the Edgeworth corrected intervals. Thus, if we are willing to incur in the additional computational cost involved in computing bootstrap intervals, these are preferred over the Edgeworth intervals. Nevertheless, if we are not willing to incur in this additional cost, our results suggest that Edgeworth corrected intervals should replace the conventional intervals based on the first order normal approximation.     

Notes on Kolassa’s Method for Estimating the Power of Wilcoxon–Mann–Whitney Test

The Kolassa method implemented in the nQuery Advisor software has been widely used for approximating the power of the Wilcoxon–Mann–Whitney (WMW) test for ordered categorical data, in which Edgeworth approximation is used to estimate the power of an unconditional test based on the WMW U statistic. When the sample size is small or when the sizes in the two groups are unequal, Kolassa’s method may yield quite poor approximation to the power of the conditional WMW test that is commonly implemented in statistical packages. Two modifications of Kolassa’s formula are proposed and assessed by simulation studies.     

Edgeworth Corrections for Realized Volatility

The quality of the asymptotic normality of realized volatility can be poor if sampling does not occur at very high frequencies. In this article we consider an alternative approximation to the finite sample distribution of realized volatility based on Edgeworth expansions. In particular, we show how confidence intervals for integrated volatility can be constructed using these Edgeworth expansions. The Monte Carlo study we conduct shows that the intervals based on the Edgeworth corrections have improved properties relatively to the conventional intervals based on the normal approximation. Contrary to the bootstrap, the Edgeworth approach is an analytical approach that is easily implemented, without requiring any resampling of one's data. A comparison between the bootstrap and the Edgeworth expansion shows that the bootstrap outperforms the Edgeworth corrected intervals. Thus, if we are willing to incur in the additional computational cost involved in computing bootstrap intervals, these are preferred over the Edgeworth intervals. Nevertheless, if we are not willing to incur in this additional cost, our results suggest that Edgeworth corrected intervals should replace the conventional intervals based on the first order normal approximation.     

Asymptotic convergence in distribution for spearman's rank correlation coefficient

The Edgeworth expansion for the distribution function of Spearman's rank correlation coefficient may be used to show that the rates of convergence for the normal and Pearson type II approximations are l/nand l/n² respectively. Using the Edgeworth expansion up to terms involving the sixth moment of the exact distribution allows an approximation with an error of order l/n³.     

A Unified Approach to the Approximation of Multivariate Densities

Approximation of a density by another density is considered in the case of different dimensionalities of the distributions. The results have been derived by inverting expansions of characteristic functions with the help of matrix techniques. The approximations obtained are all functions of cumulant differences and derivatives of the approximating density. The multivariate Edgeworth expansion follows from the results as a special case. Furthermore, the density functions of the trace and eigenvalues of the sample covariance matrix are approximated by the multivariate normal density and a numerical example is given     

Application domains for the Delta method

The Delta method uses truncated Lagrange expansions of statistics to obtain approximations to their distributions. In this paper, we consider statistics Y=g(μ+X), where X is any random vector. We obtain domains 𝒟 such that, when μ∈𝒟, we may apply the distribution derived from the Delta method. Namely, we will consider an application on the normal case to illustrate our approach.     

Saddlepoint approximations for nonlinear statistics

It is well known that saddlepoint expansions lead to accurate approximations to the cumulative distributions and densities of a sample mean and other simple linear statistics. The use of such expansions is explored in a broader situation. The saddlepoint formula for the tail probability of a certain type of nonlinear statistic is derived. The relative error of O(n^–1), as in the linear case, is retained. A simple example is considered, to illustrate the great accuracy of the approximation.     

A Two Sample Test for Mean Vectors with Unequal Covariance Matrices

In this paper, we consider testing the equality of two mean vectors with unequal covariance matrices. In the case of equal covariance matrices, we can use Hotelling’s T² statistic, which follows the F distribution under the null hypothesis. Meanwhile, in the case of unequal covariance matrices, the T² type test statistic does not follow the F distribution, and it is also difficult to derive the exact distribution. In this paper, we propose an approximate solution to the problem by adjusting the degrees of freedom of the F distribution. Asymptotic expansions up to the term of order N^{? 2} for the first and second moments of the U statistic are given, where N is the total sample size minus two. A new approximate degrees of freedom and its bias correction are obtained. Finally, numerical comparison is presented by a Monte Carlo simulation.     

Optimal designs for calibration of orientations

This paper concerns designed experiments involving observations of orientations following the models of Prentice (1989) and Rivest &Chang (2006). The authors state minimal conditions on the designs for consistent least squares estimation of the matrix parameters in these models. The conditions are expressed in terms of the axes and rotation angles of the design orientations. The authors show that designs satisfying U₁ + … + U_n = 0 are optimal in the sense of minimizing the estimation error average angular distance. The authors give constructions of optimal n‐point designs when n ≥ 4 and they compare the performance of several designs through approximations and simulation.     

On bootstrap confidence limits for possibly skew distributed statistics

Statistics for which confidence limits or tests are calculated by bootstrap techniques frequently have asymmetric distributions. Approaches based only on boot-strapped variance are inadequatein such cases. In a Mte. Carlo study with a markedly skew X²-distributed statistic an approach by Edgeworth expansions using bootstrapped estimates of variance and skewness of the statistic's distribution performed well with respect to size and power and is proposed for variaus applications.     

A Study of Expansions of Posterior Distributions

Johnson (1970 Johnson , R. ( 1970 ). Asymptotic expansions associated with posterior distributions . Ann. Math. Statist. 41 : 851 – 864 .[Crossref] , [Google Scholar]) obtained expansions for marginal posterior distributions through Taylor expansions. Here, the posterior expansion is expressed in terms of the likelihood and the prior together with their derivatives. Recently, Weng (2010 Weng , R. C. ( 2010 ). A Bayesian Edgeworth expansion by Stein's Identity . Bayesian Anal. 5 ( 4 ): 741 – 764 .[Crossref], [Web of Science ®] , [Google Scholar]) used a version of Stein's identity to derive a Bayesian Edgeworth expansion, expressed by posterior moments. Since the pivots used in these two articles are the same, it is of interest to compare these two expansions.

We found that our O(t ^?1/2) term agrees with Johnson's arithmetically, but the O(t ^?1) term does not. The simulations confirmed this finding and revealed that our O(t ^?1) term gives better performance than Johnson's.