Asymptotic expansions of moments and cumulants

This paper shows how procedures for computing moments and cumulants may themselves be computed from a few elementary identities.Many parameters, such as variance, may be expressed or approximated as linear combinations of products of expectations. The estimates of such parameters may be expressed as the same linear combinations of products of averages. The moments and cumulants of such estimates may be computed in a straightforward way if the terms of the estimates, moments and cumulants are represented as lists and the expectation operation defined as a transformation of lists. Vector space considerations lead to a unique representation of terms and hence to a simplification of results. Basic identities relating variables and their expectations induce transformations of lists, which transformations may be computed from the identities. In this way procedures for complex calculations are computed from basic identities.The procedures permit the calculation of results which would otherwise involve complementary set partitions, k-statistics, and pattern functions. The examples include the calculation of unbiased estimates of cumulants, of cumulants of these, and of moments of bootstrap estimates.     

Edgeworth expansions for signed linear rank statistics under near location alternatives

Edgeworth expansions with the uniform remainder of order o(N⁻¹) are established for signed linear rank statistics with regression constants under near location alternatives. The results are obtained both with exact scores and with approximate scores, normalized with natural parameters as well as with simple constants.     

Monte carlo approximation to edgeworth expansions

Since the 1930s, empirical Edgeworth expansions have been employed to develop techniques for approximate, nonparametric statistical inference. The introduction of bootstrap methods has increased the potential usefulness of Edgeworth approximations. In particular, a recent paper by Lee & Young introduced a novel approach to approximating bootstrap distribution functions, using first an empirical Edgeworth expansion and then a more traditional bootstrap approximation to the remainder. In principle, either direct calculation or computer algebra could be used to compute the Edgeworth component, but both methods would often be difficult to implement in practice, not least because of the sheer algebraic complexity of a general Edgeworth expansion. In the present paper we show that a simple but nonstandard Monte Carlo technique is a competitive alternative. It exploits properties of Edgeworth expansions, in particular their parity and the degrees of their polynomial terms, to develop particularly accurate approximations.     

Further asymptotic expansions of the distribution of the sphericity test

In this paper new asymptotic expansions of the distributions of the sphericity test criterion are obtained in the null and the non-null case when the alternatives are close to the hypothesis. These expansions are obtained for the first time in terms of beta distributions. These appear to be better than the ones available in the literature.     

Edgeworth expansion and the bootstrap for stratified sampling without replacement from a finite population

An Edgeworth expansion for a linear combination of stratum means in stratified sampling without replacement from a finite population is derived. The expansion is applied to a bootstrap proposed for this context to show that the bootstrap captures the second-order term of the expansion.     

On the convergence rate of model selection criteria

The goal of the current paper is to compare consistent and inconsistent model selection criteria by looking at their convergence rates (to be defined in the first section). The prototypes of the two types of criteria are the AIC and BIC criterion respectively. For linear regression models with normally distributed errors, we show that the convergence rates for AIC and BIC are 0(n^-1) and 0((n log n)^-1/2) respectively. When the error distributions are unknown, the two criteria become indistinguishable, all having convergence rate O(n^-1/2). We also argue that the BIC criterion has nearly optimal convergence rate. The results partially justified some of the controversial simulation results in which inconsistent criteria seem to outperform consistent ones.     

Asymptotic convergence in distribution for spearman's rank correlation coefficient

The Edgeworth expansion for the distribution function of Spearman's rank correlation coefficient may be used to show that the rates of convergence for the normal and Pearson type II approximations are l/nand l/n² respectively. Using the Edgeworth expansion up to terms involving the sixth moment of the exact distribution allows an approximation with an error of order l/n³.     

Confidence intervals for the ratio of two variances

In this paper we consider confidence intervals for the ratio of two population variances. We propose a confidence interval for the ratio of two variances based on the t-statistic by deriving its Edgeworth expansion and considering Hall's and Johnson's transformations. Then, we consider the coverage accuracy of suggested intervals and intervals based on the F-statistic for some distributions.     

Coverage accuracy for a mean without third moment

For constructing a confidence interval for the mean of a random variable with a known variance, one may prefer the sample mean standardized by the true standard deviation to the Student's t-statistic since the information of knowing the variance is used in the former way. In this paper, by comparing the leading error term in the expansion of the coverage probability, we show that the above statement is not true when the third moment is infinite. Our theory prefers the Student's t-statistic either when one-sided confidence intervals are considered for a heavier tail distribution or when two-sided confidence intervals are considered. Unlike other existing expansions for the Student's t-statistic, the derived explicit expansion for the case of infinite third moment can be used to estimate the coverage error so that bias correction becomes possible.     

The linear and euclidean discriminant functions: a comparison v1a asymptotic expansions and simulation study

This article considers the problem of statistical classification involving multivariate normal populations and compares the performance of the linear discriminant function (LDF) and the Euclidean distance function (EDF), Although the LDF is quite popular and robust, it has been established (Marco, Young and Turner, 1989) that under certain non-trivial conditions, the EDF is "equivalent" to the LDF, in terms of equal probabilities of misclassifica-tion (error rates). Thus it follows that under those conditions the sample EDF could perform better than the sample LDF, since the sample EDF involves estimation of fewer parameters. Sindation results, also from the above paper; seemed to support this hypothesis. This article compares the two sample discriminant functions through asymptotic expansions of error rates, and identifies situations when the sample EDF should perform better than the sample LDF. Results from simulation experiments are also reported and discussed.     

Sequential estimation of the mean of a first-order autoregressive process

This paper considers the problem of sequential point estimation, under an appropriate loss function, of the location parameter when the errors form an autoregressive process with unknown scale and autoregressive parameters, A sequential procedure is developed and an asymptotic second order expansion is provided for the difference between expected stopping time and the optimal fixed sample size procedure. Also, the asymptotic normality of the stopping time is proved. Though the procedure Is asymptotically risk efficient, it. Is not clear whether it has bounded regret.     

Asymptotic expansions for sequential confidence levels in inverse linear regression

Non-linear renewal theory is used to derive second order asymptotic expansions for the coverage probability of a fixed-width sequential confidence interval for an unknown parameter xin the inverse linear regression model. These expansions are obtained for a two-stage sequential procedure, proposed by Perng and Tong (1974) for the construction of a confidence interval for x.     

Asymptotic expansions of the distributions of the chi-square statistic based on the asymptotically distribution-free theory in covariance structures

An asymptotic expansion of the null distribution of the chi-square statistic based on the asymptotically distribution-free theory for general covariance structures is derived under non-normality. The added higher-order term in the approximate density is given by a weighted sum of those of the chi-square distributed variables with different degrees of freedom. A formula for the corresponding Bartlett correction is also shown without using the above asymptotic expansion. Under a fixed alternative hypothesis, the Edgeworth expansion of the distribution of the standardized chi-square statistic is given up to order O(1/n). From the intermediate results of the asymptotic expansions for the chi-square statistics, asymptotic expansions of the joint distributions of the parameter estimators both under the null and fixed alternative hypotheses are derived up to order O(1/n).     

A modification of the Fisher-Cornish approximation for the student t percentiles

An asymptotic expansion of the Student t distribution is derived by expanding the standardized Student t distribution in terms of the normal distribution. This expansion is inverted to obtain corresponding asymptotic expansions for the Student t percentiles as functions of the standard normal percentiles0 Using the first two, three or four terms of these expansions, we get approximations of the Student t percentiles which are generally more accurate than the approximations given by Fisher and Cornish(1960) and Koehler (1983).An approximation of the distribution function obtained from this expansion is compared with the approximations discussed by Ling (1978) andfound to be more accurate for moderate degrees of freedom.     

On the relative accuracy of certain bootstrap procedures

We show the second-order relative accuracy, on bounded sets, of the Studentized bootstrap, exponentially tilted bootstrap and nonparametric likelihood tilted bootstrap, for means and smooth functions of means. We also consider the relative errors for larger deviations. Our method exploits certain connections between Edgeworth and saddlepoint approximations to simplify the computations.     

Saddlepoint approximations to exact tests and improved likelihood ratio tests for the gamma distribution

For the most common one-sample and two-sample tests in the gamma distribution we derive the log likelihood ratio tests and the improved versions obtained by a Bartlett adjustment. For most of these tests an exact test exists and we give the saddlepoint approximation to the latter. The tests are compared with previously published tests and a small simulation study is included.     

Asymptotic cumulants of the estimator of the canonical parameter in the exponential family

Asymptotic cumulants of the maximum likelihood estimator of the canonical parameter in the exponential family are obtained up to the fourth order with the added higher-order asymptotic variance. In the case of a scalar parameter, the corresponding results with and without studentization are given. These results are also obtained for the estimators by the weighted score, especially for those using the Jeffreys prior. The asymptotic cumulants are used for reducing bias and mean square error to improve a point estimator and for interval estimation to have higher-order accuracy. It is shown that the kurtosis to squared skewness ratio of the sufficient statistic plays a fundamental role.     

Hypotheses testing for a multidimensional parameter of inhomogeneous Poisson processes

We observe a realization of an inhomogeneous Poisson process whose intensity function depends on an unknown multidimensional parameter. We consider the asymptotic behaviour of the Rao score test for a simple null hypothesis against the multilateral alternative. By using the Edgeworth type expansion (under the null hypothesis) for a vector of stochastic integrals with respect to the Poisson process, we refine the (classic) threshold of the test (obtained by the central limit theorem), which improves the first type probability of error. The expansion allows us to describe the power of the test under the local alternative, i.e. a sequence of alternatives, which converge to the null hypothesis with a certain rate. The rates can be different for components of the parameter.     

The Cornish-Fisher expansion for a class of statistics in first order autoregression

ABSTRACT

This article is concerned with the derivation and study of the Cornish-Fisher expansion for a wide class of estimators of the parameter in the first order autoregressive process. Second and third order Cornish-Fisher approximations to the quantile of the distribution of the corresponding asymptotically normal standardized statistic are stated explicitly and their accuracy is examined, both theoretically and numerically, by comparing them with the exact value of the quantile obtained by Monte Carlo simulation.     

Maximum Entropy Approximations for Asymptotic Distributions of Smooth Functions of Sample Means

Abstract. We propose an information‐theoretic approach to approximate asymptotic distributions of statistics using the maximum entropy (ME) densities. Conventional ME densities are typically defined on a bounded support. For distributions defined on unbounded supports, we use an asymptotically negligible dampening function for the ME approximation such that it is well defined on the real line. We establish order n^?1 asymptotic equivalence between the proposed method and the classical Edgeworth approximation for general statistics that are smooth functions of sample means. Numerical examples are provided to demonstrate the efficacy of the proposed method.