Asymptotic approximations to the distribution of Kendall's sample τ

This paper provides a saddlepoint approximation to the distribution of the sample version of Kendall's τ, which is a measure of association between two samples. The saddlepoint approximation is compared with the Edgeworth and the normal approximations, and with the bootstrap resampling distribution. A numerical study shows that with small sample sizes the saddlepoint approximation outperforms both the normal and the Edgeworth approximations. This paper gives also an analytical comparison between approximated and exact cumulants of the sample Kendall's τ when the two samples are independent.     

Saddlepoint density and distribution functions for the ratio of two linear functions and the product of generalized gamma variates

The generalized gamma distribution is a flexible and attractive distribution because it incorporates several well-known distributions, i.e., gamma, Weibull, Rayleigh, and Maxwell. This article derives saddlepoint density and distribution functions for the ratio of two linear functions of generalized gamma variables and the product of n independent generalized gamma variables. Simulation studies are used to evaluate the accuracy of the saddlepoint approximations. The saddlepoint approximations are fast, easy, and very accurate.     

Approximation of transition densities of stochastic differential equations by saddlepoint methods applied to small-time Ito–Taylor sample-path expansions

Likelihood-based inference for parameters of stochastic differential equation (SDE) models is challenging because for most SDEs the transition density is unknown. We propose a method for estimating the transition density that involves expanding the sample path as an Ito–Taylor series, calculating the moment generating function of the retained terms in the Ito–Taylor expansion, then employing a saddlepoint approximation. We perform a numerical comparison with two other methods similarly based on small-time expansions and discuss the pros and cons of our new method relative to other approaches.     

Saddlepoint Approximations to the Density and the Distribution Functions of Linear Combinations of Ratios of Partial Sums

A class of ratios of partial sums, including Normal, Weibull, Gamma, and Exponential distributions, is considered. The distribution of a linear combination of ratios of partial sums from this class is characterized by the distribution of a linear combination of Dirichlet components. This article presents two saddlepoint approaches to calculate the density and the distribution function for such a class of linear combinations. A simulation study is conducted to assess the performance of the saddlepoint methods and shows the great accuracy of the approximations over the usual asymptotic approximation. Applications of the presented approximations in statistical inferences are discussed.     

On the bootstrap and smoothed bootstrap

The standard bootstrap and two commonly used types of smoothed bootstrap are investigated. The saddlepoint approximations are used to evaluate the accuracy of the three bootstrap estimates of the density of a sample mean. The optimal choice for the smoothing parameter is obtained when smoothing is useful in reducing the mean squared error.     

Saddlepoint Approximations for Stopped-Sum Distributions

One of the common used classes of distributions is the stopped-sum class. This class includes Hermite distribution, Polya–Aeppli distribution, Poisson-Gamma distribution, and Neyman type A. This article introduces the saddlepoint approximations to the stopped-sum class in continuous and discrete settings. We discuss approximations for mass/density and cumulative distribution functions of stopped-sum distributions. Examples of continuous and discrete distributions from the Poisson stopped-sum class are presented. Comparisons between saddlepoint approximations and the exact calculations show the great accuracy of the saddlepoint methods.     

General Saddlepoint Approximation for Testing Separate Location-Scale Families of Hypotheses

For testing separate families of hypotheses, the likelihood ratio test does not have the usual asymptotic properties. This paper considers the asymptotic distribution of the ratio of maximized likelihoods (RML) statistic in the special case of testing separate scale or location-scale families of distributions. We derive saddlepoint approximations to the density and tail probabilities of the log of the RML statistic. These approximations are based on the expansion of the log of the RML statistic up to the second order, which is shown not to depend on the location and scale parameters. The resulting approximations are applied in several cases, including normal versus Laplace, normal versus Cauchy, and Weibull versus log-normal. Our results show that the saddlepoint approximations are satisfactory, even for fairly small sample sizes, and are more accurate than normal approximations and Edgeworth approximations, especially for tail probabilities that are the values of main interest in hypothesis testing problems.     

Saddlepoint <Emphasis Type="Italic">p</Emphasis>-values and confidence intervals for a class of two sample permutation tests for current status and panel count data

The current status and panel count data frequently arise from cancer and tumorigenicity studies when events currently occur. A common and widely used class of two sample tests, for current status and panel count data, is the permutation class. We manipulate the double saddlepoint method to calculate the exact mid-p-values of the underlying permutation distributions of this class of tests. Permutation simulations are replaced by analytical saddlepoint computations which provide extremely accurate mid-p-values that are exact for most practical purposes and almost always more accurate than normal approximations. The method is illustrated using two real tumorigenicity panel count data. To compare the saddlepoint approximation with the normal asymptotic approximation, a simulation study is conducted. The speed and accuracy of the saddlepoint method facilitate the calculation of the confidence interval for the treatment effect. The inversion of the mid-p-values to calculate the confidence interval for the mean rate of development of the recurrent event is discussed.     

Saddlepoint approximations for nonlinear statistics

It is well known that saddlepoint expansions lead to accurate approximations to the cumulative distributions and densities of a sample mean and other simple linear statistics. The use of such expansions is explored in a broader situation. The saddlepoint formula for the tail probability of a certain type of nonlinear statistic is derived. The relative error of O(n^–1), as in the linear case, is retained. A simple example is considered, to illustrate the great accuracy of the approximation.     

Multivariate Saddlepoint test for the wrapped normal model

In this article we show the effectiveness and the accuracy of the test statistic based on the expnnent of the saddlepoint approximation for the density of M-estimators, proposed by Robinson, Ronchetti and Young (1999), for testing simultaneous hypotheses on the mean and on the variance of a wrapped normal distribution. We base this test statistic on the trigonometric method of moments estimator proposed by Gatto and Jammalamadaka (l999b), which admits the M-estimator representation necessary for this test. This test statistic has an approximate chi-squared distribution, asympiotically up to the second order, and the high accuracy of this approximation is shown by numerical simulations.     

Some alternatives to Edgeworth

The Edgeworth expansion is well known as a means for obtaining approximate tail probabilities from information concerning the moments of the distribution. Recent saddlepoint and asymptotic methods lead to several alternative approximations. These alternatives are developed and compared by means of average relative error.     

Coverage accuracy for a mean without third moment

For constructing a confidence interval for the mean of a random variable with a known variance, one may prefer the sample mean standardized by the true standard deviation to the Student's t-statistic since the information of knowing the variance is used in the former way. In this paper, by comparing the leading error term in the expansion of the coverage probability, we show that the above statement is not true when the third moment is infinite. Our theory prefers the Student's t-statistic either when one-sided confidence intervals are considered for a heavier tail distribution or when two-sided confidence intervals are considered. Unlike other existing expansions for the Student's t-statistic, the derived explicit expansion for the case of infinite third moment can be used to estimate the coverage error so that bias correction becomes possible.     

Bootstrapping survival times in stochastic systems by using saddlepoint approximations

The single bootstrap is implemented by using a saddlepoint approximation to determine estimates for the survival and hazard functions of first-passage times in complicated semi-Markov processes. The double bootstrap is also implemented by resampling saddlepoint inversions and provides BC_a confidence bands for these functions. Confidence intervals for the mean and variance of first-passage times are easily computed. A new characterization of the asymptotic hazard rate for survival times is presented and leads to an indirect method for constructing its bootstrap confidence interval.     

Simulation-assisted saddlepoint approximation

A general saddlepoint/Monte Carlo method to approximate (conditional) multivariate probabilities is presented. This method requires a tractable joint moment generating function (m.g.f.), but does not require a tractable distribution or density. The method is easy to program and has a third-order accuracy with respect to increasing sample size in contrast to standard asymptotic approximations which are typically only accurate to the first order.

The method is most easily described in the context of a continuous regular exponential family. Here, inferences can be formulated as probabilities with respect to the joint density of the sufficient statistics or the conditional density of some sufficient statistics given the others. Analytical expressions for these densities are not generally available, and it is often not possible to simulate exactly from the conditional distributions to obtain a direct Monte Carlo approximation of the required integral. A solution to the first of these problems is to replace the intractable density by a highly accurate saddlepoint approximation. The second problem can be addressed via importance sampling, that is, an indirect Monte Carlo approximation involving simulation from a crude approximation to the true density. Asymptotic normality of the sufficient statistics suggests an obvious candidate for an importance distribution.

The more general problem considers the computation of a joint probability for a subvector of random T, given its complementary subvector, when its distribution is intractable, but its joint m.g.f. is computable. For such settings, the distribution may be tilted, maintaining T as the sufficient statistic. Within this tilted family, the computation of such multivariate probabilities proceeds as described for the exponential family setting.     

Infinite Parameter Estimates in Logistic Regression, with Application to Approximate Conditional Inference

This paper discusses recovery of information regarding logistic regression parameters in cases when maximum likelihood estimates of some parameters are infinite. An algorithm for detecting such cases and characterizing the divergence of the parameter estimates is presented. A method for fitting the remaining parameters is also presented . All of these methods rely only on sufficient statistics rather than less aggregated quantities, as required for inference according to the method of Kolassa & Tanner (1994). These results are applied to approximate conditional inference via saddlepoint methods. Specifically, the double saddlepoint method of Skovgaard (1987) is adapted to the case when the solution to the saddlepoint equations exists as a point at infinity     

Saddlepoint p-values for group of linear rank tests

Many nonparametric tests in one sample problem, matched pairs, and competingrisks under censoring have the same underlying permutation distribution. This article proposes a saddlepoint approximation to the exact p-values of these tests instead of the asymptotic approximations. The performance of the saddlepoint approximation is assessed by using simulation studies that show the superiority of the saddlepoint methods over the asymptotic approximations in several settings. The use of the saddlepoint to approximate the p-values of class of two sample tests under complete randomized design is also discussed.     

SADDLEPOINT METHODS FOR BOOTSTRAP CONFIDENCE BANDS IN NONPARAMETRIC REGRESSION

Bootstrap techniques have been used to construct confidence bands in nonparametric regression problems (Härdle & Bowman, 1988). Yet the required simulation is generally computationally intensive and therefore makes it difficult to conduct further investigations. In this paper, two saddlepoint methods are considered as alternatives to the naive simulation procedure. Some improvements to Härdle & Bowman's bootstrap method are suggested. The improvements are numerically verified using these efficient and accurate analytic methods.     

Saddlepoint Approximations for the Difference of Order Statistics and Studentized Sample Quantiles

For a sample from a given distribution the difference of two order statistics and the Studentized quantile are statistics whose distribution is needed to obtain tests and confidence intervals for quantiles and quantile differences. This paper gives saddlepoint approximations for densities and saddlepoint approximations of the Lugannani–Rice form for tail probabilities of these statistics. The relative errors of the approximations are n ⁻¹ uniformly in a neighbourhood of the parameters and this uniformity is global if the densities are log-concave.     

Saddlepoint approach to inference for response probabilities under the logistic response model

This paper studies lower confidence limits of response probabilities based on sensitivity testing data set. The saddlepoint approximation to a conditional distribution is developed. Based on it we give a modified algorithm to find approximate confidence limits for the parameter of interest. A simulation study shows that the saddlepoint approximation with proper corrections gives better coverage probability than the direct saddlepoint approximation and the asymptotic normality approximation. Finally, we apply the proposed approximation to a real data set.     

Log‐rank permutation tests for trend: saddlepoint p‐values and survival rate confidence intervals

Suppose p + 1 experimental groups correspond to increasing dose levels of a treatment and all groups are subject to right censoring. In such instances, permutation tests for trend can be performed based on statistics derived from the weighted log‐rank class. This article uses saddlepoint methods to determine the mid‐P‐values for such permutation tests for any test statistic in the weighted log‐rank class. Permutation simulations are replaced by analytical saddlepoint computations which provide extremely accurate mid‐P‐values that are exact for most practical purposes and almost always more accurate than normal approximations. The speed of mid‐P‐value computation allows for the inversion of such tests to determine confidence intervals for the percentage increase in mean (or median) survival time per unit increase in dosage. The Canadian Journal of Statistics 37: 5‐16; 2009 © 2009 Statistical Society of Canada