Small sample confidence intervals for survival functions under the proportional hazards model

We develop a saddlepoint-based method for generating small sample confidence bands for the population surviival function from the Kaplan-Meier (KM), the product limit (PL), and Abdushukurov-Cheng-Lin (ACL) survival function estimators, under the proportional hazards model. In the process we derive the exact distribution of these estimators and developed mid-ppopulation tolerance bands for said estimators. Our saddlepoint method depends upon the Mellin transform of the zero-truncated survival estimator which we derive for the KM, PL, and ACL estimators. These transforms are inverted via saddlepoint approximations to yield highly accurate approximations to the cumulative distribution functions of the respective cumulative hazard function estimators and these distribution functions are then inverted to produce our saddlepoint confidence bands. For the KM, PL and ACL estimators we compare our saddlepoint confidence bands with those obtained from competing large sample methods as well as those obtained from the exact distribution. In our simulation studies we found that the saddlepoint confidence bands are very close to the confidence bands derived from the exact distribution, while being much easier to compute, and outperform the competing large sample methods in terms of coverage probability.     

Building and Fitting Non‐Gaussian Latent Variable Models via the Moment‐Generating Function

Abstract. For certain classes of hierarchical models, it is easy to derive an expression for the joint moment‐generating function (MGF) of data, whereas the joint probability density has an intractable form which typically involves an integral. The most important example is the class of linear models with non‐Gaussian latent variables. Parameters in the model can be estimated by approximate maximum likelihood, using a saddlepoint‐type approximation to invert the MGF. We focus on modelling heavy‐tailed latent variables, and suggest a family of mixture distributions that behaves well under the saddlepoint approximation (SPA). It is shown that the well‐known normalization issue renders the ordinary SPA useless in the present context. As a solution we extend the non‐Gaussian leading term SPA to a multivariate setting, and introduce a general rule for choosing the leading term density. The approach is applied to mixed‐effects regression, time‐series models and stochastic networks and it is shown that the modified SPA is very accurate.     

Bayesian prediction of waiting times in stochastic models

The authors show how saddlepoint techniques lead to highly accurate approximations for Bayesian predictive densities and cumulative distribution functions in stochastic model settings where the prior is tractable, but not necessarily the likelihood or the predictand distribution. They consider more specifically models involving predictions associated with waiting times for semi‐Markov processes whose distributions are indexed by an unknown parameter θ. Bayesian prediction for such processes when they are not stationary is also addressed and the inverse‐Gaussian based saddlepoint approximation of Wood, Booth & Butler (1993) is shown to accurately deal with the nonstationarity whereas the normal‐based Lugannani & Rice (1980) approximation cannot, Their methods are illustrated by predicting various waiting times associated with M/M/q and M/G/1 queues. They also discuss modifications to the matrix renewal theory needed for computing the moment generating functions that are used in the saddlepoint methods.     

Saddlepoint Approximations for Stopped-Sum Distributions

One of the common used classes of distributions is the stopped-sum class. This class includes Hermite distribution, Polya–Aeppli distribution, Poisson-Gamma distribution, and Neyman type A. This article introduces the saddlepoint approximations to the stopped-sum class in continuous and discrete settings. We discuss approximations for mass/density and cumulative distribution functions of stopped-sum distributions. Examples of continuous and discrete distributions from the Poisson stopped-sum class are presented. Comparisons between saddlepoint approximations and the exact calculations show the great accuracy of the saddlepoint methods.     

Improved Measures of the Spread of Data for Some Unknown Complex Distributions Using Saddlepoint Approximations

Measures of the spread of data for random sums arise frequently in many problems and have a wide range of applications in real life, such as in the insurance field (e.g., the total claim size in a portfolio). The exact distribution of random sums is extremely difficult to determine, and normal approximation usually performs very badly for this complex distributions. A better method of approximating a random-sum distribution involves the use of saddlepoint approximations.

Saddlepoint approximations are powerful tools for providing accurate expressions for distribution functions that are not known in closed form. This method not only yields an accurate approximation near the center of the distribution but also controls the relative error in the far tail of the distribution.

In this article, we discuss approximations to the unknown complex random-sum Poisson–Erlang random variable, which has a continuous distribution, and the random-sum Poisson-negative binomial random variable, which has a discrete distribution. We show that the saddlepoint approximation method is not only quick, dependable, stable, and accurate enough for general statistical inference but is also applicable without deep knowledge of probability theory. Numerical examples of application of the saddlepoint approximation method to continuous and discrete random-sum Poisson distributions are presented.     

Saddlepoint Approximation for Sample and Bootstrap Quantiles

The paper gives the saddlepoint approximation for the distribution function of the sample quantile. A comparison of the saddlepoint approximations for the distribution functions of the sample quantile and the bootstrap quantile shows that the error of the bootstrap approximation to the distribution of the sample quantile obtained by Singh (1981) as an absolute error is actually a relative error.     

A Dimensional CLT for Non-Central Wilks' Lambda in Multivariate Analysis

Abstract.  We consider the non-central distribution of the classical Wilks' lambda statistic for testing the general linear hypothesis in MANOVA. We prove that as the dimension of the observation vector goes to infinity, Wilks' lambda obeys a central limit theorem under simple growth conditions on the non-centrality matrix. In one case we also prove a stronger result: the saddlepoint cumulative distribution function (CDF) approximation for the standardized version of Wilks' lambda converges uniformly on compact sets to the standard normal CDF. These theoretical results go some way towards explaining why saddlepoint approximations to the distribution of Wilks' lambda retain excellent accuracy in high-dimensional cases.     

Bootstrapping survival times in stochastic systems by using saddlepoint approximations

The single bootstrap is implemented by using a saddlepoint approximation to determine estimates for the survival and hazard functions of first-passage times in complicated semi-Markov processes. The double bootstrap is also implemented by resampling saddlepoint inversions and provides BC_a confidence bands for these functions. Confidence intervals for the mean and variance of first-passage times are easily computed. A new characterization of the asymptotic hazard rate for survival times is presented and leads to an indirect method for constructing its bootstrap confidence interval.     

Approximate and estimated saddlepoint approximations

Classical saddlepoint methods, which assume that the cumulant generating function is known, result in an approximation to the distribution that achieves an error of order O(n^?1). The authors give a general theorem to address the accuracy of saddlepoint approximations in which the cumulant generating function has been estimated or approximated. In practice, the resulting saddlepoint approximations are typically of the order O(n^?1/2). The authors give simulation results for small sample examples to compare estimated saddlepoint approximations.     

A uniform saddlepoint expansion for the null‐distribution of the wilcoxon‐mann‐whitney statistic

The authors give the exact coefficient of 1/N in a saddlepoint approximation to the Wilcoxon‐Mann‐Whitney null‐distribution. This saddlepoint approximation is obtained from an Edgeworth approximation to the exponentially tilted distribution. Moreover, the rate of convergence of the relative error is uniformly of order O (1/N) in a large deviation interval as defined in Feller (1971). The proposed method for computing the coefficient of 1/N can be used to obtain the exact coefficients of 1/Nⁱ, for any i. The exact formulas for the cumulant generating function and the cumulants, needed for these results, are those of van Dantzig (1947‐1950).     

Maximum likelihood vs. maximum goodness of fit estimation of the three-parameter Weibull distribution

The use of statistics based on the empirical distribution function is analysed for estimation of the scale, shape, and location parameters of the three-parameter Weibull distribution. The resulting maximum goodness of fit (MGF) estimators are compared with their maximum likelihood counterparts. In addition to the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling statistics, some related empirical distribution function statistics using different weight functions are considered. The results show that the MGF estimators of the scale and shape parameters are usually more efficient than the maximum likelihood estimators when the shape parameter is smaller than 2, particularly if the sample size is large.     

A note on the most powerful invariant test of Rayleigh against exponential distribution

Abstract

The problem of testing Rayleigh distribution against exponentiality, based on a random sample of observations is considered. This problem arises in survival analysis, when testing a linearly increasing hazard function against a constant hazard function. It is shown that for this problem the most powerful invariant test is equivalent to the “ratio of maximized likelihoods” (RML) test. However, since the two families are separate, the RML test statistic does not have the usual asymptotic chi-square distribution. Normal and saddlepoint approximations to the distribution of the RML test statistic are derived. Simulations show that saddlepoint approximation is more accurate than the normal approximation, especially for tail probabilities that are the main values of interest in hypothesis testing.     

Saddlepoint approximations for some models of circular data

In this article we provide saddlepoint approximations for some important models of circular data. The particularity of these saddlepoint approximations is that they do not require solving the saddlepoint equation iteratively, so their evaluation is immediate. We first give very accurate approximations to P-values, critical values and power functions for some optimal tests regarding the concentration parameter under wrapped symmetric α-stable and circular normal models. Then, we consider an approximation to the distribution of a projection of the two-dimensional Pearson random walk with exponential step sizes.     

Saddlepoint approximations to tail expectations under non-Gaussian base distributions: option pricing applications

The saddlepoint approximation formulas provide versatile tools for analytic approximation of the tail expectation of a random variable by approximating the complex Laplace integral of the tail expectation expressed in terms of the cumulant generating function of the random variable. We generalize the saddlepoint approximation formulas for calculating tail expectations from the usual Gaussian base distribution to an arbitrary base distribution. Specific discussion is presented on the criteria of choosing the base distribution that fits better the underlying distribution. Numerical performance and comparison of accuracy are made among different saddlepoint approximation formulas. Improved accuracy of the saddlepoint approximations to tail expectations is revealed when proper base distributions are chosen. We also demonstrate enhanced accuracy of the generalized saddlepoint approximation formulas under non-Gaussian base distributions in pricing European options on continuous integrated variance under the Heston stochastic volatility model.     

Saddlepoint approach to inference for response probabilities under the logistic response model

This paper studies lower confidence limits of response probabilities based on sensitivity testing data set. The saddlepoint approximation to a conditional distribution is developed. Based on it we give a modified algorithm to find approximate confidence limits for the parameter of interest. A simulation study shows that the saddlepoint approximation with proper corrections gives better coverage probability than the direct saddlepoint approximation and the asymptotic normality approximation. Finally, we apply the proposed approximation to a real data set.     

Approximate multivariate conditional inference using the adjusted profile likelihood

The author proposes saddlepoint approximation methods that are adapted to multivariate conditional inference in canonical exponential familles. Several approaches to approximating conditional discrete distributions involve dividing an approximation to the full joint mass function, summed over tail regions of interest, by an approximate marginal density. The author first approximates this conditional likelihood by the adjusted profile likelihood, and then applies a multivariate saddlepoint approximation. He also presents formulas to aid in performing simultaneously the profiling and maximizing steps.     

Simulating random variables using moment-generating functions and the saddlepoint approximation

When we are given only a transform such as the moment-generating function of a distribution, it is rare that we can efficiently simulate random variables. Possible approaches such as the inverse transform using numerical inversion of the transform are computationally very expensive. However, the saddlepoint approximation is known to be exact for the Normal, Gamma, and inverse Gaussian distribution and remarkably accurate for a large number of others. We explore the efficient use of the saddlepoint approximation for simulating distributions and provide three examples of the accuracy of these simulations.     

Asymptotic approximations to the distribution of Kendall's sample τ

This paper provides a saddlepoint approximation to the distribution of the sample version of Kendall's τ, which is a measure of association between two samples. The saddlepoint approximation is compared with the Edgeworth and the normal approximations, and with the bootstrap resampling distribution. A numerical study shows that with small sample sizes the saddlepoint approximation outperforms both the normal and the Edgeworth approximations. This paper gives also an analytical comparison between approximated and exact cumulants of the sample Kendall's τ when the two samples are independent.     

Estimation of discrete survival function for error‐prone diagnostic tests

The product limit or Kaplan‐Meier (KM) estimator is commonly used to estimate the survival function in the presence of incomplete time to event. Application of this method assumes inherently that the occurrence of an event is known with certainty. However, the clinical diagnosis of an event is often subject to misclassification due to assay error or adjudication error, by which the event is assessed with some uncertainty. In the presence of such errors, the true distribution of the time to first event would not be estimated accurately using the KM method. We develop a method to estimate the true survival distribution by incorporating negative predictive values and positive predictive values, into a KM‐like method of estimation. This allows us to quantify the bias in the KM survival estimates due to the presence of misclassified events in the observed data. We present an unbiased estimator of the true survival function and its variance. Asymptotic properties of the proposed estimators are provided, and these properties are examined through simulations. We demonstrate our methods using data from the Viral Resistance to Antiviral Therapy of Hepatitis C study.     

Symbolic computation for approximating distributions of some families of one and two-sample nonparametric test statistics

A conditional saddlepoint approximation was provided by Gatto and Jammalamadaka (1999) for computing the distribution function of many test statistics based on dependent quantities like multinomial frequencies, spacing frequencies, etc. The considerable complexity of the formulas involved can be bypassed by symbolic computation. This article illustrates the effectiveness of symbolic computation to evaluate the saddlepoint approximation for the likelihood ratio, the exponential score, and the Wald-Wolfowitz test statistics. The case of composite hypotheses is also discussed.