Testing Normality Against the Logistic Distribution Using Saddlepoint Approximation

We consider the problem of testing normality against the logistic distribution, based on a random sample of observations. Since the two families are separate (non nested), the ratio of maximized likelihoods (RML) statistic does not have the usual asymptotic chi-square distribution. We derive the saddlepoint approximation to the distribution of the RML statistic and show that this approximation is more accurate than the normal and Edgeworth approximations, especially for tail probabilities that are the main values of interest in hypothesis testing. It is also shown that this test is almost identical to the most powerful invariant test.     

General Saddlepoint Approximation for Testing Separate Location-Scale Families of Hypotheses

For testing separate families of hypotheses, the likelihood ratio test does not have the usual asymptotic properties. This paper considers the asymptotic distribution of the ratio of maximized likelihoods (RML) statistic in the special case of testing separate scale or location-scale families of distributions. We derive saddlepoint approximations to the density and tail probabilities of the log of the RML statistic. These approximations are based on the expansion of the log of the RML statistic up to the second order, which is shown not to depend on the location and scale parameters. The resulting approximations are applied in several cases, including normal versus Laplace, normal versus Cauchy, and Weibull versus log-normal. Our results show that the saddlepoint approximations are satisfactory, even for fairly small sample sizes, and are more accurate than normal approximations and Edgeworth approximations, especially for tail probabilities that are the values of main interest in hypothesis testing problems.     

Multivariate Saddlepoint test for the wrapped normal model

In this article we show the effectiveness and the accuracy of the test statistic based on the expnnent of the saddlepoint approximation for the density of M-estimators, proposed by Robinson, Ronchetti and Young (1999), for testing simultaneous hypotheses on the mean and on the variance of a wrapped normal distribution. We base this test statistic on the trigonometric method of moments estimator proposed by Gatto and Jammalamadaka (l999b), which admits the M-estimator representation necessary for this test. This test statistic has an approximate chi-squared distribution, asympiotically up to the second order, and the high accuracy of this approximation is shown by numerical simulations.     

A Dimensional CLT for Non-Central Wilks' Lambda in Multivariate Analysis

Abstract.  We consider the non-central distribution of the classical Wilks' lambda statistic for testing the general linear hypothesis in MANOVA. We prove that as the dimension of the observation vector goes to infinity, Wilks' lambda obeys a central limit theorem under simple growth conditions on the non-centrality matrix. In one case we also prove a stronger result: the saddlepoint cumulative distribution function (CDF) approximation for the standardized version of Wilks' lambda converges uniformly on compact sets to the standard normal CDF. These theoretical results go some way towards explaining why saddlepoint approximations to the distribution of Wilks' lambda retain excellent accuracy in high-dimensional cases.     

Simulation-assisted saddlepoint approximation

A general saddlepoint/Monte Carlo method to approximate (conditional) multivariate probabilities is presented. This method requires a tractable joint moment generating function (m.g.f.), but does not require a tractable distribution or density. The method is easy to program and has a third-order accuracy with respect to increasing sample size in contrast to standard asymptotic approximations which are typically only accurate to the first order.

The method is most easily described in the context of a continuous regular exponential family. Here, inferences can be formulated as probabilities with respect to the joint density of the sufficient statistics or the conditional density of some sufficient statistics given the others. Analytical expressions for these densities are not generally available, and it is often not possible to simulate exactly from the conditional distributions to obtain a direct Monte Carlo approximation of the required integral. A solution to the first of these problems is to replace the intractable density by a highly accurate saddlepoint approximation. The second problem can be addressed via importance sampling, that is, an indirect Monte Carlo approximation involving simulation from a crude approximation to the true density. Asymptotic normality of the sufficient statistics suggests an obvious candidate for an importance distribution.

The more general problem considers the computation of a joint probability for a subvector of random T, given its complementary subvector, when its distribution is intractable, but its joint m.g.f. is computable. For such settings, the distribution may be tilted, maintaining T as the sufficient statistic. Within this tilted family, the computation of such multivariate probabilities proceeds as described for the exponential family setting.     

An approximation of the distribution function of the LIML identifiability test statistic using the method of moments

This paper contains an application of the asymptotic expansion of a pFp() function to a problem encountered in econometrics. In particular we consider an approximation of the distribution function of the limited information maximum likelihood (LIML) identifiability test statistic using the method of moments. An expression for the Sth order asymptotic approximation of the moments of the LIML identifiability test statistic is derived and tabulated. The exact distribution function of the test statistic is approximated by a member of the class of F (variance ratio) distribution functions having the same first two integer moments. Some tabulations of the approximating distribution function are included.     

Restricted tests for testing independence of time to failure and cause of failure in a competing-risks model

We consider the competing-risks problem without making any assumption concerning the independence of the risks. Maximum-likelihood estimates of the cause-specific hazard rates are obtained under the condition that their ratio is monotone. We also consider the likelihood-ratio test for testing the proportionality of two cause-specific hazard rates against the alternative that the ratio of these two hazard rates is monotonic. This testing problem is equivalent to testing independence against likelihood-ratio dependence of the time to failure and the cause of failure in the competing-risks setup. We allow for random censoring on the right. The asymptotic null distribution of the test statistic is obtained and is found to be of the chi-bar-square type. The problem is extended to the case of more than two risks. A numerical example is given to illustrate the procedure.     

A Laguerre polynomial approximation for a goodness-of-fit test for exponential distribution based on progressively censored data

This paper proposes an approximation to the distribution of a goodness-of-fit statistic proposed recently by Balakrishnan et al. [Balakrishnan, N., Ng, H.K.T. and Kannan, N., 2002, A test of exponentiality based on spacings for progressively Type-II censored data. In: C. Huber-Carol et al. (Eds.), Goodness-of-Fit Tests and Model Validity (Boston: Birkhäuser), pp. 89–111.] for testing exponentiality based on progressively Type-II right censored data. The moments of this statistic can be easily calculated, but its distribution is not known in an explicit form. We first obtain the exact moments of the statistic using Basu's theorem and then the density approximants based on these exact moments of the statistic, expressed in terms of Laguerre polynomials, are proposed. A comparative study of the proposed approximation to the exact critical values, computed by Balakrishnan and Lin [Balakrishnan, N. and Lin, C.T., 2003, On the distribution of a test for exponentiality based on progressively Type-II right censored spacings. Journal of Statistical Computation and Simulation, 73 (4), 277–283.], is carried out. This reveals that the proposed approximation is very accurate.     

On optimal tests for separate hypotheses and conditional probability integral transformations

Consider the problem of testing the composite null hypothesis that a random sample X₁,…,X_n is from a parent which is a member of a particular continuous parametric family of distributions against an alternative that it is from a separate family of distributions. It is shown here that in many cases a uniformly most powerful similar (UMPS) test exists for this problem, and, moreover, that this test is equivalent to a uniformly most powerful invariant (UMPI) test. It is also seen in the method of proof used that the UMPS test statistic Is a function of the statistics U₁,…,U_n?k obtained by the conditional probability integral transformations (CPIT), and thus that no Information Is lost by these transformations, It is also shown that these optimal tests have power that is a nonotone function of the null hypothesis class of distributions, so that, for example, if one additional parameter for the distribution is assumed known, then the power of the test can not lecrease. It Is shown that the statistics U₁, …, U_n?k are independent of the complete sufficient statistic, and that these statistics have important invariance properties. Two examples at given. The UMPS tests for testing the two-parameter uniform family against the two-parameter exponential family, and for testing one truncation parameter distribution against another one are derived.     

Goodness-of-fit tests for the Gompertz distribution

Abstract

While the Gompertz distribution is often fitted to lifespan data, testing whether the fit satisfies theoretical criteria is being neglected. Here four goodness-of-fit measures – the Anderson–Darling statistic, the correlation coefficient test, a statistic using moments, and a nested test against the generalized extreme value distributions – are discussed. Along with an application to laboratory rat data, critical values calculated by the empirical distribution of the test statistics are also presented.     

Approximate and estimated saddlepoint approximations

Classical saddlepoint methods, which assume that the cumulant generating function is known, result in an approximation to the distribution that achieves an error of order O(n^?1). The authors give a general theorem to address the accuracy of saddlepoint approximations in which the cumulant generating function has been estimated or approximated. In practice, the resulting saddlepoint approximations are typically of the order O(n^?1/2). The authors give simulation results for small sample examples to compare estimated saddlepoint approximations.     

Gap-ratio goodness of fit tests for weibull or extreme value distribution assumptions with left or right censored data

With data collection in environmental science and bioassay, left censoring because of nondetects is a problem. Similarly in reliability and life data analysis right censoring frequently occurs. There is a need for goodness of fit tests that can adapt to left or right censored data and be used to check important distributional assumptions without becoming too difficult to regularly implement in practice. A new test statistic is derived from a plot of the standardized spacings between the order statistics versus their ranks. Any linear or curvilinear pattern is evidence against the null distribution. When testing the Weibull or extreme value null hypothesis this statistic has a null distribution that is approximately F for most combinations of sample size and censoring of practical interest. Our statistic is compared to the Mann-Scheuer-Fertig statistic which also uses the standardized spacings between the order statistics. The results of a simulation study show the two tests are competitive in terms of power. Although the Mann-Scheuer-Fertig statistic is somewhat easier to compute, our test enjoys advantages in the accuracy of the F approximation and the availability of a graphical diagnostic.     

SMALL SAMPLE INFERENCE IN LOCATION SCALE MODELS WITH STUDENT(λ) ERRORS

ABSTRACT

A third order accurate approximation to the p value in testing either the location or scale parameter in a location scale model with Student(λ) errors is introduced. The third order approximation is developed via an asymptotic method, based on exponential models and the saddlepoint approximation. Techniques are presented for the numerical computation of all quantities required for the third order approximation. To compare the accuracy of various asymptotic methods a numerical example and simulation study are included. The numerical example and simulation study illustrate that the third order method presented leads to a more accurate p value approximation compared to first order methods in Student(λ) models with small samples.     

Bootstrap procedures for variance breaks test in time series with a changing trend

In this article, we consider the problem of testing for variance breaks in time series in the presence of a changing trend. In performing the test, we employ the cumulative sum of squares (CUSSQ) test introduced by Inclán and Tiao (1994, J.?Amer.?Statist.?Assoc., 89, 913 ? 923). It is shown that CUSSQ test is not robust in the case of broken trend and its asymptotic distribution does not convergence to the sup of a standard Brownian bridge. As a remedy, a bootstrap approximation method is designed to alleviate the size distortions of test statistic while preserving its high power. Via a bootstrap functional central limit theorem, the consistency of these bootstrap procedures is established under general assumptions. Simulation results are provided for illustration and an empirical example of application to a set of high frequency real data is given.     

An L-statistic approach to a test of exponentiality against IFR alternatives

In this note we consider the problem of testing exponentiality against IFR alternatives. A measure of deviation from exponentiality is developed and a test statistic constructed on the basis of this measure. It is shown that the test statistic is an L-statistic. The asymptotic as well as the exact distribution of the test statistic is obtained and the test is shown to be consistent.     

Saddlepoint approximations to tail expectations under non-Gaussian base distributions: option pricing applications

The saddlepoint approximation formulas provide versatile tools for analytic approximation of the tail expectation of a random variable by approximating the complex Laplace integral of the tail expectation expressed in terms of the cumulant generating function of the random variable. We generalize the saddlepoint approximation formulas for calculating tail expectations from the usual Gaussian base distribution to an arbitrary base distribution. Specific discussion is presented on the criteria of choosing the base distribution that fits better the underlying distribution. Numerical performance and comparison of accuracy are made among different saddlepoint approximation formulas. Improved accuracy of the saddlepoint approximations to tail expectations is revealed when proper base distributions are chosen. We also demonstrate enhanced accuracy of the generalized saddlepoint approximation formulas under non-Gaussian base distributions in pricing European options on continuous integrated variance under the Heston stochastic volatility model.     

Testing equality of two normal covariance matrices with monotone missing data

Abstract

The problem of testing equality of two multivariate normal covariance matrices is considered. Assuming that the incomplete data are of monotone pattern, a quantity similar to the Likelihood Ratio Test Statistic is proposed. A satisfactory approximation to the distribution of the quantity is derived. Hypothesis testing based on the approximate distribution is outlined. The merits of the test are investigated using Monte Carlo simulation. Monte Carlo studies indicate that the test is very satisfactory even for moderately small samples. The proposed methods are illustrated using an example.     

Sample Size and Power Calculations for Left-Truncated Normal Distribution

Abstract

Sample size calculation is an important component in designing an experiment or a survey. In a wide variety of fields—including management science, insurance, and biological and medical science—truncated normal distributions are encountered in many applications. However, the sample size required for the left-truncated normal distribution has not been investigated, because the distribution of the sample mean from the left-truncated normal distribution is complex and difficult to obtain. This paper compares an ad hoc approach to two newly proposed methods based on the Central Limit Theorem and on a high degree saddlepoint approximation for calculating the required sample size with the prespecified power. As shown by use of simulations and an example of health insurance cost in China, the ad hoc approach underestimates the sample size required to achieve prespecified power. The method based on the high degree saddlepoint approximation provides valid sample size and power calculations, and it performs better than the Central Limit Theorem. When the sample size is not too small, the Central Limit Theorem also provides a valid, but relatively simple tool to approximate that sample size.     

Saddlepoint approach to inference for response probabilities under the logistic response model

This paper studies lower confidence limits of response probabilities based on sensitivity testing data set. The saddlepoint approximation to a conditional distribution is developed. Based on it we give a modified algorithm to find approximate confidence limits for the parameter of interest. A simulation study shows that the saddlepoint approximation with proper corrections gives better coverage probability than the direct saddlepoint approximation and the asymptotic normality approximation. Finally, we apply the proposed approximation to a real data set.     

A uniform saddlepoint expansion for the null‐distribution of the wilcoxon‐mann‐whitney statistic

The authors give the exact coefficient of 1/N in a saddlepoint approximation to the Wilcoxon‐Mann‐Whitney null‐distribution. This saddlepoint approximation is obtained from an Edgeworth approximation to the exponentially tilted distribution. Moreover, the rate of convergence of the relative error is uniformly of order O (1/N) in a large deviation interval as defined in Feller (1971). The proposed method for computing the coefficient of 1/N can be used to obtain the exact coefficients of 1/Nⁱ, for any i. The exact formulas for the cumulant generating function and the cumulants, needed for these results, are those of van Dantzig (1947‐1950).