Statistical inference about the shape parameter of the exponential power distribution

After being proposed by Smith & Bain (1975), the exponential power distribution has been discussed by many authors. This paper proposes a simple exact statistical test for the shape parameter of an exponential power distribution, as well as an exact confidence interval for the same parameter. Necessary critical values of the test are given. The method provided in this paper can be used for type II censored data. Comparing this method to the existing approaches, this method requires less calculation or less tables, and is easier to use in practice.     

Accurate computation of single and product moments of order statistics under progressive censoring

An accurate procedure is proposed to calculate approximate moments of progressive order statistics in the context of statistical inference for lifetime models. The study analyses the performance of power series expansion to approximate the moments for location and scale distributions with high precision and smaller deviations with respect to the exact values. A comparative analysis between exact and approximate methods is shown using some tables and figures. The different approximations are applied in two situations. First, we consider the problem of computing the large sample variance–covariance matrix of maximum likelihood estimators. We also use the approximations to obtain progressively censored sampling plans for log-normal distributed data. These problems illustrate that the presented procedure is highly useful to compute the moments with precision for numerous censoring patterns and, in many cases, is the only valid method because the exact calculation may not be applicable.     

Tests and limits for the common odds ratio of several 2 × 2 contingency tables: methods in analogy with the Mantel-Haenszel procedure

For a postulated common odds ratio for several 2 × 2 contingency tables one may, by conditioning on the marginals of the seperate tables, determine the exact expectation and variance of the entry in a particular cell of each table, hence for the total of such cells across all tables. This makes it feasible to determine limiting values, via single-degree-of-freedom, continuity-corrected chi-square tests on the common odds ratio–one determines lower and upper limits corresponding to just barely significant chi-square values. The Mantel-Haenszel approach can be viewed as a special application of this, but directed specifically to the case of unity for the odds ratio, for which the expectation and variance formulas are particularly simple. Computation of exact expectations and variances may be feasible only for 2 × 2 tables of limited size, but asymptotic formulas can be applied in other instances.Illustration is given for a particular set of four 2 × 2 tables in which both exact limits and limits by the proposed method could be applied, the two methods giving reasonably good agreement. Both procedures are directed at the distribution of the total over the designated cells, the proposed method treating that distribution as being asymptotically normal. Especially good agreement of proposed with exact limits could be anticipated in more asymptotic situations (overall, not for individual tables) but in practice this may not be demonstrable as the computation of exact limits is then unfeasible.     

Inferences on the lognormal mean for complete samples

In many engineering problems it is necessary to draw statistical inferences on the mean of a lognormal distribution based on a complete sample of observations. Statistical demonstration of mean time to repair (MTTR) is one example. Although optimum confidence intervals and hypothesis tests for the lognormal mean have been developed, they are difficult to use, requiring extensive tables and/or a computer. In this paper, simplified conservative methods for calculating confidence intervals or hypothesis tests for the lognormal mean are presented. In this paper, “conservative” refers to confidence intervals (hypothesis tests) whose infimum coverage probability (supremum probability of rejecting the null hypothesis taken over parameter values under the null hypothesis) equals the nominal level. The term “conservative” has obvious implications to confidence intervals (they are “wider” in some sense than their optimum or exact counterparts). Applying the term “conservative” to hypothesis tests should not be confusing if it is remembered that this implies that their equivalent confidence intervals are conservative. No implication of optimality is intended for these conservative procedures. It is emphasized that these are direct statistical inference methods for the lognormal mean, as opposed to the already well-known methods for the parameters of the underlying normal distribution. The method currently employed in MIL-STD-471A for statistical demonstration of MTTR is analyzed and compared to the new method in terms of asymptotic relative efficiency. The new methods are also compared to the optimum methods derived by Land (1971, 1973).     

Computing Critical Values of Exact Tests by Incorporating Monte Carlo Simulations Combined with Statistical Tables

Various exact tests for statistical inference are available for powerful and accurate decision rules provided that corresponding critical values are tabulated or evaluated via Monte Carlo methods. This article introduces a novel hybrid method for computing p‐values of exact tests by combining Monte Carlo simulations and statistical tables generated a priori. To use the data from Monte Carlo generations and tabulated critical values jointly, we employ kernel density estimation within Bayesian‐type procedures. The p‐values are linked to the posterior means of quantiles. In this framework, we present relevant information from the Monte Carlo experiments via likelihood‐type functions, whereas tabulated critical values are used to reflect prior distributions. The local maximum likelihood technique is employed to compute functional forms of prior distributions from statistical tables. Empirical likelihood functions are proposed to replace parametric likelihood functions within the structure of the posterior mean calculations to provide a Bayesian‐type procedure with a distribution‐free set of assumptions. We derive the asymptotic properties of the proposed nonparametric posterior means of quantiles process. Using the theoretical propositions, we calculate the minimum number of needed Monte Carlo resamples for desired level of accuracy on the basis of distances between actual data characteristics (e.g. sample sizes) and characteristics of data used to present corresponding critical values in a table. The proposed approach makes practical applications of exact tests simple and rapid. Implementations of the proposed technique are easily carried out via the recently developed STATA and R statistical packages.     

Better approximate confidence intervals for a binomial parameter

This paper discusses five methods for constructing approximate confidence intervals for the binomial parameter Θ, based on Y successes in n Bernoulli trials. In a recent paper, Chen (1990) discusses various approximate methods and suggests a new method based on a Bayes argument, which we call method I here. Methods II and III are based on the normal approximation without and with continuity correction. Method IV uses the Poisson approximation of the binomial distribution and then exploits the fact that the exact confidence limits for the parameter of the Poisson distribution can be found through the x² distribution. The confidence limits of method IV are then provided by the Wilson-Hilferty approximation of the x². Similarly, the exact confidence limits for the binomial parameter can be expressed through the F distribution. Method V approximates these limits through a suitable version of the Wilson-Hilferty approximation. We undertake a comparison of the five methods in respect to coverage probability and expected length. The results indicate that method V has an advantage over Chen's Bayes method as well as over the other three methods.     

Asymmetry models for square contingency tables: exact tests via algebraic statistics

Square contingency tables with the same row and column classification occur frequently in a wide range of statistical applications, e.g. whenever the members of a matched pair are classified on the same scale, which is usually ordinal. Such tables are analysed by choosing an appropriate loglinear model. We focus on the models of symmetry, triangular, diagonal and ordinal quasi symmetry. The fit of a specific model is tested by the chi-squared test or the likelihood-ratio test, where p-values are calculated from the asymptotic chi-square distribution of the test statistic or, if this seems unjustified, from the exact conditional distribution. Since the calculation of exact p-values is often not feasible, we propose alternatives based on algebraic statistics combined with MCMC methods.     

Effective directed tests for models with ordered categorical data

This paper offers a new method for testing one‐sided hypotheses in discrete multivariate data models. One‐sided alternatives mean that there are restrictions on the multidimensional parameter space. The focus is on models dealing with ordered categorical data. In particular, applications are concerned with R×C contingency tables. The method has advantages over other general approaches. All tests are exact in the sense that no large sample theory or large sample distribution theory is required. Testing is unconditional although its execution is done conditionally, section by section, where a section is determined by marginal totals. This eliminates any potential nuisance parameter issues. The power of the tests is more robust than the power of the typical linear tests often recommended. Furthermore, computer programs are available to carry out the tests efficiently regardless of the sample sizes or the order of the contingency tables. Both censored data and uncensored data models are discussed.     

Modified method on the means for several log-normal distributions

Among statistical inferences, one of the main interests is drawing the inferences about the log-normal means since the log-normal distribution is a well-known candidate model for analyzing positive and right-skewed data. In the past, the researchers only focused on one or two log-normal populations or used the large sample theory or quadratic procedure to deal with several log-normal distributions. In this article, we focus on making inferences on several log-normal means based on the modification of the quadratic method, in which the researchers often used the vector of the generalized variables to deal with the means of the symmetric distributions. Simulation studies show that the quadratic method performs well only for symmetric distributions. However, the modified procedure fits both symmetric and skew distribution. The numerical results show that the proposed modified procedure can provide the confidence interval with coverage probabilities close to the nominal level and the hypothesis testing performed with satisfactory results.     

Approximate Studentization with marginal and conditional inference

Many inference problems lead naturally to a marginal or conditional measure of departure that depends on a nuisance parameter. As a device for first-order elimination of the nuisance parameter, we suggest averaging with respect to an exact or approximate confidence distribution function. It is shown that for many standard problems where an exact answer is available by other methods, the averaging method reproduces the exact answer. Moreover, for the gamma-mean problem, where the exact answer is not explicitly available, the averaging method gives results that agree closely with those obtained from higher-order asymptotic methods. Examples are discussed; detailed asymptotic calculations will be examined elsewhere.     

On the computation of the noncentral <Emphasis Type="Italic">F</Emphasis> and noncentral beta distribution

Unfortunately many of the numerous algorithms for computing the comulative distribution function (cdf) and noncentrality parameter of the noncentral F and beta distributions can produce completely incorrect results as demonstrated in the paper by examples. Existing algorithms are scrutinized and those parts that involve numerical difficulties are identified. As a result, a pseudo code is presented in which all the known numerical problems are resolved. This pseudo code can be easily implemented in programming language C or FORTRAN without understanding the complicated mathematical background. Symbolic evaluation of a finite and closed formula is proposed to compute exact cdf values. This approach makes it possible to check quickly and reliably the values returned by professional statistical packages over an extraordinarily wide parameter range without any programming knowledge. This research was motivated by the fact that a very useful table for calculating the size of detectable effects for ANOVA tables contains suspect values in the region of large noncentrality parameter values compared to the values obtained by Patnaik’s 2-moment central-F approximation. The cause is identified and the corrected form of the table for ANOVA purposes is given. The accuracy of the approximations to the noncentral-F distribution is also discussed. The authors wish to thank Mr. Richárd Király for his preliminary work. The authors are grateful to the Editor and Associate Editor of STCO and the unknown reviewers for their helpful suggestions.     

On the accuracy of approximate studentization

With a parametric model, a measure of departure for an interest parameter is often easily constructed but frequently depends in distribution on nuisance parameters; the elimination of such nuisance parameter effects is a central problem of statistical inference. Fraser & Wong (1993) proposed a nuisance-averaging or approximate Studentization method for eliminating the nuisance parameter effects. They showed that, for many standard problems where an exact answer is available, the averaging method reproduces the exact answer. Also they showed that, if the exact answer is unavailable, as say in the gamma-mean problem, the averaging method provides a simple approximation which is very close to that obtained from third order asymptotic theory. The general asymptotic accuracy, however, of the method has not been examined. In this paper, we show in a general asymptotic context that the averaging method is asymptotically a second order procedure for eliminating the effects of nuisance parameters.     

An averaging approach to prediction

The problem of predicting a future observation based on an observed sample is discussed. As a device for eliminating the parameter from the conditional distribution of a future observation given the observed sample, we suggest averaging with respect to an exact or approximate confidence distribution function. It is shown that in many standard problems where an exact answer is available by other methods, the averaging method reproduces that exact answer. When the exact answer is not easily available, the averaging method gives a simple and systematic approach to the problems. Applications to life data from exponential distribution and regression problems are examined.     

The left-truncated Weibull distribution: theory and computation

This paper studies the two-parameter, left-truncated Weibull distribution (LTWD) with known, fixed, positive truncation pointT. Important hitherto unknown statistical properties of the LTWD are derived. The asymptotic theory of the maximum likelihood estimates (MLEs) is invoked to develop parameter confidence intervals and regions. Numerical methods are described for computing the MLEs and for evaluating the exact, asymptotic variances and covariances of the MLEs. An illustrative example is given.     

On the fisher β-sufficient partition

This paper shows that the Fisher information in a partition of the space of a random variable X is less than or equal to the Fisher information of X about the unknown parameter. It also provides tables to construct β-sufficient partitions if X has an exponential distribution or a geometric distribution. Simulation study was conducted to show the advantage of using these tables over the usual methods used to construct histograms.     

New critical region tables for Fisher's exact test

The best-known non-asymptotic method for comparing two independent proportions is Fisher's exact text. The usual critical region (CR) tables for this test contain one or more of the following defects:they distinguish between rows and columns; they distinguish between the alternatives H = p1 < p2 and H = p1 > p2; they assume that the error for the two-tailed test is twice that of the one-tailed test; they do not use the optimal version of the test; they do not give both CRs for one and two tails at the same time. All this results in the unnecessary duplication of the space required for the tables, the construction of tables of low-powered methods, or the need to manipulate two different tables (one for the one-tailed test, the other for the two-tailed test). This paper presents CR tables which have been obtained from the most powerful version of Fisher's exact test and which occupy the minimum space possible. The tables, which are valid for one- or two-tailed tests, have levels of significance of 10%, 5% and 1% and values for N (the total size of both samples) of less than or equal to 40. This article shows how to calculate the P value in a specific problem, using the tables as a means of partial checking and as a preliminary step to determining the exact P value.     

Efficient time/space algorithm to compute rectangular probabilities of multinomial, multivariate hypergeometric and multivariate Pólya distributions

The computation of rectangular probabilities of multivariate discrete integer distributions such as the multinomial, multivariate hypergeometric or multivariate Pólya distributions is of great interest both for statistical applications and for probabilistic modeling purpose. All these distributions are members of a broader family of multivariate discrete integer distributions for which computationaly efficient approximate methods have been proposed for the evaluation of such probabilities, but with no control over their accuracy. Recently, exact algorithms have been proposed for computing such probabilities, but they are either dedicated to a specific distribution or to very specific rectangular probabilities. We propose a new algorithm that allows to perform the computation of arbitrary rectangular probabilities in the most general case. Its accuracy matches or even outperforms the accuracy exact algorithms when the rounding errors are taken into account. In the worst case, its computational cost is the same as the most efficient exact method published so far, and is much lower in many situations of interest. It does not need any additional storage than the one for the parameters of the distribution, which allows to deal with large dimension/large counting parameter applications at no extra memory cost and with an acceptable computation time, which is a major difference with respect to the methods published so far.     

Exact Tests of Significance in Higher Dimensional Tables

We describe methods used to provide an exact test of significance of the hypothesis that all factors are mutually independent of each other in 2³ and 2⁴ contingency tables. Several numerical examples demonstrate the advantages of exact tests over approximate significance levels. We give bounds on the number of tables needed to perform this exact significance test. In four or more dimensions the number of tables in this enumeration becomes astronomical with even modest sample sizes. Inverting the characteristic function of the exact distribution has proved useful in these situations.     

Generalized gamma parameter estimation and moment evaluation

The generalized gamma distribution includes the exponential distribution, the gamma distribution, and the Weibull distribution as special cases. It also includes the log-normal distribution in the limit as one of its parameters goes to infinity. Prentice (1974) developed an estimation method that is effective even when the underlying distribution is nearly log-normal. He reparameterized the density function so that it achieved the limiting case in a smooth fashion relative to the new parameters. He also gave formulas for the second partial derivatives of the log-density function to be used in the nearly log-normal case. His formulas included infinite summations, and he did not estimate the error in approximating these summations.

We derive approximations for the log-density function and moments of the generalized gamma distribution that are smooth in the nearly log-normal case and involve only finite summations. Absolute error bounds for these approximations are included. The approximation for the first moment is applied to the problem of estimating the parameters of a generalized gamma distribution under the constraint that the distribution have mean one. This enables the development of a correspondence between the parameters in a mean one generalized gamma distribution and certain parameters in acoustic scattering theory.     

Control Charts for the Variance and Coefficient of Variation Based on Their Predictive Distribution

This article develops a control chart for the variance of a normal distribution and, equivalently, the coefficient of variation of a log-normal distribution. A Bayesian approach is used to incorporate parameter uncertainty, and the control limits are obtained from the predictive distribution for the variance. We evaluate this control chart by examining its performance for various values of the process variance.