Approximate Studentization with marginal and conditional inference

Many inference problems lead naturally to a marginal or conditional measure of departure that depends on a nuisance parameter. As a device for first-order elimination of the nuisance parameter, we suggest averaging with respect to an exact or approximate confidence distribution function. It is shown that for many standard problems where an exact answer is available by other methods, the averaging method reproduces the exact answer. Moreover, for the gamma-mean problem, where the exact answer is not explicitly available, the averaging method gives results that agree closely with those obtained from higher-order asymptotic methods. Examples are discussed; detailed asymptotic calculations will be examined elsewhere.     

On the accuracy of approximate studentization

With a parametric model, a measure of departure for an interest parameter is often easily constructed but frequently depends in distribution on nuisance parameters; the elimination of such nuisance parameter effects is a central problem of statistical inference. Fraser & Wong (1993) proposed a nuisance-averaging or approximate Studentization method for eliminating the nuisance parameter effects. They showed that, for many standard problems where an exact answer is available, the averaging method reproduces the exact answer. Also they showed that, if the exact answer is unavailable, as say in the gamma-mean problem, the averaging method provides a simple approximation which is very close to that obtained from third order asymptotic theory. The general asymptotic accuracy, however, of the method has not been examined. In this paper, we show in a general asymptotic context that the averaging method is asymptotically a second order procedure for eliminating the effects of nuisance parameters.     

A Monte Carlo Method for Estimating Prediction Limit for the Arithmetic Mean of Lognormal Sample

A Monte Carlo (MC) method is suggested for calculating an upper prediction limit for the mean of a future sample of small size N from a lognormal distribution. This is done by obtaining a Monte Carlo estimator of the limit utilizing the future sample generated from the Gibbs sampler. For the Gibbs sampler, a full conditional posterior predictive distribution of each observation in the future sample is derived. The MC method is straightforward to specify distributionally and to implement computationally, with output readily adapted for required inference summaries. In an example, practical application of the method is described.     

The Multi-Sample Block-Scalar Sphericity Test: Exact and Near-Exact Distributions for Its Likelihood Ratio Test Statistic

In this article the authors show how by adequately decomposing the null hypothesis of the multi-sample block-scalar sphericity test it is possible to obtain the likelihood ratio test statistic as well as a different look over its exact distribution. This enables the construction of well-performing near-exact approximations for the distribution of the test statistic, whose exact distribution is quite elaborate and non-manageable. The near-exact distributions obtained are manageable and perform much better than the available asymptotic distributions, even for small sample sizes, and they show a good asymptotic behavior for increasing sample sizes as well as for increasing number of variables and/or populations involved.     

Bayesian estimation and prediction based on generalized Type-II hybrid censored sample

ABSTRACT

In this paper, we consider a general form for the underlying distribution and a general conjugate prior, and develop a general procedure for deriving the maximum likelihood and Bayesian estimators based on an observed generalized Type-II hybrid censored sample. The problems of predicting the future order statistics from the same sample and that from a future sample are also discussed from a Bayesian viewpoint. For the illustration of the developed results, the exponential and Pareto distributions are used as examples. Finally, two numerical examples are presented for illustrating all the inferential procedures developed here.     

On nonparametric Bayesian inference for the distribution of a random sample

The nonparametric Bayesian approach for inference regarding the unknown distribution of a random sample customarily assumes that this distribution is random and arises through Dirichlet-process mixing. Previous work within this setting has focused on the mean of the posterior distribution of this random distribution, which is the predictive distribution of a future observation given the sample. Our interest here is in learning about other features of this posterior distribution as well as about posteriors associated with functionals of the distribution of the data. We indicate how to do this in the case of linear functionals. An illustration, with a sample from a Gamma distribution, utilizes Dirichlet-process mixtures of normals to recover this distribution and its features.     

A general method of inference for two-parameter continuous distributions

Abstract

This article presents a general method of inference of the parameters of a continuous distribution with two unknown parameters. Except in a few distributions such as the normal distribution, the classical approach fails in this context to provide accurate inferences with small samples.Therefore, by taking the generalized approach to inference (cf. Weerahandi, 1995 Weerahandi, S. (1995). Exact Statistical Methods for Data Analysis. New York: Springer Verlag. [Google Scholar]), in this article we present a general method of inference to tackle practically useful two-parameter distributions such as the gamma distribution as well as distributions of theoretical interest such as the two-parameter uniform distribution. The proposed methods are exact in the sense that they are based on exact probability statements and exact expected values. The advantage of taking the generalized approach over the classical approximate inferences is shown via simulation studies.

This article has the potential to motivate much needed further research in non normal regressions, multiparameter problems, and multivariate problems for which basically there are only large sample inferences available. The approach that we take should pave the way for researchers to solve a variety of non normal problems, including ANOVA and MANOVA problems, where even the Bayesian approach fails. In the context of testing of hypotheses, the proposed method provides a superior alternative to the classical generalized likelihood ratio method.     

Order statistics from discrete distributions

Several recurrence relations and identities available for single and product moments of order1 statistics in a sample size n from an arbitrary continuous distribution are extended for the discrete case,, Making use of these recurrence relations it is shown that it is sufficient to evaluate just two single moments and (n-l)/2 product moments when n is odd and two single moments and {n-2)/2 product moments when n is even, in order to evaluate the first, second and product moments of order statistics in a sample of size n drawn from an arbitrary discrete distribution, given these moments in samples of sizes n-1 and less.. A series representation for the product moments of order statistics is derived.. Besides enabling us to obtain an exact and explicit expression for the product moments of order statistics from the geometric distribution, it. makes the computation of the product moments of order statistics from other discrete distributions easy too.     

Improved closed-form prediction intervals for binomial and Poisson distributions

The problems of constructing prediction intervals for the binomial and Poisson distributions are considered. Available approximate, exact and conditional methods for both distributions are reviewed and compared. Simple approximate prediction intervals based on the joint distribution of the past samples and the future sample are proposed. Exact coverage studies and expected widths of prediction intervals show that the new prediction intervals are comparable to or better than the available ones in most cases. The methods are illustrated using two practical examples.     

Generalized Inverse Gamma Distribution and its Application in Reliability

In this article, we introduce a new reliability model of inverse gamma distribution referred to as the generalized inverse gamma distribution (GIG). A generalization of inverse gamma distribution is defined based on the exact form of generalized gamma function of Kobayashi (1991). This function is useful in many problems of diffraction theory and corrosion problems in new machines. The new distribution has a number of lifetime special sub-models. For this model, some of its statistical properties are studied. The method of maximum likelihood is used for estimating the model parameters and the observed information matrix is derived. We also demonstrate the usefulness of this distribution on a real data set.     

Bayesian estimation and prediction based on generalized Type-I hybrid censored sample

In this paper, we consider an exponential form for the underlying distributionand a conjugate prior, and develop a procedure for deriving the maximum likelihood and Bayesian estimators based on an observed generalized Type-I hybrid censored sample. The problems of predicting the future order statistics from the same sample and that from a future sample are also discussed from a Bayesian viewpoint. For the illustration of the developed results, the exponential and Pareto distributions are used as examples. Finally, two numerical examples are presented for illustrating all the inferential procedures developed here.     

Exact inferences of the two-parameter exponential distribution and Pareto distribution with censored data

We develop an exact inference for the location and the scale parameters of the two-exponential distribution and the Pareto distribution based on their maximum-likelihood estimators from the doubly Type-II and the progressive Type-II censored sample. Based on some pivotal quantities, exact confidence intervals and tests of hypotheses are constructed. Exact distributions of the pivotal quantities are expressed as mixtures of linear combinations and of ratios of linear combinations of standard exponential random variables, which facilitates the computation of quantiles of these pivotal quantities. We also provide a bootstrap method for constructing a confidence interval. Some simulation studies are carried out to assess their performances. Using the exact distribution of the scale parameter, we establish an acceptance sampling procedure based on the lifetime of the unit. Some numerical results are tabulated for the illustration. One biometrical example is also given to illustrate the proposed methods.     

An exact Kolmogorov–Smirnov test for the Poisson distribution with unknown mean

We develop an exact Kolmogorov–Smirnov goodness-of-fit test for the Poisson distribution with an unknown mean. This test is conditional, with the test statistic being the maximum absolute difference between the empirical distribution function and its conditional expectation given the sample total. Exact critical values are obtained using a new algorithm. We explore properties of the test, and we illustrate it with three examples. The new test seems to be the first exact Poisson goodness-of-fit test for which critical values are available without simulation or exhaustive enumeration.     

Exact inference and prediction for k-sample exponential case under type-ii censoring

The exact inference and prediction intervals for the K-sample exponential scale parameter under doubly Type-II censored samples are derived using an algorithm of Huffer and Lin [Huffer, F.W. and Lin, C.T., 2001, Computing the joint distribution of general linear combinations of spacings or exponen-tial variates. Statistica Sinica, 11, 1141–1157.]. This approach provides a simple way to determine the exact percentage points of the pivotal quantity based on the best linear unbiased estimator in order to develop exact inference for the scale parameter as well as to construct exact prediction intervals for failure times unobserved in the ith sample. Similarly, exact prediction intervals for failure times of units from a future sample can also be easily obtained.     

A review and some new results on permutation testing for multivariate problems

In recent years permutation testing methods have increased both in number of applications and in solving complex multivariate problems. When available permutation tests are essentially of an exact nonparametric nature in a conditional context, where conditioning is on the pooled observed data set which is often a set of sufficient statistics in the null hypothesis. Whereas, the reference null distribution of most parametric tests is only known asymptotically. Thus, for most sample sizes of practical interest, the possible lack of efficiency of permutation solutions may be compensated by the lack of approximation of parametric counterparts. There are many complex multivariate problems, quite common in empirical sciences, which are difficult to solve outside the conditional framework and in particular outside the method of nonparametric combination (NPC) of dependent permutation tests. In this paper we review such a method and its main properties along with some new results in experimental and observational situations (robust testing, multi-sided alternatives and testing for survival functions).     

Interval estimation for the Pareto distribution based on the progressive Type II censored sample

For the complete sample and the right Type II censored sample, Chen [Joint confidence region for the parameters of Pareto distribution. Metrika 44 (1996), pp. 191–197] proposed the interval estimation of the parameter θ and the joint confidence region of the two parameters of Pareto distribution. This paper proposed two methods to construct the confidence region of the two parameters of the Pareto distribution for the progressive Type II censored sample. A simulation study comparing the performance of the two methods is done and concludes that Method 1 is superior to Method 2 by obtaining a smaller confidence area. The interval estimation of parameter ν is also given under progressive Type II censoring. In addition, the predictive intervals of the future observation and the ratio of the two future consecutive failure times based on the progressive Type II censored sample are also proposed. Finally, one example is given to illustrate all interval estimations in this paper.     

Bayes estimation and prediction of the two-parameter gamma distribution

In this article, the Bayes estimates of two-parameter gamma distribution are considered. It is well known that the Bayes estimators of the two-parameter gamma distribution do not have compact form. In this paper, it is assumed that the scale parameter has a gamma prior and the shape parameter has any log-concave prior, and they are independently distributed. Under the above priors, we use Gibbs sampling technique to generate samples from the posterior density function. Based on the generated samples, we can compute the Bayes estimates of the unknown parameters and can also construct HPD credible intervals. We also compute the approximate Bayes estimates using Lindley's approximation under the assumption of gamma priors of the shape parameter. Monte Carlo simulations are performed to compare the performances of the Bayes estimators with the classical estimators. One data analysis is performed for illustrative purposes. We further discuss the Bayesian prediction of future observation based on the observed sample and it is seen that the Gibbs sampling technique can be used quite effectively for estimating the posterior predictive density and also for constructing predictive intervals of the order statistics from the future sample.     

Approximate studentization for Pareto distribution with application to censored data

The use of the Pareto distribution as a model for various socio-economic phenomena dates back to the late nineteenth century. Recently, it has also been recognized as a useful model for the analysis of lifetime data. In this paper, we apply the approximate studentization method to obtain inference for the scale parameter of the Pareto distribution, and also for the strong Pareto law. Moreover, we extend the method to construct prediction limits for thejth smallest future observation based on the firstk observed data.     

Simultaneous Inferences on the Cumulative Distribution Function of a Normal Distribution

This paper addresses the problem of constructing simultaneous confidence intervals for the cumulative distribution function of a normal distribution at several specified points. The procedure is based upon the observation of a random sample of independent observations from a normal distribution with an unknown mean and variance. A new methodology is proposed for obtaining confidence intervals with a specified overall simultaneous confidence level through the inversion of acceptance sets. Both one-sided and two-sided confidence intervals are considered. Some illustrations of the new method are provided, and comparisons are made with other approaches to the problem.     

The role of weighted distributions in stochastic modeling

C. R. Rao pointed out that “The role of statistical methodology is to extract the relevant information from a given sample to answer specific questions about the parent population” and raised the question “What population does a sample represent”? Wrong specification can lead to invalid inference giving rise to a third kind of error. Rao introduced the concept of weighted distributions as a method of adjustment applicable to many situations.

In this paper, we study the relationship between the weighted distributions and the parent distributions in the context of reliability and life testing. These relationships depend on the nature of the weight function and give rise to interesting connections between the different ageing criteria of the two distributions. As special cases, the length biased distribution, the equilibrium distribution of the backward and forward recurrence times and the residual life distribution, which frequently arise in practice, are studied and their relationships with the original distribution are examined. Their survival functions, failure rates and mean residual life functions are compared and some characterization results are established.