On Hacking's fiducial theory of inference

Fisher's theory of fiducial inference is known to lead to mathematical inconsistencies. Hacking (1965) puts forward a new basis for fiducial inference. In this paper we have presented Hacking's theory retaining his original terminology but replacing his notation by more usual mathematical notation. His condition of irrelevance is derived in an explicit mathematical form, making it more comprehensible to statisticians. Further an example is constructed to show that Hacking's theory also leads to mathematical inconsistencies.     

Generalized fiducial inference for generalized exponential distribution

This article mainly considers interval estimation of the scale and shape parameters of the generalized exponential (GE) distribution. We adopt the generalized fiducial method to construct a kind of new confidence intervals for the parameters of interest and compare them with the frequentist and Bayesian methods. In addition, we give the comparison of the point estimation based on the frequentist, generalized fiducial and Bayesian methods. Simulation results show that a new procedure based on generalized fiducial inference is more applicable than the non-fiducial methods for the point and interval estimation of the GE distribution. Finally, two lifetime data sets are used to illustrate the application of our new procedure.     

Bayesian and fiducial inference for the inverse gaussian distribution via Gibbs sampler

This paper presents a kernel estimation of the distribution of the scale parameter of the inverse Gaussian distribution under type II censoring together with the distribution of the remaining time. Estimation is carried out via the Gibbs sampling algorithm combined with a missing data approach. Estimates and confidence intervals for the parameters of interest are also presented.     

A fiducial approach to multiple comparisons

Comparing treatment means from populations that follow independent normal distributions is a common statistical problem. Many frequentist solutions exist to test for significant differences amongst the treatment means. A different approach would be to determine how likely it is that particular means are grouped as equal. We developed a fiducial framework for this situation. Our method provides fiducial probabilities that any number of means are equal based on the data and the assumed normal distributions. This methodology was developed when there is constant and non-constant variance across populations. Simulations suggest that our method selects the correct grouping of means at a relatively high rate for small sample sizes and asymptotic calculations demonstrate good properties. Additionally, we have demonstrated the flexibility in the methods ability to calculate the fiducial probability for any number of equal means. This was done by analyzing a simulated data set and a data set measuring the nitrogen levels of red clover plants that were inoculated with different treatments.     

Composite transformation models: A fiducial perspective

This paper discusses inferences for the parameters of a transformation model in the presence of a scalar nuisance parameter that describes the shape of the error distribution. The development is from the point of view of conditional inference and thus is an attempt to extend the classical fiducial (or structural inference) argument. For known shape parameter it is straightforward to derive a fiducial distribution of the transformation parameters from which confidence points can be obtained. For unknown shape parameter, the paper discusses a certain average of these fiducial distributions. The weights used in this averaging process are naturally induced by the action of the underlying group of transformations and correspond to a noninformative prior for the nuisance parameter. This results in a confidence distribution for the transformation parameters which in some cases has good frequentist properties. The method is illustrated by some examples.     

On fiducial generators

Fiducial inference has been gaining presence recently and it is the intention of the present article to look at the notion of fiducial generators; meaning procedures to simulate parameter values that in some sense correspond to simulations from some implicit fiducial distribution. It is well known that when the distribution has group structure, stemming from the natural pivotal associated, a fiducial may be obtained. It is in the non group distributions that there appears to be still room for finding a fiducial distribution. Recently some general procedures have been proposed for dealing with generalized fiducials, but these depend on certain choices for a structural equation or a fiducial equation, as in Hannig (2009 Hannig, J. (2009). On generalized fiducial inference. Stat. Sin. 19:491–544.[Web of Science ®] , [Google Scholar]) or Taraldsen and Lindqvist (2013 Taraldsen, G., Lindqvist, B.H. (2013). Fiducial theory and optimal inference. Ann. Stat. 41(1):323–341.[Crossref], [Web of Science ®] , [Google Scholar]), respectively. A brief presentation is made of an earlier approach to fiducial inference for multivariate parameters, as in Brillinger (1962 Brillinger, D.R. (1962). Examples bearing on the definition of fiducial probability with a bibliography. Ann. Math. Stat. 33(4):1349–1355.[Crossref] , [Google Scholar]), and the implied fiducial generator introduced in Engen and Lillegård (1997 Engen, S., Lillegård, M. (1997). Stochastic simulation conditioned on sufficient statistics. Biometrika 84(1):235–240.[Crossref], [Web of Science ®] , [Google Scholar]), trying to connect them. Three interesting non group distributions are seen; two of them, the truncated exponential and the two-parameter gamma, already reported in literature. A third non group distribution is analyzed; the inverse Gaussian, connecting the fiducial that results following Brillinger (1962 Brillinger, D.R. (1962). Examples bearing on the definition of fiducial probability with a bibliography. Ann. Math. Stat. 33(4):1349–1355.[Crossref] , [Google Scholar]), with a result pertaining confidence limits for the shape parameter in Hsieh (1990 Hsieh, H.K. (1990). Inferences on the coefficient of variation of an inverse-Gaussian distribution. Commun. Stat. - Theory Methods 19(5):1589–1605.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). In the three cases, comparisons are made with the Bayesian posteriors that have been known to be close numerically. Some discussion is made on the issue of singularities of the fiducial density and its connection with densities that do not integrate to unity. As to the case of discrete observables, some comments are made for the Bernoulli distribution, only.     

A fiducial p-value approach for comparing heteroscedastic regression models

To study the equality of regression coefficients in several heteroscedastic regression models, we propose a fiducial-based test, and theoretically examine the frequency property of the proposed test. We numerically compare the performance of the proposed approach with the parametric bootstrap (PB) approach. Simulation results indicate that the fiducial approach controls the Type I error rates satisfactorily regardless of the number of regression models and sample sizes, whereas the PB approach tends to be a little of liberal in some scenarios. Finally, the proposed approach is applied to an analysis of a real dataset for illustration.     

On the validation of fiducial techniques

A structured model is essentially a family of random vectors X_θ defined on a probability space with values in a sample space. If, for a given sample value x and for each ω in the probability space, there is at most one parameter value θ for which X_θ(ω) is equal to x, then the model is called additive at x. When a certain conditional distribution exists, a frequency interpretation specific to additive structured models holds, and is summarized in a unique structured distribution for the parameter. Many of the techniques used by Fisher in deriving and handling his fiducial probability distribution are shown to be valid when dealing with a structured distribution.     

The fiducial argument and hacking's principle of irrelevance

In a searching analysis of the fiducial argument Hacking (1965) proposed the Principle of Irrelevance as a condition under which the argument is valid. His statement of the Principle was essentially non-mathematical and this paper presents a mathematical development of the Principle. The relationship with likelihood inference is explored and some of the proposed counter-examples to fiducial theory are considered. It is shown that even with the Principle of Irrelevance examples of non-uniqueness of fiducial distributions exist.     

A fiducial approach for testing the non-inferiority of proportion difference in matched-pairs design

The non-inferiority of one treatment/drug to another is a common and important issue in medical and pharmaceutical fields. This study explored a fiducial approach for testing the non-inferiority of proportion difference in matched-pairs design. Approximate tests constructed using fiducial quantities with a combination of different parameters were proposed. Four simulation studies were employed to compare the performance of fiducial tests by comparing their type I errors and powers. The results showed that fiducial quantities with parameter $0.6\le w_1\le 0.8$ performed satisfactorily from small to large samples. Therefore, the fiducial tests could be recommended for practical applications. The recommended fiducial tests might be a competitive alternative to other available tests. Three real data sets were analyzed to illustrate the proposed methods were competitive or even better than other tests.     

Confidence distributions applied to propagating uncertainty to inference based on estimating the local false discovery rate: A fiducial continuum from confidence sets to empirical Bayes set estimates as the number of comparisons increases

Empirical Bayes estimates of the local false discovery rate can reflect uncertainty about the estimated prior by supplementing their Bayesian posterior probabilities with confidence levels as posterior probabilities. This use of coherent fiducial inference with hierarchical models generates set estimators that propagate uncertainty to varying degrees. Some of the set estimates approach estimates from plug-in empirical Bayes methods for high numbers of comparisons and can come close to the usual confidence sets given a sufficiently low number of comparisons.     

A computational framework for empirical Bayes inference

In empirical Bayes inference one is typically interested in sampling from the posterior distribution of a parameter with a hyper-parameter set to its maximum likelihood estimate. This is often problematic particularly when the likelihood function of the hyper-parameter is not available in closed form and the posterior distribution is intractable. Previous works have dealt with this problem using a multi-step approach based on the EM algorithm and Markov Chain Monte Carlo (MCMC). We propose a framework based on recent developments in adaptive MCMC, where this problem is addressed more efficiently using a single Monte Carlo run. We discuss the convergence of the algorithm and its connection with the EM algorithm. We apply our algorithm to the Bayesian Lasso of Park and Casella (J. Am. Stat. Assoc. 103:681–686, 2008) and on the empirical Bayes variable selection of George and Foster (J. Am. Stat. Assoc. 87:731–747, 2000).     

A Martingale-based bootstrap inference with censored data

In this paper, me shall investigate a bootstrap method hasd on a martingale representation of the relevant statistic for inference to a class of functionals of the survival distribution. The method is similar in spirit to Efron's (1981) bootstrap, and thus in the present paper will be referred to as “martingale-based bootstrap” The method was derived from Lin,Wei and Ying (1993), who appiied the method in checking the Cox model with cumulative sums of martingale-based residuals. It is shown that this martingale-based bootstrap gives a correct first-order asymptotic approximation to the distribution function of the corresponding functional of the Kaplan-Meier estimator. As a consequence, confidence intervals constructed by the martingale-based bootstrap have asymptotially correct coverage probability. Our simulation study indicats that the martingale-based bootst strap method for a small and moderate sample sizes can be uniformly better than the usual bootstrap method in estimating the sampling distribution for a mean function and a point probability in survival analysis.     

A note on fiducial generalized pivots for in one-way heteroscedastic ANOVA with random effects

The paper deals with generalized confidence intervals for the between-group variance in one-way heteroscedastic (unbalanced) ANOVA with random effects. The approach used mimics the standard one applied in mixed linear models with two variance components, where interval estimators are based on a minimal sufficient statistic derived after an initial reduction by the principle of invariance. A minimal sufficient statistic under heteroscedasticity is found to resemble its homoscedastic counterpart and further analogies between heteroscedastic and homoscedastic cases lead us to two classes of fiducial generalized pivots for the between-group variance. The procedures suggested formerly by Wimmer and Witkovský [Between group variance component interval estimation for the unbalanced heteroscedastic one-way random effects model, J. Stat. Comput. Simul. 73 (2003), pp. 333–346] and Li [Comparison of confidence intervals on between group variance in unbalanced heteroscedastic one-way random models, Comm. Statist. Simulation Comput. 36 (2007), pp. 381–390] are found to belong to these two classes. We comment briefly on some of their properties that were not mentioned in the original papers. In addition, properties of another particular generalized pivot are considered.     

A comparison of inference procedures in unbalanced split-plot designs

Several procedures for constructing confidence intervals and testing hypotheses about fixed effects in unbalanced split-plot experiments are described in this paper. These procedures can also be used for unbalanced repeated measures experiments when the repeated measures satisfy the Huyhn-Feldt (1970) conditions. A number of these procedures require that the whole plot error mean square has a distribution proportional to a chi-square distribution and that it be independent of estimators of the parameter functions. Often, neither of these conditions are met in unbalanced split-plot experiments. Simulation studies of a small design of eight observations and larger designs with 34 to 48 observations are used to investigate the performance of the different procedures.     

A note on statistical inference for differences of covariances

This article investigates statistical inferences about differences of covariances matrices when the response has more than two values. The subspace constructed by differences of covariance matrices is related to the sufficient dimension subspace and the central space. The asymptotic distribution of test statistic for structural dimension is outlined.     

A general method of inference for two-parameter continuous distributions

Abstract

This article presents a general method of inference of the parameters of a continuous distribution with two unknown parameters. Except in a few distributions such as the normal distribution, the classical approach fails in this context to provide accurate inferences with small samples.Therefore, by taking the generalized approach to inference (cf. Weerahandi, 1995 Weerahandi, S. (1995). Exact Statistical Methods for Data Analysis. New York: Springer Verlag. [Google Scholar]), in this article we present a general method of inference to tackle practically useful two-parameter distributions such as the gamma distribution as well as distributions of theoretical interest such as the two-parameter uniform distribution. The proposed methods are exact in the sense that they are based on exact probability statements and exact expected values. The advantage of taking the generalized approach over the classical approximate inferences is shown via simulation studies.

This article has the potential to motivate much needed further research in non normal regressions, multiparameter problems, and multivariate problems for which basically there are only large sample inferences available. The approach that we take should pave the way for researchers to solve a variety of non normal problems, including ANOVA and MANOVA problems, where even the Bayesian approach fails. In the context of testing of hypotheses, the proposed method provides a superior alternative to the classical generalized likelihood ratio method.     

A note on fiducial model averaging as an alternative to checking Bayesian and frequentist models

Just as frequentist hypothesis tests have been developed to check model assumptions, prior predictive p-values and other Bayesian p-values check prior distributions as well as other model assumptions. These model checks not only suffer from the usual threshold dependence of p-values, but also from the suppression of model uncertainty in subsequent inference. One solution is to transform Bayesian and frequentist p-values for model assessment into a fiducial distribution across the models. Averaging the Bayesian or frequentist posterior distributions with respect to the fiducial distribution can reproduce results from Bayesian model averaging or classical fiducial inference.     

A computer algebra package for approximate conditional inference

This paper presents a set of REDUCE procedures that make a number of existing higher-order asymptotic results available for both theoretical and practical research. Attention has been restricted to the context of exact and approximate inference for a parameter of interest conditionally either on an ancillary statistic or on a statistic partially sufficient for the nuisance parameter. In particular, the procedures apply to regression-scale models and multiparameter exponential families. Most of them support algebraic computation as well as numerical calculation for a given data set. Examples illustrate the code.     

A note on simultaneous inference with rerandomization tests

Valid simultaneous confidence intervals based on rerandomization are provided for the first time. They are derived from joint confidence regions which are constructed by testing for all possible parametric values. A simple exampe illustrates these confidence intervals and compares inferences from them with other methods.