Intrinsic Bayesian inference on a Poisson rate and on the ratio of two Poisson rates

Our purpose is to explore the intrinsic Bayesian inference on the rate of a Poisson distribution and on the ratio of the rates of two independent Poisson distributions, with the natural conjugate family of priors in the first case and the semi-conjugate family of priors defined by Laurent and Legrand (2011) in the second case. Intrinsic Bayesian inference is derived from the Bayesian decision theory framework based on the intrinsic discrepancy loss function. We cover in particular the case of some objective Bayesian procedures suggested by Bernardo when considering reference priors.     

Intrinsic Priors for Testing Two Normal Means with Intrinsic Bayes Factors

ABSTRACT

In this article we consider the problem of comparing two normal means with unknown common variance using a Bayesian approach. Conventional Bayes factors with improper non informative priors are not well defined. The intrinsic Bayes factors are used to overcome such a difficulty. We derive intrinsic priors whose Bayes factors are asymptotically equivalent to the corresponding intrinsic Bayes factors. We illustrate our results with numerical examples.     

Intrinsic Bayes factor approach to a test for the power law process

The versatile new criterion called the intrinsic Bayes factor (IBF), introduced by Berger and Pericchi [J. Amer. Statist. Assoc. 91 (1996) 109–122], has made it possible to perform model selection and hypotheses testing using standard (improper) noninformative priors in a variety of situations. In this paper, we use their methodology to test several hypotheses regarding the shape parameter of the power law process, which has been widely used to model failure times of repairable systems. Assuming that we have data from the process according to the time-truncation sampling scheme, we derive the arithmetic IBFs using four default priors, including the reference and Jeffreys priors. We establish the frequentist probability matching properties of these priors. We also identify two priors that are justifiable under both time-truncation and failure-truncation schemes, so that the IBFs for both schemes can be unified. Deducing the intrinsic priors of a certain canonical form, as the time of truncation tends to infinity, we show that the arithmetic IBFs correspond asymptotically to actual Bayes factors. We also discuss the expected IBFs, which are useful with small samples. We then use these results to analyze an actual data set on the interruption times of a transmission line, summarizing our results under the default priors.     

Intrinsic Priors for Model Selection Using an Encompassing Model with Applications to Censored Failure Time Data

In Bayesian model selection or testingproblems one cannot utilize standard or default noninformativepriors, since these priors are typically improper and are definedonly up to arbitrary constants. Therefore, Bayes factors andposterior probabilities are not well defined under these noninformativepriors, making Bayesian model selection and testing problemsimpossible. We derive the intrinsic Bayes factor (IBF) of Bergerand Pericchi (1996a, 1996b) for the commonly used models in reliabilityand survival analysis using an encompassing model. We also deriveproper intrinsic priors for these models, whose Bayes factors are asymptoticallyequivalent to the respective IBFs. We demonstrate our resultsin three examples.     

Objective Bayesian hypothesis testing in regression models with first-order autoregressive residuals

This article considers the objective Bayesian testing in the normal regression models with first-order autoregressive residuals. We propose some solutions based on a Bayesian model selection procedure to this problem where no subjective input is considered. We construct the proper priors for testing the autocorrelation coefficient based on measures of divergence between competing models, which is called the divergence-based (DB) priors and then propose the objective Bayesian decision-theoretic rule, which is called the Bayesian reference criterion (BRC). Finally, we derive the intrinsic test statistic for testing the autocorrelation coefficient. The behavior of the Bayes factor-based DB priors is examined by comparing with the BRC in a simulation study and an example.     

Objective priors for hypothesis testing in one-way random effects models

The Bayes factor is a key tool in hypothesis testing. Nevertheless, the important issue of which priors should be used to develop objective Bayes factors remains open. The authors consider this problem in the context of the one-way random effects model. They use concepts such as orthogonality, predictive matching and invariance to justify a specific form of the priors for common parameters and derive the intrinsic and divergence based prior for the new parameter. The authors show that both intrinsic priors or divergence-based priors produce consistent Bayes factors. They illustrate the methods and compare them with other proposals.     

Alternative Bayes factors for model selection

Several alternative Bayes factors have been recently proposed in order to solve the problem of the extreme sensitivity of the Bayes factor to the priors of models under comparison. Specifically, the impossibility of using the Bayes factor with standard noninformative priors for model comparison has led to the introduction of new automatic criteria, such as the posterior Bayes factor (Aitkin 1991), the intrinsic Bayes factors (Berger and Pericchi 1996b) and the fractional Bayes factor (O'Hagan 1995). We derive some interesting properties of the fractional Bayes factor that provide justifications for its use additional to the ones given by O'Hagan. We further argue that the use of the fractional Bayes factor, originally introduced to cope with improper priors, is also useful in a robust analysis. Finally, using usual classes of priors, we compare several alternative Bayes factors for the problem of testing the point null hypothesis in the univariate normal model.     

INTRINSIC PRIORS FOR TWO-SAMPLE TESTS IN NORMAL POPULATIONS

ABSTRACT

There have been considerable amounts of work regarding the development of various default Bayes factors in model selection and hypothesis testing. Two commonly used criteria, the intrinsic Bayes factor and the fractional Bayes factor are compared to test two independent normal means and variances. We also derive several intrinsic priors whose Bayes factors are asymptotically equivalent to the respective Bayes factors. We demonstrate our results in simulated datasets.     

Default Bayesian analysis of the Behrens–Fisher problem

In the Bayesian approach, the Behrens–Fisher problem has been posed as one of estimation for the difference of two means. No Bayesian solution to the Behrens–Fisher testing problem has yet been given due, perhaps, to the fact that the conventional priors used are improper. While default Bayesian analysis can be carried out for estimation purposes, it poses difficulties for testing problems. This paper generates sensible intrinsic and fractional prior distributions for the Behrens–Fisher testing problem from the improper priors commonly used for estimation. It allows us to compute the Bayes factor to compare the null and the alternative hypotheses. This default procedure of model selection is compared with a frequentist test and the Bayesian information criterion. We find discrepancy in the sense that frequentist and Bayesian information criterion reject the null hypothesis for data, that the Bayes factor for intrinsic or fractional priors do not.     

Objective Bayesian multiple comparisons for normal variances

This paper considers the multiple comparisons problem for normal variances. We propose a solution based on a Bayesian model selection procedure to this problem in which no subjective input is considered. We construct the intrinsic and fractional priors for which the Bayes factors and model selection probabilities are well defined. The posterior probability of each model is used as a model selection tool. The behaviour of these Bayes factors is compared with the Bayesian information criterion of Schwarz and some frequentist tests.     

Bayesian model comparison based on expected posterior priors for discrete decomposable graphical models

The implementation of the Bayesian paradigm to model comparison can be problematic. In particular, prior distributions on the parameter space of each candidate model require special care. While it is well known that improper priors cannot be routinely used for Bayesian model comparison, we claim that also the use of proper conventional priors under each model should be regarded as suspicious, especially when comparing models having different dimensions. The basic idea is that priors should not be assigned separately under each model; rather they should be related across models, in order to acquire some degree of compatibility, and thus allow fairer and more robust comparisons. In this connection, the intrinsic prior as well as the expected posterior prior (EPP) methodology represent a useful tool. In this paper we develop a procedure based on EPP to perform Bayesian model comparison for discrete undirected decomposable graphical models, although our method could be adapted to deal also with directed acyclic graph models. We present two possible approaches. One based on imaginary data, and one which makes use of a limited number of actual data. The methodology is illustrated through the analysis of a 2×3×4 contingency table.     

Posterior robustness with more than one sampling model

In order to robustify posterior inference, besides the use of large classes of priors, it is necessary to consider uncertainty about the sampling model. In this article we suggest that a convenient and simple way to incorporate model robustness is to consider a discrete set of competing sampling models, and combine it with a suitable large class of priors. This set reflects foreseeable departures of the base model, like thinner or heavier tails or asymmetry. We combine the models with different classes of priors that have been proposed in the vast literature on Bayesian robustness with respect to the prior. Also we explore links with the related literature of stable estimation and precise measurement theory, now with more than one model entertained. To these ends it will be necessary to introduce a procedure for model comparison that does not depend on an arbitrary constant or scale. We utilize a recent development on automatic Bayes factors with self-adjusted scale, the ‘intrinsic Bayes factor’ (Berger and Pericchi, Technical Report, 1993).     

Asymptotic inference for mixture models by using data-dependent priors

For certain mixture models, improper priors are undesirable because they yield improper posteriors. However, proper priors may be undesirable because they require subjective input. We propose the use of specially chosen data-dependent priors. We show that, in some cases, data-dependent priors are the only priors that produce intervals with second-order correct frequentist coverage. The resulting posterior also has another interpretation: it is the product of a fixed prior and a pseudolikelihood.     

Noninformative priors for the common mean in the bivariate normal distribution

In this paper, we consider some noninformative priors for the common mean in a bivariate normal population. We develop the first-order and second-order matching priors and reference priors. We find that the second-order matching prior is also an HPD matching prior, and matches the alternative coverage probabilities up to the second order. It turns out that derived reference priors do not satisfy a second-order matching criterion. Our simulation study indicates that the second-order matching prior performs better than the reference priors in terms of matching the target coverage probabilities in a frequentist sense. We also illustrate our results using real data.     

Jeffreys priors for survival models with censored data

When prior information on model parameters is weak or lacking, Bayesian statistical analyses are typically performed with so-called “default” priors. We consider the problem of constructing default priors for the parameters of survival models in the presence of censoring, using Jeffreys’ rule. We compare these Jeffreys priors to the “uncensored” Jeffreys priors, obtained without considering censored observations, for the parameters of the exponential and log-normal models. The comparison is based on the frequentist coverage of the posterior Bayes intervals obtained from these prior distributions.     

A class of shrinkage priors for the dependence structure in longitudinal data

We review a general class of priors for the dependence in longitudinal (temporal) data in settings where a parametric form is often assumed and place them in the context of the literature. The idea is to embed priors on the parameters of the structure within a richer, more flexible class of priors. These priors are shown to contain standard objective priors for structured and unstructured dependence models as special cases under certain conditions and parameterizations. Recommendations and specific details regarding their use are provided.     

Bayesian model selection for life time data under type II censoring

This paper considers the Bayesian model selection problem in life-time models using type-II censored data. In particular, the intrinsic Bayes factors are calculated for log-normal, exponential, and Weibull lifetime models using noninformative priors under type-II censoring. Numerical examples are given to illustrate our results.     

Noninformative priors for the normal variance ratio

In this paper, we consider noninformative priors for the ratio of variances in two normal populations. We develop first and second order matching priors. We find that the second order matching prior matches alternative coverage probabilities up to the second order and is also a HPD matching prior. It turns out that among the reference priors, only one-at-a-time reference prior satisfies a second order matching criterion. Our simulation study indicates that the one-at-a-time reference prior performs better than other reference priors in terms of matching the target coverage probabilities in a frequentist sense. This work is supported by Korea Research Foundation Grant (KRF-2004-002-C00041).     

The conflict between improper priors and robustness

Most methods for assessing the sensitivity of the posterior to the prior do not work if the prior is improper. We characterize the neighborhoods of priors that permit non-trivial sensitivity analysis for improper priors. We show that these neighborhoods are not “tail rich”, i.e. they do not contain measures with a variety of tail behavior. Thus there are no neighborhoods that are simultaneously non-trivial and rich. We also show that using the formal structure of finitely additive priors does not solve the problem. We suggest some directions for addressing the problem. In particular, we consider replacing the improper prior with a sequence of asymptotically well-behaved data-dependent priors.     

Bayesian estimation of the generalized lognormal distribution using objective priors

The generalized lognormal distribution plays an important role in analysing data from different life testing experiments. In this paper, we consider Bayesian analysis of this distribution using various objective priors for the model parameters. Specifically, we derive expressions for the Jeffreys-type priors, the reference priors with different group orderings of the parameters, and the first-order matching priors. We also study the properties of the posterior distributions of the parameters under these improper priors. It is shown that only two of them result in proper posterior distributions. Numerical simulation studies are conducted to compare the performances of the Bayesian estimators under the considered priors and the maximum likelihood estimates. Finally, a real-data application is also provided for illustrative purposes.