Bayesian Updating with Confounded Signals

We develop a Bayesian framework for estimating the means of two random variables when only the sum of those random variables can be observed. Mixture models are proposed for establishing conjugacy between the joint prior distribution and the distribution for observations. Among other desirable features, conjugate distributions allow Bayesian methods to be applied in sequential decision problems.     

Prior distribution assessment for a multivariate normal distribution: an experimental study

A variety of methods of eliciting a prior distribution for a multivariate normal (MVN) distribution have recently been proposed. This paper reports an experiment in which 16 meteorologists used the methods to quantify their opinions about climatology variables. Our results compare prior models and show, in particular, that it can be better to assume the mean and variance of an MVN distribution are independent a priori, rather than to model opinion by the conjugate prior distribution. Using a proper scoring rule, different forms of assessment task are examined and alternative ways of estimating parameters are compared. To quantify opinion about means, it proved preferable to ask directly about the means rather than individual observations while, to quantify opinion about the variance matrix, it was best to ask about deviations from the mean. Further results include recommendations for the way parameters of the prior distribution are estimated.     

Posterior bimodality in the balanced one-way random-effects model

Summary. Although some researchers have examined posterior multimodality for specific richly parameterized models, multimodality is not well characterized for any such model. The paper characterizes bimodality of the joint and marginal posteriors for a conjugate analysis of the balanced one-way random-effects model with a flat prior on the mean. This apparently simple model has surprisingly complex and even bizarre mode behaviour. Bimodality usually arises when the data indicate a much larger between-groups variance than does the prior. We examine an example in detail, present a graphical display for describing bimodality and use real data sets from a statistical practice to shed light on the practical relevance of bimodality for these models.     

Variable selection in quantile regression via Gibbs sampling

Due to computational challenges and non-availability of conjugate prior distributions, Bayesian variable selection in quantile regression models is often a difficult task. In this paper, we address these two issues for quantile regression models. In particular, we develop an informative stochastic search variable selection (ISSVS) for quantile regression models that introduces an informative prior distribution. We adopt prior structures which incorporate historical data into the current data by quantifying them with a suitable prior distribution on the model parameters. This allows ISSVS to search more efficiently in the model space and choose the more likely models. In addition, a Gibbs sampler is derived to facilitate the computation of the posterior probabilities. A major advantage of ISSVS is that it avoids instability in the posterior estimates for the Gibbs sampler as well as convergence problems that may arise from choosing vague priors. Finally, the proposed methods are illustrated with both simulation and real data.     

On robust Bayesian estimation under some asymmetric and bounded loss function

The problem of Bayesian and robust Bayesian estimation with some bounded and asymmetric loss function ABL is considered for various models. The prior distribution is not exactly specified and covers the conjugate family of prior distributions. The posterior regret, most robust and conditional Γ-minimax estimators are constructed and a preliminary comparison with square-error loss and LINEX loss is presented.     

Local smoothing with given marginals

In models using categorical data, one may use adjacency relations to justify smoothing to improve upon simple histogram approximations of the probabilities. This is particularly convenient for sparsely observed or rather peaked distributions. Moreover, in a few models, prior knowledge of a marginal distribution is available. We adapt local polynomial estimators to include this partial information about the underlying distribution and give explicit representations for the proposed estimators. An application to a set of anthropological data is included.     

A natural conjugate prior for the nonhomogeneous poisson process with an exponential intensity function

This article presents a natural conjugate prior for the nonhomogeneous Poisson process (NHPP) with an exponential intensity function, for modeling the failure rate of repairable systems. The behavior of the conjugate prior distribution with respect to its parameters is studied, and the use of this prior in Bayesian estimation is compared to two other estimation approaches (the use of independent prior distributions, and the bivariate normal distribution). The use of the conjugate prior proposed here facilitates Bayesian statistical analysis of aging. In particular, the proposed prior allows us to explicitly account for dependence between the initial failure rate and the aging rate. This is a significant improvement over the assumptions made in most prior work (either the assumption that the aging rate is known, or the assumption that the initial failure rate and the aging rate are independent). Monte Carlo simulation shows that Bayesian estimation using the proposed prior generally performs at least as well as Bayesian estimation using independent priors for the initial failure rate and the aging rate,except in the case where the prior distribution underestimates both the initial failure rate and the aging rate.     

Bayesian analysis in multivariate regression models with conjugate priors

In this paper, we consider the full rank multivariate regression model with matrix elliptically contoured distributed errors. We formulate a conjugate prior distribution for matrix elliptical models and derive the posterior distributions of mean and scale matrices. In the sequel, some characteristics of regression matrix parameters are also proposed.     

A bayesian analysis of imperfect inspection models

An examination of sampling inspection models is provided for the case where inspection is not perfect and classification errors can be made. The conjugate family of distributions is obtained under t h e assumption that defective items are generated according to a Bernoulli process. To simplify analysis, the use of a single beta prior distribution is considered. Relevant predictive distributions are obtained.     

Analysis of rounded exponential data

The problem of inference based on a rounded random sample from the exponential distribution is treated. The main results are given by an explicit expression for the maximum-likelihood estimator, a confidence interval with a guaranteed level of confidence, and a conjugate class of distributions for Bayesian analysis. These results are exemplified on two concrete examples. The large and increasing body of results on the topic of grouped data has been mostly focused on the effect on the estimators. The methods and results for the derivation of confidence intervals here are hence of some general theoretical value as a model approach for other parametric models. The Bayesian credibility interval recommended in cases with a lack of other prior information follows by letting the prior equal the inverted exponential with a scale equal to one divided by the resolution. It is shown that this corresponds to the standard non-informative prior for the scale in the case of non-rounded data. For cases with the absence of explicit prior information it is argued that the inverted exponential prior with a scale given by the resolution is a reasonable choice for more general digitized scale families also.     

Conjugate analysis of multivariate normal data with incomplete observations

The authors discuss prior distributions that are conjugate to the multivariate normal likelihood when some of the observations are incomplete. They present a general class of priors for incorporating information about unidentified parameters in the covariance matrix. They analyze the special case of monotone patterns of missing data, providing an explicit recursive form for the posterior distribution resulting from a conjugate prior distribution. They develop an importance sampling and a Gibbs sampling approach to sample from a general posterior distribution and compare the two methods.     

Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models

While conjugate Bayesian inference in decomposable Gaussian graphical models is largely solved, the non-decomposable case still poses difficulties concerned with the specification of suitable priors and the evaluation of normalizing constants. In this paper we derive the DY-conjugate prior ( Diaconis & Ylvisaker, 1979 ) for non-decomposable models and show that it can be regarded as a generalization to an arbitrary graph G of the hyper inverse Wishart distribution ( Dawid & Lauritzen, 1993 ). In particular, if G is an incomplete prime graph it constitutes a non-trivial generalization of the inverse Wishart distribution. Inference based on marginal likelihood requires the evaluation of a normalizing constant and we propose an importance sampling algorithm for its computation. Examples of structural learning involving non-decomposable models are given. In order to deal efficiently with the set of all positive definite matrices with non-decomposable zero-pattern we introduce the operation of triangular completion of an incomplete triangular matrix. Such a device turns out to be extremely useful both in the proof of theoretical results and in the implementation of the Monte Carlo procedure.     

Bayesian inference for the randomly censored Weibull distribution

In this paper, we consider the Bayesian inference of the unknown parameters of the randomly censored Weibull distribution. A joint conjugate prior on the model parameters does not exist; we assume that the parameters have independent gamma priors. Since closed-form expressions for the Bayes estimators cannot be obtained, we use Lindley's approximation, importance sampling and Gibbs sampling techniques to obtain the approximate Bayes estimates and the corresponding credible intervals. A simulation study is performed to observe the behaviour of the proposed estimators. A real data analysis is presented for illustrative purposes.     

Eliciting Dirichlet and Gaussian copula prior distributions for multinomial models

In this paper, we propose novel methods of quantifying expert opinion about prior distributions for multinomial models. Two different multivariate priors are elicited using median and quartile assessments of the multinomial probabilities. First, we start by eliciting a univariate beta distribution for the probability of each category. Then we elicit the hyperparameters of the Dirichlet distribution, as a tractable conjugate prior, from those of the univariate betas through various forms of reconciliation using least-squares techniques. However, a multivariate copula function will give a more flexible correlation structure between multinomial parameters if it is used as their multivariate prior distribution. So, second, we use beta marginal distributions to construct a Gaussian copula as a multivariate normal distribution function that binds these marginals and expresses the dependence structure between them. The proposed method elicits a positive-definite correlation matrix of this Gaussian copula. The two proposed methods are designed to be used through interactive graphical software written in Java.     

Sequential imputation for models with latent variables assuming latent ignorability

Models that involve an outcome variable, covariates, and latent variables are frequently the target for estimation and inference. The presence of missing covariate or outcome data presents a challenge, particularly when missingness depends on the latent variables. This missingness mechanism is called latent ignorable or latent missing at random and is a generalisation of missing at random. Several authors have previously proposed approaches for handling latent ignorable missingness, but these methods rely on prior specification of the joint distribution for the complete data. In practice, specifying the joint distribution can be difficult and/or restrictive. We develop a novel sequential imputation procedure for imputing covariate and outcome data for models with latent variables under latent ignorable missingness. The proposed method does not require a joint model; rather, we use results under a joint model to inform imputation with less restrictive modelling assumptions. We discuss identifiability and convergence‐related issues, and simulation results are presented in several modelling settings. The method is motivated and illustrated by a study of head and neck cancer recurrence. Imputing missing data for models with latent variables under latent‐dependent missingness without specifying a full joint model.     

A joint model for hierarchical continuous and zero-inflated overdispersed count data

Many applications in public health, medical and biomedical or other studies demand modelling of two or more longitudinal outcomes jointly to get better insight into their joint evolution. In this regard, a joint model for a longitudinal continuous and a count sequence, the latter possibly overdispersed and zero-inflated (ZI), will be specified that assembles aspects coming from each one of them into one single model. Further, a subject-specific random effect is included to account for the correlation in the continuous outcome. For the count outcome, clustering and overdispersion are accommodated through two distinct sets of random effects in a generalized linear model as proposed by Molenberghs et al. [A family of generalized linear models for repeated measures with normal and conjugate random effects. Stat Sci. 2010;25:325–347]; one is normally distributed, the other conjugate to the outcome distribution. The association among the two sequences is captured by correlating the normal random effects describing the continuous and count outcome sequences, respectively. An excessive number of zero counts is often accounted for by using a so-called ZI or hurdle model. ZI models combine either a Poisson or negative-binomial model with an atom at zero as a mixture, while the hurdle model separately handles the zero observations and the positive counts. This paper proposes a general joint modelling framework in which all these features can appear together. We illustrate the proposed method with a case study and examine it further with simulations.     

ON BAYES PREDICTION OF FUTURE MEDIAN

An expression for the Bayesian predictive survival function of the median of a set of future observations is obtained whether its size is assumed to be odd or even. Both of the informative and future samples are drawn from a population whose distribution is a general class that includes several distributions used in life testing (and other areas as well) such as the Weibull (including the exponential and Rayleigh), compound Weibull (including the compound exponential and compound Rayleigh), Pareto, beta, Gompertz and compound Gompertz, among other distributions. A general proper (conjugate) prior density function is used to cover most prior distributions that have been used in literature. Applications to the Weibull, exponential and Rayleigh models are illustrated.     

Estimation and prediction of the Burr type XII distribution based on record values and inter-record times

The maximum likelihood and Bayesian approaches for parameter estimations and prediction of future record values have been considered for the two-parameter Burr Type XII distribution based on record values with the number of trials following the record values (inter-record times). Firstly, the Bayes estimates are obtained based on a joint bivariate prior for the shape parameters. In this case, the Bayes estimates of the parameters have been developed by using Lindley's approximation and the Markov Chain Monte Carlo (MCMC) method due to the lack of explicit forms under the squared error and the linear-exponential loss functions. The MCMC method has been also used to construct the highest posterior density credible intervals. Secondly, the Bayes estimates are obtained with respect to a discrete prior for the first shape parameter and a conjugate prior for other shape parameter. The Bayes and the maximum likelihood estimates are compared in terms of the estimated risk by the Monte Carlo simulations. We further consider the non-Bayesian and Bayesian prediction for future lower record arising from the Burr Type XII distribution based on record data. The comparison of the derived predictors is carried out by using Monte Carlo simulations. A real data are analysed for illustration purposes.     

The empirical Bayes estimators of the mean and variance parameters of the normal distribution with a conjugate normal-inverse-gamma prior by the moment method and the MLE method

Most of the samples in the real world are from the normal distributions with unknown mean and variance, for which it is common to assume a conjugate normal-inverse-gamma prior. We calculate the empirical Bayes estimators of the mean and variance parameters of the normal distribution with a conjugate normal-inverse-gamma prior by the moment method and the Maximum Likelihood Estimation (MLE) method in two theorems. After that, we illustrate the two theorems for the monthly simple returns of the Shanghai Stock Exchange Composite Index.     

The equivalence of Bayes and robust Bayes estimators for various loss functions

The problem of Bayes and robust Bayes estimation for various bounded and/or symmetric loss functions in a normal model with conjugate and non-informative prior distributions is considered. The prior distribution is not fully specified and covers the conjugate family of priors. It is of interest to know that the Bayes and robust Bayes estimators for symmetric losses are the same as those for the standard square-error loss function.