Bayesian inference for quantum state tomography

We present a Bayesian approach to the problem of estimating density matrices in quantum state tomography. A general framework is presented based on a suitable mathematical formulation, where a study of the convergence of the Monte Carlo Markov Chain algorithm is given, including a comparison with other estimation methods, such as maximum likelihood estimation and linear inversion. This analysis indicates that our approach not only recovers the underlying parameters quite properly, but also produces physically acceptable punctual and interval estimates. A prior sensitive study was conducted indicating that when useful prior information is available and incorporated, more accurate results are obtained. This general framework, which is based on a reparameterization of the model, allows an easier choice of the prior and proposal distributions for the Metropolis–Hastings algorithm.     

Saddlepoint condition on a predictor to reconfirm the need for the assumption of a prior distribution

Saddlepoint conditions on a predictor are introduced and developed to reconfirm the need for the assumption of a prior distribution in constructing a useful inferential procedure. A condition yields that the predictor induced from the maximum likelihood estimator is the worst under a loss, while the predictor induced from a suitable posterior mean is the best. This result indicates the promising role of Bayesian criteria, such as the deviance information criterion (DIC). As an implication, we critique the conventional empirical Bayes method because of its partial assumption of a prior distribution.     

Objective Bayesian Analysis for Log-logistic Distribution

In this article, Bayesian approach is applied to estimate the parameters of Log-logistic distribution under reference prior and Jeffreys’ prior. The reference prior is derived and it is found that the reference prior is also a second-order matching priors as for the case of any parameter of interest. The Bayesian estimators cannot be obtained in explicit forms. Metropolis within Gibbs sampling algorithm is used to obtain the Bayesian estimators. The Bayesian estimates are compared with the maximum likelihood estimates via simulation study. A real dataset is considered for illustrative purposes.     

Bayesian estimation and prediction for Weibull model with progressive censoring

This article presents the statistical inferences on Weibull parameters with the data that are progressively type II censored. The maximum likelihood estimators are derived. For incorporation of previous information with current data, the Bayesian approach is considered. We obtain the Bayes estimators under squared error loss with a bivariate prior distribution, and derive the credible intervals for the parameters of Weibull distribution. Also, the Bayes prediction intervals for future observations are obtained in the one- and two-sample cases. The method is shown to be practical, although a computer program is required for its implementation. A numerical example is presented for illustration and some simulation study are performed.     

The Bayesian choice of crop variety and fertilizer dose

Recent contributions to the theory of optimizing fertilizer doses in agricultural crop production have introduced Bayesian ideas to incorporate information on crop yield from several environments and on soil nutrients from a soil test, but they have not used a fully Bayesian formulation. We present such a formulation and demonstrate how the resulting Bayes decision procedure can be evaluated in practice by using Markov chain Monte Carlo methods. The approach incorporates expert knowledge of the crop and of regional and local soil conditions and allows a choice of crop variety as well as of fertilizer level. Alternative dose–response functions are expressed in terms of a common interpretable set of parameters to facilitate model comparisons and the specification of prior distributions. The approach is illustrated with a set of yield data from spring barley nitrogen–response trials and is found to be robust to changes in the dose–response function and the prior distribution for indigenous soil nitrogen.     

A Bayesian approach with generalized ridge estimation for high-dimensional regression and testing

This paper adopts a Bayesian strategy for generalized ridge estimation for high-dimensional regression. We also consider significance testing based on the proposed estimator, which is useful for selecting regressors. Both theoretical and simulation studies show that the proposed estimator can simultaneously outperform the ordinary ridge estimator and the LSE in terms of the mean square error (MSE) criterion. The simulation study also demonstrates the competitive MSE performance of our proposal with the Lasso under sparse models. We demonstrate the method using the lung cancer data involving high-dimensional microarrays.     

Objective Bayesian Analysis of Skew‐t Distributions

Abstract. We study the Jeffreys prior and its properties for the shape parameter of univariate skew‐t distributions with linear and nonlinear Student's t skewing functions. In both cases, we show that the resulting priors for the shape parameter are symmetric around zero and proper. Moreover, we propose a Student's t approximation of the Jeffreys prior that makes an objective Bayesian analysis easy to perform. We carry out a Monte Carlo simulation study that demonstrates an overall better behaviour of the maximum a posteriori estimator compared with the maximum likelihood estimator. We also compare the frequentist coverage of the credible intervals based on the Jeffreys prior and its approximation and show that they are similar. We further discuss location‐scale models under scale mixtures of skew‐normal distributions and show some conditions for the existence of the posterior distribution and its moments. Finally, we present three numerical examples to illustrate the implications of our results on inference for skew‐t distributions.     

Propriety of posteriors in structured additive regression models: Theory and empirical evidence

Structured additive regression comprises many semiparametric regression models such as generalized additive (mixed) models, geoadditive models, and hazard regression models within a unified framework. In a Bayesian formulation, non-parametric functions, spatial effects and further model components are specified in terms of multivariate Gaussian priors for high-dimensional vectors of regression coefficients. For several model terms, such as penalized splines or Markov random fields, these Gaussian prior distributions involve rank-deficient precision matrices, yielding partially improper priors. Moreover, hyperpriors for the variances (corresponding to inverse smoothing parameters) may also be specified as improper, e.g. corresponding to Jeffreys prior or a flat prior for the standard deviation. Hence, propriety of the joint posterior is a crucial issue for full Bayesian inference in particular if based on Markov chain Monte Carlo simulations. We establish theoretical results providing sufficient (and sometimes necessary) conditions for propriety and provide empirical evidence through several accompanying simulation studies.     

Inference in flexible families of distributions with normal kernel

This paper addresses the inference problem for a flexible class of distributions with normal kernel known as skew-bimodal-normal family of distributions. We obtain posterior and predictive distributions assuming different prior specifications. We provide conditions for the existence of the maximum-likelihood estimators (MLE). An EM-type algorithm is built to compute them. As a by product, we obtain important results related to classical and Bayesian inferences for two special subclasses called bimodal-normal and skew-normal (SN) distribution families. We perform a Monte Carlo simulation study to analyse behaviour of the MLE and some Bayesian ones. Considering the frontier data previously studied in the literature, we use the skew-bimodal-normal (SBN) distribution for density estimation. For that data set, we conclude that the SBN model provides as good a fit as the one obtained using the location-scale SN model. Since the former is a more parsimonious model, such a result is shown to be more attractive.     

Variable selection in linear regression analysis with alternative Bayesian information criteria using differential evaluation algorithm

In statistical analysis, one of the most important subjects is to select relevant exploratory variables that perfectly explain the dependent variable. Variable selection methods are usually performed within regression analysis. Variable selection is implemented so as to minimize the information criteria (IC) in regression models. Information criteria directly affect the power of prediction and the estimation of selected models. There are numerous information criteria in literature such as Akaike Information Criteria (AIC) and Bayesian Information Criteria (BIC). These criteria are modified for to improve the performance of the selected models. BIC is extended with alternative modifications towards the usage of prior and information matrix. Information matrix-based BIC (IBIC) and scaled unit information prior BIC (SPBIC) are efficient criteria for this modification. In this article, we proposed a combination to perform variable selection via differential evolution (DE) algorithm for minimizing IBIC and SPBIC in linear regression analysis. We concluded that these alternative criteria are very useful for variable selection. We also illustrated the efficiency of this combination with various simulation and application studies.     

Analysis of Frechet Distribution Using Reference Priors

This article develops the Bayesian estimators in the context of reference priors for the two-parameter Frechet distribution. The general forms of the second-order matching priors are also derived in case of any parameter of interest and concluded that the reference prior is also a second order matching prior. Since the Bayesian estimators cannot be obtained in closed form, they are obtained using Monte Carlo simulation and Laplace approximation. The Bayesian and maximum likelihood estimates are compared via simulation study. Two real-life data sets are analyzed for illustration and comparison purpose.     

A wavelet approach to shape analysis for spinal curves

We present a new method to describe shape change and shape differences in curves, by constructing a deformation function in terms of a wavelet decomposition. Wavelets form an orthonormal basis which allows representations at multiple resolutions. The deformation function is estimated, in a fully Bayesian framework, using a Markov chain Monte Carlo algorithm. This Bayesian formulation incorporates prior information about the wavelets and the deformation function. The flexibility of the MCMC approach allows estimation of complex but clinically important summary statistics, such as curvature in our case, as well as estimates of deformation functions with variance estimates, and allows thorough investigation of the posterior distribution. This work is motivated by multi-disciplinary research involving a large-scale longitudinal study of idiopathic scoliosis in UK children. This paper provides novel statistical tools to study this spinal deformity, from which 5% of UK children suffer. Using the data we consider statistical inference for shape differences between normals, scoliotics and developers of scoliosis, in particular for spinal curvature, and look at longitudinal deformations to describe shape changes with time.     

Semiparametric hierarchical selection models for bayesian meta analysis

Meta-analysis refers to quantitative methods for combining results from independent studies in order to draw overall conclusions. Hierarchical models including selection models are introduced and shown to be useful in such Bayesian meta-analysis. Semiparametric hierarchical models are proposed using the Dirichlet process prior. These rich class of models combine the information of independent studies, allowing investigation of variability both between and within studies, and weight function. Here we investigate sensitivity of results to unobserved studies by considering a hierarchical selection model with including unknown weight function and use Markov chain Monte Carlo methods to develop inference for the parameters of interest. Using Bayesian method, this model is used on a meta-analysis of twelve studies comparing the effectiveness of two different types of flouride, in preventing cavities. Clinical informative prior is assumed. Summaries and plots of model parameters are analyzed to address questions of interest.     

Nonparametric approach to intervention time series modeling

Time series are often affected by interventions such as strikes, earthquakes, or policy changes. In the current paper, we build a practical nonparametric intervention model using the central mean subspace in time series. We estimate the central mean subspace for time series taking into account known interventions by using the Nadaraya–Watson kernel estimator. We use the modified Bayesian information criterion to estimate the unknown lag and dimension. Finally, we demonstrate that this nonparametric approach for intervened time series performs well in simulations and in a real data analysis such as the Monthly average of the oxidant.     

Bayesian A- and D-optimal designs for gamma regression model with inverse link function

Bayesian optimal designs have received increasing attention in recent years, especially in biomedical and clinical trials. Bayesian design procedures can utilize the available prior information of the unknown parameters so that a better design can be achieved. With this in mind, this article considers the Bayesian A- and D-optimal designs of the two- and three-parameter Gamma regression model. In this regard, we first obtain the Fisher information matrix of the proposed model and then calculate the Bayesian A- and D-optimal designs assuming various prior distributions such as normal, half-normal, gamma, and uniform distribution for the unknown parameters. All of the numerical calculations are handled in R software. The results of this article are useful in medical and industrial researches.     

Bayesian predictive power: choice of prior and some recommendations for its use as probability of success in drug development

Bayesian predictive power, the expectation of the power function with respect to a prior distribution for the true underlying effect size, is routinely used in drug development to quantify the probability of success of a clinical trial. Choosing the prior is crucial for the properties and interpretability of Bayesian predictive power. We review recommendations on the choice of prior for Bayesian predictive power and explore its features as a function of the prior. The density of power values induced by a given prior is derived analytically and its shape characterized. We find that for a typical clinical trial scenario, this density has a u‐shape very similar, but not equal, to a β‐distribution. Alternative priors are discussed, and practical recommendations to assess the sensitivity of Bayesian predictive power to its input parameters are provided. Copyright © 2016 John Wiley & Sons, Ltd.     

Diagnostics of prior-data agreement in applied Bayesian analysis

This article focused on the definition and the study of a binary Bayesian criterion which measures a statistical agreement between a subjective prior and data information. The setting of this work is concrete Bayesian studies. It is an alternative and a complementary tool to the method recently proposed by Evans and Moshonov, [M. Evans and H. Moshonov, Checking for Prior-data conflict, Bayesian Anal. 1 (2006), pp. 893–914]. Both methods try to help the work of the Bayesian analyst, from preliminary to the posterior computation. Our criterion is defined as a ratio of Kullback–Leibler divergences; two of its main features are to make easy the check of a hierarchical prior and be used as a default calibration tool to obtain flat but proper priors in applications. Discrete and continuous distributions exemplify the approach and an industrial case study in reliability, involving the Weibull distribution, is highlighted.     

Bayes estimation in exponential censored samples with incomplete information

A Bayesian procedure is proposed to estimate the exponential mean lifetime and the reliability function in a time censored sampling with incomplete information. On the basis of a Monte Carlo study, the Bayes point and interval estimators are compared to the maximum likelihood ones, taking into account several factors, such as prior information, sample size, and censoring time. It is found that only a vague (from an engineering viewpoint) prior knowledge on the mean lifetime is required to make attractive the Bayesian procedure.     

A Bayesian Model for Markov Chains via Jeffrey's Prior

Abstract

This work deals with the problem of Bayesian estimation of the transition probabilities associated with multistate Markov chain. The model is based on the Jeffreys' noninformative prior. The Bayesian estimator is approximated by means of MCMC techniques. A numerical study by simulation is done in order to compare the Bayesian estimator with the maximum likelihood estimator.     

Estimates for geographical domains through geoadditive models in presence of incomplete geographical information

The paper deals with the matter of producing geographical domains estimates for a variable with a spatial pattern in presence of incomplete information about the population units location. The spatial distribution of the study variable and its eventual relations with other covariates are modeled by a geoadditive regression. The use of such a model to produce model-based estimates for some geographical domains requires all the population units to be referenced at point locations, however typically the spatial coordinates are known only for the sampled units. An approach to treat the lack of geographical information for non-sampled units is suggested: it is proposed to impose a distribution on the spatial locations inside each domain. This is realized through a hierarchical Bayesian formulation of the geoadditive model in which a prior distribution on the spatial coordinates is defined. The performance of the proposed imputation approach is evaluated through various Markov Chain Monte Carlo experiments implemented under different scenarios.