On Bayesian estimators in multistage binomial designs

A new class of Bayesian estimators for a proportion in multistage binomial designs is considered. Priors belong to the beta-J distribution family, which is derived from the Fisher information associated with the design. The transposition of the beta parameters of the Haldane and the uniform priors in fixed binomial experiments into the beta-J distribution yields bias-corrected versions of these priors in multistage designs. We show that the estimator of the posterior mean based on the corrected Haldane prior and the estimator of the posterior mode based on the corrected uniform prior have good frequentist properties. An easy-to-use approximation of the estimator of the posterior mode is provided. The new Bayesian estimators are compared to Whitehead's and the uniformly minimum variance estimators through several multistage designs. Last, the bias of the estimator of the posterior mode is derived for a particular case.     

Bayesian Analysis of ARA Imperfect Repair Models

This article proposes a Bayesian analysis of a class of imperfect repair models, the ARA models. The choice of prior distributions and the computation of posterior distributions are discussed. The presentation is unified for all ARA models and many kinds of possible priors. A numerical study on the quality of the Bayesian estimators is presented, as well as a comparison with the maximum likelihood estimators. Finally, the approach is applied to a real data set.     

Bayes estimation and prediction of the two-parameter gamma distribution

In this article, the Bayes estimates of two-parameter gamma distribution are considered. It is well known that the Bayes estimators of the two-parameter gamma distribution do not have compact form. In this paper, it is assumed that the scale parameter has a gamma prior and the shape parameter has any log-concave prior, and they are independently distributed. Under the above priors, we use Gibbs sampling technique to generate samples from the posterior density function. Based on the generated samples, we can compute the Bayes estimates of the unknown parameters and can also construct HPD credible intervals. We also compute the approximate Bayes estimates using Lindley's approximation under the assumption of gamma priors of the shape parameter. Monte Carlo simulations are performed to compare the performances of the Bayes estimators with the classical estimators. One data analysis is performed for illustrative purposes. We further discuss the Bayesian prediction of future observation based on the observed sample and it is seen that the Gibbs sampling technique can be used quite effectively for estimating the posterior predictive density and also for constructing predictive intervals of the order statistics from the future sample.     

Bayesian estimation for randomly censored generalized exponential distribution under asymmetric loss functions

This paper deals with the Bayesian estimation of generalized exponential distribution in the proportional hazards model of random censorship under asymmetric loss functions. It is well known for the two-parameter lifetime distributions that the continuous conjugate priors for parameters do not exist; we assume independent gamma priors for the scale and the shape parameters. It is observed that the closed-form expressions for the Bayes estimators cannot be obtained; we propose Tierney–Kadane's approximation and Gibbs sampling to approximate the Bayes estimates. Monte Carlo simulation is carried out to observe the behavior of the proposed methods and one real data analysis is performed for illustration. Bayesian methods are compared with maximum likelihood and it is observed that the Bayes estimators perform better than the maximum-likelihood estimators in some cases.     

Jeffreys priors for survival models with censored data

When prior information on model parameters is weak or lacking, Bayesian statistical analyses are typically performed with so-called “default” priors. We consider the problem of constructing default priors for the parameters of survival models in the presence of censoring, using Jeffreys’ rule. We compare these Jeffreys priors to the “uncensored” Jeffreys priors, obtained without considering censored observations, for the parameters of the exponential and log-normal models. The comparison is based on the frequentist coverage of the posterior Bayes intervals obtained from these prior distributions.     

Analysis of Frechet Distribution Using Reference Priors

This article develops the Bayesian estimators in the context of reference priors for the two-parameter Frechet distribution. The general forms of the second-order matching priors are also derived in case of any parameter of interest and concluded that the reference prior is also a second order matching prior. Since the Bayesian estimators cannot be obtained in closed form, they are obtained using Monte Carlo simulation and Laplace approximation. The Bayesian and maximum likelihood estimates are compared via simulation study. Two real-life data sets are analyzed for illustration and comparison purpose.     

Bayesian inference for the randomly censored Burr-type XII distribution

The article presents the Bayesian inference for the parameters of randomly censored Burr-type XII distribution with proportional hazards. The joint conjugate prior of the proposed model parameters does not exist; we consider two different systems of priors for Bayesian estimation. The explicit forms of the Bayes estimators are not possible; we use Lindley's method to obtain the Bayes estimates. However, it is not possible to obtain the Bayesian credible intervals with Lindley's method; we suggest the Gibbs sampling procedure for this purpose. Numerical experiments are performed to check the properties of the different estimators. The proposed methodology is applied to a real-life data for illustrative purposes. The Bayes estimators are compared with the Maximum likelihood estimators via numerical experiments and real data analysis. The model is validated using posterior predictive simulation in order to ascertain its appropriateness.     

On probability matching priors

First‐order probability matching priors are priors for which Bayesian and frequentist inference, in the form of posterior quantiles, or confidence intervals, agree to a second order of approximation. The authors show that the matching priors developed by Peers (1965) and Tibshirani (1989) are readily and uniquely implemented in a third‐order approximation to the posterior marginal density. The authors further show how strong orthogonality of parameters simplifies the arguments. Several examples illustrate their results.     

Bayesian estimation of the generalized lognormal distribution using objective priors

The generalized lognormal distribution plays an important role in analysing data from different life testing experiments. In this paper, we consider Bayesian analysis of this distribution using various objective priors for the model parameters. Specifically, we derive expressions for the Jeffreys-type priors, the reference priors with different group orderings of the parameters, and the first-order matching priors. We also study the properties of the posterior distributions of the parameters under these improper priors. It is shown that only two of them result in proper posterior distributions. Numerical simulation studies are conducted to compare the performances of the Bayesian estimators under the considered priors and the maximum likelihood estimates. Finally, a real-data application is also provided for illustrative purposes.     

Progressively Type-I interval censored competing risks data for the proportional hazards family

In this article, we consider some problems of estimation and prediction when progressive Type-I interval censored competing risks data are from the proportional hazards family. The maximum likelihood estimators of the unknown parameters are obtained. Based on gamma priors, the Lindely's approximation and importance sampling methods are applied to obtain Bayesian estimators under squared error and linear–exponential loss functions. Several classical and Bayesian point predictors of censored units are provided. Also, based on given producer's and consumer's risks accepting sampling plans are considered. Finally, the simulation study is given by Monte Carlo simulations to evaluate the performances of the different methods.     

Bayesian inference on extreme value distribution using upper record values

In this paper we address estimation and prediction problems for extreme value distributions under the assumption that the only available data are the record values. We provide some properties and pivotal quantities, and derive unbiased estimators for the location and rate parameters based on these properties and pivotal quantities. In addition, we discuss mean-squared errors of the proposed estimators and exact confidence intervals for the rate parameter. In Bayesian inference, we develop objective Bayesian analysis by deriving non informative priors such as the Jeffrey, reference, and probability matching priors for the location and rate parameters. We examine the validity of the proposed methods through Monte Carlo simulations for various record values of size and present a real data set for illustration purposes.     

Statistical inference based on generalized Lindley record values

This paper addresses the problems of frequentist and Bayesian estimation for the unknown parameters of generalized Lindley distribution based on lower record values. We first derive the exact explicit expressions for the single and product moments of lower record values, and then use these results to compute the means, variances and covariance between two lower record values. We next obtain the maximum likelihood estimators and associated asymptotic confidence intervals. Furthermore, we obtain Bayes estimators under the assumption of gamma priors on both the shape and the scale parameters of the generalized Lindley distribution, and associated the highest posterior density interval estimates. The Bayesian estimation is studied with respect to both symmetric (squared error) and asymmetric (linear-exponential (LINEX)) loss functions. Finally, we compute Bayesian predictive estimates and predictive interval estimates for the future record values. To illustrate the findings, one real data set is analyzed, and Monte Carlo simulations are performed to compare the performances of the proposed methods of estimation and prediction.     

A Bayesian approach for non-homogeneous gamma degradation processes

A Bayesian approach based on the Markov Chain Monte Carlo technique is proposed for the non-homogeneous gamma process with power-law shape function. Vague and informative priors, formalized on some quantities having a “physical” meaning, are provided. Point and interval estimation of process parameters and some functions thereof are developed, as well as prediction on some observable quantities that are useful in defining the maintenance strategy is proposed. Some useful approximations are derived for the conditional and unconditional mean and median of the residual life to reduce computational time. Finally, the proposed approach is applied to a real dataset.     

Bayesian inference for the randomly censored Weibull distribution

In this paper, we consider the Bayesian inference of the unknown parameters of the randomly censored Weibull distribution. A joint conjugate prior on the model parameters does not exist; we assume that the parameters have independent gamma priors. Since closed-form expressions for the Bayes estimators cannot be obtained, we use Lindley's approximation, importance sampling and Gibbs sampling techniques to obtain the approximate Bayes estimates and the corresponding credible intervals. A simulation study is performed to observe the behaviour of the proposed estimators. A real data analysis is presented for illustrative purposes.     

Bayesian Recovery of the Initial Condition for the Heat Equation

We study a Bayesian approach to recovering the initial condition for the heat equation from noisy observations of the solution at a later time. We consider a class of prior distributions indexed by a parameter quantifying “smoothness” and show that the corresponding posterior distributions contract around the true parameter at a rate that depends on the smoothness of the true initial condition and the smoothness and scale of the prior. Correct combinations of these characteristics lead to the optimal minimax rate. One type of priors leads to a rate-adaptive Bayesian procedure. The frequentist coverage of credible sets is shown to depend on the combination of the prior and true parameter as well, with smoother priors leading to zero coverage and rougher priors to (extremely) conservative results. In the latter case, credible sets are much larger than frequentist confidence sets, in that the ratio of diameters diverges to infinity. The results are numerically illustrated by a simulated data example.     

Bias-Corrected maximum likelihood estimation of the parameters of the weighted Lindley distribution

The two-parameter weighted Lindley distribution is useful for modeling survival data, whereas its maximum likelihood estimators (MLEs) are biased in finite samples. This motivates us to construct nearly unbiased estimators for the unknown parameters. We adopt a “corrective” approach to derive modified MLEs that are bias-free to second order. We also consider an alternative bias-correction mechanism based on Efron’s bootstrap resampling. Monte Carlo simulations are conducted to compare the performance between the proposed and two previous methods in the literature. The numerical evidence shows that the bias-corrected estimators are extremely accurate even for very small sample sizes and are superior than the previous estimators in terms of biases and root mean squared errors. Finally, applications to two real datasets are presented for illustrative purposes.     

Objective Bayesian Analysis for Log-logistic Distribution

In this article, Bayesian approach is applied to estimate the parameters of Log-logistic distribution under reference prior and Jeffreys’ prior. The reference prior is derived and it is found that the reference prior is also a second-order matching priors as for the case of any parameter of interest. The Bayesian estimators cannot be obtained in explicit forms. Metropolis within Gibbs sampling algorithm is used to obtain the Bayesian estimators. The Bayesian estimates are compared with the maximum likelihood estimates via simulation study. A real dataset is considered for illustrative purposes.     

Learning from a lot: Empirical Bayes for high‐dimensional model‐based prediction

Empirical Bayes is a versatile approach to “learn from a lot” in two ways: first, from a large number of variables and, second, from a potentially large amount of prior information, for example, stored in public repositories. We review applications of a variety of empirical Bayes methods to several well‐known model‐based prediction methods, including penalized regression, linear discriminant analysis, and Bayesian models with sparse or dense priors. We discuss “formal” empirical Bayes methods that maximize the marginal likelihood but also more informal approaches based on other data summaries. We contrast empirical Bayes to cross‐validation and full Bayes and discuss hybrid approaches. To study the relation between the quality of an empirical Bayes estimator and p, the number of variables, we consider a simple empirical Bayes estimator in a linear model setting. We argue that empirical Bayes is particularly useful when the prior contains multiple parameters, which model a priori information on variables termed “co‐data”. In particular, we present two novel examples that allow for co‐data: first, a Bayesian spike‐and‐slab setting that facilitates inclusion of multiple co‐data sources and types and, second, a hybrid empirical Bayes–full Bayes ridge regression approach for estimation of the posterior predictive interval.     

Bayesian Estimators for Small Area Models when Auxiliary Information is Measured with Error

Small area estimators in linear models are typically expressed as a convex combination of direct estimators and synthetic estimators from a suitable model. When auxiliary information used in the model is measured with error, a new estimator, accounting for the measurement error in the covariates, has been proposed in the literature. Recently, for area‐level model, Ybarra & Lohr (Biometrika, 95, 2008, 919) suggested a suitable modification to the estimates of small area means based on Fay & Herriot (J. Am. Stat. Assoc., 74, 1979, 269) model where some of the covariates are measured with error. They used a frequentist approach based on the method of moments. Adopting a Bayesian approach, we propose to rewrite the measurement error model as a hierarchical model; we use improper non‐informative priors on the model parameters and show, under a mild condition, that the joint posterior distribution is proper and the marginal posterior distributions of the model parameters have finite variances. We conduct a simulation study exploring different scenarios. The Bayesian predictors we propose show smaller empirical mean squared errors than the frequentist predictors of Ybarra & Lohr (Biometrika, 95, 2008, 919), and they seem also to be more stable in terms of variability and bias. We apply the proposed methodology to two real examples.     

Evaluation of spatial Bayesian models—Two computational methods

Integrating a posterior function with respect to its parameters is required to compare the goodness-of-fit among Bayesian models which may have distinct priors or likelihoods. This paper is concerned with two integration methods for very high dimensional functions, using a Markovian Monte Carlo simulation or a Gaussian approximation. Numerical applications include analyses of spatial data in epidemiology and seismology.