Bayes and robust Bayes predictions in a subfamily of scale parameters under a precautionary loss function

ABSTRACT

This paper deals with Bayes, robust Bayes, and minimax predictions in a subfamily of scale parameters under an asymmetric precautionary loss function. In Bayesian statistical inference, the goal is to obtain optimal rules under a specified loss function and an explicit prior distribution over the parameter space. However, in practice, we are not able to specify the prior totally or when a problem must be solved by two statisticians, they may agree on the choice of the prior but not the values of the hyperparameters. A common approach to the prior uncertainty in Bayesian analysis is to choose a class of prior distributions and compute some functional quantity. This is known as Robust Bayesian analysis which provides a way to consider the prior knowledge in terms of a class of priors Γ for global prevention against bad choices of hyperparameters. Under a scale invariant precautionary loss function, we deal with robust Bayes predictions of Y based on X. We carried out a simulation study and a real data analysis to illustrate the practical utility of the prediction procedure.     

Robust Bayesian methodology with applications in credibility premium derivation and future claim size prediction

Robust Bayesian methodology deals with the problem of explaining uncertainty of the inputs (the prior, the model, and the loss function) and provides a breakthrough way to take into account the input’s variation. If the uncertainty is in terms of the prior knowledge, robust Bayesian analysis provides a way to consider the prior knowledge in terms of a class of priors \(\varGamma \) and derive some optimal rules. In this paper, we motivate utilizing robust Bayes methodology under the asymmetric general entropy loss function in insurance and pursue two main goals, namely (i) computing premiums and (ii) predicting a future claim size. To achieve the goals, we choose some classes of priors and deal with (i) Bayes and posterior regret gamma minimax premium computation, (ii) Bayes and posterior regret gamma minimax prediction of a future claim size under the general entropy loss. We also perform a prequential analysis and compare the performance of posterior regret gamma minimax predictors against the Bayes predictors.     

Robust Bayesian methods in simple ANOVA models

A robust Bayesian analysis in a conjugate normal framework for the simple ANOVA model is suggested. By fixing the prior mean and varying the prior covariance matrix over a restricted class, we obtain the so-called HiFi and core region, a union and intersection of HPD regions. Based on these robust HPD regions we develop the concept of a ‘robust Bayesian judgement’ procedure. We apply this approach to the simple analysis of variance model with orthogonal designs. The example analyses the costs of an asthma medication obtained by a two-way cross-over study.     

Bayesian and robust Bayesian analysis in a general setting

In this paper we introduce a broad family of loss functions based on the concept of Bregman divergence. We deal with both Bayesian estimation and prediction problems and show that all Bayes solutions associated with loss functions belonging to the introduced family of losses satisfy the same equation. We further concentrate on the concept of robust Bayesian analysis and provide one equation that explicitly leads to robust Bayes solutions. The results are model-free and include many existing results in Bayesian and robust Bayesian contexts in the literature.     

Asymptotic optimality of a two-stage procedure in Bayes sequential estimation

The problem of sequential estimation of the mean with quadratic loss and fixed cost per observation is considered within the Bayesian framework. Instead of fully sequential sampling, a two-stage sampling technique is introduced to solve the problem. The proposed two-stage procedure is robust in the sense that it does not depend on the distribution of outcome variables and the prior. It is shown to be asymptotically not worse than the optimal fixed-sample-size procedures for the arbitrary distributions, and to be asymptotically Bayes for the distributions of one-parameter exponential family.     

Bayesian estimation for first-order autoregressive model with explanatory variables

In this article, we develop a Bayesian analysis in autoregressive model with explanatory variables. When σ² is known, we consider a normal prior and give the Bayesian estimator for the regression coefficients of the model. For the case σ² is unknown, another Bayesian estimator is given for all unknown parameters under a conjugate prior. Bayesian model selection problem is also being considered under the double-exponential priors. By the convergence of ρ-mixing sequence, the consistency and asymptotic normality of the Bayesian estimators of the regression coefficients are proved. Simulation results indicate that our Bayesian estimators are not strongly dependent on the priors, and are robust.     

Behaviour of the posterior error rate with partial prior information in auditing

Most of the Bayesian literature on statistical techniques in auditing has focused on assessing appropriate prior density using parameters such as interest, error rate and the mean of the error amount. Frequently, prior beliefs and mathematical tractable reasons are jointly used to assess prior distributions. As a robust Bayesian approach, we propose to replace the prior distribution with a set of prior distributions compatible with auditor's beliefs. We show how an auditor may draw the behaviour of the posterior error rate, using only partial prior information (quartiles of the prior distribution for the error rate O and, very often, the prior distribution is assumed to be unimodal). An example is pursued in depth.     

Predictive control of posterior robustness for sample size choice in a Bernoulli model

In this article we consider the sample size determination problem in the context of robust Bayesian parameter estimation of the Bernoulli model. Following a robust approach, we consider classes of conjugate Beta prior distributions for the unknown parameter. We assume that inference is robust if posterior quantities of interest (such as point estimates and limits of credible intervals) do not change too much as the prior varies in the selected classes of priors. For the sample size problem, we consider criteria based on predictive distributions of lower bound, upper bound and range of the posterior quantity of interest. The sample size is selected so that, before observing the data, one is confident to observe a small value for the posterior range and, depending on design goals, a large (small) value of the lower (upper) bound of the quantity of interest. We also discuss relationships with and comparison to non robust and non informative Bayesian methods.     

Robust Bayesian prediction under a general linear-exponential posterior risk function and its application in finite population

We consider robust Bayesian prediction of a function of unobserved data based on observed data under an asymmetric loss function. Under a general linear-exponential posterior risk function, the posterior regret gamma-minimax (PRGM), conditional gamma-minimax (CGM), and most stable (MS) predictors are obtained when the prior distribution belongs to a general class of prior distributions. We use this general form to find the PRGM, CGM, and MS predictors of a general linear combination of the finite population values under LINEX loss function on the basis of two classes of priors in a normal model. Also, under the general ε-contamination class of prior distributions, the PRGM predictor of a general linear combination of the finite population values is obtained. Finally, we provide a real-life example to predict a finite population mean and compare the estimated risk and risk bias of the obtained predictors under the LINEX loss function by a simulation study.     

Robust Bayesian hypothesis testing in the presence of nuisance parameters

Robust Bayesian testing of point null hypotheses is considered for problems involving the presence of nuisance parameters. The robust Bayesian approach seeks answers that hold for a range of prior distributions. Three techniques for handling the nuisance parameter are studied and compared. They are (i) utilize a noninformative prior to integrate out the nuisance parameter; (ii) utilize a test statistic whose distribution does not depend on the nuisance parameter; and (iii) use a class of prior distributions for the nuisance parameter. These approaches are studied in two examples, the univariate normal model with unknown mean and variance, and a multivariate normal example.     

Robust Bayesian analysis of generalized inverted family of distributions

ABSTRACT

In the current study we develop the robust Bayesian inference for the generalized inverted family of distributions (GIFD) under an ε-contamination class of prior distributions for the shape parameter α, with different possibilities of known and unknown scale parameter. We used Type II censoring and Bartholomew sampling scheme (1963) for the following derivations under the squared-error loss function (SELF) and linear exponential (LINEX) loss function : ML-II Bayes estimators of the i) parameters; ii) Reliability function and; iii) Hazard function. We also present simulation study and analysis of a real data set.     

Inference in hybrid Bayesian networks using dynamic discretization

We consider approximate inference in hybrid Bayesian Networks (BNs) and present a new iterative algorithm that efficiently combines dynamic discretization with robust propagation algorithms on junction trees. Our approach offers a significant extension to Bayesian Network theory and practice by offering a flexible way of modeling continuous nodes in BNs conditioned on complex configurations of evidence and intermixed with discrete nodes as both parents and children of continuous nodes. Our algorithm is implemented in a commercial Bayesian Network software package, AgenaRisk, which allows model construction and testing to be carried out easily. The results from the empirical trials clearly show how our software can deal effectively with different type of hybrid models containing elements of expert judgment as well as statistical inference. In particular, we show how the rapid convergence of the algorithm towards zones of high probability density, make robust inference analysis possible even in situations where, due to the lack of information in both prior and data, robust sampling becomes unfeasible.     

An efficiency Bayesian unit root test in Unobserved-ARCH models

This paper investigates the new prior distribution on the Unobserved-Autoregressive Conditional Heteroscedasticity (ARCH) unit root test. Monte Carlo simulations show that the sample size is seriously effective in efficiency of Bayesian test. To improve the performance of Bayesian test for unit root, we propose a new Bayesian test that is robust in the presence of stationary and nonstationary Unobserved-ARCH. The finite sample property of the proposed test statistic is evaluated using Monte Carlo studies. Applying the developed method, we test the policy of daily exchange rate of the German Marc with respect to the Greek Drachma.     

Efficient Bayesian sampling plans for exponential distributions with random censoring

This paper considers Bayesian sampling plans for exponential distribution with random censoring. The efficient Bayesian sampling plan for a general loss function is derived. This sampling plan possesses the property that it may make decisions prior to the end of the life test experiment, and its decision function is the same as the Bayes decision function which makes decisions based on data collected at the end of the life test experiment. Compared with the optimal Bayesian sampling plan of Chen et al. (2004), the efficient Bayesian sampling plan has the smaller Bayes risk due to the less duration time of life test experiment. Computations of the efficient Bayes risks for the conjugate prior are given. Numerical comparisons between the proposed efficient Bayesian sampling plan and the optimal Bayesian sampling plan of Chen et al. (2004) under two special decision losses, including the quadratic decision loss, are provided. Numerical results also demonstrate that the performance of the proposed efficient sampling plan is superior to that of the optimal sampling plan by Chen et al. (2004).     

Bayesian Factor Model Shrinkage for Linear IV Regression With Many Instruments

A Bayesian approach for the many instruments problem in linear instrumental variable models is presented. The new approach has two components. First, a slice sampler is developed, which leverages a decomposition of the likelihood function that is a Bayesian analogue to two-stage least squares. The new sampler permits nonconjugate shrinkage priors to be implemented easily and efficiently. The new computational approach permits a Bayesian analysis of problems that were previously infeasible due to computational demands that scaled poorly in the number of regressors. Second, a new predictor-dependent shrinkage prior is developed specifically for the many instruments setting. The prior is constructed based on a factor model decomposition of the matrix of observed instruments, allowing many instruments to be incorporated into the analysis in a robust way. Features of the new method are illustrated via a simulation study and three empirical examples.     

Optimal,nearly optimal and robust procedures for the exponential distribution with relative linear exponential loss

In this paper, the problem of sequentially estimating the mean of the exponential distribution with relative linear exponential loss and fixed cost for each observation is considered within the Bayesian framework. An optimal procedure with a deterministic stopping rule is derived. Since the corresponding value of the optimal deterministic stopping rule cannot be obtained directly, an approximate optimal deterministic stopping rule and an asymptotically pointwise optimal rule are proposed. In addition, we propose a robust procedure with a deterministic stopping rule, which does not depend on the parameters of the prior distribution. All of the proposed procedures are shown to be asymptotically optimal. Some numerical studies are conducted to investigate the performances of the proposed procedures. A real data set is provided to illustrate the use of the proposed procedures.     

Bayesian acceptance sampling plans following economic criteria: An application to paper pulp manufacturing

The main purposes of this paper are to derive Bayesian acceptance sampling plans regarding the number of defects per unit of product, and to illustrate how to apply the methodology to the paper pulp industry. The sampling plans are obtained following an economic criterion: minimize the expected total cost of quality. It has been assumed that the number of defects per unit of product follows a Poisson distribution with process average 5 , whose prior information is described either for a gamma or for a non- informative distribution. The expected total cost of quality is composed of three independent components: inspection, acceptance and rejection. Both quadratic and step-loss functions have been used to quantify the cost incurred for the acceptance of a lot containing units with defects. Combining the prior information on 5 with the loss functions, four different sampling plans are obtained. When the quadratic-loss function is used, an analytical relation between the optimum settings of the sample size and the acceptance number is derived. The robustness analysis indicates that the sampling plans obtained are robust with respect to the prior distribution of the process average as well as to the misspecification of its mean and variance.     

The equivalence of Bayes and robust Bayes estimators for various loss functions

The problem of Bayes and robust Bayes estimation for various bounded and/or symmetric loss functions in a normal model with conjugate and non-informative prior distributions is considered. The prior distribution is not fully specified and covers the conjugate family of priors. It is of interest to know that the Bayes and robust Bayes estimators for symmetric losses are the same as those for the standard square-error loss function.     

Experience with a bayesian bootstrap method incorporating proper prior information

Although bootstrapping has become widely used in statistical analysis, there has been little reported concerning bootstrapped Bayesian analyses, especially when there is proper prior informa-tion concerning the parameter of interest. In this paper, we first propose an operationally implementable definition of a Bayesian bootstrap. Thereafter, in simulated studies of the estimation of means and variances, this Bayesian bootstrap is compared to various parametric procedures. It turns out that little information is lost in using the Bayesian bootstrap even when the sampling distribution is known. On the other hand, the parametric procedures are at times very sensitive to incorrectly specified sampling distributions, implying that the Bayesian bootstrap is a very robust procedure for determining the posterior distribution of the parameter.     

Bayesian robustness in bidimensional models: Prior independence

When θ is a multidimensional parameter, the issue of prior dependence or independence of coordinates is a serious concern. This is especially true in robust Bayesian analysis; Lavine et al. (J. Amer. Statist. Assoc.86, 964–971 (1991)) show that allowing a wide range of prior dependencies among coordinates can result in near vacuous conclusions. It is sometimes possible, however, to make confidently the judgement that the coordinates of θ are independent a priori and, when this can be done, robust Bayesian conclusions improve dramatically. In this paper, it is shown how to incorporate the independence assumption into robust Bayesian analysis involving -contamination and density band classes of priors. Attention is restricted to the case θ = (θ₁, θ₂) for clarity, although the ideas generalize.