Higher-order Bayesian Approximations for Pseudo-posterior Distributions

The theory of higher-order asymptotics provides accurate approximations to posterior distributions for a scalar parameter of interest, and to the corresponding tail area, for practical use in Bayesian analysis. The aim of this article is to extend these approximations to pseudo-posterior distributions, e.g., posterior distributions based on a pseudo-likelihood function and a suitable prior, which are proved to be particularly useful when the full likelihood is analytically or computationally infeasible. In particular, from a theoretical point of view, we derive the Laplace approximation for a pseudo-posterior distribution, and for the corresponding tail area, for a scalar parameter of interest, also in the presence of nuisance parameters. From a computational point of view, starting from these higher-order approximations, we discuss the higher-order tail area (HOTA) algorithm useful to approximate marginal posterior distributions, and related quantities. Compared to standard Markov chain Monte Carlo methods, the main advantage of the HOTA algorithm is that it gives independent samples at a negligible computational cost. The relevant computations are illustrated by two examples.     

Full Bayesian Significance Test for Zero-Inflated Distributions

ABSTRACT

In this article we propose a new Kolmogorov-Smirnov type test for testing the nonlinearity of time series, based on the one which was originally introduced by An and Cheng. Our simulation study shows that the suggested test performs better than the original test. An associated bootstrap test is also found to outperform remarkably the non-bootstrap test.     

Objective Bayesian Analysis of Skew‐t Distributions

Abstract. We study the Jeffreys prior and its properties for the shape parameter of univariate skew‐t distributions with linear and nonlinear Student's t skewing functions. In both cases, we show that the resulting priors for the shape parameter are symmetric around zero and proper. Moreover, we propose a Student's t approximation of the Jeffreys prior that makes an objective Bayesian analysis easy to perform. We carry out a Monte Carlo simulation study that demonstrates an overall better behaviour of the maximum a posteriori estimator compared with the maximum likelihood estimator. We also compare the frequentist coverage of the credible intervals based on the Jeffreys prior and its approximation and show that they are similar. We further discuss location‐scale models under scale mixtures of skew‐normal distributions and show some conditions for the existence of the posterior distribution and its moments. Finally, we present three numerical examples to illustrate the implications of our results on inference for skew‐t distributions.     

Bayesian Estimation of the Parameters of Bivariate Exponential Distributions

In this article, we develop an empirical Bayesian approach for the Bayesian estimation of parameters in four bivariate exponential (BVE) distributions. We have opted for gamma distribution as a prior for the parameters of the model in which the hyper parameters have been estimated based on the method of moments and maximum likelihood estimates (MLEs). A simulation study was conducted to compute empirical Bayesian estimates of the parameters and their standard errors. We use moment estimators or MLEs to estimate the hyper parameters of the prior distributions. Furthermore, we compare the posterior mode of parameters obtained by different prior distributions and the Bayesian estimates based on gamma priors are very close to the true values as compared to improper priors. We use MCMC method to obtain the posterior mean and compared the same using the improper priors and the classical estimates, MLEs.     

Posterior Predictive p-values in Bayesian Hierarchical Models

Abstract.  The present work focuses on extensions of the posterior predictive p -value (ppp-value) for models with hierarchical structure, designed for testing assumptions made on underlying processes. The ppp-values are popular as tools for model criticism, yet their lack of a common interpretation limit their practical use. We discuss different extensions of ppp-values to hierarchical models, allowing for discrepancy measures that can be used for checking properties of the model at all stages. Through analytical derivations and simulation studies on simple models, we show that similar to the standard ppp-values, these extensions are typically far from uniformly distributed under the model assumptions and can give poor power in a hypothesis testing framework. We propose a calibration of the p -values, making the resulting calibrated p -values uniformly distributed under the model conditions. Illustrations are made through a real example of multinomial regression to age distributions of fish.     

Bayesian Point Estimation Using the Predictive Distribution

There is considerable question about how a Bayesian might provide a point estimate for a parameter when no loss function is specified. The mean, median, and mode of the posterior distribution have all been suggested. This article considers a natural Bayesian estimator based on the predictive distribution of future observations. It is shown that for the set of parameters that admit an unbiased estimate, this predictive estimate coincides with the posterior mean of the parameter. It is argued that this result provides some justification for use of the posterior mean as a Bayesian point estimate when there is no loss structure.     

Bayesian Goodness of Fit Testing with Mixtures of Triangular Distributions

Abstract.  We consider the consistency of the Bayes factor in goodness of fit testing for a parametric family of densities against a non-parametric alternative. Sufficient conditions for consistency of the Bayes factor are determined and demonstrated with priors using certain mixtures of triangular densities.     

Objective Bayesian Inference for the Half-Normal and Half-t Distributions

In this article, Bayesian inference for the half-normal and half-t distributions using uninformative priors is considered. It is shown that exact Bayesian inference can be undertaken for the half-normal distribution without the need for Gibbs sampling. Simulation is then used to compare the sampling properties of Bayesian point and interval estimators with those of their maximum likelihood based counterparts. Inference for the half-t distribution based on the use of Gibbs sampling is outlined, and an approach to model comparison based on the use of Bayes factors is discussed. The fitting of the half-normal and half-t models is illustrated using real data on the body fat measurements of elite athletes.     

Bayesian Nonparametric Inference for Random Distributions and Related Functions

In recent years, Bayesian nonparametric inference, both theoretical and computational, has witnessed considerable advances. However, these advances have not received a full critical and comparative analysis of their scope, impact and limitations in statistical modelling; many aspects of the theory and methods remain a mystery to practitioners and many open questions remain. In this paper, we discuss and illustrate the rich modelling and analytic possibilities that are available to the statistician within the Bayesian nonparametric and/or semiparametric framework.     

Bayesian Analysis of Least Absolute Relative Error Regression

In an important article by Chen et al. (2010) introduced a new distribution compatible with maximum likelihood estimation in a Least Absolute Relative Error (LARE) setting. In this article, we show first that the posterior of the model is log – concave and thus specialized and highly efficient techniques can be used to perform Bayesian inference without the use of MCMC since they provide independent draws from the posterior. Second, we approximate the distribution using a finite mixture of normals. Surprisingly, the log-LARE distribution can be approximated using a finite scale mixture of normals with few components.     

Bayesian Interval Estimation for Predictive Values from Case-Control Studies

Positive predictive and negative predictive values (PPV and NPV) are often used to assess the accuracy of binary diagnostic tests. Unlike sensitivity and specificity, PPV and NPV are functions of the accuracy of the test and the overall prevalence of the disease in the population. In many studies of performance of estimators of PPV and NPV the population prevalence is assumed known. We allow for uncertainty in the estimate of the population prevalence and via simulation explore the impact of deviations from the assumed value.     

Mixture of Distributions in the Biparametric Exponential Family: A Bayesian Approach

In this article we propose mixture of distributions belonging to the biparametric exponential family, considering joint modeling of the mean and variance (or dispersion) parameters. As special cases we consider mixtures of normal and gamma distributions. A novel Bayesian methodology, using Markov Chain Monte Carlo (MCMC) methods, is proposed to obtain the posterior summaries of interest. We include simulations and real data examples to illustrate de performance of the proposal.     

Bayesian Inference for the Precision Matrix for Scale Mixtures of Normal Distributions

Baysian inference is considered for the precision matrix of the multivariate regression model with distribution of the random responses belonging to the multivariate scale mixtures of normal distributions. The posterior distribution and some identities involving expectations taken with respect to this posterior distribution are derived when the prior distribution of the parameters is from the conjugate family. The results are specialized to the case where the random responses have a matrix-t distribution and thus generalizing the results of Zellner (1976 Zellner , A. ( 1976 ). Bayesian and non-Bayesian analysis of the regression model with multivariate Student-t error terms . J. Amer. Statist. Assoc. 71 : 400 – 405 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Muirhead (1986 Muirhead , R. J. ( 1986 ). A note on some Wishart expectations . Metrika 33 : 247 – 251 .[Crossref] , [Google Scholar]).     

非寿险费率厘定的索赔频率预测模型及其应用

在非寿险分类费率厘定中,泊松回归模型是最常使用的索赔频率预测模型,但实际的索赔频率数据往往存在过离散特征,使泊松回归模型的结果缺乏可靠性.因此,讨论处理过离散问题的各种回归模型,包括负二项回归模型、泊松-逆高斯回归模型、泊松-对数正态回归模型、广义泊松回归模型、双泊松回归模型、混合负二项回归模型、混合二项回归模型、Delaporte回归模型和Sichel回归模型,并对其进行系统比较研究认为:这些模型都可以看做是对泊松回归模型的推广,可以用于处理各种不同过离散程度的索赔频率数据,从而改善费率厘定的效果;同时应用一组实际的汽车保险数据,讨论这些模型的具体应用.     

Bayesian Longitudinal Data Analysis with Mixed Models and Thick-tailed Distributions using MCMC

Linear mixed effects models are frequently used to analyse longitudinal data, due to their flexibility in modelling the covariance structure between and within observations. Further, it is easy to deal with unbalanced data, either with respect to the number of observations per subject or per time period, and with varying time intervals between observations. In most applications of mixed models to biological sciences, a normal distribution is assumed both for the random effects and for the residuals. This, however, makes inferences vulnerable to the presence of outliers. Here, linear mixed models employing thick-tailed distributions for robust inferences in longitudinal data analysis are described. Specific distributions discussed include the Student-t, the slash and the contaminated normal. A Bayesian framework is adopted, and the Gibbs sampler and the Metropolis-Hastings algorithms are used to carry out the posterior analyses. An example with data on orthodontic distance growth in children is discussed to illustrate the methodology. Analyses based on either the Student-t distribution or on the usual Gaussian assumption are contrasted. The thick-tailed distributions provide an appealing robust alternative to the Gaussian process for modelling distributions of the random effects and of residuals in linear mixed models, and the MCMC implementation allows the computations to be performed in a flexible manner.     

Predictive sets with approximate frequentist and Bayesian validity for arbitrary priors

With a view to predicting a scalar-valued future observation on the basis of past observations, we explore predictive sets having frequentist as well as Bayesian validity for arbitrary priors in a higher-order asymptotic sense. It is found that a connection with locally unbiased tests is useful for this purpose. Illustrative examples are given. Computation and simulation studies lend support to our asymptotic results in finite samples. The issue of expected lengths of our predictive sets is also discussed.     

On the Robustness of Bayesian Modelling of Location and Scale Structures Using Heavy-Tailed Distributions

For solving conflicting information between data and prior distributions, Bayesian modelling with heavy-tailed distributions is applied. Exploiting properties of regularly varying functions and distribution functions as well as their relationship with the finiteness of the moments, we establish results for both location and shape parameter structures. And, as a side result, rates of convergence are derived.     

On the Predictive Distributions of Outcome Gains in the Presence of an Unidentified Parameter

In this article we describe methods for obtaining the predictive distributions of outcome gains in the framework of a standard latent variable selection model. Although most previous work has focused on estimation of mean treatment parameters as the method for characterizing outcome gains from program participation, we show how the entire distributions associated with these gains can be obtained in certain situations. Although the out-of-sample outcome gain distributions depend on an unidentified parameter, we use the results of Koop and Poirier to show that learning can take place about this parameter through information contained in the identified parameters via a positive definiteness restriction on the covariance matrix. In cases where this type of learning is not highly informative, the spread of the predictive distributions depends more critically on the prior. We show both theoretically and in extensive generated data experiments how learning occurs, and delineate the sensitivity of our results to the prior specifications. We relate our analysis to three treatment parameters widely used in the evaluation literature—the average treatment effect, the effect of treatment on the treated, and the local average treatment effect—and show how one might approach estimation of the predictive distributions associated with these outcome gains rather than simply the estimation of mean effects. We apply these techniques to predict the effect of literacy on the weekly wages of a sample of New Jersey child laborers in 1903.     

Predictive analysis for joint progressive censoring plans: a Bayesian approach

Comparative lifetime experiments are of particular importance in production processes when one wishes to determine the relative merits of several competing products with regard to their reliability. This paper confines itself to the data obtained by running a joint progressive Type-II censoring plan on samples in a combined manner. The problem of Bayesian predicting failure times of surviving units is discussed in details when parent populations are exponential. Two real data sets are analyzed in order to illustrate all the inferential procedures developed here. When destructive experiments under a censoring scheme finished, the researchers are usually interested to estimate remaining lifetimes of surviving units for sequel experiments. Findings of this paper are useful for these purposes specially when samples are non-homogeneous such as those taken from industrial storages.     

Bayesian Estimation Using Warner's Randomized Response Model through Simple and Mixture Prior Distributions

The linear discriminant function (LDF) is known to be optimal in the sense of achieving an optimal error rate when sampling from multivariate normal populations with equal covariance matrices. Use of the LDF in nonnormal situations is known to lead to some strange results. This paper will focus on an evaluation of misclassification probabilities when the power transformation could have been used to achieve at least approximate normality and equal covariance matrices in the sampled populations for the distribution of the observed random variables. Attention is restricted to the two-population case with bivariate distributions.