Nonparametric Bayesian inference for ergodic diffusions

The problem of nonparametric drift estimation for ergodic diffusions is studied from a Bayesian perspective. In particular, Gaussian process priors are exhibited that yield optimal contraction rates if the drift function belongs to a smoothness class.     

A note on Bayesian nonparametric regression function estimation

In this note the problem of nonparametric regression function estimation in a random design regression model with Gaussian errors is considered from the Bayesian perspective. It is assumed that the regression function belongs to a class of functions with a known degree of smoothness. A prior distribution on the given class can be induced by a prior on the coefficients in a series expansion of the regression function through an orthonormal system. The rate of convergence of the resulting posterior distribution is employed to provide a measure of the accuracy of the Bayesian estimation procedure defined by the posterior expected regression function. We show that the Bayes’ estimator achieves the optimal minimax rate of convergence under mean integrated squared error over the involved class of regression functions, thus being comparable to other popular frequentist regression estimators.     

Gibbs sampling methods for Bayesian quantile regression

This paper considers quantile regression models using an asymmetric Laplace distribution from a Bayesian point of view. We develop a simple and efficient Gibbs sampling algorithm for fitting the quantile regression model based on a location-scale mixture representation of the asymmetric Laplace distribution. It is shown that the resulting Gibbs sampler can be accomplished by sampling from either normal or generalized inverse Gaussian distribution. We also discuss some possible extensions of our approach, including the incorporation of a scale parameter, the use of double exponential prior, and a Bayesian analysis of Tobit quantile regression. The proposed methods are illustrated by both simulated and real data.     

Bayesian Conditional Mean Estimation in Log‐Normal Linear Regression Models with Finite Quadratic Expected Loss

Log‐normal linear regression models are popular in many fields of research. Bayesian estimation of the conditional mean of the dependent variable is problematic as many choices of the prior for the variance (on the log‐scale) lead to posterior distributions with no finite moments. We propose a generalized inverse Gaussian prior for this variance and derive the conditions on the prior parameters that yield posterior distributions of the conditional mean of the dependent variable with finite moments up to a pre‐specified order. The conditions depend on one of the three parameters of the suggested prior; the other two have an influence on inferences for small and medium sample sizes. A second goal of this paper is to discuss how to choose these parameters according to different criteria including the optimization of frequentist properties of posterior means.     

On the matrix-variate generalized hyperbolic distribution and its Bayesian applications

In the first part of the paper, we introduce the matrix-variate generalized hyperbolic distribution by mixing the matrix normal distribution with the matrix generalized inverse Gaussian density. The p-dimensional generalized hyperbolic distribution of [Barndorff-Nielsen, O. (1978). Hyperbolic distributions and distributions on hyperbolae. Scand. J. Stat., 5, 151–157], the matrix-T distribution and many well-known distributions are shown to be special cases of the new distribution. Some properties of the distribution are also studied. The second part of the paper deals with the application of the distribution in the Bayesian analysis of the normal multivariate linear model.     

Prior elicitation, variable selection and Bayesian computation for logistic regression models

Bayesian selection of variables is often difficult to carry out because of the challenge in specifying prior distributions for the regression parameters for all possible models, specifying a prior distribution on the model space and computations. We address these three issues for the logistic regression model. For the first, we propose an informative prior distribution for variable selection. Several theoretical and computational properties of the prior are derived and illustrated with several examples. For the second, we propose a method for specifying an informative prior on the model space, and for the third we propose novel methods for computing the marginal distribution of the data. The new computational algorithms only require Gibbs samples from the full model to facilitate the computation of the prior and posterior model probabilities for all possible models. Several properties of the algorithms are also derived. The prior specification for the first challenge focuses on the observables in that the elicitation is based on a prior prediction y ₀ for the response vector and a quantity a ₀ quantifying the uncertainty in y ₀. Then, y ₀ and a ₀ are used to specify a prior for the regression coefficients semi-automatically. Examples using real data are given to demonstrate the methodology.     

A note on Bayesian estimation of traffic intensity in single-server Markovian queues

ABSTRACT

In queuing theory, a major interest of researchers is studying the behavior and formation process and analyzing the performance characteristics of queues, particularly the traffic intensity, which is defined as the ratio between the arrival rate and the service rate. How these parameters can be estimated using some statistical inferential method is the mathematical problem treated here. This article aims to obtain better Bayesian estimates for the traffic intensity of M/M/1 queues, which, in Kendall notation, stand for Markovian single-server infinity queues. The Jeffreys prior is proposed to obtain the posterior and predictive distributions of some parameters of interest. Samples are obtained through simulation and some performance characteristics are analyzed. It is observed from the Bayes factor that Jeffreys prior is competitive, among informative and non-informative prior distributions, and presents the best performance in many of the cases tested.     

Bayesian inference for power law processes with applications in repairable systems

Statistical models for recurrent events are of great interest in repairable systems reliability and maintenance. The adopted model under minimal repair maintenance is frequently a nonhomogeneous Poisson process with the power law process (PLP) intensity function. Although inference for the PLP is generally based on maximum likelihood theory, some advantages of the Bayesian approach have been reported in the literature. In this paper it is proposed that the PLP intensity be reparametrized in terms of (β,η), where β is the elasticity of the mean number of events with respect to time and η is the mean number of events for the period in which the system was actually observed. It is shown that β and η are orthogonal and that the likelihood becomes proportional to a product of gamma densities. Therefore, the family of natural conjugate priors is also a product of gammas. The idea is extended to the case that several realizations of the same PLP are observed along overlapping periods of time. Some Monte Carlo simulations are provided to study the frequentist behavior of the Bayesian estimates and to compare them with the maximum likelihood estimates. The results are applied to a real problem concerning the determination of the optimal periodicity of preventive maintenance for a set of power transformers. Prior distributions are elicited for β and η based on their operational interpretation and engineering expertise.     

Objective Bayesian inference for the ratio of the scale parameters of two Weibull distributions

The Weibull distribution is widely used due to its versatility and relative simplicity. In our paper, the non informative priors for the ratio of the scale parameters of two Weibull models are provided. The asymptotic matching of coverage probabilities of Bayesian credible intervals is considered, with the corresponding frequentist coverage probabilities. We developed the various priors for the ratio of two scale parameters using the following matching criteria: quantile matching, matching of distribution function, highest posterior density matching, and inversion of test statistics. One particular prior, which meets all the matching criteria, is found. Next, we derive the reference priors for groups of ordering. We see that all the reference priors satisfy a first-order matching criterion and that the one-at-a-time reference prior is a second-order matching prior. A simulation study is performed and an example given.     

A Bayesian Test for the Mean of the Power Exponential Distribution

In this article, we deal with the problem of testing a point null hypothesis for the mean of a multivariate power exponential distribution. We study the conditions under which Bayesian and frequentist approaches can match. In this comparison it is observed that the tails of the model are the key to explain the reconciliability or irreconciliability between the two approaches.     

Bayesian inference for sinh-normal/independent nonlinear regression models

Sinh-normal/independent distributions are a class of symmetric heavy-tailed distributions that include the sinh-normal distribution as a special case, which has been used extensively in Birnbaum–Saunders regression models. Here, we explore the use of Markov Chain Monte Carlo methods to develop a Bayesian analysis in nonlinear regression models when Sinh-normal/independent distributions are assumed for the random errors term, and it provides a robust alternative to the sinh-normal nonlinear regression model. Bayesian mechanisms for parameter estimation, residual analysis and influence diagnostics are then developed, which extend the results of Farias and Lemonte [Bayesian inference for the Birnbaum-Saunders nonlinear regression model, Stat. Methods Appl. 20 (2011), pp. 423-438] who used the Sinh-normal/independent distributions with known scale parameter. Some special cases, based on the sinh-Student-t (sinh-St), sinh-slash (sinh-SL) and sinh-contaminated normal (sinh-CN) distributions are discussed in detail. Two real datasets are finally analyzed to illustrate the developed procedures.     

Bayesian Inference for the Precision Matrix for Scale Mixtures of Normal Distributions

Baysian inference is considered for the precision matrix of the multivariate regression model with distribution of the random responses belonging to the multivariate scale mixtures of normal distributions. The posterior distribution and some identities involving expectations taken with respect to this posterior distribution are derived when the prior distribution of the parameters is from the conjugate family. The results are specialized to the case where the random responses have a matrix-t distribution and thus generalizing the results of Zellner (1976 Zellner , A. ( 1976 ). Bayesian and non-Bayesian analysis of the regression model with multivariate Student-t error terms . J. Amer. Statist. Assoc. 71 : 400 – 405 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Muirhead (1986 Muirhead , R. J. ( 1986 ). A note on some Wishart expectations . Metrika 33 : 247 – 251 .[Crossref] , [Google Scholar]).     

Bayesian analysis of the generalized gamma distribution using non-informative priors

The Generalized gamma (GG) distribution plays an important role in statistical analysis. For this distribution, we derive non-informative priors using formal rules, such as Jeffreys prior, maximal data information prior and reference priors. We have shown that these most popular formal rules with natural ordering of parameters, lead to priors with improper posteriors. This problem is overcome by considering a prior averaging approach discussed in Berger et al. [Overall objective priors. Bayesian Analysis. 2015;10(1):189–221]. The obtained hybrid Jeffreys-reference prior is invariant under one-to-one transformations and yields a proper posterior distribution. We obtained good frequentist properties of the proposed prior using a detailed simulation study. Finally, an analysis of the maximum annual discharge of the river Rhine at Lobith is presented.     

Default Bayesian goodness-of-fit tests for the skew-normal model

In this paper we propose a series of goodness-of-fit tests for the family of skew-normal models when all parameters are unknown. As the null distributions of the considered test statistics depend only on asymmetry parameter, we used a default and proper prior on skewness parameter leading to the prior predictive p-value advocated by G. Box. Goodness-of-fit tests, here proposed, depend only on sample size and exhibit full agreement between nominal and actual size. They also have good power against local alternative models which also account for asymmetry in the data.     

Bayesian Alternatives to the F Test for Two Population Variances

Bayesian alternatives to the classical F test comparing two population variances are explored. Shoemaker (2003 Shoemaker , L. H. ( 2003 ). Fixing the F test for equal variances . The Amer. Statistician 57 : 105 – 114 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) suggested two adjustments to the F test due to it being very sensitive to the normal assumption of the two populations. A simulation study is performed to compare the Bayesian alternatives to the F test and Shoemaker's adjusted F tests as well as to the Levene/Brown–Forsythe and the squared rank nonparametric tests. The Bayesian alternatives assume a normal parent distribution and non informative priors and the conjugate prior for the variances; in addition, an exponential power distribution is considered as the parent distribution with a non informative prior for the variances. The latter looks to be very promising provided that a suitable value of a parameter which measures the extent of non normality is chosen.     

On asymptotic properties of Bayesian partially linear models

In this paper, we present large sample properties of a partially linear model from the Bayesian perspective, in which responses are explained by the semiparametric regression model with the additive form of the linear component and the nonparametric component. For this purpose, we investigate asymptotic behaviors of posterior distributions in terms of consistency. Specifically, we deal with a specific Bayesian partially linear regression model with additive noises in which the nonparametric component is modeled using Gaussian process priors. Under the Bayesian partially linear model using Gaussian process priors, we focus on consistency of posterior distribution and consistency of the Bayes factor, and extend these results to generalized additive regression models and study their asymptotic properties. In addition we illustrate the asymptotic properties based on empirical analysis through simulation studies.     

Bayesian estimation with integrated nested Laplace approximation for binary logit mixed models

In multilevel models for binary responses, estimation is computationally challenging due to the need to evaluate intractable integrals. In this paper, we investigate the performance of integrated nested Laplace approximation (INLA), a fast deterministic method for Bayesian inference. In particular, we conduct an extensive simulation study to compare the results obtained with INLA to the results obtained with a traditional stochastic method for Bayesian inference (MCMC Gibbs sampling), and with maximum likelihood through adaptive quadrature. Particular attention is devoted to the case of small number of clusters. The specification of the prior distribution for the cluster variance plays a crucial role and it turns out to be more relevant than the choice of the estimation method. The simulations show that INLA has an excellent performance as it achieves good accuracy (similar to MCMC) with reduced computational times (similar to adaptive quadrature).     

Gamma-Generalized Inverse Gaussian Class of Distributions with Applications

In this article, a new family of probability distributions with domain in ?⁺ is introduced. This class can be considered as a natural extension of the exponential-inverse Gaussian distribution in Bhattacharya and Kumar (1986 Bhattacharya , S. K. , Kumar , S. ( 1986 ). E-IG model in life testing . Calcutta Statist. Assoc. Bull. 35 : 85 – 90 . [Google Scholar]) and Frangos and Karlis (2004 Frangos , N. , Karlis , D. ( 2004 ). Modelling losses using an exponential-inverse Gaussian distribution . Insur. Math. Econo. 35 : 53 – 67 .[Crossref], [Web of Science ®] , [Google Scholar]). This new family is obtained through the mixture of gamma distribution with generalized inverse Gaussian distribution. We also show some important features such as expressions of probability density function, moments, etc. Special attention is paid to the mixture with the inverse Gaussian distribution, as a particular case of the generalized inverse Gaussian distribution. From the exponential-inverse Gaussian distribution two one-parameter family of distributions are obtained to derive risk measures and credibility expressions. The versatility of this family has been proven in numerical examples.     

Bayesian analysis of covariance under inverse Gaussian model

This paper considers the problem of analysis of covariance (ANCOVA) under the assumption of inverse Gaussian distribution for response variable from the Bayesian point of view. We develop a fully Bayesian model for ANCOVA based on the conjugate prior distributions for parameters contained in the model. The Bayes estimator of parameters, ANCOVA model and adjusted effects for both treatments and covariates along with predictive distribution of future observations are developed. We also provide the essentials for comparing adjusted treatments effects and adjusted factor effects. A simulation study and a real world application are also performed to illustrate and evaluate the proposed Bayesian model.     

Bayesian and frequentist prediction limits for the Poisson distribution

Prediction limits for Poisson distribution are useful in real life when predicting the occurrences of some phenomena, for example, the number of infections from a disease per year among school children, or the number of hospitalizations per year among patients with cardiovascular disease. In order to allocate the right resources and to estimate the associated cost, one would want to know the worst (i.e., an upper limit) and the best (i.e., the lower limit) scenarios. Under the Poisson distribution, we construct the optimal frequentist and Bayesian prediction limits, and assess frequentist properties of the Bayesian prediction limits. We show that Bayesian upper prediction limit derived from uniform prior distribution and Bayesian lower prediction limit derived from modified Jeffreys non informative prior coincide with their respective frequentist limits. This is not the case for the Bayesian lower prediction limit derived from a uniform prior and the Bayesian upper prediction limit derived from a modified Jeffreys prior distribution. Furthermore, it is shown that not all Bayesian prediction limits derived from a proper prior can be interpreted in a frequentist context. Using a counterexample, we state a sufficient condition and show that Bayesian prediction limits derived from proper priors satisfying our condition cannot be interpreted in a frequentist context. Analysis of simulated data and data on Atlantic tropical storm occurrences are presented.