Approximate reference priors for Gaussian random fields

Reference priors are theoretically attractive for the analysis of geostatistical data since they enable automatic Bayesian analysis and have desirable Bayesian and frequentist properties. But their use is hindered by computational hurdles that make their application in practice challenging. In this work, we derive a new class of default priors that approximate reference priors for the parameters of some Gaussian random fields. It is based on an approximation to the integrated likelihood of the covariance parameters derived from the spectral approximation of stationary random fields. This prior depends on the structure of the mean function and the spectral density of the model evaluated at a set of spectral points associated with an auxiliary regular grid. In addition to preserving the desirable Bayesian and frequentist properties, these approximate reference priors are more stable, and their computations are much less onerous than those of exact reference priors. Unlike exact reference priors, the marginal approximate reference prior of correlation parameter is always proper, regardless of the mean function or the smoothness of the correlation function. This property has important consequences for covariance model selection. An illustration comparing default Bayesian analyses is provided with a dataset of lead pollution in Galicia, Spain.     

Bayesian predictive densities based on latent information priors

Construction methods for prior densities are investigated from a predictive viewpoint. Predictive densities for future observables are constructed by using observed data. The simultaneous distribution of future observables and observed data is assumed to belong to a parametric submodel of a multinomial model. Future observables and data are possibly dependent. The discrepancy of a predictive density to the true conditional density of future observables given observed data is evaluated by the Kullback-Leibler divergence. It is proved that limits of Bayesian predictive densities form an essentially complete class. Latent information priors are defined as priors maximizing the conditional mutual information between the parameter and the future observables given the observed data. Minimax predictive densities are constructed as limits of Bayesian predictive densities based on prior sequences converging to the latent information priors.     

Model determination for the variance component model using reference priors

For the balanced variance component model when the inference concerning intraclass correlation coefficient is of interest, Bayesian analysis is often appropriate. However, the question remains is to choose the appropriate prior. In this paper, we consider testing of the intraclass correlation coefficient under a default prior specification. Berger and Bernardo's (1992) On the development of the reference prior method. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statist. Vol. 4. Oxford University Press, London, pp. 35–60 reference priors are developed and are used to obtain the intrinsic Bayes factor (Berger and Pericchi, 1996) The intrinsic Bayes factor for model selection and prediction. J. Amer. statist. Assoc. 91, 109–122 for the nested models. Influence diagnostics using intrinsic Bayes factors are also developed. Finally, one simulated data is provided which illustrates the proposed methodology with appropriate simulation based on computational formulas. Then in order to overcome the difficulty in Bayesian computation, MCMC method, such as Gibbs sampler and Metropolis–Hastings algorithm, is employed.     

Empirical bayes tests in a positive exponential family with partial information on priors

We investigate an empirical Bayes testing problem in a positive exponential family having pdf f{x/θ)=c(θ)u(x) exp(?x/θ), x>0, θ>0. It is assumed that θ is in some known compact interval [C₁, C₂]. The value C₁ is used in the construction of the proposed empirical Bayes test δ^* _n. The asymptotic optimality and rate of convergence of its associated Bayes risk is studied. It is shown that under the assumption that θ is in [C₁, C₂] δ^* _n is asymptotically optimal at a rate of convergence of order O(n^?1/n n). Also, δ^* _n is robust in the sense that δ^* _n still possesses the asymptotic optimality even the assumption that "C₁≦θ≦C₂ may not hold.     

Probability matching priors: a review

In recent years, extensive work has been done concerning the derivation of noninformative prior distributions assuring approximate frequentist validity of Bayesian inferences. This paper provides a review of matching priors obtained via quantiles andvia the distribution function. Various matching criteria are described and discussed. Emphasis is laid on a proposal of designing priors matching the true coverage probability as well as the false coverage probabilities of contiguous alternatives with the respective Bayesian counterparts. The review is not primarily meant to be a comprehensive account on the area, but, rather, to convey the main underlying ideas and point out the relationships between matching priors and other noninformative priors, such as the Jeifreys’ and the reference priors.     

Conditional probability and improper priors

ABSTRACT

According to Jeffreys improper priors are needed to get the Bayesian machine up and running. This may be disputed, but usage of improper priors flourish. Arguments based on symmetry or information theoretic reference analysis can be most convincing in concrete cases. The foundations of statistics as usually formulated rely on the axioms of a probability space, or alternative information theoretic axioms that imply the axioms of a probability space. These axioms do not include improper laws, but this is typically ignored in papers that consider improper priors.

The purpose of this paper is to present a mathematical theory that can be used as a foundation for statistics that include improper priors. This theory includes improper laws in the initial axioms and has in particular Bayes theorem as a consequence. Another consequence is that some of the usual calculation rules are modified. This is important in relation to common statistical practice which usually include improper priors, but tends to use unaltered calculation rules. In some cases, the results are valid, but in other cases inconsistencies may appear. The famous marginalization paradoxes exemplify this latter case.

An alternative mathematical theory for the foundations of statistics can be formulated in terms of conditional probability spaces. In this case, the appearance of improper laws is a consequence of the theory. It is proved here that the resulting mathematical structures for the two theories are equivalent. The conclusion is that the choice of the first or the second formulation for the initial axioms can be considered a matter of personal preference. Readers that initially have concerns regarding improper priors can possibly be more open toward a formulation of the initial axioms in terms of conditional probabilities. The interpretation of an improper law is given by the corresponding conditional probabilities.     

The conflict between improper priors and robustness

Most methods for assessing the sensitivity of the posterior to the prior do not work if the prior is improper. We characterize the neighborhoods of priors that permit non-trivial sensitivity analysis for improper priors. We show that these neighborhoods are not “tail rich”, i.e. they do not contain measures with a variety of tail behavior. Thus there are no neighborhoods that are simultaneously non-trivial and rich. We also show that using the formal structure of finitely additive priors does not solve the problem. We suggest some directions for addressing the problem. In particular, we consider replacing the improper prior with a sequence of asymptotically well-behaved data-dependent priors.     

Reference priors for shrinkage and smoothing parameters

A reference prior and corresponding reference posteriors are derived for a basic Normal variance components model with two components. Different parameterizations are considered, in particular one in terms of a shrinkage or smoothing parameter. Earlier results for the one-way ANOVA setting are generalized and a broad range of applications of the general results is indicated. Numerical examples of application to spline smoothing are given for illustration and the results compared with other well-known techniques considered to be “non-informative” about the smoothing parameter.     

Approximate exchangeability and de Finetti priors in 2022

This is a review paper, beginning with de Finetti's work on partial exchangeability, continuing with his approach to approximate exchangeability, and then his (surprising) approach to assigning informative priors in nonstandard situations. Recent progress on Markov chain Monte Carlo methods for drawing conclusions is supplemented by a review of work by Gerencsér and Ottolini on getting honest bounds for rates of convergence. The paper concludes with a speculative approach to combining classical asymptotics with Monte Carlo. This promises real speed-ups and makes a nice example of how theory and computation can interact.     

On priors that match posterior and frequentist distribution functions

In the multiparameter case, this paper characterizes priors so as to match, up to o(n^-1/2), the posterior joint cumulative distribution function (c.d.f.) of a posterior standardized version of the parametric vector with the corresponding frequentist c.d.f.     

A new approach to default priors and robust bayes methodology

Following the developments in DasGupta et al. (2000), the authors propose and explore a new method for constructing proper default priors and a method for selecting a Bayes estimate from a family. Their results are based on asymptotic expansions of certain marginal correlations. For ease of exposition, most results are presented for location families and squared error loss only. The default prior methodology amounts, ultimately, to the minimization of Fisher information, and hence, Bickel's prior works out as the default prior if the location parameter is bounded. As for the selected Bayes estimate, it corresponds to ‘Gaussian tilting’ of an initial reference prior.     

Additive mixed models with Dirichlet process mixture and P-spline priors

Longitudinal data often require a combination of flexible time trends and individual-specific random effects. For example, our methodological developments are motivated by a study on longitudinal body mass index profiles of children collected with the aim to gain a better understanding of factors driving childhood obesity. The high amount of nonlinearity and heterogeneity in these data and the complexity of the data set with a large number of observations, long longitudinal profiles and clusters of observations with specific deviations from the population model make the application challenging and prevent the application of standard growth curve models. We propose a fully Bayesian approach based on Markov chain Monte Carlo simulation techniques that allows for the semiparametric specification of both the trend function and the random effects distribution. Bayesian penalized splines are considered for the former, while a Dirichlet process mixture (DPM) specification allows for an adaptive amount of deviations from normality for the latter. The advantages of such DPM prior structures for random effects are investigated in terms of a simulation study to improve the understanding of the model specification before analyzing the childhood obesity data.     

Adaptive autoregressive priors for area and time structured mortality data

Mortality counts by age and area are relevant to obtaining small area life tables and summary statistics such as life expectancy. A Bayesian approach to small area life tables is proposed here based on the principle of smoothing (or “pooling strength”) over adjacent ages or areas. Several schemes have been suggested to reflect dependence between age categories x or areas i  , such as conditional autoregressive priors based on the principle of local smoothing, determined by adjacency of age groups or spatial proximity. It is argued here that a more flexible approach is to allow a mix of local and global smoothing over age groups and areas, as determined by the data and additional parameters κ∈[0,1]$\kappa \in [0,1]$ and λ∈[0,1]$\lambda \in [0,1]$ for age and area, respectively. An extension is also proposed to reflect the fact that the appropriate mix between local and global smoothing may not be constant across age bands or across the region being studied. For example, local spatial smoothing will not be appropriate if an area is disparate from its neighbours (e.g. in terms of social distance), and so area specific mixing parameters _λi${\lambda }_i$ are introduced. The _λi${\lambda }_i$ may be modelled by logit regression on observed sources of disparity between neighbouring areas. The application considers small area life tables for males over 625 small areas (electoral wards) in London over 2003–2005.     

Analysis of all-zero binomial outcomes with borderline and equilibrium priors

This article is concerned with the analysis of a random sample from a binomial distribution when all the outcomes are zero (or unity). We discuss how elicitation of the prior can be reduced to asking the expert whether (and which of) the so-called borderline or equilibrium priors are plausible.     

Equality and inequality constrained multivariate linear models: Objective model selection using constrained posterior priors

In objective Bayesian model selection, a well-known problem is that standard non-informative prior distributions cannot be used to obtain a sensible outcome of the Bayes factor because these priors are improper. The use of a small part of the data, i.e., a training sample, to obtain a proper posterior prior distribution has become a popular method to resolve this issue and seems to result in reasonable outcomes of default Bayes factors, such as the intrinsic Bayes factor or a Bayes factor based on the empirical expected-posterior prior.     

Specification analysis with discriminating priors: an application to the concentration profits debate

The problem of uncertain specification and the role of hidden prior beliefs is discussed. The methods for analysing the importance of specification uncertainty developed by Leamer (1978) are discussed. When the maintained hypothesis under consideration is based on weak foundations the reporting of specification analyses for different publicly held prior hypotheses is advocated. These methods are applied to the analysis of the relationship between market structure and performance.     

Specification analysis with discriminating priors: an application to the concentration profits debate

The problem of uncertain specification and the role of hidden prior beliefs is discussed. The methods for analysing the importance of specification uncertainty developed by Leamer (1978) are discussed. When the maintained hypothesis under consideration is based on weak foundations the reporting of specification analyses for different publicly held prior hypotheses is advocated. These methods are applied to the analysis of the relationship between market structure and performance.