BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

ON EMPIRICAL BAYES STOPPING TIMES

We consider the empirical Bayes decision theory where the component problems are the optimal fixed sample size decision problem and a sequential decision problem. With these components, an empirical Bayes decision procedure selects both a stopping rule function and a terminal decision rule function. Empirical Bayes stopping rules are constructed for each case and the asymptotic behaviours are investigated.     

A NOTE ON BAYES FACTORS

This note establishes a connection between Bayes factors and the use of the logarithmic score utility function for model selection in a Bayesian context. The connection presented provides insights into Bayes factors.     

ON BAYES PREDICTION OF FUTURE MEDIAN

An expression for the Bayesian predictive survival function of the median of a set of future observations is obtained whether its size is assumed to be odd or even. Both of the informative and future samples are drawn from a population whose distribution is a general class that includes several distributions used in life testing (and other areas as well) such as the Weibull (including the exponential and Rayleigh), compound Weibull (including the compound exponential and compound Rayleigh), Pareto, beta, Gompertz and compound Gompertz, among other distributions. A general proper (conjugate) prior density function is used to cover most prior distributions that have been used in literature. Applications to the Weibull, exponential and Rayleigh models are illustrated.     

A ROBUST BAYES FACTOR FOR LINEAR MODELS

This paper proposes a new robust Bayes factor for comparing two linear models. The factor is based on a pseudo‐model for outliers and is more robust to outliers than the Bayes factor based on the variance‐inflation model for outliers. If an observation is considered an outlier for both models this new robust Bayes factor equals the Bayes factor calculated after removing the outlier. If an observation is considered an outlier for one model but not the other then this new robust Bayes factor equals the Bayes factor calculated without the observation, but a penalty is applied to the model considering the observation as an outlier. For moderate outliers where the variance‐inflation model is suitable, the two Bayes factors are similar. The new Bayes factor uses a single robustness parameter to describe a priori belief in the likelihood of outliers. Real and synthetic data illustrate the properties of the new robust Bayes factor and highlight the inferior properties of Bayes factors based on the variance‐inflation model for outliers.     

EMPIRICAL BAYES ESTIMATION FOR FIRST-ORDER AUTOREGRESSIVE PROCESSES

Large sample properties of an empirical Bayes estimate for a first order autoregressive process are obtained with respect to both the empirical Bayes and the frequentist frameworks.     

THE BOOTSTRAP RISK OF LINEAR EMPIRICAL BAYES ESTIMATES

This paper discusses the bootstrap risk of the linear empirical Bayes estimate of the form θ=Ǎ+B̌x, where x is the current observation, and Ǎ and B̌ are generally functions of the estimates of the prior parameters. The standard error of this risk is developed and ‘computations’ of both the bootstrap risk and its standard error are made.     

EMPIRICAL BAYES ESTIMATION WITH NON-IDENTICAL COMPONENTS. CONTINUOUS CASE.

In this paper a variant of the standard empirical Bayes estimation problem is considered where the component problems in the sequence are not identical in that the conditional distribution of the observations may vary with the component problems. Let {(Θ_n, X_n)} be a sequence of independent random vectors where Θ_n? G and, given Θ_n=Θ_n, X_n -P_Θ,m(n) with {m(n)} a sequence of positive integers where m(n)≤m? < ∞ for all n. With P_Θ,m in a continuous exponential family of distributions, asymptotically optimal empirical Bayes procedures are exhibited which depend on uniform approximations of certain functions on compact sets by polynomials in e^Θ. Such approximations have been explicitly calculated in the case of normal and gamma families. In the case of normal families, asymptotically optimal linear empirical Bayes estimators in the class of all linear estimators are derived and shown to have rate O(n^-1/2).     

ALIGNING OF ESTIMATES: AN ALTERNATIVE TO EMPIRICAL BAYES METHODS

The data that are used in constructing empirical Bayes estimates can properly be regarded as arising in a two-stage sampling scheme. In this setting it is possible to modify the conventional parameter estimates so that a reduction in expected squared error is effected. In the empirical Bayes approach this is done through the use of Bayes's theorem. The alternative approach proposed in this paper specifies a class of modified estimates and then seeks to identify that member of the class which yields the minimum squared error. One advantage of this approach relative to the empirical Bayes approach is that certain problems involving multiple parameters are easily overcome. Further, it permits the use of relatively efficient methods of non-parametric estimation, such as those based on quantiles or ranks; this has not been achieved by empirical Bayes methods.     

GENERALIZED EXTREME VALUE ADDITIVE MODEL ANALYSIS VIA MEAN FIELD VARIATIONAL BAYES

We develop Mean Field Variational Bayes methodology for fast approximate inference in Bayesian Generalized Extreme Value additive model analysis. Such models are useful for flexibly assessing the impact of continuous predictor variables on sample extremes. The new methodology allows large Bayesian models to be fitted and assessed without the significant computing costs of Markov Chain Monte Carlo methods. We illustrate our new methodology with maximum rainfall data from the Sydney, Australia, hinterland. Comparisons are made between the Mean Field Variational Bayes and Markov Chain Monte Carlo approaches.     

BEADS,BAGS, BAYES,AND THE FUNDAMENTAL PROBLEM OF SAMPLING THEORY

Motivated by a discussion of an elementary probability puzzle provided by Anderson and Provost [1] Anderson, O. D. and Provost, S. B. 1992. Beads, bags and Bayes. Int. J. Math. Educ. Sci. Technol., 23: 25–37. [Taylor & Francis Online] , [Google Scholar], we review what may be called the fundamental problem of finite population sampling theory and propose that only super-model or Bayesian approaches to finite population sampling are acceptable.     

IMPROVING POPULATION-SPECIFIC ALLELE FREQUENCY ESTIMATES BY ADAPTING SUPPLEMENTAL DATA: AN EMPIRICAL BAYES APPROACH

Estimation of the allele frequency at genetic markers is a key ingredient in biological and biomedical research, such as studies of human genetic variation or of the genetic etiology of heritable traits. As genetic data becomes increasingly available, investigators face a dilemma: when should data from other studies and population subgroups be pooled with the primary data? Pooling additional samples will generally reduce the variance of the frequency estimates; however, used inappropriately, pooled estimates can be severely biased due to population stratification. Because of this potential bias, most investigators avoid pooling, even for samples with the same ethnic background and residing on the same continent. Here, we propose an empirical Bayes approach for estimating allele frequencies of single nucleotide polymorphisms. This procedure adaptively incorporates genotypes from related samples, so that more similar samples have a greater influence on the estimates. In every example we have considered, our estimator achieves a mean squared error (MSE) that is smaller than either pooling or not, and sometimes substantially improves over both extremes. The bias introduced is small, as is shown by a simulation study that is carefully matched to a real data example. Our method is particularly useful when small groups of individuals are genotyped at a large number of markers, a situation we are likely to encounter in a genome-wide association study.     

APPLYING THE SAVAGE-DICKEY DENSITY RATIO TO DEFAULT BAYES FACTORS,WITH AN ILLUSTRATION TO OUTLIER DETECTION IN RANDOM EFFECTS MODELS

When no information is available and hence improper noninformative priors should be used, Bayes factor includes the unspecified constants and can not be calibrated. To solve this problem, we modify the intrinsic Bayes factor (IBF) of Berger and Pericchi 1-2 Berger, J. O. and Pericchi, L. R. 1996. The Intrinsic Bayes Factor for Model Selection and Prediction. Journal of the American Statistical Association, 91: 109–122. Berger, J. O. and Pericchi, L. R. 1998. Accurate and Stable Bayesian Model Selection: The Median Intrinsic Bayes Factor. Sankhya, Series B, 60: 1–18.   and the fractional Bayes factor (FBF) of O'Hagan [3] O'Hagan, A. 1995. Fractional Bayes Factors for Model Comparison. Journal of the Royal Statistical Society, Series B, 57: 99–138.  [Google Scholar] with the generalized Savage-Dickey density ratio of Verdinelli and Wasserman [4] Verdinelli, I. and Wasserman, L. 1995. Computing Bayes Factors Using a Generalization of Savage-Dickey Density Ratio. Journal of the American Statistical Association, 90: 614–618. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]. These modified IBF and FBF are applied to detecting outliers in random effects models with a mean-shift structure. The proposed methodology is exemplified by a simulation experiment with a generated data set and also applied to a real data set, Dyestuff data in Box and Tiao [5] Box, G. E.P. and Tiao, G. C. 1973. Bayesian Inference in Statistical Analysis U.S.A.: Addison-Wesley Publishing Co..  [Google Scholar]