Asymptotic optimality of a two-stage procedure in Bayes sequential estimation

The problem of sequential estimation of the mean with quadratic loss and fixed cost per observation is considered within the Bayesian framework. Instead of fully sequential sampling, a two-stage sampling technique is introduced to solve the problem. The proposed two-stage procedure is robust in the sense that it does not depend on the distribution of outcome variables and the prior. It is shown to be asymptotically not worse than the optimal fixed-sample-size procedures for the arbitrary distributions, and to be asymptotically Bayes for the distributions of one-parameter exponential family.     

Asymptotically Optimal Nonparametric Empirical Bayes Via Predictive Recursion

An empirical Bayes problem has an unknown prior to be estimated from data. The predictive recursion (PR) algorithm provides fast nonparametric estimation of mixing distributions and is ideally suited for empirical Bayes applications. This article presents a general notion of empirical Bayes asymptotic optimality, and it is shown that PR-based procedures satisfy this property under certain conditions. As an application, the problem of in-season prediction of baseball batting averages is considered. There the PR-based empirical Bayes rule performs well in terms of prediction error and ability to capture the distribution of the latent features.     

The equivalence of Bayes and robust Bayes estimators for various loss functions

The problem of Bayes and robust Bayes estimation for various bounded and/or symmetric loss functions in a normal model with conjugate and non-informative prior distributions is considered. The prior distribution is not fully specified and covers the conjugate family of priors. It is of interest to know that the Bayes and robust Bayes estimators for symmetric losses are the same as those for the standard square-error loss function.     

Equality and inequality constrained multivariate linear models: Objective model selection using constrained posterior priors

In objective Bayesian model selection, a well-known problem is that standard non-informative prior distributions cannot be used to obtain a sensible outcome of the Bayes factor because these priors are improper. The use of a small part of the data, i.e., a training sample, to obtain a proper posterior prior distribution has become a popular method to resolve this issue and seems to result in reasonable outcomes of default Bayes factors, such as the intrinsic Bayes factor or a Bayes factor based on the empirical expected-posterior prior.     

Empirical bayes testing of a distribution function with d1richlet process priors

This paper considers the generalised empirical Bayes two-action (testing) and multiple action problems concerning a distribution function The Dirichiet process priors p of Ferguson have been used as the prior distributions on the space of distribution functions on the real line. The two-action component problem is considered in detail and when p is unknown partially empirical Bayes procedures {6 } which are asymptotically optimal with rates 0{jT1/2) and OCCmCn+l))     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

Empirical Bayes testing for guarantee lifetime: Non identical components case

This article considers an empirical Bayes testing problem for the guarantee lifetime in the two-parameter exponential distributions with non identical components. We study a method of constructing empirical Bayes tests under a class of unknown prior distributions for the sequence of the component testing problems. The asymptotic optimality of the sequence of empirical Bayes tests is studied. Under certain regularity conditions on the prior distributions, it is shown that the sequence of the constructed empirical Bayes tests is asymptotically optimal, and the associated sequence of regrets converges to zero at a rate O(n^{? 1 + 1/[2(r + α) + 1]}) for some integer r ? 0 and 0 ? α ? 1 depending on the unknown prior distributions, where n is the number of past data available when the (n + 1)st component testing problem is considered.     

An empirical Bayes approach to outliers

A formulation of the problem of detecting outliers as an empirical Bayes problem is studied. In so doing we encounter a non-standard empirical Bayes problem for which the notion of average risk asymptotic optimality (a.r.a.o.) of procedures is defined. Some general theorems giving sufficient conditions for a.r.a.o. procedures are developed. These general results are then used in various formulations of the outlier problem for underlying normal distributions to give a.r.a.o. empirical Bayes procedures. Rates of convergence results are also given using the methods of Johns and Van Ryzin (1971, 1972).     

Empirical bayes approach to bayes sequential estimation: the poisson and bernoulli cases

The problem considered is the Bayes sequential estimation of the mean with quadratic loss and fixed cost per observation. Assume the prior distribution is not completely known. Some empirical Bayes procedures are proposed in the Poisson and Bernoulli cases, and they are shown to be asymptotically non-deficient in the sense of Woodroofe (1981).     

Bayes estimation of the binomial parameter n

Bayes estimation of the binomial parameter n based on a general prior distribution for n is studied. As special cases improper prior and Poisson prior (which is a natural choice) are considered, and formulae for the marginal and posterior distributions are obtained. It is shown that the assumption of improper priors in both p and n leads to implausible results.     

Nonparametric empirical Bayes method for comparison of treatment effects with application to stress urinary incontinence data

Hierarchical models are widely used in medical research to structure complicated models and produce statistical inferences. In a hierarchical model, observations are sampled conditional on some parameters and these parameters are sampled from a common prior distribution. Bayes and empirical Bayes (EB) methods have been effectively applied in analyzing these models. Despite many successes, parametric Bayes and EB methods may be sensitive to misspecification of prior distributions. In this paper, without specific restriction on the form of the prior distribution, we propose a nonparametric EB method to estimate the treatment effect of each group and develop a testing procedure to compare between-group differences. Simulation studies demonstrate that the proposed EB method was more efficient than some standard procedures. An illustrative example is provided with data from a clinical trial evaluating a new treatment for patients with stress urinary incontinence.     

Calibrated Bayes factors for model comparison

A Bayes factor between two models can be greatly affected by the prior distributions on the model parameters. When prior information is weak, very dispersed proper prior distributions are known to create a problem for the Bayes factor when competing models differ in dimension, and it is of even greater concern when one of the models is of infinite dimension. Therefore, we propose an innovative method which uses training samples to calibrate the prior distributions so that they achieve a reasonable level of ‘information’. Then the calibrated Bayes factor can be computed over the remaining data. This method makes no assumption on model forms (parametric or nonparametric) and can be used with both proper and improper priors. We illustrate, through simulation studies and a real data example, that the calibrated Bayes factor yields robust and reliable model preferences under various situations.     

Bayesian predictive modeling for Inverse Gamma-Pareto composite distribution

Inverse Gamma-Pareto composite distribution is considered as a model for heavy tailed data. The maximum likelihood (ML), smoothed empirical percentile (SM), and Bayes estimators (informative and non-informative) for the parameter θ, which is the boundary point for the supports of the two distributions are derived. A Bayesian predictive density is derived via a gamma prior for θ and the density is used to estimate risk measures. Accuracy of estimators of θ and the risk measures are assessed via simulation studies. It is shown that the informative Bayes estimator is consistently more accurate than ML, Smoothed, and the non-informative Bayes estimators.     

Minimax estimation of a probability of success under LINEX loss

Minimax estimation of a binomial probability under LINEX loss function is considered. It is shown that no equalizer estimator is available in the statistical decision problem under consideration. It is pointed out that the problem can be solved by determining the Bayes estimator with respect to a least favorable distribution having finite support. In this situation, the optimal estimator and the least favorable distribution can be determined only by using numerical methods. Some properties of the minimax estimators and the corresponding least favorable prior distributions are provided depending on the parameters of the loss function. The properties presented are exploited in computing the minimax estimators and the least favorable distributions. The results obtained can be applied to determine minimax estimators of a cumulative distribution function and minimax estimators of a survival function.     

Bayesian assessment of goodness of fit against nonparametric alternatives

The classical chi‐square test of goodness of fit compares the hypothesis that data arise from some parametric family of distributions, against the nonparametric alternative that they arise from some other distribution. However, the chi‐square test requires continuous data to be grouped into arbitrary categories. Furthermore, as the test is based upon an approximation, it can only be used if there are sufficient data. In practice, these requirements are often wasteful of information and overly restrictive. The authors explore the use of the fractional Bayes factor to obtain a Bayesian alternative to the chi‐square test when no specific prior information is available. They consider the extent to which their methodology can handle small data sets and continuous data without arbitrary grouping.     

Empirical Bayes vs. fully Bayes variable selection

For the problem of variable selection for the normal linear model, fixed penalty selection criteria such as AIC, _Cp${\mathrm{C}}_p$, BIC and RIC correspond to the posterior modes of a hierarchical Bayes model for various fixed hyperparameter settings. Adaptive selection criteria obtained by empirical Bayes estimation of the hyperparameters have been shown by George and Foster [2000. Calibration and Empirical Bayes variable selection. Biometrika 87(4), 731–747] to improve on these fixed selection criteria. In this paper, we study the potential of alternative fully Bayes methods, which instead margin out the hyperparameters with respect to prior distributions. Several structured prior formulations are considered for which fully Bayes selection and estimation methods are obtained. Analytical and simulation comparisons with empirical Bayes counterparts are studied.     

Curtailed Bayesian sampling plans for exponential distributions based on Type-II censored samples

This paper studies the problem of designing a curtailed Bayesian sampling plan (CBSP) with Type-II censored data. We first derive the Bayesian sampling plan (BSP) for exponential distributions based on Type-II censored samples in a general loss function. For the conjugate prior with quadratic loss function, an explicit expression for the Bayes decision function is derived. Using the property of monotonicity of the Bayes decision function, a new Bayesian sampling plan modified by the curtailment procedure, called a CBSP, is proposed. It is shown that the risk of CBSP is less than or equal to that of BSP. Comparisons among some existing BSPs and the proposed CBSP are given. Monte Carlo simulations are conducted, and numerical results indicate that the CBSP outperforms those early existing sampling plans if the time loss is considered in the loss function.     

Flexible empirical Bayes estimation for wavelets

Wavelet shrinkage estimation is an increasingly popular method for signal denoising and compression. Although Bayes estimators can provide excellent mean-squared error (MSE) properties, the selection of an effective prior is a difficult task. To address this problem, we propose empirical Bayes (EB) prior selection methods for various error distributions including the normal and the heavier-tailed Student t -distributions. Under such EB prior distributions, we obtain threshold shrinkage estimators based on model selection, and multiple-shrinkage estimators based on model averaging. These EB estimators are seen to be computationally competitive with standard classical thresholding methods, and to be robust to outliers in both the data and wavelet domains. Simulated and real examples are used to illustrate the flexibility and improved MSE performance of these methods in a wide variety of settings.     

A note on Bayesian estimation of traffic intensity in single-server Markovian queues

ABSTRACT

In queuing theory, a major interest of researchers is studying the behavior and formation process and analyzing the performance characteristics of queues, particularly the traffic intensity, which is defined as the ratio between the arrival rate and the service rate. How these parameters can be estimated using some statistical inferential method is the mathematical problem treated here. This article aims to obtain better Bayesian estimates for the traffic intensity of M/M/1 queues, which, in Kendall notation, stand for Markovian single-server infinity queues. The Jeffreys prior is proposed to obtain the posterior and predictive distributions of some parameters of interest. Samples are obtained through simulation and some performance characteristics are analyzed. It is observed from the Bayes factor that Jeffreys prior is competitive, among informative and non-informative prior distributions, and presents the best performance in many of the cases tested.     

Convergence of posterior odds

The problem of approximating an interval null or imprecise hypothesis test by a point null or precise hypothesis test under a Bayesian framework is considered. In the literature, some of the methods for solving this problem have used the Bayes factor for testing a point null and justified it as an approximation to the interval null. However, many authors recommend evaluating tests through the posterior odds, a Bayesian measure of evidence against the null hypothesis. It is of interest then to determine whether similar results hold when using the posterior odds as the primary measure of evidence. For the prior distributions under which the approximation holds with respect to the Bayes factor, it is shown that the posterior odds for testing the point null hypothesis does not approximate the posterior odds for testing the interval null hypothesis. In fact, in order to obtain convergence of the posterior odds, a number of restrictive conditions need to be placed on the prior structure. Furthermore, under a non-symmetrical prior setup, neither the Bayes factor nor the posterior odds for testing the imprecise hypothesis converges to the Bayes factor or posterior odds respectively for testing the precise hypothesis. To rectify this dilemma, it is shown that constraints need to be placed on the priors. In both situations, the class of priors constructed to ensure convergence of the posterior odds are not practically useful, thus questioning, from a Bayesian perspective, the appropriateness of point null testing in a problem better represented by an interval null. The theories developed are also applied to an epidemiological data set from White et al. (Can. Veterinary J. 30 (1989) 147–149.) in order to illustrate and study priors for which the point null hypothesis test approximates the interval null hypothesis test. AMS Classification: Primary 62F15; Secondary 62A15