Flexible empirical Bayes estimation for wavelets

Wavelet shrinkage estimation is an increasingly popular method for signal denoising and compression. Although Bayes estimators can provide excellent mean-squared error (MSE) properties, the selection of an effective prior is a difficult task. To address this problem, we propose empirical Bayes (EB) prior selection methods for various error distributions including the normal and the heavier-tailed Student t -distributions. Under such EB prior distributions, we obtain threshold shrinkage estimators based on model selection, and multiple-shrinkage estimators based on model averaging. These EB estimators are seen to be computationally competitive with standard classical thresholding methods, and to be robust to outliers in both the data and wavelet domains. Simulated and real examples are used to illustrate the flexibility and improved MSE performance of these methods in a wide variety of settings.     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

Monte Carlo approximation of likelihood function in spatial GLMMs through an empirical Bayes method

In spatial generalized linear mixed models (SGLMMs), statistical inference encounters problems, since random effects in the model imply high-dimensional integrals to calculate the marginal likelihood function. In this article, we temporarily treat parameters as random variables and express the marginal likelihood function as a posterior expectation. Hence, the marginal likelihood function is approximated using the obtained samples from the posterior density of the latent variables and parameters given the data. However, in this setting, misspecification of prior distribution of correlation function parameter and problems associated with convergence of Markov chain Monte Carlo (MCMC) methods could have an unpleasant influence on the likelihood approximation. To avoid these challenges, we utilize an empirical Bayes approach to estimate prior hyperparameters. We also use a computationally efficient hybrid algorithm by combining inverse Bayes formula (IBF) and Gibbs sampler procedures. A simulation study is conducted to assess the performance of our method. Finally, we illustrate the method applying a dataset of standard penetration test of soil in an area in south of Iran.     

Bayes estimates in multivariate semiparametric linear models

Bayes estimates are derived in multivariate linear models with unknown distribution. The prior distribution is defined using a Dirichlet prior for the unknown error distribution and a normal-Wishart distribution for the parameters. The posterior distribution is determined and explicit expressions are given in the special cases of location-scale and two-sample models. The calculation of self-informative limits of Bayes estimates yields standard estimates.     

Bayesian analysis of the scatterometer wind retrieval inverse problem: some new approaches

Summary.  The retrieval of wind vectors from satellite scatterometer observations is a non-linear inverse problem. A common approach to solving inverse problems is to adopt a Bayesian framework and to infer the posterior distribution of the parameters of interest given the observations by using a likelihood model relating the observations to the parameters, and a prior distribution over the parameters. We show how Gaussian process priors can be used efficiently with a variety of likelihood models, using local forward (observation) models and direct inverse models for the scatterometer. We present an enhanced Markov chain Monte Carlo method to sample from the resulting multimodal posterior distribution. We go on to show how the computational complexity of the inference can be controlled by using a sparse, sequential Bayes algorithm for estimation with Gaussian processes. This helps to overcome the most serious barrier to the use of probabilistic, Gaussian process methods in remote sensing inverse problems, which is the prohibitively large size of the data sets. We contrast the sampling results with the approximations that are found by using the sparse, sequential Bayes algorithm.     

On selecting the best treatment in a generalized linear model

The problem of selecting the best treatment is studied under generalized linear models. For certain balanced designs, it is shown that simple rules are Bayes with respect to any non-informative prior on the treatment effects under any monotone invariant loss. When the nuisance parameters such as block effects are assumed to follow a uniform (improper) prior or a normal prior, Bayes rules are obtained for the normal linear model under more suitable balanced designs, keeping the generality of the loss and the generality of the non-informativeness on the prior of the treatment effects. These results are extended to certain types of informative priors on the treatment effects. When the designs are unbalanced, algorithms based on the Gibbs sampler and the Laplace method are provided to compute the Bayes rules.     

Analysis of non-repairable cold-standby systems in Bayes theory

ABSTRACT

In this paper, we seek to analyse the reliability of k-out-of-n cold-standby system with components having Weibull time-to-failure distribution in view of Bayes theory. At first, we review the existing methods exhaustively and find that all these methods have not considered Bayes theory. Then we modify the simplest method and propose new methods based on Monte Carlo simulation. Next, we combine all the information to derive the posterior distribution of Weibull parameters. A robust and universal sample-based method is proposed according to the Monte Carlo Markov Chain method to draw the sample of parameters to obtain the Bayes estimate of reliability. The drawn samples are proved to be rather satisfactory. Conducting a simulation study to compare all the methods in terms of accuracy and computational time, we have presented some useful recommendations from the simulation results. These conclusions would provide insight on the application for k-out-of-n cold-standby system.     

指数族分布中参数的经验贝叶斯估计

指数族分布是一类应用广泛的分布类,包括了泊松分布、Gamma分布、Beta分布、二项分布等常见分布.在非寿险中,索赔额或索赔次数过程常常被假定服从指数族分布,由于风险的非齐次性,指数族分布中的参数θ也为随机变量,假定服从指数族共轭先验分布.此时风险参数的估计落入了Bayes框架,风险参数θ的Bayes估计被表达“信度”形式.然而,在实际运用中,由于先验分布与样本分布中仍然含有结构参数,根据样本的边际分布的似然函数估计结构参数,从而获得风险参数的经验Bayes估计,最后证明了该经验Bayes估计是渐近最优的.     

Estimation from Burr type XII distribution using progressive first-failure censored data

In this paper, a new life test plan called a progressively first-failure-censoring scheme introduced by Wu and Ku? [On estimation based on progressive first-failure-censored sampling, Comput. Statist. Data Anal. 53(10) (2009), pp. 3659–3670] is considered. Based on this type of censoring, the maximum likelihood (ML) and Bayes estimates for some survival time parameters namely reliability and hazard functions, as well as the parameters of the Burr-XII distribution are obtained. The Bayes estimators relative to both the symmetric and asymmetric loss functions are discussed. We use the conjugate prior for the one-shape parameter and discrete prior for the other parameter. Exact and approximate confidence intervals with the exact confidence region for the two-shape parameters are derived. A numerical example using the real data set is provided to illustrate the proposed estimation methods developed here. The ML and the different Bayes estimates are compared via a Monte Carlo simulation study.     

Bayesian model selection for join point regression with application to age-adjusted cancer rates

Summary.  The method of Bayesian model selection for join point regression models is developed. Given a set of K +1 join point models M ₀,  M ₁, …,  M _K with 0, 1, …,  K join points respec-tively, the posterior distributions of the parameters and competing models M _k are computed by Markov chain Monte Carlo simulations. The Bayes information criterion BIC is used to select the model M _k with the smallest value of BIC as the best model. Another approach based on the Bayes factor selects the model M _k with the largest posterior probability as the best model when the prior distribution of M _k is discrete uniform. Both methods are applied to analyse the observed US cancer incidence rates for some selected cancer sites. The graphs of the join point models fitted to the data are produced by using the methods proposed and compared with the method of Kim and co-workers that is based on a series of permutation tests. The analyses show that the Bayes factor is sensitive to the prior specification of the variance σ ², and that the model which is selected by BIC fits the data as well as the model that is selected by the permutation test and has the advantage of producing the posterior distribution for the join points. The Bayesian join point model and model selection method that are presented here will be integrated in the National Cancer Institute's join point software ( http://www.srab.cancer.gov/joinpoint/ ) and will be available to the public.     

Robust Bayesian estimation of a bathtub-shaped distribution under progressive Type-II censoring

The bathtub-shaped failure rate function has been used for modeling the life spans of a number of electronic and mechanical products, as well as for modeling the life spans of humans, especially when some of the data are censored. This article addresses robust methods for the estimation of unknown parameters in a two-parameter distribution with a bathtub-shaped failure rate function based on progressive Type-II censored samples. Here, a class of flexible priors is considered by using the hierarchical structure of a conjugate prior distribution, and corresponding posterior distributions are obtained in a closed-form. Then, based on the square error loss function, Bayes estimators of unknown parameters are derived, which depend on hyperparameters as parameters of the conjugate prior. In order to eliminate the hyperparameters, hierarchical Bayesian estimation methods are proposed, and these proposed estimators are compared to one another based on the mean squared error, through Monte Carlo simulations for various progressively Type-II censoring schemes. Finally, a real dataset is presented for the purpose of illustration.     

On Measuring Uncertainty of Benchmarked Predictors with Application to Disease Risk Estimate

Empirical Bayes (EB) estimates in general linear mixed models are useful for the small area estimation in the sense of increasing precision of estimation of small area means. However, one potential difficulty of EB is that the overall estimate for a larger geographical area based on a (weighted) sum of EB estimates is not necessarily identical to the corresponding direct estimate such as the overall sample mean. Another difficulty is that EB estimates yield over‐shrinking, which results in the sampling variance smaller than the posterior variance. One way to fix these problems is the benchmarking approach based on the constrained empirical Bayes (CEB) estimators, which satisfy the constraints that the aggregated mean and variance are identical to the requested values of mean and variance. In this paper, we treat the general mixed models, derive asymptotic approximations of the mean squared error (MSE) of CEB and provide second‐order unbiased estimators of MSE based on the parametric bootstrap method. These results are applied to natural exponential families with quadratic variance functions. As a specific example, the Poisson‐gamma model is dealt with, and it is illustrated that the CEB estimates and their MSE estimates work well through real mortality data.     

Empirical bayes estimation of reliability characteristics for an exponential family

This paper considers empirical Bayes (EB) squared-error-loss estimations of mean lifetime, variance and reliability function for failure-time distributions belonging to an exponential family, which includes gamma and Weibull distributions as special cases. EB estimators are proposed when the prior distribution of the lifetime parameter is completely unknown but has a compact (known or unknown) support. Asymptotic optimality and rates of convergence of these estimators are investigated. The rates established here under the compact support restriction are better than the polynomial rates of convergence obtained previously.     

Estimation and prediction of the Burr type XII distribution based on record values and inter-record times

The maximum likelihood and Bayesian approaches for parameter estimations and prediction of future record values have been considered for the two-parameter Burr Type XII distribution based on record values with the number of trials following the record values (inter-record times). Firstly, the Bayes estimates are obtained based on a joint bivariate prior for the shape parameters. In this case, the Bayes estimates of the parameters have been developed by using Lindley's approximation and the Markov Chain Monte Carlo (MCMC) method due to the lack of explicit forms under the squared error and the linear-exponential loss functions. The MCMC method has been also used to construct the highest posterior density credible intervals. Secondly, the Bayes estimates are obtained with respect to a discrete prior for the first shape parameter and a conjugate prior for other shape parameter. The Bayes and the maximum likelihood estimates are compared in terms of the estimated risk by the Monte Carlo simulations. We further consider the non-Bayesian and Bayesian prediction for future lower record arising from the Burr Type XII distribution based on record data. The comparison of the derived predictors is carried out by using Monte Carlo simulations. A real data are analysed for illustration purposes.     

Empirical Bayes Estimation of Small Area Means under a Nested Error Linear Regression Model with Measurement Errors in the Covariates

Abstract.  Previously, small area estimation under a nested error linear regression model was studied with area level covariates subject to measurement error. However, the information on observed covariates was not used in finding the Bayes predictor of a small area mean. In this paper, we first derive the fully efficient Bayes predictor by utilizing all the available data. We then estimate the regression and variance component parameters in the model to get an empirical Bayes (EB) predictor and show that the EB predictor is asymptotically optimal. In addition, we employ the jackknife method to obtain an estimator of mean squared prediction error (MSPE) of the EB predictor. Finally, we report the results of a simulation study on the performance of our EB predictor and associated jackknife MSPE estimators. Our results show that the proposed EB predictor can lead to significant gain in efficiency over the previously proposed EB predictor.     

Posterior Distributions for the Gini Coefficient Using Grouped Data

When available data comprise a number of sampled households in each of a number of income classes, the likelihood function is obtained from a multinomial distribution with the income class population proportions as the unknown parameters. Two methods for going from this likelihood function to a posterior distribution on the Gini coefficient are investigated. In the first method, two alternative assumptions about the underlying income distribution are considered, namely a lognormal distribution and the Singh–Maddala (1976) income distribution. In these cases the likelihood function is reparameterized and the Gini coefficient is a nonlinear function of the income distribution parameters. The Metropolis algorithm is used to find the corresponding posterior distributions of the Gini coefficient from a sample of Bangkok households. The second method does not require an assumption about the nature of the income distribution, but uses (a) triangular prior distributions, and (b) beta prior distributions, on the location of mean income within each income class. By sampling from these distributions, and the Dirichlet posterior distribution of the income class proportions, alternative posterior distributions of the Gini coefficient are calculated.     

Bayesian estimation and prediction for Weibull model with progressive censoring

This article presents the statistical inferences on Weibull parameters with the data that are progressively type II censored. The maximum likelihood estimators are derived. For incorporation of previous information with current data, the Bayesian approach is considered. We obtain the Bayes estimators under squared error loss with a bivariate prior distribution, and derive the credible intervals for the parameters of Weibull distribution. Also, the Bayes prediction intervals for future observations are obtained in the one- and two-sample cases. The method is shown to be practical, although a computer program is required for its implementation. A numerical example is presented for illustration and some simulation study are performed.     

Calibrated Bayes factors for model comparison

A Bayes factor between two models can be greatly affected by the prior distributions on the model parameters. When prior information is weak, very dispersed proper prior distributions are known to create a problem for the Bayes factor when competing models differ in dimension, and it is of even greater concern when one of the models is of infinite dimension. Therefore, we propose an innovative method which uses training samples to calibrate the prior distributions so that they achieve a reasonable level of ‘information’. Then the calibrated Bayes factor can be computed over the remaining data. This method makes no assumption on model forms (parametric or nonparametric) and can be used with both proper and improper priors. We illustrate, through simulation studies and a real data example, that the calibrated Bayes factor yields robust and reliable model preferences under various situations.     

A Comparison of Bayes Factors for Separated Models: Some Simulation Results

Some alternative Bayes Factors: Intrinsic, Posterior, and Fractional have been proposed to overcome the difficulties presented when prior information is weak and improper prior are used. Additional difficulties also appear when the models are separated or non nested. This article presents both simulation results and some illustrative examples analysis comparing these alternative Bayes factors to discriminate among the Lognormal, the Weibull, the Gamma, and the Exponential distributions. Simulation results are obtained for different sample sizes generated from the distributions. Results from simulations indicates that these alternative Bayes factors are useful for comparing non nested models. The simulations also show some similar behavior and that when both models are true they choose the simplest model. Some illustrative example are also presented.     

Estimating the parameters of a bathtub-shaped distribution under progressive type-II censoring

We consider the problem of estimating unknown parameters, reliability function and hazard function of a two parameter bathtub-shaped distribution on the basis of progressive type-II censored sample. The maximum likelihood estimators and Bayes estimators are derived for two unknown parameters, reliability function and hazard function. The Bayes estimators are obtained against squared error, LINEX and entropy loss functions. Also, using the Lindley approximation method we have obtained approximate Bayes estimators against these loss functions. Some numerical comparisons are made among various proposed estimators in terms of their mean square error values and some specific recommendations are given. Finally, two data sets are analyzed to illustrate the proposed methods.