Empirical Bayes estimation in finite population sampling under functional measurement error models

The paper considers simultaneous estimation of finite population means for several strata. A model-based approach is taken, where the covariates in the super-population model are subject to measurement errors. Empirical Bayes (EB) estimators of the strata means are developed and an asymptotic expression for the MSE of the EB estimators is provided. It is shown that the proposed EB estimators are “first order optimal” in the sense of Robbins [1956. An empirical Bayes approach to statistics. In: Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, University of California Press, Berkeley, pp. 157–164], while the regular EB estimators which ignore the measurement error are not.     

Constrained Bayes and Empirical Bayes Estimation with Balanced Loss Functions

This article develops constrained Bayes and empirical Bayes estimators under balanced loss functions. In the normal-normal example, estimators of the mean squared errors of the EB and constrained EB estimators are provided which are correct asymptotically up to O(m ^?1), m denoting the number of strata.     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

On empirical Bayes estimation of variance components in random effects model

In this paper, Bayes estimators of variance components are derived for the one-way random effects model, and empirical Bayes (EB) estimators are constructed by the kernel estimation method of a multivariate density and its mixed partial derivatives. It is shown that the EB estimators are asymptotically optimal and convergence rates are established. Finally, an example concerning the main results is given.     

Empirical Bayes estimation in continuous one-parameter exponential families under associated samples

In this paper, we study the empirical Bayes (EB) estimation in continuous one-parameter exponential families under negatively associated (NA) samples and positively associated (PA) samples. Under certain regularity conditions, it is shown that the convergence rates of proposed EB estimators under NA or PA samples are the same as those of EB estimators under independent observations, which significantly improve the existing results in EB estimation under associated samples.     

On Measuring Uncertainty of Benchmarked Predictors with Application to Disease Risk Estimate

Empirical Bayes (EB) estimates in general linear mixed models are useful for the small area estimation in the sense of increasing precision of estimation of small area means. However, one potential difficulty of EB is that the overall estimate for a larger geographical area based on a (weighted) sum of EB estimates is not necessarily identical to the corresponding direct estimate such as the overall sample mean. Another difficulty is that EB estimates yield over‐shrinking, which results in the sampling variance smaller than the posterior variance. One way to fix these problems is the benchmarking approach based on the constrained empirical Bayes (CEB) estimators, which satisfy the constraints that the aggregated mean and variance are identical to the requested values of mean and variance. In this paper, we treat the general mixed models, derive asymptotic approximations of the mean squared error (MSE) of CEB and provide second‐order unbiased estimators of MSE based on the parametric bootstrap method. These results are applied to natural exponential families with quadratic variance functions. As a specific example, the Poisson‐gamma model is dealt with, and it is illustrated that the CEB estimates and their MSE estimates work well through real mortality data.     

Flexible empirical Bayes estimation for wavelets

Wavelet shrinkage estimation is an increasingly popular method for signal denoising and compression. Although Bayes estimators can provide excellent mean-squared error (MSE) properties, the selection of an effective prior is a difficult task. To address this problem, we propose empirical Bayes (EB) prior selection methods for various error distributions including the normal and the heavier-tailed Student t -distributions. Under such EB prior distributions, we obtain threshold shrinkage estimators based on model selection, and multiple-shrinkage estimators based on model averaging. These EB estimators are seen to be computationally competitive with standard classical thresholding methods, and to be robust to outliers in both the data and wavelet domains. Simulated and real examples are used to illustrate the flexibility and improved MSE performance of these methods in a wide variety of settings.     

Empirical bayes estimation of reliability characteristics for an exponential family

This paper considers empirical Bayes (EB) squared-error-loss estimations of mean lifetime, variance and reliability function for failure-time distributions belonging to an exponential family, which includes gamma and Weibull distributions as special cases. EB estimators are proposed when the prior distribution of the lifetime parameter is completely unknown but has a compact (known or unknown) support. Asymptotic optimality and rates of convergence of these estimators are investigated. The rates established here under the compact support restriction are better than the polynomial rates of convergence obtained previously.     

Estimation of a population size through capture-mark-recapture method: a comparison of various point and interval estimators

This article deals with the estimation of a fixed population size through capture-mark-recapture method that gives rise to hypergeometric distribution. There are a few well-known and popular point estimators available in the literature, but no good comprehensive comparison is available about their merits. Apart from the available estimators, an empirical Bayes (EB) estimator of the population size is proposed. We compare all the point estimators in terms of relative bias and relative mean squared error. Next, two new interval estimators – (a) an EB highest posterior distribution interval and (b) a frequentist interval estimator based on a parametric bootstrap method, are proposed. The comparison is then carried among the two proposed interval estimators and interval estimators derived from the currently available estimators in terms of coverage probability and average length (AL). Based on comprehensive numerical results, we rank and recommend the point estimators as well as interval estimators for practical use. Finally, a real-life data set for a green treefrog population is used as a demonstration for all the methods discussed.     

Empirical Bayes Estimation of Small Area Means under a Nested Error Linear Regression Model with Measurement Errors in the Covariates

Abstract.  Previously, small area estimation under a nested error linear regression model was studied with area level covariates subject to measurement error. However, the information on observed covariates was not used in finding the Bayes predictor of a small area mean. In this paper, we first derive the fully efficient Bayes predictor by utilizing all the available data. We then estimate the regression and variance component parameters in the model to get an empirical Bayes (EB) predictor and show that the EB predictor is asymptotically optimal. In addition, we employ the jackknife method to obtain an estimator of mean squared prediction error (MSPE) of the EB predictor. Finally, we report the results of a simulation study on the performance of our EB predictor and associated jackknife MSPE estimators. Our results show that the proposed EB predictor can lead to significant gain in efficiency over the previously proposed EB predictor.     

Empirical Bayes estimation of undercount in the decennial census

Empirical Bayes methods are used to estimate the extent of the undercount at the local level in the 1980 U.S. census. "Grouping of like subareas from areas such as states, counties, and so on into strata is a useful way of reducing the variance of undercount estimators. By modeling the subareas within a stratum to have a common mean and variances inversely proportional to their census counts, and by taking into account sampling of the areas (e.g., by dual-system estimation), empirical Bayes estimators that compromise between the (weighted) stratum average and the sample value can be constructed. The amount of compromise is shown to depend on the relative importance of stratum variance to sampling variance. These estimators are evaluated at the state level (51 states, including Washington, D.C.) and stratified on race/ethnicity (3 strata) using data from the 1980 postenumeration survey (PEP 3-8, for the noninstitutional population)."     

Adaptive nonparametric empirical Bayes estimation via wavelet series: The minimax study

In the present paper, we derive lower bounds for the risk of the nonparametric empirical Bayes estimators. In order to attain the optimal convergence rate, we propose generalization of the linear empirical Bayes estimation method which takes advantage of the flexibility of the wavelet techniques. We present an empirical Bayes estimator as a wavelet series expansion and estimate coefficients by minimizing the prior risk of the estimator. As a result, estimation of wavelet coefficients requires solution of a well-posed low-dimensional sparse system of linear equations. The dimension of the system depends on the size of wavelet support and smoothness of the Bayes estimator. An adaptive choice of the resolution level is carried out using Lepski et al. (1997) method. The method is computationally efficient and provides asymptotically optimal adaptive EB estimators. The theory is supplemented by numerous examples.     

Proper Bayes minimax estimators of the normal mean matrix with common unknown variances

This paper addresses the problem of estimating a matrix of the normal means, where the variances are unknown but common. The approach to this problem is provided by a hierarchical Bayes modeling for which the first stage prior for the means is matrix-variate normal distribution with mean zero matrix and a covariance structure and the second stage prior for the covariance is similar to Jeffreys’ rule. The resulting hierarchical Bayes estimators relative to the quadratic loss function belong to a class of matricial shrinkage estimators. Certain conditions are obtained for admissibility and minimaxity of the hierarchical Bayes estimators.     

Bayes admissible estimation of the means in Poisson decomposable graphical models

We investigate the Bayes estimation of the means in Poisson decomposable graphical models. Some classes of Bayes estimators are provided which improve on the maximum likelihood estimator under the normalized squared error loss. Both proper and improper priors are included in the proposed classes of priors. Concerning the generalized Bayes estimators with respect to the improper priors, we address their admissibility.     

Empirical Bayes estimators in hierarchical models with mixture priors

We consider subgroup analyses within the framework of hierarchical modeling and empirical Bayes (EB) methodology for general priors, thereby generalizing the normal–normal model. By doing this one obtains greater flexibility in modeling. We focus on mixture priors, that is, on the situation where group effects are exchangeable within clusters of subgroups only. We establish theoretical results on accuracy, precision, shrinkage and selection bias of EB estimators under the general priors. The impact of model misspecification is investigated and the applicability of the methodology is illustrated with datasets from the (medical) literature.     

Bayes methods in the ecological fallacy cntext:estimation of individual correlation from aggregate data

The ecological fallacy is related to Simpson's paradox (1951) where relationships among group means may be counterintuitive and substantially different from relationships within groups, where the groups are usually geographic entities such as census tracts. We consider the problem of estimating the correlation between two jointly normal random variables where only ecological data (group means) are available. Two empirical Bayes estimators and one fully Bayesian estimator are derived and compared with the usual ecological estimator, which is simply the Pearson correlation coefficient of the group sample means. We simulate the bias and mean squared error performance of these estimators, and also give an example employing a dataset where the individual level data are available for model checking. The results indicate superiority of the empirical Bayes estimators in a variety of practical situations where, though we lack individual level data, other relevant prior information is available.     

On estmation of poisson lovits

Simultaneous estimation of poisson logits is considered in a 2xp contingency table under entropy loss. Classical estimators, which are corrected versions of the maximum likeihood estimators, are obtained as generalized Bayes and empirical Bayes estimators. Finally, improved estimators are obtained which domicate the generalized Bayes estimators.     

On robust empirical bayes analysis of means and variances from stratified samples

Ghosh and Lahiri (1987a,b) considered simultaneous estimation of several strata means and variances where each stratum contains a finite number of elements, under the assumption that the posterior expectation of any stratum mean is a linear function of the sample observations - the so called“posterior linearity” property. In this paper we extend their result by retaining the “posterior linearity“ property of each stratum mean but allowing the superpopulation model whose mean as well as the variance-covariance structure changes from stratum to stratum. The performance of the proposed empirical Bayes estimators are found to be satisfactory both in terms of “asymptotic optimality” (Robbins (1955)) and “relative savings loss” (Efron and Morris (1973)).     

The relative performances of improved ridge estimators and an empirical bayes estimator: some monte carlo results

The relative 'performances of improved ridge estimators and an empirical Bayes estimator are studied by means of Monte Carlo simulations. The empirical Bayes method is seen to perform consistently better in terms of smaller MSE and more accurate empirical coverage than any of the estimators considered here. A bootstrap method is proposed to obtain more reliable estimates of the MSE of ridge esimators. Some theorems on the bootstrap for the ridge estimators are also given and they are used to provide an analytical understanding of the proposed bootstrap procedure. Empirical coverages of the ridge estimators based on the proposed procedure are generally closer to the nominal coverage when compared to their earlier counterparts. In general, except for a few cases, these coverages are still less accurate than the empirical coverages of the empirical Bayes estimator.     

On the Bayesian Estimation for the Uniform Scale Parameter via a Functional Equation

Bayes uniform model under the squared error loss function is shown to be completely identifiable by the form of the Bayes estimates of the scale parameter. This results in solving a specific functional equation. A complete characterization of differentiable Bayes estimators (BE) and generalized Bayes estimators (GBE) is given as well as relations between degrees of smoothness of the estimators and the priors. Characterizations of strong (generalized Bayes) Bayes sequence (SBS or SGBS) are also investigated. A SBS is a sequence of estimators (one for each sample size) where all its components are BE generated by the same prior measure. A complete solution is given for polynomial Bayesian estimation.