On Measuring Uncertainty of Benchmarked Predictors with Application to Disease Risk Estimate

Empirical Bayes (EB) estimates in general linear mixed models are useful for the small area estimation in the sense of increasing precision of estimation of small area means. However, one potential difficulty of EB is that the overall estimate for a larger geographical area based on a (weighted) sum of EB estimates is not necessarily identical to the corresponding direct estimate such as the overall sample mean. Another difficulty is that EB estimates yield over‐shrinking, which results in the sampling variance smaller than the posterior variance. One way to fix these problems is the benchmarking approach based on the constrained empirical Bayes (CEB) estimators, which satisfy the constraints that the aggregated mean and variance are identical to the requested values of mean and variance. In this paper, we treat the general mixed models, derive asymptotic approximations of the mean squared error (MSE) of CEB and provide second‐order unbiased estimators of MSE based on the parametric bootstrap method. These results are applied to natural exponential families with quadratic variance functions. As a specific example, the Poisson‐gamma model is dealt with, and it is illustrated that the CEB estimates and their MSE estimates work well through real mortality data.     

Bayesian approach to change point problems

A Bayesian approach is considered to study the change point problems. A hypothesis for testing change versus no change is considered using the notion of predictive distributions. Bayes factors are developed for change versus no change in the exponential families of distributions with conjugate priors. Under vague prior information, both Bayes factors and pseudo Bayes factors are considered. A new result is developed which describes how the overall Bayes factor has a decomposition into Bayes factors at each point. Finally, an example is provided in which the computations are performed using the concept of imaginary observations.     

Une condition nécessaire d'admissibilité et ses conséquences sur les estimateurs à rétrécisseur de la moyenne d'un vecteur normal

Considering exponential families of distributions, we estimate parameters which are not the natural parameters. We prove that the admissible estimators of these parameters are limits of Bayes estimators and can be expressed through a given functional form. An important particular case of this model pertains to the estimation of the mean of a multidimensional normal distribution when the variance is known up to a multiplicative factor. We deduce from the main result a necessry condition for the admissibility of matricial shrinkage estimators.     

A note on the convergence rates for empirical bayes estimators of parameters in multiple-parameter exponential families

Under suitable conditions upon prior distribution, the convergence rates for empirical Bayes estimators of parameters in multi-parameter exponential families (M-PEF) are obtained. It is shown that the assumptions Tong (1996) imposed on the marginal density can be reduced. The above result can also be extended to more general forms of M-PEF. Finally, some examples which satisfy the conditions of the theorems are given.     

Empirical Bayes Confidence Intervals for Means of Natural Exponential Family-Quadratic Variance Function Distributions with Application to Small Area Estimation

Abstract.  The paper develops empirical Bayes (EB) confidence intervals for population means with distributions belonging to the natural exponential family-quadratic variance function (NEF-QVF) family when the sample size for a particular population is moderate or large. The basis for such development is to find an interval centred around the posterior mean which meets the target coverage probability asymptotically, and then show that the difference between the coverage probabilities of the Bayes and EB intervals is negligible up to a certain order. The approach taken is Edgeworth expansion so that the sample sizes from the different populations need not be significantly large. The proposed intervals meet the target coverage probabilities asymptotically, and are easy to construct. We illustrate use of these intervals in the context of small area estimation both through real and simulated data. The proposed intervals are different from the bootstrap intervals. The latter can be applied quite generally, but the order of accuracy of these intervals in meeting the desired coverage probability is unknown.     

Bayes and empirical Bayes shrinkage estimation of regression coefficients

For a moderate or large number of regression coefficients, shrinkage estimates towards an overall mean are obtained by Bayes and empirical Bayes methods. For a special case, the Bayes and empirical Bayes shrinking weights are shown to be asymptotically equivalent as the amount of shrinkage goes to zero. Based on comparisons between Bayes and empirical Bayes solutions, a modification of the empirical Bayes shrinking weights designed to guard against unreasonable overshrinking is suggested. A numerical example is given.     

Empirical bayes shrinkage estimation of reliability in the exponential distribution

In this paper we propose two empirical Bayes shrinkage estimators for the reliability of the exponential distribution and study their properties. Under the uniform prior distribution and the inverted gamma prior distribution these estimators are developed and compared with a preliminary test estimator and with a shrinkage testimator in terms of mean squared error. The proposed empirical Bayes shrinkage estimator under the inverted gamma prior distribution is shown to be preferable to the preliminary test estimator and the shrinkage testimator when the prior value of mean life is clsoe to the true mean life.     

Conditionally Reducible Natural Exponential Families and Enriched Conjugate Priors

Consider a standard conjugate family of prior distributions for a vector-parameter indexing an exponential family. Two distinct model parameterizations may well lead to standard conjugate families which are not consistent, i.e. one family cannot be derived from the other by the usual change-of-variable technique. This raises the problem of finding suitable parameterizations that may lead to enriched conjugate families which are more flexible than the traditional ones. The previous remark motivates the definition of a new property for an exponential family, named conditional reducibility. Features of conditionally-reducible natural exponential families are investigated thoroughly. In particular, we relate this new property to the notion of cut, and show that conditionally-reducible families admit a reparameterization in terms of a vector having likelihood-independent components. A general methodology to obtain enriched conjugate distributions for conditionally-reducible families is described in detail, generalizing previous works and more recent contributions in the area. The theory is illustrated with reference to natural exponential families having simple quadratic variance function.     

Convergence rates for empirical bayes estimators of parameters in multi-parameter exponential families

This paper obtains the convergence rates of the empirical Bayes estimators of parameters in the multi-parameter exponential families. The rates can approximate to 0(n=¹) arbitrarily. The paper presents the multivariate orthogonal polynomials which are continuous on the total space R^p.     

Empirical bayes estimation of reliability characteristics for an exponential family

This paper considers empirical Bayes (EB) squared-error-loss estimations of mean lifetime, variance and reliability function for failure-time distributions belonging to an exponential family, which includes gamma and Weibull distributions as special cases. EB estimators are proposed when the prior distribution of the lifetime parameter is completely unknown but has a compact (known or unknown) support. Asymptotic optimality and rates of convergence of these estimators are investigated. The rates established here under the compact support restriction are better than the polynomial rates of convergence obtained previously.     

Point estimation of the stress–strength reliability parameter for parallel system with independent and non-identical components

In this article, the estimation problem of the multicomponent stress–strength reliability parameter is considered where the stress and the strength systems have arbitrary fixed numbers of independent and non-identical parallel components. It is assumed that the distribution functions of the stress and the strength components satisfy the proportional reversed hazard rate model. The study is done in more details when the baseline distributions are exponential. Maximum likelihood and uniformly minimum variance unbiased estimators are obtained and compared. Also, Bayes and empirical Bayes estimators are discussed and Monte Carlo simulations are carried out to compare their performances.     

Empirical Bayes estimation in continuous one-parameter exponential families under associated samples

In this paper, we study the empirical Bayes (EB) estimation in continuous one-parameter exponential families under negatively associated (NA) samples and positively associated (PA) samples. Under certain regularity conditions, it is shown that the convergence rates of proposed EB estimators under NA or PA samples are the same as those of EB estimators under independent observations, which significantly improve the existing results in EB estimation under associated samples.     

Empirical Bayes estimation for the mean of the selected normal population when there are additional data

ABSTRACT

This paper is concerned with the problem of estimation for the mean of the selected population from two normal populations with unknown means and common known variance in a Bayesian framework. The empirical Bayes estimator, when there are available additional observations, is derived and its bias and risk function are computed. The expected bias and risk of the empirical Bayes estimator and the intuitive estimator are compared. It is shown that the empirical Bayes estimator is asymptotically optimal and especially dominates the intuitive estimator in terms of Bayes risk, with respect to any normal prior. Also, the Bayesian correlation between the mean of the selected population (random parameter) and some interested estimators are obtained and compared.     

Robust empirical Bayes tests for continuous distributions

In this paper, we study the empirical Bayes two-action problem under linear loss function. Upper bounds on the regret of empirical Bayes testing rules are investigated. Previous results on this problem construct empirical Bayes tests using kernel type estimators of nonparametric functionals. Further, they have assumed specific forms, such as the continuous one-parameter exponential family for {F_θ:θΩ}, for the family of distributions of the observations. In this paper, we present a new general approach of establishing upper bounds (in terms of rate of convergence) of empirical Bayes tests for this problem. Our results are given for any family of continuous distributions and apply to empirical Bayes tests based on any type of nonparametric method of functional estimation. We show that our bounds are very sharp in the sense that they reduce to existing optimal or nearly optimal rates of convergence when applied to specific families of distributions.     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

Empirical Bayes estimation of median income of four-person families by state using time series and cross-sectional data

The Department of Health and Human Services uses estimates of the median income of four-person families for all the fifty states and the District of Columbia to formulate its energy assistance program for low income families. Such estimates are provided by the US Census Bureau on an annual basis.A hierarchical time series model is considered to combine information from three relevant sources: (a) Current Population Survey (CPS), (b) Decennial Censuses and (c) Bureau of Economic Analysis. An empirical Bayes (EB) method is used to smooth the CPS estimates of the median income of four-person families for the states. The proposed method is an advancement over the EB method currently used by the US Bureau of the Census in the sense that it uses a more realistic model, provides maximum likelihood and residual maximum likelihood method of variance components estimation and provides a valid measure of uncertainty of the proposed estimates which captures all different sources of variations. Compared to the corresponding hierarchical Bayes estimation, the method is very easy to implement and saves a tremendous amount of computer time. The proposed EB method is compared with rival estimators using the 1989 four-person median income figures obtained from the 1990 Census.     

The Superiorities of Empirical Bayes Estimation of Variance Components in Random Effects Model

In this article, the Bayes estimators of variance components are derived and the parametric empirical Bayes estimators (PEBE) for the balanced one-way classification random effects model are constructed. The superiorities of the PEBE over the analysis of variance (ANOVA) estimators are investigated under the mean square error (MSE) criterion, some simulation results for the PEBE are obtained. Finally, a remark for the main results is given.     

The use of the weighted likelihood in the natural exponential families with quadratic variance

The authors propose a weighted likelihood concept for the estimation of parameters in natural exponential families with quadratic variance. They apply the results to both simulated and real data.     

EMPIRICAL BAYES ESTIMATION WITH NON-IDENTICAL COMPONENTS. CONTINUOUS CASE.

In this paper a variant of the standard empirical Bayes estimation problem is considered where the component problems in the sequence are not identical in that the conditional distribution of the observations may vary with the component problems. Let {(Θ_n, X_n)} be a sequence of independent random vectors where Θ_n? G and, given Θ_n=Θ_n, X_n -P_Θ,m(n) with {m(n)} a sequence of positive integers where m(n)≤m? < ∞ for all n. With P_Θ,m in a continuous exponential family of distributions, asymptotically optimal empirical Bayes procedures are exhibited which depend on uniform approximations of certain functions on compact sets by polynomials in e^Θ. Such approximations have been explicitly calculated in the case of normal and gamma families. In the case of normal families, asymptotically optimal linear empirical Bayes estimators in the class of all linear estimators are derived and shown to have rate O(n^-1/2).     

Minimum variance unbiased estimation in natural exponential families generated by stable distributions

The class of nature exponential families generated by stable distributions has been introduced in different contexts by several authors. Tweedie (1984) and Jorgensen (1987) studied this class in the context of generalized liner models and exponential dispersion models. Bar-Lev and Enis (1986) introduced this class in the context of the property of reproducibility in natural exponential families and Hougaard (1986) found the distributions in this class to be natural candidates for applications as survival distributions in life tables for heterogeneous populations. In this note, we consider such a class in the context of minimum variance unbiased estimation. For each family in this class, we obtain an explicit expression for the uniformly minimum variance unbiased estimator for the r-th cumlant, the density function, and the reliability function.