Empirical Bayes Estimation of Small Area Means under a Nested Error Linear Regression Model with Measurement Errors in the Covariates

Abstract.  Previously, small area estimation under a nested error linear regression model was studied with area level covariates subject to measurement error. However, the information on observed covariates was not used in finding the Bayes predictor of a small area mean. In this paper, we first derive the fully efficient Bayes predictor by utilizing all the available data. We then estimate the regression and variance component parameters in the model to get an empirical Bayes (EB) predictor and show that the EB predictor is asymptotically optimal. In addition, we employ the jackknife method to obtain an estimator of mean squared prediction error (MSPE) of the EB predictor. Finally, we report the results of a simulation study on the performance of our EB predictor and associated jackknife MSPE estimators. Our results show that the proposed EB predictor can lead to significant gain in efficiency over the previously proposed EB predictor.     

BAYES EMPIRICAL BAYES APPROACH TO ESTIMATION OF THE FAILURE RATE IN EXPONENTIAL DISTRIBUTION

ABSTRACT

In the empirical Bayes (EB) decision problem consisting of squared error estimation of the failure rate in exponential distribution, a prior Λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the a.o. property of the Bayes EB estimators.     

On empirical Bayes estimation of variance components in random effects model

In this paper, Bayes estimators of variance components are derived for the one-way random effects model, and empirical Bayes (EB) estimators are constructed by the kernel estimation method of a multivariate density and its mixed partial derivatives. It is shown that the EB estimators are asymptotically optimal and convergence rates are established. Finally, an example concerning the main results is given.     

Empirical Bayes estimation in finite population sampling under functional measurement error models

The paper considers simultaneous estimation of finite population means for several strata. A model-based approach is taken, where the covariates in the super-population model are subject to measurement errors. Empirical Bayes (EB) estimators of the strata means are developed and an asymptotic expression for the MSE of the EB estimators is provided. It is shown that the proposed EB estimators are “first order optimal” in the sense of Robbins [1956. An empirical Bayes approach to statistics. In: Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, University of California Press, Berkeley, pp. 157–164], while the regular EB estimators which ignore the measurement error are not.     

Flexible empirical Bayes estimation for wavelets

Wavelet shrinkage estimation is an increasingly popular method for signal denoising and compression. Although Bayes estimators can provide excellent mean-squared error (MSE) properties, the selection of an effective prior is a difficult task. To address this problem, we propose empirical Bayes (EB) prior selection methods for various error distributions including the normal and the heavier-tailed Student t -distributions. Under such EB prior distributions, we obtain threshold shrinkage estimators based on model selection, and multiple-shrinkage estimators based on model averaging. These EB estimators are seen to be computationally competitive with standard classical thresholding methods, and to be robust to outliers in both the data and wavelet domains. Simulated and real examples are used to illustrate the flexibility and improved MSE performance of these methods in a wide variety of settings.     

Empirical and Hierarchical Bayesian Estimation in Finite Population Sampling under Structural Measurement Error Models

Abstract.  This paper considers simultaneous estimation of means from several strata. A model-based approach is taken, where the covariates in the superpopulation model are subject to measurement errors. Empirical Bayes (EB) and Hierarchical Bayes estimators of the strata means are developed and asymptotic optimality of EB estimators is proved. Their performances are examined and compared with that of the sample mean in a simulation study as well as in data analysis.     

Estimation of a population size through capture-mark-recapture method: a comparison of various point and interval estimators

This article deals with the estimation of a fixed population size through capture-mark-recapture method that gives rise to hypergeometric distribution. There are a few well-known and popular point estimators available in the literature, but no good comprehensive comparison is available about their merits. Apart from the available estimators, an empirical Bayes (EB) estimator of the population size is proposed. We compare all the point estimators in terms of relative bias and relative mean squared error. Next, two new interval estimators – (a) an EB highest posterior distribution interval and (b) a frequentist interval estimator based on a parametric bootstrap method, are proposed. The comparison is then carried among the two proposed interval estimators and interval estimators derived from the currently available estimators in terms of coverage probability and average length (AL). Based on comprehensive numerical results, we rank and recommend the point estimators as well as interval estimators for practical use. Finally, a real-life data set for a green treefrog population is used as a demonstration for all the methods discussed.     

On Measuring Uncertainty of Benchmarked Predictors with Application to Disease Risk Estimate

Empirical Bayes (EB) estimates in general linear mixed models are useful for the small area estimation in the sense of increasing precision of estimation of small area means. However, one potential difficulty of EB is that the overall estimate for a larger geographical area based on a (weighted) sum of EB estimates is not necessarily identical to the corresponding direct estimate such as the overall sample mean. Another difficulty is that EB estimates yield over‐shrinking, which results in the sampling variance smaller than the posterior variance. One way to fix these problems is the benchmarking approach based on the constrained empirical Bayes (CEB) estimators, which satisfy the constraints that the aggregated mean and variance are identical to the requested values of mean and variance. In this paper, we treat the general mixed models, derive asymptotic approximations of the mean squared error (MSE) of CEB and provide second‐order unbiased estimators of MSE based on the parametric bootstrap method. These results are applied to natural exponential families with quadratic variance functions. As a specific example, the Poisson‐gamma model is dealt with, and it is illustrated that the CEB estimates and their MSE estimates work well through real mortality data.     

On Nelson–Aalen type estimation in the partial Koziol–Green model

In this paper, a Nelson–Aalen (NA) type estimator is derived and its sample properties are compared with the partial Abdushukurov–Cheng–Lin (PACL), generalized maximum likelihood (GMLE), and Kaplan–Meier (KM) estimators under the partial Koziol–Green model. These comparisons are made through Monto Carlo simulations under various sample sizes. The results indicate that the NA estimator always performs better than the KM estimator and is competitive with other estimators. Moreover, the PACL, GMLE, and NA estimators are shown to be asymptotically equivalent.     

Empirical bayes estimation of reliability characteristics for an exponential family

This paper considers empirical Bayes (EB) squared-error-loss estimations of mean lifetime, variance and reliability function for failure-time distributions belonging to an exponential family, which includes gamma and Weibull distributions as special cases. EB estimators are proposed when the prior distribution of the lifetime parameter is completely unknown but has a compact (known or unknown) support. Asymptotic optimality and rates of convergence of these estimators are investigated. The rates established here under the compact support restriction are better than the polynomial rates of convergence obtained previously.     

Robust pairwise multiple comparisons under short-tailed symmetric distributions

In one-way ANOVA, most of the pairwise multiple comparison procedures depend on normality assumption of errors. In practice, errors have non-normal distributions so frequently. Therefore, it is very important to develop robust estimators of location and the associated variance under non-normality. In this paper, we consider the estimation of one-way ANOVA model parameters to make pairwise multiple comparisons under short-tailed symmetric (STS) distribution. The classical least squares method is neither efficient nor robust and maximum likelihood estimation technique is problematic in this situation. Modified maximum likelihood (MML) estimation technique gives the opportunity to estimate model parameters in closed forms under non-normal distributions. Hence, the use of MML estimators in the test statistic is proposed for pairwise multiple comparisons under STS distribution. The efficiency and power comparisons of the test statistic based on sample mean, trimmed mean, wave and MML estimators are given and the robustness of the test obtained using these estimators under plausible alternatives and inlier model are examined. It is demonstrated that the test statistic based on MML estimators is efficient and robust and the corresponding test is more powerful and having smallest Type I error.     

Constrained Bayes and Empirical Bayes Estimation with Balanced Loss Functions

This article develops constrained Bayes and empirical Bayes estimators under balanced loss functions. In the normal-normal example, estimators of the mean squared errors of the EB and constrained EB estimators are provided which are correct asymptotically up to O(m ^?1), m denoting the number of strata.     

Convergence rates for empirical bayes estimators of parameters in linear regressin models

In this paper, the convergence rates of the EB estimators of the regression coefficients and the error variance in a linear model are obtained. The rates can approximate to O(n¹) arbitrarily. The convergency of the EB estimators of the regression coefiicients and the variance components in a variance component model is also investigated. The investigation makes use of the results concerning the convergence rates of the EB estimators of the parameters in multi-parameter exponential families.     

Construction of improved estimators of multinomial proportions

The improved large sample estimation theory for the probabilities of multi¬nomial distribution is developed under uncertain prior information (UPI) that the true proportion is a known quantity. Several estimators based on pretest and the Stein-type shrinkage rules are constructed. The expressions for the bias and risk of the proposed estimators are derived and compared with the maximum likelihood (ml) estimators. It is demonstrated that the shrinkage estimators are superior to the ml estimators. It is also shown that none of the preliminary test and shrinkage estimators dominate each other, though they perform y/ell relative to the ml estimators. The relative dominance picture of the estimators is presented. A simulation study is carried out to assess the performance of the estimators numerically in small samples.     

Two-stage Huber estimation

In this paper we propose a new robust estimator in the context of two-stage estimation methods directed towards the correction of endogeneity problems in linear models. Our estimator is a combination of Huber estimators for each of the two stages, with scale corrections implemented using preliminary median absolute deviation estimators. In this way we obtain a two-stage estimation procedure that is an interesting compromise between concerns of simplicity of calculation, robustness and efficiency. This method compares well with other possible estimators such as two-stage least-squares (2SLS) and two-stage least-absolute-deviations (2SLAD), asymptotically and in finite samples. It is notably interesting to deal with contamination affecting more heavily the distribution tails than a few outliers and not losing as much efficiency as other popular estimators in that case, e.g. under normality. An additional originality resides in the fact that we deal with random regressors and asymmetric errors, which is not often the case in the literature on robust estimators.     

Bayesian and Non Bayesian Estimations on the Exponentiated Modified Weibull Distribution for Progressive Censored Sample

The four-parameter Exponentiated Modified Weibull (EMW) is considered as an important lifetime distribution. Based on progressive Type-II censored sample, maximum likelihood and Bayesian estimators of the parameters, reliability function, and hazard rate function are derived. Two cases are considered: first, the case of one unknown exponent parameter of EMW and second, the case when two parameters of the EMW are both unknown. The Bayes estimators are studied under squared error and LINEX loss functions. The standard Bayes and importance sampling are considered for the estimation. Monte Carlo simulations are performed under different samples sizes and different censoring schemes for investigating and comparing the methods of estimation.     

Empirical Bayes estimation of median income of four-person families by state using time series and cross-sectional data

The Department of Health and Human Services uses estimates of the median income of four-person families for all the fifty states and the District of Columbia to formulate its energy assistance program for low income families. Such estimates are provided by the US Census Bureau on an annual basis.A hierarchical time series model is considered to combine information from three relevant sources: (a) Current Population Survey (CPS), (b) Decennial Censuses and (c) Bureau of Economic Analysis. An empirical Bayes (EB) method is used to smooth the CPS estimates of the median income of four-person families for the states. The proposed method is an advancement over the EB method currently used by the US Bureau of the Census in the sense that it uses a more realistic model, provides maximum likelihood and residual maximum likelihood method of variance components estimation and provides a valid measure of uncertainty of the proposed estimates which captures all different sources of variations. Compared to the corresponding hierarchical Bayes estimation, the method is very easy to implement and saves a tremendous amount of computer time. The proposed EB method is compared with rival estimators using the 1989 four-person median income figures obtained from the 1990 Census.     

Adaptive nonparametric empirical Bayes estimation via wavelet series: The minimax study

In the present paper, we derive lower bounds for the risk of the nonparametric empirical Bayes estimators. In order to attain the optimal convergence rate, we propose generalization of the linear empirical Bayes estimation method which takes advantage of the flexibility of the wavelet techniques. We present an empirical Bayes estimator as a wavelet series expansion and estimate coefficients by minimizing the prior risk of the estimator. As a result, estimation of wavelet coefficients requires solution of a well-posed low-dimensional sparse system of linear equations. The dimension of the system depends on the size of wavelet support and smoothness of the Bayes estimator. An adaptive choice of the resolution level is carried out using Lepski et al. (1997) method. The method is computationally efficient and provides asymptotically optimal adaptive EB estimators. The theory is supplemented by numerous examples.     

Estimation of the Mean and Standard Deviation of the Logistic Distribution Based on Multiply Type-II Censored Samples

In this paper, we discuss the problem of estimating the mean and standard deviation of a logistic population based on multiply Type-II censored samples. First, we discuss the best linear unbiased estimation and the maximum likelihood estimation methods. Next, by appropriately approximating the likelihood equations we derive approximate maximum likelihood estimators for the two parameters and show that these estimators are quite useful as they do not need the construction of any special tables (as required for the best linear unbiased estimators) and are explicit estimators (unlike the maximum likelihood estimators which need to be determined by numerical methods). We show that these estimators are also quite efficient, and derive the asymptotic variances and covariance of the estimators. Finally, we present an example to illustrate the methods of estimation discussed in this paper.     

ON THE COMMON SCALE PARAMETER OF SEVERAL PARETO POPULATIONS IN CENSORED SAMPLES

The problem of estimation of an unknown common scale parameter of several Pareto distributions with unknown and possibly unequal shape parameters in censored samples is considered. A new class of estimators which includes both the maximum likelihood estimator (MLE) and the uniformly minimum variance unbiased estimator (UMVUE) is proposed and examined under a squared error loss.