Empirical bayes estimation of binomial parameter with symmetric priors

This paper deals with the problem of estimating the binomial parameter via the nonparametric empirical Bayes approach. This estimation problem has the feature that estimators which are asymptotically optimal in the usual empirical Bayes sense do not exist (Robbins (1958, 1964)), However, as pointed out by Liang (1934) and Gupta and Liang (1988), it is possible to construct asymptotically optimal empirical Bayes estimators if the unknown prior is symmetric about the point 1/2, In this paper, assuming symmetric priors a monotone empirical Bayes estimator is constructed by using the isotonic regression method. This estimator is asymptotically optimal in the usual empirical Bayes sense. The corresponding rate of convergence is investigated and shown to be of order n^-1, where n is the number of past observations at hand.     

An empirical bayes approach to a variables acceptance sampling plan problem

An empirical Bayes approach to a variables acceptance sampling plan problem is presented and an empirical Bayes rule is developed which is shown to be asymptotically optimal under general conditions. The problem considered is one in which the ratio of the costs of accepting defective items and rejecting non-defective items is specified. Sampling costs are not considered and the size of the sample taken from each lot is fixed and constant. The empirical Bayes estimation of the Bayes rule is shown to require the estimation of a conditional probability. An estimator for conditional probabilities of the form needed is derived and shown to have good asymptotic properties.     

Empirical bayes estimation of reliability characteristics for an exponential family

This paper considers empirical Bayes (EB) squared-error-loss estimations of mean lifetime, variance and reliability function for failure-time distributions belonging to an exponential family, which includes gamma and Weibull distributions as special cases. EB estimators are proposed when the prior distribution of the lifetime parameter is completely unknown but has a compact (known or unknown) support. Asymptotic optimality and rates of convergence of these estimators are investigated. The rates established here under the compact support restriction are better than the polynomial rates of convergence obtained previously.     

A note on james-stein and bayes empiricl bayes estimators

In an empirical Bayes decision problem, a simple class of estimators is constructed that dominate the James-Stein

estimator, A prior distribution A is placed on a restricted (normal) class G of priors to produce a Bayes empirical Bayes estimator, The Bayes empirical Bayes estimator is smooth, admissible, and asymptotically optimal. For certain A rate of convergence to minimum Bayes risk is 0(n^-1)uniformly on G. The results of a Monte Carlo study are presented to demonstrate the favorable risk bebhavior of the Bayes estimator In comparison with other competitors including the James-Stein estimator.     

Convergence rates for empirical bayes estimators of parameters in multi-parameter exponential families

This paper obtains the convergence rates of the empirical Bayes estimators of parameters in the multi-parameter exponential families. The rates can approximate to 0(n=¹) arbitrarily. The paper presents the multivariate orthogonal polynomials which are continuous on the total space R^p.     

Optimal,nearly optimal and robust procedures for the exponential distribution with relative linear exponential loss

In this paper, the problem of sequentially estimating the mean of the exponential distribution with relative linear exponential loss and fixed cost for each observation is considered within the Bayesian framework. An optimal procedure with a deterministic stopping rule is derived. Since the corresponding value of the optimal deterministic stopping rule cannot be obtained directly, an approximate optimal deterministic stopping rule and an asymptotically pointwise optimal rule are proposed. In addition, we propose a robust procedure with a deterministic stopping rule, which does not depend on the parameters of the prior distribution. All of the proposed procedures are shown to be asymptotically optimal. Some numerical studies are conducted to investigate the performances of the proposed procedures. A real data set is provided to illustrate the use of the proposed procedures.     

Empirical bayes testing of a distribution function with d1richlet process priors

This paper considers the generalised empirical Bayes two-action (testing) and multiple action problems concerning a distribution function The Dirichiet process priors p of Ferguson have been used as the prior distributions on the space of distribution functions on the real line. The two-action component problem is considered in detail and when p is unknown partially empirical Bayes procedures {6 } which are asymptotically optimal with rates 0{jT1/2) and OCCmCn+l))     

Empirical bayes shrinkage estimation of reliability in the exponential distribution

In this paper we propose two empirical Bayes shrinkage estimators for the reliability of the exponential distribution and study their properties. Under the uniform prior distribution and the inverted gamma prior distribution these estimators are developed and compared with a preliminary test estimator and with a shrinkage testimator in terms of mean squared error. The proposed empirical Bayes shrinkage estimator under the inverted gamma prior distribution is shown to be preferable to the preliminary test estimator and the shrinkage testimator when the prior value of mean life is clsoe to the true mean life.     

Estimating changes in a multi-parameter exponential family

A two-stage procedure is studied for estimating changes in the parameters of the multi-parameter exponential family, given a sample X ₁,…,X _n. The first step is a likelihood ratio test of the hypothesis H_oof no change. Upon rejection of this hypothesis, the change point index and pre- and post-change parameters are estimated by maximum likelihood. The asymptotic (n → ∞) distribution of the log-likelihood ratio statistic is obtained under both H_oand local alternatives. The m.l.e.fs o of the pre- and post-change parameters are shown to be asymptotically jointly normal. The distribution of the change point estimate is obtained under local alternatives. Performance of the procedure for moderate samples is studied by Monte Carlo methods.     

Empirical Bayes estimation in continuous one-parameter exponential families under associated samples

In this paper, we study the empirical Bayes (EB) estimation in continuous one-parameter exponential families under negatively associated (NA) samples and positively associated (PA) samples. Under certain regularity conditions, it is shown that the convergence rates of proposed EB estimators under NA or PA samples are the same as those of EB estimators under independent observations, which significantly improve the existing results in EB estimation under associated samples.     

Optimal spacing of quantiles for the estimation of the mixing parameters in a mixture of two exponential distributions

Methods for estimating the mixing parameters in a mixture of two exponential distributions are proposed. The estimators proposed are consistent and BAN(best asymptotically normal). The optimal spacings for estimating these mixture parameters are calculated.     

A note on the convergence rates for empirical bayes estimators of parameters in multiple-parameter exponential families

Under suitable conditions upon prior distribution, the convergence rates for empirical Bayes estimators of parameters in multi-parameter exponential families (M-PEF) are obtained. It is shown that the assumptions Tong (1996) imposed on the marginal density can be reduced. The above result can also be extended to more general forms of M-PEF. Finally, some examples which satisfy the conditions of the theorems are given.     

Local power of some tests in exponential family nonlinear models

In this paper we obtain asymptotic expansions up to order n^−1/2 for the nonnull distribution functions of the likelihood ratio, Wald, score and gradient test statistics in exponential family nonlinear models (Cordeiro and Paula, 1989), under a sequence of Pitman alternatives. The asymptotic distributions of all four statistics are obtained for testing a subset of regression parameters and for testing the dispersion parameter, thus generalising the results given in Cordeiro et al. (1994) and Ferrari et al. (1997). We also present Monte Carlo simulations in order to compare the finite-sample performance of these tests.     

Empirical bayes estimation of a distribution function with a gamma process prior

A sequence of empirical Bayes estimators is given for estimating a distribution function. It is shown that ‘i’ this sequence is asymptotically optimum relative to a Gamma process prior, ‘ii’ the overall expected loss approaches the minimum Bayes risk at a rate of n , and ‘iii’ the estimators form a sequence of proper distribution functions. Finally, the numerical example presented by Susarla and Van Ryzin ‘Ann. Statist., 6, 1978’ reworked by Phadia ‘Ann. Statist., 1, 1980, to appear’ has been analyzed and the results are compared to the numerical results by Phadia     

Convergence rates for empirical bayes estimators of parameters in linear regressin models

In this paper, the convergence rates of the EB estimators of the regression coefficients and the error variance in a linear model are obtained. The rates can approximate to O(n¹) arbitrarily. The convergency of the EB estimators of the regression coefiicients and the variance components in a variance component model is also investigated. The investigation makes use of the results concerning the convergence rates of the EB estimators of the parameters in multi-parameter exponential families.     

Empirical Bayes estimators in hierarchical models with mixture priors

We consider subgroup analyses within the framework of hierarchical modeling and empirical Bayes (EB) methodology for general priors, thereby generalizing the normal–normal model. By doing this one obtains greater flexibility in modeling. We focus on mixture priors, that is, on the situation where group effects are exchangeable within clusters of subgroups only. We establish theoretical results on accuracy, precision, shrinkage and selection bias of EB estimators under the general priors. The impact of model misspecification is investigated and the applicability of the methodology is illustrated with datasets from the (medical) literature.     

Robust empirical Bayes tests for continuous distributions

In this paper, we study the empirical Bayes two-action problem under linear loss function. Upper bounds on the regret of empirical Bayes testing rules are investigated. Previous results on this problem construct empirical Bayes tests using kernel type estimators of nonparametric functionals. Further, they have assumed specific forms, such as the continuous one-parameter exponential family for {F_θ:θΩ}, for the family of distributions of the observations. In this paper, we present a new general approach of establishing upper bounds (in terms of rate of convergence) of empirical Bayes tests for this problem. Our results are given for any family of continuous distributions and apply to empirical Bayes tests based on any type of nonparametric method of functional estimation. We show that our bounds are very sharp in the sense that they reduce to existing optimal or nearly optimal rates of convergence when applied to specific families of distributions.