A new class of minimax generalized Bayes estimators of a normal variance

A new class of minimax generalized Bayes estimators of the variance of a normal distribution is given under both quadratic and entropy losses. One contribution of the paper is a new class of minimax generalized Bayes estimators of a particularly simple form. Another contribution is a class of minimax generalized Bayes procedures satisfying a Strawderman [1974. Minimax estimation of powers of the variance of a normal population under squared error loss. Ann. Statist. 2, 190–198]-type condition which do not satisfy a Brewster and Zidek [1974. Improving on equivariant estimators. Ann. Statist. 2, 21–38]-type condition. We indicate that the new class may have a noticeably larger region of substantial improvement over the usual estimator than Brewster and Zidek-type procedures.     

Minimax estimation of a lower-bounded scale parameter of a gamma distribution for scale-invariant squared-error loss

Let X have a gamma distribution with known shape parameter θr;aL and unknown scale parameter θ. Suppose it is known that θ ≥ a for some known a > 0. An admissible minimax estimator for scale-invariant squared-error loss is presented. This estimator is the pointwise limit of a sequence of Bayes estimators. Further, the class of truncated linear estimators C = {θ_ρ|θ_ρ(x) = max(a, ρ), ρ > 0} is studied. It is shown that each θ_ρ is inadmissible and that exactly one of them is minimax. Finally, it is shown that Katz's [Ann. Math. Statist., 32, 136–142 (1961)] estimator of θ is not minimax for our loss function. Some further properties of and comparisons among these estimators are also presented.     

Estimation of a scale parameter in mixture models with unknown location

Estimation of the scale parameter in mixture models with unknown location is considered under Stein's loss. Under certain conditions, the inadmissibility of the “usual” estimator is established by exhibiting better estimators. In addition, robust improvements are found for a specified submodel of the original model. The results are applied to mixtures of normal distributions and mixtures of exponential distributions. Improved estimators of the variance of a normal distribution are shown to be robust under any scale mixture of normals having variance greater than the variance of that normal distribution. In particular, Stein's (Ann. Inst. Statist. Math. 16 (1964) 155) and Brewster's and Zidek's (Ann. Statist. 2 (1974) 21) estimators obtained under the normal model are robust under the t model, for arbitrary degrees of freedom, and under the double-exponential model. Improved estimators for the variance of a t distribution with unknown and arbitrary degrees of freedom are also given. In addition, improved estimators for the scale parameter of the multivariate Lomax distribution (which arises as a certain mixture of exponential distributions) are derived and the robustness of Zidek's (Ann. Statist. 1 (1973) 264) and Brewster's (Ann. Statist. 2 (1974) 553) estimators of the scale parameter of an exponential distribution is established under a class of modified Lomax distributions.     

Strawderman-type estimators for a scale parameter with application to the exponential distribution

It is shown that Strawderman's [1974. Minimax estimation of powers of the variance of a normal population under squared error loss. Ann. Statist. 2, 190–198] technique for estimating the variance of a normal distribution can be extended to estimating a general scale parameter in the presence of a nuisance parameter. Employing standard monotone likelihood ratio-type conditions, a new class of improved estimators for this scale parameter is derived under quadratic loss. By imposing an additional condition, a broader class of improved estimators is obtained. The dominating procedures are in form analogous to those in Strawderman [1974. Minimax estimation of powers of the variance of a normal population under squared error loss. Ann. Statist. 2, 190–198]. Application of the general results to the exponential distribution yields new sufficient conditions, other than those of Brewster and Zidek [1974. Improving on equivariant estimators. Ann. Statist. 2, 21–38] and Kubokawa [1994. A unified approach to improving equivariant estimators. Ann. Statist. 22, 290–299], for improving the best affine equivariant estimator of the scale parameter. A class of estimators satisfying the new conditions is constructed. The results shed new light on Strawderman's [1974. Minimax estimation of powers of the variance of a normal population under squared error loss. Ann. Statist. 2, 190–198] technique.     

Minimax estimation of normal precisions via expansion estimators

In this paper, the simultaneous estimation of the precision parameters of k normal distributions is considered under the squared loss function in a decision-theoretic framework. Several classes of minimax estimators are derived by using the chi-square identity, and the generalized Bayes minimax estimators are developed out of the classes. It is also shown that the improvement on the unbiased estimators is characterized by the superharmonic function. This corresponds to Stein's [1981. Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9, 1135–1151] result in simultaneous estimation of normal means.     

On certain alternative mean square error estimators in complex survey sampling

Rao (J. Indian Statist. Assoc. 17 (1979) 125) has given a ‘necessary form’ for an unbiased mean square error (MSE) estimator to be ‘uniformly non-negative’. The MSE is of a homogeneous linear estimator ‘subject to a specified constraint’, for a survey population total of a real variable of interest. We present a corresponding theorem when the ‘constraint’ is relaxed. Certain results are added presenting formulae for estimators of MSEs when the variate-values for the sampled individuals are not ascertainable. Though not ascertainable, they are supposed to be suitably estimated either by (1) randomized response techniques covering sensitive issues or by (2) further sampling in ‘subsequent’ stages in specific ways when the initial sampling units are composed of a number of sub-units. Using live numerical data, practical uses of the proposed alternative MSE estimators are demonstrated.     

On bahadur's representation of quantiles in nonregular cases

The paper considers Bahadur’s representation of quantiles (see Bahadur (1966), Ann. Math. Statist., 37, 577-580) in cases where the usual assumptions regarding the existence and boundedness of the derivatives of the distribution function in a neighbourhood of the population quantile(s) of interest are not met. Following Kiefer((1967), Ann. Math. Statist., 38, 1323-1342) we provide an exact order of the remainder term in Bahadur’s representation. A weaker result regarding the order of the remainder term is also provided under weaker regularity assumptions.     

Quadratic estimators of covariance components in a multivariate mixed linear model

It is known that the Henderson Method III (Biometrics 9:226–252, 1953) is of special interest for the mixed linear models because the estimators of the variance components are unaffected by the parameters of the fixed factor (or factors). This article deals with generalizations and minor extensions of the results obtained for the univariate linear models. A MANOVA mixed model is presented in a convenient form and the covariance components estimators are given on finite dimensional linear spaces. The results use both the usual parametric representations and the coordinate-free approach of Kruskal (Ann Math Statist 39:70–75, 1968) and Eaton (Ann Math Statist 41:528–538, 1970). The normal equations are generalized and it is given a necessary and sufficient condition for the existence of quadratic unbiased estimators for covariance components in the considered model.     

A functional law of the iterated logarithm for kernel-type estimators of the tail index

Under von Mises's condition, the kernel tail index estimators of Csörgő et al. (Ann. Statist. 13 (1985) 1050) have been generalized by Groeneboon et al. (Ann. Statist. 31 (2003) 1956) for all real tail indices. Weak consistency and asymptotic normality of their kernel estimators have been established. In this paper, we present a characterization of the almost sure behavior of these estimators and we show their strong consistency.     

Estimation of a Conditional Copula and Association Measures

Abstarct. This paper is concerned with studying the dependence structure between two random variables Y ₁ and Y ₂ conditionally upon a covariate X. The dependence structure is modelled via a copula function, which depends on the given value of the covariate in a general way. Gijbels et al. (Comput. Statist. Data Anal., 55, 2011, 1919) suggested two non‐parametric estimators of the ‘conditional’ copula and investigated their numerical performances. In this paper we establish the asymptotic properties of the proposed estimators as well as conditional association measures derived from them. Practical recommendations for their use are then discussed.     

Nonparametric Bayes estimation of a distribution function with truncated data

A truncation bias affects the observation of a pair of variables (X,Y), so that data are available only if Y ⩽ X. In such a situation, the nonparametric maximum likelihood estimator (NPMLE) of the distribution function of Y may have unpleasant features (Woodroofe, Ann. Statist. 13 (1985) 163–177). As a possible alternative, a nonparametric Bayes estimator is obtained using a Dirichlet prior (Ferguson, Ann. Statist. 1 (1973) 209–230). Its frequentist asymptotic behavior is investigated and found to be the same as the asymptotic behavior of the NPMLE. The results are illustrated by an example, with astronomical data, where the NPMLE is clearly unacceptable.     

Bayes estimation for the Block and Basu bivariate and multivariate Weibull distributions

Block and Basu bivariate exponential distribution is one of the most popular absolute continuous bivariate distributions. Recently, Kundu and Gupta [A class of absolute continuous bivariate distributions. Statist Methodol. 2010;7:464–477] introduced Block and Basu bivariate Weibull (BBBW) distribution, which is a generalization of the Block and Basu bivariate exponential distribution, and provided the maximum likelihood estimators using EM algorithm. In this paper, we consider the Bayesian inference of the unknown parameters of the BBBW distribution. The Bayes estimators are obtained with respect to the squared error loss function, and the prior distributions allow for prior dependence among the unknown parameters. Prior independence also can be obtained as a special case. It is observed that the Bayes estimators of the unknown parameters cannot be obtained in explicit forms. We propose to use the importance sampling technique to compute the Bayes estimates and also to construct the associated highest posterior density credible intervals. The analysis of two data sets has been performed for illustrative purposes. The performances of the proposed estimators are quite satisfactory. Finally, we generalize the results for the multivariate case.     

Bayesian analysis of vector-autoregressive models with noninformative priors

In this paper, we investigate the properties of Bayes estimators of vector autoregression (VAR) coefficients and the covariance matrix under two commonly employed loss functions. We point out that the posterior mean of the variances of the VAR errors under the Jeffreys prior is likely to have an over-estimation bias. Our Bayesian computation results indicate that estimates using the constant prior on the VAR regression coefficients and the reference prior of Yang and Berger (Ann. Statist. 22 (1994) 1195) on the covariance matrix dominate the constant-Jeffreys prior estimates commonly used in applications of VAR models in macroeconomics. We also estimate a VAR model of consumption growth using both constant-reference and constant-Jeffreys priors.     

Bias reduction in kernel density estimation

In this paper, we propose two kernel density estimators based on a bias reduction technique. We study the properties of these estimators and compare them with Parzen–Rosenblatt's density estimator and Mokkadem, A., Pelletier, M., and Slaoui, Y. (2009, ‘The stochastic approximation method for the estimation of a multivariate probability density’, J. Statist. Plann. Inference, 139, 2459–2478) is density estimators. It turns out that, with an adequate choice of the parameters of the two proposed estimators, the rate of convergence of two estimators will be faster than the two classical estimators and the asymptotic MISE (Mean Integrated Squared Error) will be smaller than the two classical estimators. We corroborate these theoretical results through simulations.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

On blocks and runs estimators of the extremal index

Given a sample from a stationary sequence of random variables, we study the blocks and runs estimators of the extremal index. Conditions are given for consistency and asymptotic normality of these estimators. We show that moment restrictions assumed by Hsing (Stochast. Process. Appl. 37(1), 117–139; Ann. Statist. 21(4), 2043-2021) may be relaxed if a stronger mixing condition holds. The CLT for the runs estimator seems to be proven for the first time.     

Adaptive Warped Kernel Estimators

In this work, we develop a method of adaptive non‐parametric estimation, based on ‘warped’ kernels. The aim is to estimate a real‐valued function s from a sample of random couples (X,Y). We deal with transformed data (Φ(X),Y), with Φ a one‐to‐one function, to build a collection of kernel estimators. The data‐driven bandwidth selection is performed with a method inspired by Goldenshluger and Lepski (Ann. Statist., 39, 2011, 1608). The method permits to handle various problems such as additive and multiplicative regression, conditional density estimation, hazard rate estimation based on randomly right‐censored data, and cumulative distribution function estimation from current‐status data. The interest is threefold. First, the squared‐bias/variance trade‐off is automatically realized. Next, non‐asymptotic risk bounds are derived. Lastly, the estimator is easily computed, thanks to its simple expression: a short simulation study is presented.     

On the cohen-sackrowitz estimator of a common mean

The paper reconsider certain estimators proposed by COHENand SACKROWITZ[Ann.Statist.(1974)2,1274-1282,Ann.Statist.4,1294]for the common mean of two normal distributions on the basis of independent samples of equal size from the two populations. It derives the ncecessary and sufficient condition for improvement over the first sample mean, under squared error loss, for any member of a class containing these. It shows that the estimator proposded by them for simultaneous improvement over botyh sample means has the desired property if and only if the common size of the samples is at least nine. The requirement is milder than that for any other estimator at the present state of knolwledge and may be constrasted with their result which implies the desired property of the estimator only if the common size of the samples is at least fifteen. Upper bounds for variances if the estimators derived by them are also improved     

Estimation from Burr type XII distribution using progressive first-failure censored data

In this paper, a new life test plan called a progressively first-failure-censoring scheme introduced by Wu and Ku? [On estimation based on progressive first-failure-censored sampling, Comput. Statist. Data Anal. 53(10) (2009), pp. 3659–3670] is considered. Based on this type of censoring, the maximum likelihood (ML) and Bayes estimates for some survival time parameters namely reliability and hazard functions, as well as the parameters of the Burr-XII distribution are obtained. The Bayes estimators relative to both the symmetric and asymmetric loss functions are discussed. We use the conjugate prior for the one-shape parameter and discrete prior for the other parameter. Exact and approximate confidence intervals with the exact confidence region for the two-shape parameters are derived. A numerical example using the real data set is provided to illustrate the proposed estimation methods developed here. The ML and the different Bayes estimates are compared via a Monte Carlo simulation study.     

A New Approach to the Estimation of Inter-Variable Correlation

The use of different measures of similarity between observed vectors for the purposes of classifying or clustering them has been expanding dramatically in recent years. One result of this expansion has been the use of many new similarity measures, designed for the purpose of satisfying various criteria. A noteworthy application involves estimating the relationships between genes using microarray experimental data. We consider the class of ‘correlation-type’ similarity measures. The use of these new measures of similarity suggest that the whole problem needs to be formulated in statistical terms to clarify their relative benefits. Pursuant to this need, we define, for each given observed vector, a baseline representing the ‘true’ value common to each of the component observations. These ‘true’ values are taken to be parameters. We define the ‘true correlation’ between each two observed vectors as the average (over the distribution of the observations for given baseline parameters) of Pearson's correlation with sample means replaced by the corresponding baseline parameters. Estimators of this true correlation are assessed using their mean squared error (MSE). Proper Bayes estimators of this true correlation, being based on the predictive posterior distribution of the data, are both difficult to calculate/analyze and highly non robust. By constrast, empirical Bayes estimators are: (i) close to their Bayesian counterparts; (ii) easy to analyze; and (iii) strongly robust. For these reasons, we employ empirical Bayes estimators of correlation in place of their Bayesian counterparts. We show how to construct two different kinds of simultaneous Bayes correlation estimators: the first assumes no apriori correlation between baseline parameters; the second assumes a common unknown correlation between them. Estimators of the latter type frequently have significantly smaller MSE than those of the former type which, in turn, frequently have significantly smaller MSE than their Pearson estimator counterparts. For purposes of illustrating our results, we examine the problem of inferring the relationships between gene expression level vectors, in the context of observing microarray experimental data.