A new estimator of entropy and its application in testing normality

In this paper, we introduce a new estimator of entropy of a continuous random variable. We compare the proposed estimator with the existing estimators, namely, Vasicek [A test for normality based on sample entropy, J. Roy. Statist. Soc. Ser. B 38 (1976), pp. 54–59], van Es [Estimating functionals related to a density by class of statistics based on spacings, Scand. J. Statist. 19 (1992), pp. 61–72], Correa [A new estimator of entropy, Commun. Statist. Theory and Methods 24 (1995), pp. 2439–2449] and Wieczorkowski-Grzegorewski [Entropy estimators improvements and comparisons, Commun. Statist. Simulation and Computation 28 (1999), pp. 541–567]. We next introduce a new test for normality. By simulation, the powers of the proposed test under various alternatives are compared with normality tests proposed by Vasicek (1976) and Esteban et al. [Monte Carlo comparison of four normality tests using different entropy estimates, Commun. Statist.–Simulation and Computation 30(4) (2001), pp. 761–785].     

A comparative study of doubly robust estimators of the mean with missing data

Doubly robust (DR) estimators of the mean with missing data are compared. An estimator is DR if either the regression of the missing variable on the observed variables or the missing data mechanism is correctly specified. One method is to include the inverse of the propensity score as a linear term in the imputation model [D. Firth and K.E. Bennett, Robust models in probability sampling, J. R. Statist. Soc. Ser. B. 60 (1998), pp. 3–21; D.O. Scharfstein, A. Rotnitzky, and J.M. Robins, Adjusting for nonignorable drop-out using semiparametric nonresponse models (with discussion), J. Am. Statist. Assoc. 94 (1999), pp. 1096–1146; H. Bang and J.M. Robins, Doubly robust estimation in missing data and causal inference models, Biometrics 61 (2005), pp. 962–972]. Another method is to calibrate the predictions from a parametric model by adding a mean of the weighted residuals [J.M Robins, A. Rotnitzky, and L.P. Zhao, Estimation of regression coefficients when some regressors are not always observed, J. Am. Statist. Assoc. 89 (1994), pp. 846–866; D.O. Scharfstein, A. Rotnitzky, and J.M. Robins, Adjusting for nonignorable drop-out using semiparametric nonresponse models (with discussion), J. Am. Statist. Assoc. 94 (1999), pp. 1096–1146]. The penalized spline propensity prediction (PSPP) model includes the propensity score into the model non-parametrically [R.J.A. Little and H. An, Robust likelihood-based analysis of multivariate data with missing values, Statist. Sin. 14 (2004), pp. 949–968; G. Zhang and R.J. Little, Extensions of the penalized spline propensity prediction method of imputation, Biometrics, 65(3) (2008), pp. 911–918]. All these methods have consistency properties under misspecification of regression models, but their comparative efficiency and confidence coverage in finite samples have received little attention. In this paper, we compare the root mean square error (RMSE), width of confidence interval and non-coverage rate of these methods under various mean and response propensity functions. We study the effects of sample size and robustness to model misspecification. The PSPP method yields estimates with smaller RMSE and width of confidence interval compared with other methods under most situations. It also yields estimates with confidence coverage close to the 95% nominal level, provided the sample size is not too small.     

Doubly robust empirical likelihood inference in covariate-missing data problems

Missing covariate data occurs often in regression analysis. We study methods for estimating the regression coefficients in an assumed conditional mean function when some covariates are completely observed but other covariates are missing for some subjects. We adopt the semiparametric perspective of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866] on regression analyses with missing covariates, in which they pioneered the use of two working models, the working propensity score model and the working conditional score model. A recent approach to missing covariate data analysis is the empirical likelihood method of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503], which effectively combines unbiased estimating equations. In this paper, we consider an alternative likelihood approach based on the full likelihood of the observed data. This full likelihood-based method enables us to generate estimators for the vector of the regression coefficients that are (a) asymptotically equivalent to those of Qin et al. [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the working propensity score model is correctly specified, and (b) doubly robust, like the augmented inverse probability weighting (AIPW) estimators of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Am Statist Assoc. 1994;89:846–866]. Thus, the proposed full likelihood-based estimators improve on the efficiency of the AIPW estimators when the working propensity score model is correct but the working conditional score model is possibly incorrect, and also improve on the empirical likelihood estimators of Qin, Zhang and Leung [Empirical likelihood in missing data problems. J Amer Statist Assoc. 2009;104:1492–1503] when the reverse is true, that is, the working conditional score model is correct but the working propensity score model is possibly incorrect. In addition, we consider a regression method for estimation of the regression coefficients when the working conditional score model is correctly specified; the asymptotic variance of the resulting estimator is no greater than the semiparametric variance bound characterized by the theory of Robins et al. [Estimation of regression coefficients when some regressors are not always observed. J Amer Statist Assoc. 1994;89:846–866]. Finally, we compare the finite-sample performance of various estimators in a simulation study.     

A new class of minimax generalized Bayes estimators of a normal variance

A new class of minimax generalized Bayes estimators of the variance of a normal distribution is given under both quadratic and entropy losses. One contribution of the paper is a new class of minimax generalized Bayes estimators of a particularly simple form. Another contribution is a class of minimax generalized Bayes procedures satisfying a Strawderman [1974. Minimax estimation of powers of the variance of a normal population under squared error loss. Ann. Statist. 2, 190–198]-type condition which do not satisfy a Brewster and Zidek [1974. Improving on equivariant estimators. Ann. Statist. 2, 21–38]-type condition. We indicate that the new class may have a noticeably larger region of substantial improvement over the usual estimator than Brewster and Zidek-type procedures.     

Wavelet estimation of density for censored data with censoring indicator missing at random

In this paper, we define the nonlinear wavelet estimator of density for the right censoring model with the censoring indicator missing at random (MAR), and develop its asymptotic expression for mean integrated squared error (MISE). Unlike for kernel estimator, the MISE expression of the estimator is not affected by the presence of discontinuities in the curve. Meanwhile, asymptotic normality of the estimator is established. The proposed estimator can reduce to the estimator defined by Li [Non-linear wavelet-based density estimators under random censorship. J Statist Plann Inference. 2003;117(1):35–58] when the censoring indicator MAR does not occur and a bandwidth in non-parametric estimation is close to zero. Also, we define another two nonlinear wavelet estimators of the density. A simulation is done to show the performance of the three proposed estimators.     

Estimation of a scale parameter in mixture models with unknown location

Estimation of the scale parameter in mixture models with unknown location is considered under Stein's loss. Under certain conditions, the inadmissibility of the “usual” estimator is established by exhibiting better estimators. In addition, robust improvements are found for a specified submodel of the original model. The results are applied to mixtures of normal distributions and mixtures of exponential distributions. Improved estimators of the variance of a normal distribution are shown to be robust under any scale mixture of normals having variance greater than the variance of that normal distribution. In particular, Stein's (Ann. Inst. Statist. Math. 16 (1964) 155) and Brewster's and Zidek's (Ann. Statist. 2 (1974) 21) estimators obtained under the normal model are robust under the t model, for arbitrary degrees of freedom, and under the double-exponential model. Improved estimators for the variance of a t distribution with unknown and arbitrary degrees of freedom are also given. In addition, improved estimators for the scale parameter of the multivariate Lomax distribution (which arises as a certain mixture of exponential distributions) are derived and the robustness of Zidek's (Ann. Statist. 1 (1973) 264) and Brewster's (Ann. Statist. 2 (1974) 553) estimators of the scale parameter of an exponential distribution is established under a class of modified Lomax distributions.     

General procedure for estimating the population mean using ranked set sampling

In this paper, we suggest a class of estimators for estimating the population mean ? of the study variable Y using information on X?, the population mean of the auxiliary variable X using ranked set sampling envisaged by McIntyre [A method of unbiased selective sampling using ranked sets, Aust. J. Agric. Res. 3 (1952), pp. 385–390] and developed by Takahasi and Wakimoto [On unbiased estimates of the population mean based on the sample stratified by means of ordering, Ann. Inst. Statist. Math. 20 (1968), pp. 1–31]. The estimator reported by Kadilar et al. [Ratio estimator for the population mean using ranked set sampling, Statist. Papers 50 (2009), pp. 301–309] is identified as a member of the proposed class of estimators. The bias and the mean-squared error (MSE) of the proposed class of estimators are obtained. An asymptotically optimum estimator in the class is identified with its MSE formulae. To judge the merits of the suggested class of estimators over others, an empirical study is carried out.     

Efficient closed-form maximum a posteriori estimators for the gamma distribution

We proposed a new class of maximum a posteriori estimators for the parameters of the Gamma distribution. These estimators have simple closed-form expressions and can be rewritten as a bias-corrected maximum likelihood estimators presented by Ye and Chen [Closed-form estimators for the gamma distribution derived from likelihood equations. Am Statist. 2017;71(2):177–181]. A simulation study was carried out to compare different estimation procedures. Numerical results revels that our new estimation scheme outperforms the existing closed-form estimators and produces extremely efficient estimates for both parameters, even for small sample sizes.     

Estimating the common hazard rate of two exponential distributions with ordered location parameters

This paper is concerned with estimating the common hazard rate of two exponential distributions with unknown and ordered location parameters under a general class of bowl-shaped scale invariant loss functions. The inadmissibility of the best affine equivariant estimator is established by deriving an improved estimator. Another estimator is obtained which improves upon the best affine equivariant estimator. A class of improving estimators is derived using the integral expression of risk difference approach of Kubokawa [A unified approach to improving equivariant estimators. Ann Statist. 1994;22(1):290–299]. These results are applied to specific loss functions. It is further shown that these estimators can be derived for four important sampling schemes: (i) complete and i.i.d. sample, (ii) record values, (iii) type-II censoring, and (iv) progressive Type-II censoring. A simulation study is carried out for numerically comparing the risk performance of these proposed estimators.     

Alternative estimators of the common regression matrix in two GMANOVA models under weighted quadratic losses

We consider the problem of estimating the common regression matrix of two GMANOVA models with different unknown covariance matrices under certain type of loss functions which include a weighted quadratic loss function as a special case. We consider a class of estimators, which contains the Graybill–Deal-type estimator proposed by Sugiura and Kubokawa (Ann. Inst. Statist. Math. 40 (1988) 119), and we give its risk representation via Kubokawa and Srivastava's (Ann. Statist. 27 (1999) 600; J. Multivariate Anal. 76 (2001) 138) identities when the error matrices follow the elliptically contoured distributions. Using the method similar to an approximate minimization of the unbiased risk estimate due to Stein (Studies in the Statistical Theory of Estimation, vol. 74, Nauka, Leningrad, 1977, p. 4), we obtain an alternative estimator to the Graybill–Deal-type estimator which was given under the normality assumption. However, it seems difficult to evaluate the risk of our proposed estimator analytically because of complex nature of its risk function. Instead, we conduct a Monte-Carlo simulation to evaluate the performance of our proposed estimator. The results indicate that our proposed estimator compares favorably with the Graybill–Deal-type estimator.     

Generalized Begun–Reid estimators for multiple hazard rates

A class of invariant estimators with respect to the selection of a base population is developed for estimating the hazard rates in multiple populations. The class generalizes the estimators of Begun and Reid (J. Amer. Statist. Assoc. 78 (1983) 337) and includes the estimator of Mantel and Haenszel (J. Natl. Canser Inst. 22 (1959) 719) as a special case. The estimators have explicit forms and, it is shown that their asymptotic covariance matrices are less than those of the Begun–Reid estimators when the number of populations is greater than two. A Monte-Carlo simulation indicates that the estimators are slightly more efficient than the Cox partial likelihood estimator (Biometrika 62 (2) (1975) 269) for small and medium sample sizes. An example is presented for the illustration of the estimators.     

Robust estimation in simultaneous equations models

In this paper we review existing work on robust estimation for simultaneous equations models. Then we sketch three strategies for obtaining estimators with a high breakdown point and a controllable efficiency: (a) robustifying three-stage least squares, (b) robustifying the full information maximum likelihood method by minimizing the determinant of a robust covariance matrix of residuals, and (c) generalizing multivariate tau-estimators (Lopuhaä, 1992, Can. J. Statist., 19, 307–321) to these models. They have the same order of computational complexity as high breakdown point multivariate estimators. The latter seems the most promising approach.     

A jackknifed difference-based ridge estimator in the partial linear model with correlated errors

Tabakan and Akdeniz [Difference-based ridge estimator of parameters in partial linear model. Statist Pap. 2010;51(2):357–368] proposed a difference-based ridge estimator (DBRE) in the partial linear model. In this paper, a new estimator is introduced by jackknifing the DBRE that Tabakan and Akdeniz presented. We investigate the performance of this new estimator over the DBRE and difference-based estimator introduced by Yatchew [An elementary estimator of the partial linear model. Econom Lett. 1997;57:135–143] in terms of mean-squared error and mean-squared error matrix and a numerical example is provided to demonstrate the performance of the estimators.     

On the entropy estimators

The paper introduces an estimator of the entropy of a continuous random variable. The estimator is obtained by modifying the estimator proposed by Ebrahimi et al. [Two measures of sample entropy, Statist. Probab. Lett. 20 (1994), pp. 225–234]. The consistency of the estimator is proved and comparisons are made with Vasicek's estimator [A test for normality based on sample entropy, J. R. Stat. Soc. Ser. B 38 (1976), pp. 54–59], van Es estimator [Estimating functionals related to a density by class of statistics based on spacings, Scand. J. Statist. 19 (1992), pp. 61–72], Ebrahimi et al. estimator and Correa estimator [A new estimator of entropy, Comm. Statist. Theory Methods 24 (1995), pp. 2439–2449]. The results indicate that the proposed estimator has smaller mean-squared error than above estimators. A real example is presented and analysed.     

Tests of fit for the Laplace distribution based on correcting moments of entropy estimators

ABSTRACT

In this paper, we first consider the entropy estimators introduced by Vasicek [A test for normality based on sample entropy. J R Statist Soc, Ser B. 1976;38:54–59], Ebrahimi et al. [Two measures of sample entropy. Stat Probab Lett. 1994;20:225–234], Yousefzadeh and Arghami [Testing exponentiality based on type II censored data and a new cdf estimator. Commun Stat – Simul Comput. 2008;37:1479–1499], Alizadeh Noughabi and Arghami [A new estimator of entropy. J Iran Statist Soc. 2010;9:53–64], and Zamanzade and Arghami [Goodness-of-fit test based on correcting moments of modified entropy estimator. J Statist Comput Simul. 2011;81:2077–2093], and the nonparametric distribution functions corresponding to them. We next introduce goodness-of-fit test statistics for the Laplace distribution based on the moments of nonparametric distribution functions of the aforementioned estimators. We obtain power estimates of the proposed test statistics with Monte Carlo simulation and compare them with the competing test statistics against various alternatives. Performance of the proposed new test statistics is illustrated in real cases.     

A Comparison of REML and Covariance Adjustment Method in the Estimation of Growth Curve Models

The classical growth curve model is considered when one continuous characteristic is measured at q time points. The covariance adjusted estimator of growth curve parameters is the OLS estimator adjusted using analysis of covariance. The covariates are obtained from functions of within individuals error contrasts. On the other hand, REML estimators emerge from maximization of the likelihood of OLS residuals. We compare the efficiency of estimators of growth curve parameters obtained by REML with that of covariance-adjusted least squares estimators with covariates selected via CAIC.     

On Robust and Efficient Estimation of the Center of Symmetry

In this article, a class of estimators of the center of symmetry based on the empirical characteristic function is examined. In the spirit of the Hodges–Lehmann estimator, the resulting procedures are shown to be a function of the pairwise averages. The proposed procedures are also shown to have an equivalent representation as the minimizers of certain distances between two corresponding kernel density estimators. An alternative characterization of the Hodges–Lehmann estimator is established upon the use of a particularly simple choice of kernel.     

A new approach to use multivariate auxiliary information in sample surveys

A new approach to form multivariate difference estimator is suggested which does not require the knowledge of unknown population parameters as such. It gives minimum variance among the class of multivariate difference estimators. The performance of this estimator with respect to Des Raj's (J. Amer. Statist. Assoc. 60 (1965), 270–277) multivariate difference estimator is illustrated. Using the information on two auxiliary variates, the robustness of Des Raj's estimator y_d is studied empirically. Two new estimators to estimate population mean/total are developed on the same lines as that of y_d. The performance of these estimators is studied for a wide variety of populations.     

Bias reduction in kernel density estimation

In this paper, we propose two kernel density estimators based on a bias reduction technique. We study the properties of these estimators and compare them with Parzen–Rosenblatt's density estimator and Mokkadem, A., Pelletier, M., and Slaoui, Y. (2009, ‘The stochastic approximation method for the estimation of a multivariate probability density’, J. Statist. Plann. Inference, 139, 2459–2478) is density estimators. It turns out that, with an adequate choice of the parameters of the two proposed estimators, the rate of convergence of two estimators will be faster than the two classical estimators and the asymptotic MISE (Mean Integrated Squared Error) will be smaller than the two classical estimators. We corroborate these theoretical results through simulations.