On invariant quadratic unbiased estimation of variance components

The present study deals with three different invarint quadratic unbiased estimators (IQUE) for variance components namely quadratic least squares estimators (QLSE), weighted quadratic least squares estimators (WQLSE) and Mitra type estimators (MTE). The variance and covariances of these three different estimators are presented for unbalanced one-way random model. The relative performances of these estimators are assessed based on different optimality criteria like, D-optimality, T-optimality and M-optimality together with variances of these estimators. As a result, it has been shown that MTE has optimal properties.     

Componentwise B-spline estimation for varying coefficient models with longitudinal data

A componentwise B-spline method is proposed for estimating the unknown functions in the varying-coefficient models with longitudinal data. Different amounts of smoothing are used for different individual coefficient functions and the estimators of different coefficient functions are obtained by different minimization operations. The local asymptotic bias and variance of the estimators are derived. It is shown that our estimators achieve the local and global optimal convergence rates even if the coefficient functions belong to different smoothness families. The asymptotic distributions of the estimators are also established and are used to construct approximate pointwise confidence intervals for coefficient functions. Finite sample properties of our procedures are studied through Monte Carlo simulations.     

A composite class of estimators using scrambled response mechanism for sensitive population mean in successive sampling

This paper considers the problem of estimation of population mean of a sensitive characteristics using non-sensitive auxiliary variable at current move in two move successive sampling. The proposed estimator is studied under five different scrambled response models. Various estimators have been elaborated to be the member of the proposed class of estimators. The properties of the proposed estimators have been analysed. Many estimators belonging to the proposed class have been explored under five scrambled response models. In order to identify the scrambled model effect, the proposed composite class of estimators is compared to the direct methods. Respondents privacy protection have also been elaborated under different models. Theoretical results are supplemented with numerical demonstrations using real data. Simulation has been carried out to show the applicability of proposed estimators and hence suitable recommendations are forwarded.     

Estimating the Population Coefficient of Variation by Confidence Intervals

Several researchers considered various interval estimators for estimating the population coefficient of variation (CV) of symmetric and skewed distributions. Since they considered at different times and under different simulation conditions, their performances are not comparable as a whole. In this article, an attempt has been made to review some existing estimators along with some proposed methods and compare them under the same simulation condition. In particular, we have considered Hendricks and Robey, Mckay, Miller, Sharma and Krishna, Curto and Pinto, and also some bootstrap proposed interval estimators for estimating the population CV. A simulation study has been conducted to compare the performance of the estimators. Both average widths and coverage probabilities are considered as a criterion of the good estimators. Two real life health related data sets are analyzed to illustrate the findings of the article. Based on the simulation study, some possible good interval estimators have been recommended for the practitioners.     

Estimation of finite population mean in simple random sampling and stratified random sampling using two auxiliary variables

In this article, we propose a new class of estimators to estimate the finite population mean by using two auxiliary variables under two different sampling schemes such as simple random sampling and stratified random sampling. The proposed class of estimators gives minimum mean squared error as compared to all other considered estimators. Some real data sets are used to observe the performances of the estimators. We show numerically that the proposed class of estimators performs better as compared to all other competitor estimators.     

Estimating principal points of univariate distributions

SUMMARY The term 'principal points' originated in a problem of determining 'typical' heads for the design of protection masks, as described by Flury. Two principal points in the mask example correspond to a small and a large size. Principal points are cluster means for theoretical distributions, and sample cluster means from a k -means algorithm are non-parametric estimators of principal points. This paper demonstrates that maximum likelihood estimators and semi-parametric estimators based on symmetry constraints typically perform much better than the k -means estimators. Asymptotic results on the efficiency of these estimators of two principal points for four symmetric univariate distributions are given. Simulation results are provided to examine the performance of the estimators for finite sample sizes. Finally, the different estimators of two principal points are compared using the head dimension data for the design of protection masks.     

On the nonparametric smooth estimation of the reversed Hazard Rate function

The Reversed Hazard Rate (RHR) function is an important measure as a tool in the analysis of the reliability of both natural and man-made systems. In this paper, we present several new estimators of the RHR function using nonparametric techniques. These estimators are obtained by incorporating different binning techniques with fixed design local polynomial regression. We show that these estimators are asymptotically unbiased and consistent and, to determine the bandwidth, we propose two simple yet efficient plug-in bandwidth selection methods for even and odd order local polynomial estimators. Simulated and real life data are subsequently used to evaluate the performances of these estimators.     

On the boundary properties of Bernstein polynomial estimators of density and distribution functions

For density and distribution functions supported on [0,1], Bernstein polynomial estimators are known to have optimal mean integrated squared error (MISE) properties under the usual smoothness conditions on the function to be estimated. These estimators are also known to be well-behaved in terms of bias: they have uniform bias over the entire unit interval. What is less known, however, is that some of these estimators do experience a boundary effect, but of a different nature than what is seen with the usual kernel estimators.     

Almost Consistent Estimation of Panel Probit Models with “Small” Fixed Effects

We propose four different GMM estimators that allow almost consistent estimation of the structural parameters of panel probit models with fixed effects for the case of small Tand large N. The moments used are derived for each period from a first order approximation of the mean of the dependent variable conditional on explanatory variables and on the fixed effect. The estimators differ w.r.t. the choice of instruments and whether they use trimming to reduce the bias or not. In a Monte Carlo study, we compare these estimators with pooled probit and conditional logit estimators for different data generating processes. The results show that the proposed estimators outperform these competitors in several situations.     

An Investigation of Quantile Function Estimators Relative to Quantile Confidence Interval Coverage

In this article, we investigate the limitations of traditional quantile function estimators and introduce a new class of quantile function estimators, namely, the semi-parametric tail-extrapolated quantile estimators, which has excellent performance for estimating the extreme tails with finite sample sizes. The smoothed bootstrap and direct density estimation via the characteristic function methods are developed for the estimation of confidence intervals. Through a comprehensive simulation study to compare the confidence interval estimations of various quantile estimators, we discuss the preferred quantile estimator in conjunction with the confidence interval estimation method to use under different circumstances. Data examples are given to illustrate the superiority of the semi-parametric tail-extrapolated quantile estimators. The new class of quantile estimators is obtained by slight modification of traditional quantile estimators, and therefore, should be specifically appealing to researchers in estimating the extreme tails.     

Test for normality based on two new estimators of entropy

In this article, two new consistent estimators are introduced of Shannon's entropy that compares root of mean-square error with other estimators. Then we define new tests for normality based on these new estimators. Finally, by simulation, the powers of the proposed tests are compared under different alternatives with other entropy tests for normality.     

Preliminary test estimation of the parameters of exponential and Pareto distributions for censored samples

This paper deals with the preliminary test estimation (PTE) of the parameters of the exponential and Pareto distributions in censored samples. The biases, risk functions, efficiency tables and the graphs for the relative efficiency for the proposed estimators for the parameters of the exponential and Pareto distributions are given. We find that the proposed estimators dominate the corresponding unrestricted (usual) estimators in the neighborhood of null hypothesis. The range of the parameters for which the proposed estimators dominate the corresponding usual estimators for different sample sizes and level of significance are given. The findings of the paper will be useful for the practitioners who are dealing with the censored samples in life testing experiments.     

Shrinkage and Penalty Estimators of a Poisson Regression Model

In this paper we propose Stein‐type shrinkage estimators for the parameter vector of a Poisson regression model when it is suspected that some of the parameters may be restricted to a subspace. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Furthermore, we consider three different penalty estimators: the LASSO, adaptive LASSO, and SCAD estimators and compare their relative performance with that of the shrinkage estimators. Monte Carlo simulation studies reveal that the shrinkage strategy compares favorably to the use of penalty estimators, in terms of relative mean squared error, when the number of inactive predictors in the model is moderate to large. The shrinkage and penalty strategies are applied to two real data sets to illustrate the usefulness of the procedures in practice.     

On the consistency between model-and design-based estimators in survey sampling

In finite population sampling, often a distinction is made between model-and design-based estimators of the parameters of interest (like the population total, population variance, etc.). The model-based estimators depend on the (known) parameters of the model, while the design-based estimators depend on the (known) selection probabilities of the different units in the population. It is shown in this paper that the two approaches are not necessarily incompatible, and indeed can often lead to the same estimator. Our ideas are illustrated with the Horvitz-Thompson, and the generalized Horvitz-Thompson estimator. These estimators are identified as hierarchical Bays estimators. Also, certain “stepwise-Bayes” estimators of Vardeman and Meeden (J. Stat. Inf. (1983), V7, pp 329-341) are unified from a hierarchical Bayes point of view.     

Partial derivatives and confidence intervals of bivariate tail dependence functions

Bivariate extreme value theory was used to estimate a rare event (see de Haan and de Ronde [1998. Sea and wind: multivariate extremes at work. Extremes 1, 7–45]). This procedure involves estimating a tail dependence function. There are several estimators for the tail dependence function in the literature, but their limiting distributions depend on partial derivatives of the tail dependence function. In this paper smooth estimators are proposed for estimating partial derivatives of bivariate tail dependence functions and their asymptotic distributions are derived as well. A simulation study is conducted to compare different estimators of partial derivatives in terms of both mean squared errors and coverage accuracy of confidence intervals of the bivariate tail dependence function based on these different estimators of partial derivatives.     

Examples of Differing Weighted and Unweighted Estimates from a Sample Survey

Unweighted estimators using data collected in a sample survey can be badly biased, whereas weighted estimators are approximately unbiased for population parameters. We present four examples using data from the 1988 National Maternal and Infant Health Survey to demonstrate that weighted and unweighted estimators can be quite different, and to show the underlying causes of such differences.     

An efficient and fast algorithm for estimating the parameters of two-dimensional sinusoidal signals

In this paper we propose a computationally efficient algorithm to estimate the parameters of a 2-D sinusoidal model in the presence of stationary noise. The estimators obtained by the proposed algorithm are consistent and asymptotically equivalent to the least squares estimators. Monte Carlo simulations are performed for different sample sizes and it is observed that the performances of the proposed method are quite satisfactory and they are equivalent to the least squares estimators. The main advantage of the proposed method is that the estimators can be obtained using only finite number of iterations. In fact it is shown that starting from the average of periodogram estimators, the proposed algorithm converges in three steps only. One synthesized texture data and one original texture data have been analyzed using the proposed algorithm for illustrative purpose.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

Reducing component estimation for varying coefficient models

The estimation problem for varying coefficient models has been studied by many authors. We consider the problem in the case that the unknown functions admit different degrees of smoothness. In this paper we propose a reducing component local polynomial method to estimate the unknown functions. It is shown that all of our estimators achieve the optimal convergence rates. The asymptotic distributions of our estimators are also derived. The established asymptotic results and the simulation results show that our estimators outperform the the existing two-step estimators when the coefficient functions admit different degrees of smoothness. We also develop methods to speed up the estimation of the model and the selection of the bandwidths.     

Estimation of the optimal portfolio weights by shrinking the mean vector towards a linear subspace

To obtain estimators of mean-variance optimal portfolio weights, Stein-type estimators of the mean vector that shrink a sample mean towards the grand mean have been applied. However, the dominance of these estimators has not been shown under the loss function used in the estimation problem of the mean-variance optimal portfolio weights, which is different than the quadratic function for the case in which the covariance matrix is unknown. We analytically give the conditions for Stein-type estimators that shrink towards the grand mean, or more generally, towards a linear subspace, to improve upon the classical estimators, which are obtained by simply plugging in sample estimates. We also show the dominance when there are linear constraints on portfolio weights.