A Note on the Estimation of Binomial Probabilities

I am concerned with the admissibility under quadratic loss of certain estimators of binomial probabilities. The minimum variance unbiased estimator is shown to be admissible for Pr(X = 0) and Pr(X = n), but it is inadmissible for Pr(X = k), where 0 < k < n. An example is given of an admissible maximum likelihood estimator (MLE). It is conjectured that the MLE is always admissible.     

Minimax estimation of a lower-bounded scale parameter of a gamma distribution for scale-invariant squared-error loss

Let X have a gamma distribution with known shape parameter θr;aL and unknown scale parameter θ. Suppose it is known that θ ≥ a for some known a > 0. An admissible minimax estimator for scale-invariant squared-error loss is presented. This estimator is the pointwise limit of a sequence of Bayes estimators. Further, the class of truncated linear estimators C = {θ_ρ|θ_ρ(x) = max(a, ρ), ρ > 0} is studied. It is shown that each θ_ρ is inadmissible and that exactly one of them is minimax. Finally, it is shown that Katz's [Ann. Math. Statist., 32, 136–142 (1961)] estimator of θ is not minimax for our loss function. Some further properties of and comparisons among these estimators are also presented.     

Admissible linear estimators of the multivariate normal mean without extra information

Suppose y is normally distributed with mean IRⁿ and covariance σ²V, where σ²>0 and V>0 is known. The n. s. conditions that a linear estimator Ay+a of μ be admissible in the class of all estimators of μ which depend only on y are derived. In particular, the usual estimator δ₀(y)=y is admissible in this class. The results are applied to the normal linear model and the admissibilities of many well-known linear estimators are demonstrated.     

Improving on truncated linear estimates of exponential and gamma scale parameters

We consider the problem of estimating the scale parameter of an exponential or a gamma distribution under squared error loss when the scale parameter θ is known to be greater than some fixed value θ₀. Natural estimators in this setting include truncated linear functions of the sufficient statistic. Such estimators are typically inadmissible, but explicit improvements seem difficult to find. Some are presented here. A particularly interesting finding is that estimators which are admissible in the untruncated problem which take values only in the interior of the truncated parameter space are found to be inadmissible for the truncated problem.     

Local improvement of best linear unbiased estimation and admissibility under the weakly singular gauss-markov model

Under the weakly singular Gauss-Markov model, the class of linearly admissible estimators for the expectation of the observable random vector with respect to the mean square error criterion is considered. It is demonstrated that this class admits linearly admissible estimators for an arbitrary estimable parametric function, which locally improve the best linear estimator with respect to the mean square error matrix criterion.     

A Remedy for Kernel Estimation Under Random Design

Two common kernel-based methods for non-parametric regression estimation suffer from well-known drawbacks when the design is random. The Gasser-Müller estimator is inadmissible due to its high variance while the Nadaraya-Watson estimator has zero asymptotic efficiency because of poor bias behavior. Under asymptotic consideration, the local linear estimator avoids these two drawbacks of kernel estimators and achieves minimax optimality. However, when based on compact support kernels its finite sample behavior is disappointing because sudden kinks may show up in the estimate.

This paper proposes a modification of the kernel estimator, called the binned convolution estimator leading to a fast O(n) method. Provided the design density is continously differentiable and the conditional fourth moments exist the binned convolution estimator has asymptotic properties identical with those of the local linear estimator.     

Some inadmissibility results for estimating ordered uniform scale parameters

Independent random samples (of possibly unequal sizes) are drawn from k (≥2) uniform populations having unknown scale parameters μ₁,…,μ_k. The problem of componentwise estimation of ordered parameters is investigated. The loss function is assumed to be squared error and the cases of known and unknown ordering among μ₁,…,μ_k. are dealt with separately. Sufficient conditions for an estimator to be inadmissible are provided and as a consequence, many natural estimators are shown to be inadmissible, Better estimators are provided.     

On the improved estimation of a function of the scale parameter of an exponential distribution based on doubly censored sample

In the present article, we have studied the estimation of entropy, that is, a function of scale parameter ln⁡σ of an exponential distribution based on doubly censored sample when the location parameter is restricted to positive real line. The estimation problem is studied under a general class of bowl-shaped non monotone location invariant loss functions. It is established that the best affine equivariant estimator (BAEE) is inadmissible by deriving an improved estimator. This estimator is non-smooth. Further, we have obtained a smooth improved estimator. A class of estimators is considered and sufficient conditions are derived under which these estimators improve upon the BAEE. In particular, using these results we have obtained the improved estimators for the squared error and the linex loss functions. Finally, we have compared the risk performance of the proposed estimators numerically. One data analysis has been performed for illustrative purposes.     

A test of the mean square error criterion for linear admissible estimators

A test for choosing between a linear admissible estimator and the least squares estimator (LSE) is developed. A characterization of linear admissible estimators useful for comparing estimators is presented and necessary and sufficient conditions for superiority of a linear admissible estimator over the LS estimetor is derived for the test. The test is based on the MSE matrix superiority, but also new resl?!ts concerning covariance matrix comparisons of linear estimators are derived. Further,shown that the test of Toro - Vizcarrondo and Wailace applies iioi only the restricted least squares estimators but also to certain estimators outside this class.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Estimation of common location parameter of two exponential populations based on records

Consider the problem of estimating the common location parameter of two exponential populations using record data when the scale parameters are unknown. We derive the maximum likelihood estimator (MLE), the modified maximum likelihood estimator (MMLE) and the uniformly minimum variance unbiased estimator (UMVUE) of the common location parameter. Further, we derive a general result for inadmissibility of an equivariant estimator under the scaled-squared error loss function. Using this result, we conclude that the MLE and the UMVUE are inadmissible and better estimators are provided. A simulation study is conducted for comparing the performances of various competing estimators.     

Comparison of renewal function estimators for censored data

The computation of the renewal function when the distribution function is completely known has received much attention in the literature. However, in many cases the form of the distribution function is unknown and has to be estimated nonparametrically. A nonparametric estimator for the renewal function for complete data was suggested by Frees (1986). In many cases, however, censoring of the lifetime might occur. We shall present parametric and nonparametric estimators of the renewal function based on censored data. In a simulation study we compare the nonparametric estimators with parametric estimators for the Weibull and lognormal distribution. The study suggests that the nonparametric estimator is a viable alternative to the parametric estimators when the lifetime distribution is unknown. Also, the nonparametric estimator is computationally simpler than the parametric estimator.     

Shrinkage estimator of regression model under asymmetric loss

This article investigates the performance of the shrinkage estimator (SE) of the parameters of a simple linear regression model under the LINEX loss criterion. The risk function of the estimator under the asymmetric LINEX loss is derived and analyzed. The moment-generating functions and the first two moments of the estimators are also obtained. The risks of the SE have been compared numerically with that of pre-test and least-square estimators (LSEs) under the LINEX loss criterion. The numerical comparison reveals that under certain conditions the LSE is inadmissible, and the SE is the best among the three estimators.     

Estimated confidence under ancillary statistic everywhere-valid constraint

Consider the problem of estimating the coverage function of an usual confidence interval for a randomly chosen linear combination of the elements of the mean vector of a p-dimensional normal distribution. The usual constant coverage probability estimator is shown to be admissible under the ancillary statistic everywhere-valid constraint. Note that this estimator is not admissible under the usual sense if p⩾5. Since the criterion of admissibility under the ancillary statistic everywhere-valid constraint is a reasonable one, that the constant coverage probability estimator has been commonly accepted is justified.     

Jackknife Estimation for Smooth Functions of the Parametric Component in Partially Linear Regression Models

Abstract

It is known that due to the existence of the nonparametric component, the usual estimators for the parametric component or its function in partially linear regression models are biased. Sometimes this bias is severe. To reduce the bias, we propose two jackknife estimators and compare them with the naive estimator. All three estimators are shown to be asymptotically equivalent and asymptotically normally distributed under some regularity conditions. However, through simulation we demonstrate that the jackknife estimators perform better than the naive estimator in terms of bias when the sample size is small to moderate. To make our results more useful, we also construct consistent estimators of the asymptotic variance, which are robust against heterogeneity of the error variances.     

Admissibility of linear estimators with respect to restricted parameter sets

In this paper the admissibility of a linear estimator for a linear regression parameter is characterized for such cases, where the considered parameter varies in an ellipsoid. We obtain a certain subset of the set of all linear estimators which are admissible with respect to the unrestricted parameter set. Furthermore, various linear estimators which have been proposed for improving the least squares estimator in cases of a restricted parameter set are investigated for admissibility. It turns out that only some shrunken estimators and some estimators of ridge type are admissible, whereas the KUKS-OLMAN estimator and all estimators of MARQUARDT type can be improved.     

Difference-based estimation and model identification for panel data semiparametric models with cross-section dependence

Abstract

In this article, we consider a panel data partially linear regression model with fixed effect and non parametric time trend function. The data can be dependent cross individuals through linear regressor and error components. Unlike the methods using non parametric smoothing technique, a difference-based method is proposed to estimate linear regression coefficients of the model to avoid bandwidth selection. Here the difference technique is employed to eliminate the non parametric function effect, not the fixed effects, on linear regressor coefficient estimation totally. Therefore, a more efficient estimator for parametric part is anticipated, which is shown to be true by the simulation results. For the non parametric component, the polynomial spline technique is implemented. The asymptotic properties of estimators for parametric and non parametric parts are presented. We also show how to select informative ones from a number of covariates in the linear part by using smoothly clipped absolute deviation-penalized estimators on a difference-based least-squares objective function, and the resulting estimators perform asymptotically as well as the oracle procedure in terms of selecting the correct model.     

The admissible minimax estimator in Gauss–Markov model under a balanced loss function

In this paper, we investigate the admissible minimax estimator (AME) of regression coefficient in Gauss–Markov model under a balanced loss function. In the class of homogeneous linear estimators, we obtain the AME under two occasions, respectively. We also prove that the AME is a shrinkage estimator of the best linear unbiased estimator (BLUE). Furthermore, we prove that the AME dominates the BLUE under certain conditions.     

Semiparametric Stein estimators

Stein [Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Proc. 3rd Berkeley symp. math. statist. and pro. (pp. 197–206). University of California Press], in his seminal paper, came up with the surprising discovery that the sample mean is an inadmissible estimator of the population mean in three or higher dimensions under squared error loss. The past five decades have witnessed multiple extensions and variations of Stein’s results. In this paper we develop Stein-type estimators in a semiparametric framework and prove their coordinatewise asymptotic dominance over the sample mean in terms of Bayes risks.