The Superiorities of Bayes Linear Minimum Risk Estimation in Linear Model

In this article, the Bayes linear minimum risk estimator (BLMRE) of parameters is derived in linear model. The superiorities of the BLMRE over ordinary least square estimator (LSE) is studied in terms of the mean square error matrix (MSEM) criterion and Pitman closeness (PC) criterion.     

A comparison of estimation techniques for the three parameter pareto distribution

This paper compares minimum distance estimation with best linear unbiased estimation to determine which technique provides the most accurate estimates for location and scale parameters as applied to the three parameter Pareto distribution. Two minimum distance estimators are developed for each of the three distance measures used (Kolmogorov, Cramer‐von Mises, and Anderson‐Darling) resulting in six new estimators. For a given sample size 6 or 18 and shape parameter 1(1)4, the location and scale parameters are estimated. A Monte Carlo technique is used to generate the sample sets. The best linear unbiased estimator and the six minimum distance estimators provide parameter estimates based on each sample set. These estimates are compared using mean square error as the evaluation tool. Results show that the best linear unbaised estimator provided more accurate estimates of location and scale than did the minimum estimators tested.     

A comparison of estimators for the mean in the inverse gaussian distribution with a known coefficient of variation

In this paper, we discuss an estimation problem of the mean in the inverse Gaussian distribution with a known coefficient of variation. Two types of linear estimators for the mean, the linear minimum variance unbiased estimator and the linear minimum mean squared error estimator, are constructed by using the squared error loss function and their properties are examined. It is observed that, for small samples the performance of the proposed estimators is better than that of the maximum likelihood estimator, when the coefficient of variation is large.     

Should S Get More Press?

This note discusses a problem appropriate for a beginning mathematical statistics course. Four estimators of the standard deviation of a normal data source are compared using mean square error. Both the uniformly minimum variance unbiased estimator and the usual estimator are found to be inadmissible.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

On the Estimation of the Probability Density by Trigonometric Series

We present in this article an estimator based on a new orthogonal trigonometric series. We give its statistical properties (bias, variance, mean square error, and mean integrated square error) and the asymptotic properties (convergence of variance, convergence of the mean square error, convergence of the mean integrated square error, uniform convergence in probability, and the rate of convergence of the mean integrated square error). The comparison by simulation on a test density between the estimator obtained from a new trigonometric series with Fejer estimator also based on orthogonal trigonometric series, shows that our estimator is more performant in the sense of the mean integrated square error.     

Selecting a test level for random effects

A method is presented for selecting an a-level to use when testing for group difference in a one-way classification random effects model. The a-level is chosen to make the power of the test equal to .5 when the parameters are such that between group mean square and total mean square are equally good minimum expected squared error estimators of the variance of y the estimator of the mean     

Local improvement of best linear unbiased estimation and admissibility under the weakly singular gauss-markov model

Under the weakly singular Gauss-Markov model, the class of linearly admissible estimators for the expectation of the observable random vector with respect to the mean square error criterion is considered. It is demonstrated that this class admits linearly admissible estimators for an arbitrary estimable parametric function, which locally improve the best linear estimator with respect to the mean square error matrix criterion.     

Some asymptotic results in the multivariate lognormal estimation theory

An asymptotic expansion of the variance of the uniformly minimum variance unbiased estimator of a class of parameters of the multivariate lognormal distribution is considered. It is obtained by some calculations of the zonal polynomials. Then it is compared with an asymptotic mean square error of the maximum likelihood estimator of the same parameter.     

A new estimator of entropy

Vasicek (1976) proposed an estimator of entropy based on spacings. A new estimator of entropy is proposed. This new estimator is based on local linear regression. Comparisons between this new estimator and Vasicek's estimator are made. The mean square error (MSE) of the new estimator is consistently smaller than the MSE of Vasicek's estimator.     

Estimation of reliability for a multicomponent survival stress-strength model based on exponential distributions

Uniformly minimum variance unbiased estimator (UMVUE) of reliability in stress-strength model (known stress) is obtained for a multicomponent survival model based on exponential distributions for parallel system. The variance of this estimator is compared with Cramer-Rao lower bound (CRB) for the variance of unbiased estimator of reliability, and the mean square error (MSE) of maximum likelihood estimator of reliability in case of two component system.     

On Bayes Linear Unbiased Estimator Under the Balanced Loss Function

In this paper, the Bayes linear unbiased estimator (Bayes LUE) is derived under the balanced loss function. Moreover, the superiority of Bayes LUE over ordinary least square estimator is studied under the mean square error matrix criterion and Pitman closeness criterion. Furthermore, we compare Bayes LUE under the balanced loss function with Bayes LUE under the quadratic loss function.     

Minimum mean squared error estimation of each individual coefficient in a linear regression model

In this paper, we derive the exact mean squared error (MSE) of the minimum MSE estimator for each individual coefficient in a linear regression model, and show a sufficient condition for the minimum MSE estimator for each individual coefficient to dominate the OLS estimator. Numerical results show that when the number of independent variables is 2 and 3, the minimum MSE estimator for each individual coefficient can be a good alternative to the OLS and Stein-rule estimators.     

Approximate optimal allocation in repeated sampling from a finite population

Samples of size n are drawn from a finite population on each of two occasions. On the first occasion a variate x is measured, and on the second a variate y. In estimating the population mean of y, the variance of the best linear unbiased combination of means for matched and unmatched samples is itself minimized, with respect to the sampling design on the second occasion, by a certain degree of matching. This optimal allocation depends on the population correlation coefficient, which previous authors have assumed known. We estimate the correlation from an initial matched sample, then an approximately optimal allocation is completed and an estimator formed which, under a bivariate normal superpopulation model, has model expected mean square error equal, apart from an error of order n^-2, to the minimum enjoyed by any linear, unbiased estimator.     

The Minimum Density Power Divergence Estimation for the Lognormal Density

In this article, we implement the minimum density power divergence estimation for estimating the parameters of the lognormal density. We compare the minimum density power divergence estimator (MDPDE) and the maximum likelihood estimator (MLE) in terms of robustness and asymptotic distribution. The simulations and an example indicate that the MDPDE is less biased than MLE and is as good as MLE in terms of the mean square error under various distributional situations.     

On a generalized stein estimator of regression coefficients

This paper studies a generalized Stein estimator of regression coefficients. The small disturbance approximations for the bias and mean square error matrix of the estimator are derived and a necessary and sufficient condition is obtained for the estimator to dominate the ordinary least squares estimator under the mean square error criterion.     

A new Liu-type estimator in linear regression model

In this paper, we introduce a new Liu-type estimator called modified Liu estimator based on prior information for the vector of parameters in a linear regression model and discuss its properties. Furthermore, we obtain that our new estimator is superior, in the mean square error matrix sense, to the least squares estimator, Liu estimator, ridge estimator and modified ridge estimator. Finally, a numerical example and a Monte Carlo simulation are done to illustrate some of the theoretical results.     

Asymptotic design and estimation using linear splines

The estimation of a regression function g using linear splines is considered. The integrated mean square error is minimized using choice of estimator, allocation of observations and displacement of knots.     

On the estimation of the marginal density of a moving average process

The authors present a new convolution‐type kernel estimator of the marginal density of an MA(1) process with general error distribution. They prove the √n; ‐consistency of the nonparametric estimator and give asymptotic expressions for the mean square and the integrated mean square error of some unobservable version of the estimator. An extension to MA(q) processes is presented in the case of the mean integrated square error. Finally, a simulation study shows the good practical behaviour of the estimator and the strong connection between the estimator and its unobservable version in terms of the choice of the bandwidth.     

Bayes and Empirical Bayes Inference in Changepoint Problems

ABSTRACT

In the case of the random design nonparametric regression, the double smoothing technique is applied to estimate the multivariate regression function. The proposed estimator has desirable properties in both the finite sample and the asymptotic cases. In the finite sample case, it has bounded conditional (and unconditional) bias and variance. On the other hand, in the asymptotic case, it has the same mean square error as the local linear estimator in Fan (Design-Adaptive Nonparametric Regression. Journal of the American Statistical Association 1992, 87, 998–1004; Local Linear Regression Smoothers and Their Minimax Efficiencies. Annals of Statistics 1993, 21, 196–216). Simulation studies demonstrate that the proposed estimator is better than the local linear estimator, because it has a smaller sample mean integrated square error and gives smoother estimates.