On the Estimation of the Probability Density by Trigonometric Series

We present in this article an estimator based on a new orthogonal trigonometric series. We give its statistical properties (bias, variance, mean square error, and mean integrated square error) and the asymptotic properties (convergence of variance, convergence of the mean square error, convergence of the mean integrated square error, uniform convergence in probability, and the rate of convergence of the mean integrated square error). The comparison by simulation on a test density between the estimator obtained from a new trigonometric series with Fejer estimator also based on orthogonal trigonometric series, shows that our estimator is more performant in the sense of the mean integrated square error.     

Bias Adjustment Minimizing the Asymptotic Mean Square Error

A method of bias adjustment which minimizes the asymptotic mean square error is presented for an estimator typically given by maximum likelihood. Generally, this adjustment includes unknown population values. However, in some examples, the adjustment can be done without population values. In the case of a logit, a reasonable fixed value for the adjustment is found, which gives the asymptotic mean square error smaller than those of the asymptotically unbiased estimator and the maximum likelihood estimator. The weighted-score method, which yields directly the estimator with the minimized asymptotic mean square error, is also given.     

On the estimation of the marginal density of a moving average process

The authors present a new convolution‐type kernel estimator of the marginal density of an MA(1) process with general error distribution. They prove the √n; ‐consistency of the nonparametric estimator and give asymptotic expressions for the mean square and the integrated mean square error of some unobservable version of the estimator. An extension to MA(q) processes is presented in the case of the mean integrated square error. Finally, a simulation study shows the good practical behaviour of the estimator and the strong connection between the estimator and its unobservable version in terms of the choice of the bandwidth.     

Caliper pair-matching on a continuous variable in case-control studies

The use of matched pairs has been criticized as being less efficient than estimators based on random samples. This paper compares the mean square error of an analysis of covariance estimator based on random samples with two estimators based on caliper matched pairs. The first of these is a simple mean difference estimator and the second a regression estimator suggested by Rubin (1973b). Under conditions which commonly occur in epidemiologic case-control studies, both of the matched pair estimators can have smaller mean square errors than analysis o f covariance estimator. When there is a weak relationship between the matching and response variate, the mean difference estimator has a lower mean square error than the regression estimator.     

Mean square error and efficiency of the least squares estimator over interval constraints

We derive the mean square error of an interval constrained least squares estimator (INCLS) for a regression model. We then show that the INCLS estimator dominates, in mean square error, the unconstrained least squares estimator provided the regression residuais are normally distri'iiuted and Ynat Yrie imposed coii-

straint is satisfied or nearly satisfied.     

Efficient improved estimation of the parameters in two seemingly unrelated regression models

For a system of two seemingly unrelated regression equations, this paper proposes a two-stage covariance improved estimator of the regression coefficients. The new estimator is shown to uniformly dominate the present estimators in terms of generalized mean square error criterion. In addition, we also propose the exact generalized mean square error of new estimator.     

A Note on Superiority Comparisons of Homogeneous Linear Estimators

This note extends some results on homogeneous linear estimators to the general, even nonlinear case.A Sufficient condition for the difference of mean square error matrices of minimum conditional mean square error estimator and minimum average risk linear estimator to be postive definite is derived.     

Some conditions for optimality of the almost unbiased estimators of regression coefficients

The purpose of this paper is to examine the asymptotic properties of the operational almost unbiased estimator of regression coefficients which includes almost unbiased ordinary ridge estimator a s a special case. The small distrubance approximations for the bias and mean square error matrix of the estimator are derived. As a consequence, it is proved that, under certain conditions, the estimator is more efficient than a general class of estimators given by Vinod and Ullah (1981). Also it is shown that, if the ordinary ridge estimator (ORE) dominates the ordinary least squares estimator then the almost unbiased ordinary ridge estimator does not dominate ORE under the mean square error criterion.     

Sharpening estimators using resampling

We study ways to improve a given estimator using resampling methods like the jackknife or the bootstrap in terms of bias and the mean square error. Our key task is to devise a method to empirically check whether the bias correction employed leads to an increase or decrease in the mean square error in terms of second-order asymptotics. We derive conditions under which we can sharpen the given estimator in terms of bias and the mean square error. One may attempt to verify the condition empirically using resampling methods.     

Modified and Restricted r-k Class Estimators

In this article, we introduce the modified r-k class estimator and the restricted r-k class estimator. We compare the performances of the new estimators to the r-k class estimator with respect to the matrix mean square error (MSE) criterion. As a special case of the restricted r-k class estimator, we obtain the restricted principal components regression (RPCR) estimator. Finally, we conduct a Monte Carlo simulation study and a numerical example to investigate the performances of the proposed estimators by the scalar mean square error (mse) criterion.     

Chain ratio type estimator for ratio of two population m3ans using auxiliary characters

In this paper we have proposed chain ratio type estimators for ratio of two population means using two auxiliary characters. The expressions for bias and mean square error of these estimators have been derived. A comparison of the proposed estimator with that of double sampling estimator has been made in terms of mean square error. An emperical study has also been made.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

Some finite sample properties of generalized ridge regression estimators

In this paper we study the mean square error properties of the generalized ridge estimator. We obtain the exact and the approximate bias and the mean square error of the operational generalized ridge estimator in terms of G( ) functions. We show, among other things, that the operational generalized ridge estimator does not dominate the ordinary least squares estimator up to a certain order of approximation. Finally, we note that the iterative procedures to obtain coverging ridge estimators should be used with caution.     

A likelihood based estimator for vector autoregressive processes

A onestep estimator, which is an approximation to the unconditional maximum likelihood estimator (MLE) of the coefficient matrices of a Gaussian vector autoregressive process is presented. The onestep estimator is easy to compute and can be computed using standard software. Unlike the computation of the unconditional MLE, the computation of the onestep estimator does not require any iterative optimization and the computation is numerically stable. In finite samples the onestep estimator generally has smaller mean square error than the ordinary least squares estimator. In a simple model, where the unconditional MLE can be computed, numerical investigation shows that the onestep estimator is slightly worse than the unconditional MLE in terms of mean square error but superior to the ordinary least squares estimator. The limiting distribution of the onestep estimator for processes with some unit roots is derived.     

MSE-matrix superiority of the mixed over the least squares estimator in the presence of outliers

In his recent paper, Ali (1991) has shown that the mixed regression estimator, when data contain mean-shift or variance inflation outliers, is uniformly superior to the ordinary least squares estimator in terms of scalar-valued mean square error. However, when using the matrix-valued mean square error criterion, this dominance fails to hold in general. The subsequent investigation gives a complete characterization of the situation where the mixed estimator is superior to the LS-estimator when the comparison is made with respect to this stronger MSE-property. Vice versa, the LS-estimator never dominates the mixed estimator relative to this criterion.     

Error misspecification and properties of the simple ridge estimator

This paper gives necessary and sufficient conditions for the ridge estimator applied to an error misspecified regression model to dominate the generalised least squares estimator. It is shown that the requirements for mean square error dominance are more stringent than in the correct specification case.     

One-sided trimming in small samples with asymmetric contamination

An estimator for location, given a sample of only four or five observations, is proposed. The underlying distribution on of the sample may (with probability p) be contaminated by an outlier from a rightly-skewed distribution. The estimator minimizes the maximum mean squared error over all values of p. In fact, there exists an estimator which is unbiased in both the outlier - free and extreme-outlier cases, but its mean square error is substantially higher than the mean squared error for the minimax estimator. Mean squared errors for various underlying distributional situations are calculated and compared with those of other location estimators such as the mean and the median.     

An MSE‐reduced estimator for the response proportion in a two‐stage clinical trial

Two‐stage design is very useful in clinical trials for evaluating the validity of a specific treatment regimen. When the second stage is allowed to continue, the method used to estimate the response rate based on the results of both stages is critical for the subsequent design. The often‐used sample proportion has an evident upward bias. However, the maximum likelihood estimator or the moment estimator tends to underestimate the response rate. A mean‐square error weighted estimator is considered here; its performance is thoroughly investigated via Simon's optimal and minimax designs and Shuster's design. Compared with the sample proportion, the proposed method has a smaller bias, and compared with the maximum likelihood estimator, the proposed method has a smaller mean‐square error. Copyright © 2010 John Wiley & Sons, Ltd.     

Superiority comparisons between mixed regression estimators

This paper gives necessary and sufficient conditions for a mixed regression estimator to be superior to another mixed estimator. The comparisons are based on the mean square error matrices of the estimators. Both estimators are allowed to be biased.     

On necessary and sufficient condition for superiority of ridge estimator over least squares estimator

The necessary and sufficient condition is obtained such that ridge estimator is better than the least squares estimator relative to the matrix mean square error.