Comparison of point estimators of normal percentiles

There are available several point estimators of the percentiles of a normal distribution with both mean and variance unknown. Consequently, it would seem appropriate to make a comparison among the estimators through some “closeness to the true value” criteria. Along these lines, the concept of Pitman-closeness efficiency is introduced. Essentially, when comparing two estimators, the Pit-man-closeness efficiency gives the “odds” in favor of one of the estimators being closer to the true value than is the other in a given situation. Through the use of Pitman-closeness efficiency, this paper compares (a) the maximum likelihood estimator, (b) the minimum variance unbiased estimator, (c) the best invariant estimator, and (d) the median unbiased estimator within a class of estimators which includes (a), (b), and (c). Mean squared efficiency is also discussed.     

Performance of nonparametric maximum likelihood estimator in a

When the probability of selecting an individual in a population is propor­tional to its lifelength, it is called length biased sampling. A nonparametric maximum likelihood estimator (NPMLE) of survival in a length biased sam­ple is given in Vardi (1982). In this study, we examine the performance of Vardi's NPMLE in estimating the true survival curve when observations are from a length biased sample. We also compute estimators based on a linear combination (LCE) of empirical distribution function (EDF) estimators and weighted estimators. In our simulations, we consider observations from a mix­ture of two different distributions, one from F and the other from G which is a length biased distribution of F. Through a series of simulations with vari­ous proportions of length biasing in a sample, we show that the NPMLE and the LCE closely approximate the true survival curve. Throughout the sur­vival curve, the EDF estimators overestimate the survival. We also consider a case where the observations are from three different weighted distributions, Again, both the NPMLE and the LCE closely approximate the true distribu­tion, indicating that the length biasedness is properly adjusted for. Finally, an efficiency study shows that Vardi's estimators are more efficient than the EDF estimators in the lower percentiles of the survival curves.     

Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Conditional inference in finite population sampling under a calibration model

Several estimators, including the classical and the regression estimators of finite population mean, are compared, both theoretically and empirically, under a calibration model, where the dependent variable(y), and not the independent variable(x), can be observed for all units of the finite population. It is shown asymptotically that when conditioned on x, the bias of the classical estimator may be much smaller than that of the regression estimators; whereas when conditioned on y, the regression estimator may have much smaller conditional bias than the classical estimator. Since all the y's(not x's) can be observed, it seems appropriate to make comparison under the conditional distribution of each estimator with y fixed. In this case, the regression estimator has smaller variance, smaller conditional bias, and the conditional coverage probability closer to its nominal level     

Empirical bayes shrinkage estimation of reliability in the exponential distribution

In this paper we propose two empirical Bayes shrinkage estimators for the reliability of the exponential distribution and study their properties. Under the uniform prior distribution and the inverted gamma prior distribution these estimators are developed and compared with a preliminary test estimator and with a shrinkage testimator in terms of mean squared error. The proposed empirical Bayes shrinkage estimator under the inverted gamma prior distribution is shown to be preferable to the preliminary test estimator and the shrinkage testimator when the prior value of mean life is clsoe to the true mean life.     

On the estimation of the true probability of a correct selection

For ranking and selection problems, the true probabiIity of a correct selection P(CS) is unknown even if a selection is made under the indifference-zone approach. Thus to estimate the true P(CS) some Bayes estimators and a bootstrap estimator are proposed for two normcal populations with common known variance. Also a bootstrap estimator and a bootstrap confidence interval are proposed for normal populations with common unknown variance. Some comparisons between proposed estimators and some other known estimators are made via Monte Carlo simulations.     

A note on the Zhang omnibus test for normality based on the Q statistic

A discussion about the estimators proposed by Zhang (1999) for the true standard deviation σof a normal distribution is presented. Those estimators, called by Zhang q 1 and q 2 , are functions of the expected values of the order statistics from a standard normal distribution and they were the basis of the Q statistic used in the derivation of a new test for normality proposed by Zhang. Although the type I error and the power of the test was discussed by Zhang, no study was performed to test the reliability of q 1 and q 2 as estimators of σ. In this paper, it is shown that q 1 is a very poor estimator for σespecially when σis large. On the other hand, the estimator q 2 has a performance very similar to the well-known sample standard deviation S. When some correlation is introduced among the sample units it can be seen that the estimator q 1 is much more affected than the estimators q 2 and S.     

Goodness—of—fit for the two—parameter weibull distribution with estimated parameters

Goodness—of—fit statistics based on the empirical distribution function (EDF) are not distribution—free when parameters for the hypothesized distribution are estimated. Tables are percentile values of several EDF statistics are available for the two—parameter Weibull distribution when parameters are estimated by maximum likelihood. To determine how these tabled values change when simpler estimators are employed, percentile scores for EDF goodness—of—fit tests were obtained by Monte—Carlo simulation for maximum likelihood estimators (MLEs), good linear unbiased estimators (GLUEs), and modified Cramer—von Mises, Anderson—Darling, and Watson statistics are presented for GLUEs for both complete and censored samples. Critical values for Kolmogorov—Smirnov statistics were less affected by the method of estimation than were closer for MLEs and MGLUEs than for MGLUEs and GLUEs. On the other hand, MGLUE and GLUE results were much more similar to each other than to the MLE results when censoring was light and sample sizes were large.     

Estimation of reliability under ordered restriction on the parameters

This paper deals with the estimation of reliability for a strength-stress model under ordered restriction on the parameters. It is assumed that components have exponential distributions and are arranged in a parallel system and the failure of one component, results in increasing the failure rate of the remaining components. Results are derived when (i) the ordering of the means is taken into account and when (ii) the ordering of the means is ignored. Simulation studies are carried out to compare the results. It is noticed that, in almost all cases, in case (i) the estimates are closer to the true value with smaller mean squared error (MSE) and smaller’ standard deviation than in case (ii). Thus when the ordering of the means is present in the model, such information should be incorporated in the estimation of reliability.     

Shrinkage estimation of scale in exponential distribution from censored samples

In this paper some shrunken and pretest shrunken estimators are suggested for the scale parameter of an exponential distribution, when observations become available from life test experiments. These estimators are shown to be more efficient than the usual estimator when a guessed value is nearer to the true value.     

Edge Estimation in the Population of a Binary Tree Using Node-Sampling

Suppose a finite population of several vertices, each connected to single or multiple edges. This constitutes a structure of graphical population of vertices and edges. As a special case, the graphical population like a binary tree having only two child vertices associated to parent vertex is taken into consideration. The entire binary tree is divided into two sub-graphs such as a group of left-nodes and a group of right-nodes. This paper takes into account a mixture of graph structured and population sampling theory together and presents a methodology for mean-edge-length estimation of left sub-graph using right edge sub-graph as an auxiliary source of information. A node-sampling procedure is developed for this purpose and a class of estimators is proposed containing several good estimators. Mathematical conditions for minimum bias and optimum mean squared error of the class are derived and theoretical results are numerically supported with a test of 99% confidence intervals. It is shown that suggested class has a sub-class of optimum estimators, and sample-based estimates are closer to the true value of the population parameter.     

The relative efficiency of the restricted estimators in linear regression models

This paper deals with the problem of multicollinearity in a multiple linear regression model with linear equality restrictions. The restricted two parameter estimator which was proposed in case of multicollinearity satisfies the restrictions. The performance of the restricted two parameter estimator over the restricted least squares (RLS) estimator and the ordinary least squares (OLS) estimator is examined under the mean square error (MSE) matrix criterion when the restrictions are correct and not correct. The necessary and sufficient conditions for the restricted ridge regression, restricted Liu and restricted shrunken estimators, which are the special cases of the restricted two parameter estimator, to have a smaller MSE matrix than the RLS and the OLS estimators are derived when the restrictions hold true and do not hold true. Theoretical results are illustrated with numerical examples based on Webster, Gunst and Mason data and Gorman and Toman data. We conduct a final demonstration of the performance of the estimators by running a Monte Carlo simulation which shows that when the variance of the error term and the correlation between the explanatory variables are large, the restricted two parameter estimator performs better than the RLS estimator and the OLS estimator under the configurations examined.     

Efficiency of two classes of stochastic restricted almost unbiased type principal component estimators in linear regression model

In this paper, we introduce two new classes of estimators called the stochastic restricted almost unbiased ridge-type principal component estimator (SRAURPCE) and the stochastic restricted almost unbiased Liu-type principal component estimator (SRAURPCE) to overcome the well-known multicollinearity problem in linear regression model. For the two cases when the restrictions are true and not true, necessary and sufficient conditions for the superiority of the proposed estimators are derived and compared, respectively. Furthermore, a Monte Carlo simulation study and a numerical example are given to illustrate the performance of the proposed estimators.     

Pitman closeness,monotonicity and consistency of best linear unbiased and invariant estimators for exponential distribution under Type II censoring

Comparisons of best linear unbiased estimators with some other prominent estimators have been carried out over the last 50 years since the ground breaking work of Lloyd [E.H. Lloyd, Least squares estimation of location and scale parameters using order statistics, Biometrika 39 (1952), pp. 88–95]. These comparisons have been made under many different criteria across different parametric families of distributions. A noteworthy one is by Nagaraja [H.N. Nagaraja, Comparison of estimators and predictors from two-parameter exponential distribution, Sankhyā Ser. B 48 (1986), pp. 10–18], who made a comparison of best linear unbiased (BLUE) and best linear invariant (BLIE) estimators in the case of exponential distribution. In this paper, continuing along the same lines by assuming a Type II right censored sample from a scaled-exponential distribution, we first compare BLUE and BLIE of the exponential mean parameter in terms of Pitman closeness (nearness) criterion. We show that the BLUE is always Pitman closer than the BLIE. Next, we introduce the notions of Pitman monotonicity and Pitman consistency, and then establish that both BLUE and BLIE possess these two properties.     

LASSO and shrinkage estimation in Weibull censored regression models

In this paper we address the problem of estimating a vector of regression parameters in the Weibull censored regression model. Our main objective is to provide natural adaptive estimators that significantly improve upon the classical procedures in the situation where some of the predictors may or may not be associated with the response. In the context of two competing Weibull censored regression models (full model and candidate submodel), we consider an adaptive shrinkage estimation strategy that shrinks the full model maximum likelihood estimate in the direction of the submodel maximum likelihood estimate. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Further, we consider a LASSO type estimation strategy and compare the relative performance with the shrinkage estimators. Monte Carlo simulations reveal that when the true model is close to the candidate submodel, the shrinkage strategy performs better than the LASSO strategy when, and only when, there are many inactive predictors in the model. Shrinkage and LASSO strategies are applied to a real data set from Veteran's administration (VA) lung cancer study to illustrate the usefulness of the procedures in practice.     

High-dimensional Markowitz portfolio optimization problem: empirical comparison of covariance matrix estimators

We compare the performance of recently developed regularized covariance matrix estimators for Markowitz's portfolio optimization and of the minimum variance portfolio (MVP) problem in particular. We focus on seven estimators that are applied to the MVP problem in the literature; three regularize the eigenvalues of the sample covariance matrix, and the other four assume the sparsity of the true covariance matrix or its inverse. Comparisons are made with two sets of long-term S&P 500 stock return data that represent two extreme scenarios of active and passive management. The results show that the MVPs with sparse covariance estimators have high Sharpe ratios but that the naive diversification (also known as the ‘uniform (on market share) portfolio’) still performs well in terms of wealth growth.     

Optimized estimation for population mean using conventional and non-conventional measures under the joint influence of measurement error and non-response

Most of the research work in the theory of survey sampling only deals with the sampling errors under the assumptions: (i) there is a complete response and (ii) recorded information from individuals is correct but in practice it is not always true. Non-sampling errors like non-response and measurement errors (MEs) mostly creep into the survey and become more influential for estimators than sampling errors. Considering this practical situation of non-response and MEs jointly, we proposed an optimum class of estimators for population mean under simple random sampling using conventional and non-conventional measures. Bias and mean square error of the proposed estimators are derived up to first degree of approximation. Moreover, a simulation study is conducted to assess the performance of new estimators which proves that proposed estimators are more efficient than the traditional Hansen and Hurwitz estimator and other competing estimators.     

ON THE ANALYSIS AND APPLICATION OF MEASURES OF LINKAGE DISEQUILIBRIUM

The maximum likelihood, jackknife and bootstrap estimators of linkage disequilibrium, a measure of association in population genetics, are derived and compared. It is found that for point estimation, the resampling methods generate almost identical mean square errors. The maximum likelihood estimator could have bigger or smaller mean square errors depending on the parameters of the underlying population. However the bootstrap confidence interval is superior to the other two as the length of the intervals is shorter or the probability that the 95% confidence intervals include the true parameter is closer to 0.95. Although the standardised measure of linkage disequilibrium has a range from -1 to 1 regardless of marginal frequencies, it is shown that the distribution of this standardised measure is still not allele frequency independent under the multinomial sampling scheme.     

Estimation following selection of the largest of two normal means

This paper considers the problem of estimation when one of a number of populations, assumed normal with known common variance, is selected on the basis of it having the largest observed mean. Conditional on selection of the population, the observed mean is a biased estimate of the true mean. This problem arises in the analysis of clinical trials in which selection is made between a number of experimental treatments that are compared with each other either with or without an additional control treatment. Attempts to obtain approximately unbiased estimates in this setting have been proposed by Shen [2001. An improved method of evaluating drug effect in a multiple dose clinical trial. Statist. Medicine 20, 1913–1929] and Stallard and Todd [2005. Point estimates and confidence regions for sequential trials involving selection. J. Statist. Plann. Inference 135, 402–419]. This paper explores the problem in the simple setting in which two experimental treatments are compared in a single analysis. It is shown that in this case the estimate of Stallard and Todd is the maximum-likelihood estimate (m.l.e.), and this is compared with the estimate proposed by Shen. In particular, it is shown that the m.l.e. has infinite expectation whatever the true value of the mean being estimated. We show that there is no conditionally unbiased estimator, and propose a new family of approximately conditionally unbiased estimators, comparing these with the estimators suggested by Shen.     

Reducing bias in parameter estimates from stepwise regression in proportional hazards regression with right-censored data

When variable selection with stepwise regression and model fitting are conducted on the same data set, competition for inclusion in the model induces a selection bias in coefficient estimators away from zero. In proportional hazards regression with right-censored data, selection bias inflates the absolute value of parameter estimate of selected parameters, while the omission of other variables may shrink coefficients toward zero. This paper explores the extent of the bias in parameter estimates from stepwise proportional hazards regression and proposes a bootstrap method, similar to those proposed by Miller (Subset Selection in Regression, 2nd edn. Chapman & Hall/CRC, 2002) for linear regression, to correct for selection bias. We also use bootstrap methods to estimate the standard error of the adjusted estimators. Simulation results show that substantial biases could be present in uncorrected stepwise estimators and, for binary covariates, could exceed 250% of the true parameter value. The simulations also show that the conditional mean of the proposed bootstrap bias-corrected parameter estimator, given that a variable is selected, is moved closer to the unconditional mean of the standard partial likelihood estimator in the chosen model, and to the population value of the parameter. We also explore the effect of the adjustment on estimates of log relative risk, given the values of the covariates in a selected model. The proposed method is illustrated with data sets in primary biliary cirrhosis and in multiple myeloma from the Eastern Cooperative Oncology Group.