The small sample properties of the restricted principal component regression estimator in linear regression model

In regression analysis, to deal with the problem of multicollinearity, the restricted principal components regression estimator is proposed. In this paper, we compared the restricted principal components regression estimator, the principal components regression estimator, and the ordinary least-squares estimator with each other under the Pitman's closeness criterion. We showed that the restricted principal components regression estimator is always superior to the principal components regression estimator, under certain conditions the restricted principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion and under certain conditions the principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion.     

Estimation of an exponential quantile under pitman's measure of closeness

We consider the problem of estimating a quantile of an exponential distribution with unknown location and scale parameters under Pitman's measure of closeness (PMC). The loss function is required to satisfy some mild conditions but is otherwise arbitrary. An optimal estimator is obtained in the class of location-scale-equivariant estimators, and its admissibility in the sense of PMC is investigated.     

Near Optimal Prediction from Relevant Components

Abstract. The random x regression model is approached through the group of rotations of the eigenvectors for the x ‐covariance matrix together with scale transformations for each of the corresponding regression coefficients. The partial least squares model can be constructed from the orbits of this group. A generalization of Pitman's Theorem says that the best equivariant estimator under a group is given by the Bayes estimator with the group's invariant measure as the prior. A straightforward application of this theorem turns out to be impossible since the relevant invariant prior leads to a non‐defined posterior. Nevertheless we can devise an approximate scale group with a proper invariant prior leading to a well‐defined posterior distribution with a finite mean. This Bayes estimator is explored using Markov chain Monte Carlo technique. The estimator seems to require heavy computations, but can be argued to have several nice properties. It is also a valid estimator when p>n.     

Some conditions for optimality of the almost unbiased estimators of regression coefficients

The purpose of this paper is to examine the asymptotic properties of the operational almost unbiased estimator of regression coefficients which includes almost unbiased ordinary ridge estimator a s a special case. The small distrubance approximations for the bias and mean square error matrix of the estimator are derived. As a consequence, it is proved that, under certain conditions, the estimator is more efficient than a general class of estimators given by Vinod and Ullah (1981). Also it is shown that, if the ordinary ridge estimator (ORE) dominates the ordinary least squares estimator then the almost unbiased ordinary ridge estimator does not dominate ORE under the mean square error criterion.     

On a generalized stein estimator of regression coefficients

This paper studies a generalized Stein estimator of regression coefficients. The small disturbance approximations for the bias and mean square error matrix of the estimator are derived and a necessary and sufficient condition is obtained for the estimator to dominate the ordinary least squares estimator under the mean square error criterion.     

Comparisons of the <Emphasis Type="Italic">r</Emphasis> − <Emphasis Type="Italic">k</Emphasis> class estimator to the ordinary least squares estimator under the Pitman’s closeness criterion

In the presence of multicollinearity, the r − k class estimator is proposed as an alternative to the ordinary least squares (OLS) estimator which is a general estimator including the ordinary ridge regression (ORR), the principal components regression (PCR) and the OLS estimators. Comparison of competing estimators of a parameter in the sense of mean square error (MSE) criterion is of central interest. An alternative criterion to the MSE criterion is the Pitman’s (1937) closeness (PC) criterion. In this paper, we compare the r − k class estimator to the OLS estimator in terms of PC criterion so that we can get the comparison of the ORR estimator to the OLS estimator under the PC criterion which was done by Mason et al. (1990) and also the comparison of the PCR estimator to the OLS estimator by means of the PC criterion which was done by Lin and Wei (2002).     

An improved and efficient biased estimation technique in logistic regression model

Abstract

In this article, we propose a new improved and efficient biased estimation method which is a modified restricted Liu-type estimator satisfying some sub-space linear restrictions in the binary logistic regression model. We study the properties of the new estimator under the mean squared error matrix criterion and our results show that under certain conditions the new estimator is superior to some other estimators. Moreover, a Monte Carlo simulation study is conducted to show the performance of the new estimator in the simulated mean squared error and predictive median squared errors sense. Finally, a real application is considered.     

some properties of posterior pitman closeness

This article presents some results on a Bayesian notion of Pitman Closeness, defined in Ghosh and Sen (1991) and called Posterior Pitman Closeness (PPC). Their criterion avoids some of the drawbacks of the well-known (frequentist) Pitman closeness criterion, as introduced by Pitman (1937). It is shown that, if two estimators have the same posterior distribution of the distance from θ, the posterior distribution of θ has to be symmetric. This implies, in particular, that the estimators are Posterior Pitman equivalent. It is also shown that the PPC criterion does not suffer from another paradoxical property illustrated by Blyth and Pathak (1985) - that of an estimator δ₁ being stochastically closer to a parameter θ than another estimator δ₂ and yet being Pitman closer to θ than δ₁. It turns out that, if δ₁ is stochastically closer to θ than δ₂, conditional on x, then it is also Posterior Pitman closer.

We show that the original multivariate concept of PPC is no longer transitive. We provide necessary and sufficient conditions for a Posterior Pitman closest estimator to exist, thus generalizing Theorems 2 and 3 of Ghosh and Sen (1991). We show that a Posterior Pitman closest estimator does not always exist in several dimensions.     

A new stochastic mixed ridge estimator in linear regression model

This paper is concerned with the parameter estimation in linear regression model with additional stochastic linear restrictions. To overcome the multicollinearity problem, a new stochastic mixed ridge estimator is proposed and its efficiency is discussed. Necessary and sufficient conditions for the superiority of the stochastic mixed ridge estimator over the ridge estimator and the mixed estimator in the mean squared error matrix sense are derived for the two cases in which the parametric restrictions are correct and are not correct. Finally, a numerical example is also given to show the theoretical results.     

A note on generalized ridge estimators

It is shown that a necessary and sufficient condition derived by Farebrother (1984)for a generalized ridge estimator to dominate the ordinary least-squares estimator with respect to the mean-square-error-matrix criterion in the linear regression model admits a similar interpretation as the well known criterion of Toro-Viz-carrondo and Wallace (1968)for the dominance of a restricted least-squares estimator over the ordinary least-squares estimator. Two other properties of the generalized ridge estimators, referring to the concept of admissibility, are also pointed out.     

Estimated confidence under ancillary statistic everywhere-valid constraint

Consider the problem of estimating the coverage function of an usual confidence interval for a randomly chosen linear combination of the elements of the mean vector of a p-dimensional normal distribution. The usual constant coverage probability estimator is shown to be admissible under the ancillary statistic everywhere-valid constraint. Note that this estimator is not admissible under the usual sense if p⩾5. Since the criterion of admissibility under the ancillary statistic everywhere-valid constraint is a reasonable one, that the constant coverage probability estimator has been commonly accepted is justified.     

Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Exact small sample properties of an operational variant of the minimum mean squared error estimator

In this paper, we show a sufficient condition for an operational variant of the minimum mean squared error estimator (simply, the minimum MSE estimator) to dominate the ordinary least squares (OLS) estimator. It is also shown numerically that the minimum MSE estimator dominates the OLS estimator if the number of regression coefficients is larger than or equal to three, even if the sufficient condition is not satisfied. When the number of regression coefficients is smaller than three, our numerical results show that the gain in MSE of using the minimum MSE estimator is larger than the loss.     

A note on Pitman's measure of closeness with balanced loss function

In this note, we consider the problem of estimating an unknown parameter θ in the sense of the Pitman's measure of closeness (PMC) using the balanced loss function (BLF). We show that the PMC comparison of estimators under the BLF can be reduced to the PMC comparison under the usual absolute error loss. The Pitman-closest estimators of the location and scale parameters under BLF are also characterized. Illustrative examples are given to show the broad range applications of the obtained results.     

Minimax property of stein's estimator

Stein's estimator and some other estimators of the mean of a K-variate normal distribution are known to dominate the maximum likelihood estimator under quadratic loss for K > 3, and are therefore minimax. In this paper it is shown that the minimax property of Stein's rule is preserved with respect to a generalized loss function.     

An example arising from berkson's conjecture

Berkson (1980) conjectured that minimum x² was a superior procedure to that of maximum likelihood, especially with regard to mean squared error. To explore his conjecture, we analyze his (1955) bioassay problem related to logistic regression. We consider not only the criterion of mean squared error for the comparison of these estimators, but also include alternative criteria such as concentration functions and Pitman's measure of closeness. The choice of these latter criteria is motivated by Rao's (1981) considerations of the shortcomings of mean squared error. We also include several Rao-Blackwellized versions of the minimum logit x² the purpose of these comparisons.     

Generalized james-stein estimatoes

Let the p-component vector X be normally distributed with mean θ and covariance σ²I where I denotes the identity matrix. Stein's estimator of θ is kown to dominate the usual estimator X for p ≥ 3, We obtain a family of estimators which dominate Stein's estimator for p≥ 3     

The relative efficiency of the restricted estimators in linear regression models

This paper deals with the problem of multicollinearity in a multiple linear regression model with linear equality restrictions. The restricted two parameter estimator which was proposed in case of multicollinearity satisfies the restrictions. The performance of the restricted two parameter estimator over the restricted least squares (RLS) estimator and the ordinary least squares (OLS) estimator is examined under the mean square error (MSE) matrix criterion when the restrictions are correct and not correct. The necessary and sufficient conditions for the restricted ridge regression, restricted Liu and restricted shrunken estimators, which are the special cases of the restricted two parameter estimator, to have a smaller MSE matrix than the RLS and the OLS estimators are derived when the restrictions hold true and do not hold true. Theoretical results are illustrated with numerical examples based on Webster, Gunst and Mason data and Gorman and Toman data. We conduct a final demonstration of the performance of the estimators by running a Monte Carlo simulation which shows that when the variance of the error term and the correlation between the explanatory variables are large, the restricted two parameter estimator performs better than the RLS estimator and the OLS estimator under the configurations examined.     

A Note on Bayesian Analyses of Capture–Recapture Data with Perfect Recaptures

The present article deals with the problem of misspecifying the disturbance-covariance matrix as scalar, when it is locally non scalar. We consider a family of shrinkage estimators based on OLS estimator and compare its asymptotic properties with the properties of OLS estimator. We proposed a similar family of estimators based on FGLS and compared its asymptotic properties with the shrinkage estimator based on OLS under a Pitman's drift process. The effect of misspecifying the disturbances covariance matrix was analyzed with the help of a numerical simulation.     

Estimation and prediction in the presence of an outlier under Type-II censoring

A single-outlier data set containing some independent random variables is considered such that all of observations expect one have the same distribution. To describe the model of interested, a location-scale family of distributions is used and the estimation problem of the parameters is studied when the data are collected under Type-II censoring scheme. Moreover, three different predictors are presented to predict the censored order statistics. They are also compared regarding both of mean squared prediction error and Pitman's measure of closeness criteria. The role of outlier parameter as well as censorship rate is studied on performance of proposed estimator and predictors. The results of the paper are illustrated via a real data set. Finally, some conclusions are stated.