Comparisons of the <Emphasis Type="Italic">r</Emphasis> − <Emphasis Type="Italic">k</Emphasis> class estimator to the ordinary least squares estimator under the Pitman’s closeness criterion

In the presence of multicollinearity, the r − k class estimator is proposed as an alternative to the ordinary least squares (OLS) estimator which is a general estimator including the ordinary ridge regression (ORR), the principal components regression (PCR) and the OLS estimators. Comparison of competing estimators of a parameter in the sense of mean square error (MSE) criterion is of central interest. An alternative criterion to the MSE criterion is the Pitman’s (1937) closeness (PC) criterion. In this paper, we compare the r − k class estimator to the OLS estimator in terms of PC criterion so that we can get the comparison of the ORR estimator to the OLS estimator under the PC criterion which was done by Mason et al. (1990) and also the comparison of the PCR estimator to the OLS estimator by means of the PC criterion which was done by Lin and Wei (2002).     

Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Shrunken estimators via a pitman nearness criterion

Shrunken estimators have traditionally been developed and studied using mean square error (MSE). Recent research on Pitman nearness (PN), however, indicates that it is an interesting, “intrinsic”, alternative to the mean square error (MSE) criterion for investigating estimators. Thus, we develop a shrunken estimator for the mean of a multivariate normal distribution based on minimizing PN, instead of MSE, Further, since the shrinkage factor of this estimator depends on unknown parameters, we examine two approaches for determining this factor: (1) “plug-in” estimates, (2) a range of values for the factor based on an approximate cońfidence interval for the Pitman Nearness probability. A numerical example is given.     

Comparison of the Stein and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted

This paper compares the Stein and the usual estimators of the error variance under the Pitman nearness (PN) criterion in a regression model which is mis-specified due to missing relevant explanatory variables. The exact expression of the PN-probability is derived and numerically evaluated. Contrary to the well-known result under mean squared errors (MSE), with the PN criterion the Stein variance estimator is uniformly dominated by the usual estimator when no relevant variables are excluded from the model. With an increased degree of model mis-specification, neither estimator strictly dominates the other. The authors are grateful to two anonymous referees for their valuable comments. Also, the first author is grateful to the Japan Society for the Promotion of Science for partial financial support.     

PMSE performance of two different types of preliminary test estimators under a multivariate t error term

Abstract

In this paper, assuming that the error terms follow a multivariate t distribution, we derive the exact formula for the predictive mean squared error (PMSE) of two different types of pretest estimators. It is shown analytically that one of the pretest estimator dominates the SR estimator if a critical value of the pretest is chosen appropriately. Also, we compare the PMSE of the pretest estimators with the MMSE, AMMSE, SR and PSR estimators by numerical evaluations. Our results show that the pretest estimators dominate the OLS estimator for all combinations when the degrees of freedom is not more than 5.     

Ridge regression versus ols by pitman's closeness under quadratic and fisher's loss

The existence of values of the ridge parameter such that ridge regression is preferable to OLS by the Pitman nearness criterion under both the quadratic and the Fisher's loss is shown. Preference regions of the two estimators under the above loss functions are found. An upper bound for the value of the Pitman's measure of closeness, independent of a deterministic or stochastic choice of the ridge parameter, is given.     

Performance of Kibria's Method for the Heteroscedastic Ridge Regression Model: Some Monte Carlo Evidence

It is common for a linear regression model that the error terms display some form of heteroscedasticity and at the same time, the regressors are also linearly correlated. Both of these problems have serious impact on the ordinary least squares (OLS) estimates. In the presence of heteroscedasticity, the OLS estimator becomes inefficient and the similar adverse impact can also be found on the ridge regression estimator that is alternatively used to cope with the problem of multicollinearity. In the available literature, the adaptive estimator has been established to be more efficient than the OLS estimator when there is heteroscedasticity of unknown form. The present article proposes the similar adaptation for the ridge regression setting with an attempt to have more efficient estimator. Our numerical results, based on the Monte Carlo simulations, provide very attractive performance of the proposed estimator in terms of efficiency. Three different existing methods have been used for the selection of biasing parameter. Moreover, three different distributions of the error term have been studied to evaluate the proposed estimator and these are normal, Student's t and F distribution.     

Comparison of normal variance estimators under multiple criteria and towards a compromise estimator

For estimating a normal variance under the squared error loss function it is well known that the best affine (location and scale) equivariant estimator, which is better than the maximum likelihood estimator as well as the unbiased estimator, is also inadmissible. The improved estimators, e.g., stein type, brown type and Brewster–Zidek type, are all scale equivariant but not location invariant. Lately, a good amount of research has been done to compare the improved estimators in terms of risk, but comparatively less attention had been paid to compare these estimators in terms of the Pitman nearness criterion (PNC) as well as the stochastic domination criterion (SDC). In this paper, we have undertaken a comprehensive study to compare various variance estimators in terms of the PNC and the SDC, which has been long overdue. Finally, using the results for risk, the PNC and the SDC, we propose a compromise estimator (sort of a robust estimator) which appears to work ‘well’ under all the criteria discussed above.     

On the Nearness of Records to Population Quantiles with Respect to Order Statistics in the Sense of Pitman Closeness

In this paper, Pitman closeness criterion is used to compare the nearness of record values and order statistics from two independent samples to a specific population quantile of the parent distribution while the underlying distributions are the same. General expressions for the associated Pitman closeness probability are obtained when the support of the parent distribution is bounded and also unbounded. Some distribution-free results are achieved for symmetric distributions. The exponential and uniform distributions are considered for illustrative proposes and exact expressions are obtained in each case.     

some properties of posterior pitman closeness

This article presents some results on a Bayesian notion of Pitman Closeness, defined in Ghosh and Sen (1991) and called Posterior Pitman Closeness (PPC). Their criterion avoids some of the drawbacks of the well-known (frequentist) Pitman closeness criterion, as introduced by Pitman (1937). It is shown that, if two estimators have the same posterior distribution of the distance from θ, the posterior distribution of θ has to be symmetric. This implies, in particular, that the estimators are Posterior Pitman equivalent. It is also shown that the PPC criterion does not suffer from another paradoxical property illustrated by Blyth and Pathak (1985) - that of an estimator δ₁ being stochastically closer to a parameter θ than another estimator δ₂ and yet being Pitman closer to θ than δ₁. It turns out that, if δ₁ is stochastically closer to θ than δ₂, conditional on x, then it is also Posterior Pitman closer.

We show that the original multivariate concept of PPC is no longer transitive. We provide necessary and sufficient conditions for a Posterior Pitman closest estimator to exist, thus generalizing Theorems 2 and 3 of Ghosh and Sen (1991). We show that a Posterior Pitman closest estimator does not always exist in several dimensions.     

Pitman closeness,monotonicity and consistency of best linear unbiased and invariant estimators for exponential distribution under Type II censoring

Comparisons of best linear unbiased estimators with some other prominent estimators have been carried out over the last 50 years since the ground breaking work of Lloyd [E.H. Lloyd, Least squares estimation of location and scale parameters using order statistics, Biometrika 39 (1952), pp. 88–95]. These comparisons have been made under many different criteria across different parametric families of distributions. A noteworthy one is by Nagaraja [H.N. Nagaraja, Comparison of estimators and predictors from two-parameter exponential distribution, Sankhyā Ser. B 48 (1986), pp. 10–18], who made a comparison of best linear unbiased (BLUE) and best linear invariant (BLIE) estimators in the case of exponential distribution. In this paper, continuing along the same lines by assuming a Type II right censored sample from a scaled-exponential distribution, we first compare BLUE and BLIE of the exponential mean parameter in terms of Pitman closeness (nearness) criterion. We show that the BLUE is always Pitman closer than the BLIE. Next, we introduce the notions of Pitman monotonicity and Pitman consistency, and then establish that both BLUE and BLIE possess these two properties.     

Simulated deficiencies of robust estimators of a proportionality constant

In linear regression, robust methods are at the beginning of their use in practice. In the small sample case, such robust methods provide a necessary measure of protection against deviations from the assumed error distribution. This paper studies through simulation the deficiencies of bioptimal estimators and compares them with more common methods like Huber's estimator or Tukey's estimator. Polyoptimal estimators are convex combinations of Pitman estimators and are optimally robust for a confrontation containing several shapes. The word confrontation is due to J.W. Tukey. It expresses the situation when compromising two or several error distributions. The paper uses the confrontation containing the Gaussian distribution along with a symmetric heavy-tailed distribution having a tail of order 0(t^-2) as t→ ±∞.     

On a class of nonparametric tests for the treatment vs control problem

The classical problem of testing treatment versus control is revisited by considering a class of test statistics based on a kernel that depends on a constant ‘a’. The proposed class includes the celebrated Wilcoxon-Mann-Whitnet statistics as a special case when ‘a’=1. It is shown that, with optimal choice of ‘a’ depending on the underlying distribution, the optimal member performs better (in terms of Pitman efficiency) than the Wilcoxon-Mann-Whitney and the Median tests for a wide range of underlying distributions. An extended Hodges-Lehmann type point estimator of the shift prameter corresponding to the proposed ‘optimal’ test statistic is also derived.     

THE SMALL SAMPLE PROPERTIES OF THE PRINCIPAL COMPONENTS ESTIMATOR FOR REGRESSION COEFFICIENTS

ABSTRACT

Under the mean square error matrix (MSEM) criterion and Pitman closeness (PC) criterion, the principal components estimator (PRCE) is compared with the least square estimator (LSE) and the superiority of PRCE over LSE is achieved respectively. Finally, we examine the superiority of PRCE predictor over the LSE predictor based on these two criteria.     

Asymptotic properties of the ols and grls estimator for the replicated functional relationship model

For the simple linear functional relationship model with replication, the asymptotic properties of the ordinary (OLS) and grouping least squares (GRLS) estimator of the slope are investi- gated under the assumption of normally distributed errors with unknown covariance matrix. The relative performance of the OLS and GRLS estimator is compared in terms of the asymptotic mean square error, and a set of critical parameters are identified for determining the dominance of one estimator over the other. It is also shown that the GRLS estimator is asymptoticallyequivalent to the maximum likelihood (ML) estimator under the given assumptions.     

Peculiar bias properties of the ols estimator when applied to a dynamic model with autocorrelated disturbances

This study reveals that contrary to the conventional wisdom among econometricians, the bias of the OLS estimator can be quite small when the estimator is applied to a geometrically distributed lag model, y_t<ce:glyph name="dbnd6"/> α + βx _t+ λy _t-₁. + u_t, with autocorrelated disturbances, be they AR(1), MA(1), MA(2), AR(2), and ARMA(1,1). This happens when λ is large and x_tis smoothly trended (e.g., a real GNP series). In fact, the bias of the OLS estimator becomes zero at one parameter combination, and the OLS estimator performs well over a wide range around this parameter combination. By decomposing the disturbance term into two parts, the paper also explains why OLS shows such an unexpected property. These findings have both pedagogical and practical significance.     

Combining the unrestricted estimators into a single estimator and a simulation study on the unrestricted estimators

The purpose of this paper is to combine several regression estimators (ordinary least squares (OLS), ridge, contraction, principal components regression (PCR), Liu, r?k and r?d class estimators) into a single estimator. The conditions for the superiority of this new estimator over the PCR, the r?k class, the r?d class, β?(k, d), OLS, ridge, Liu and contraction estimators are derived by the scalar mean square error criterion and the estimators of the biasing parameters for this new estimator are examined. Also, a numerical example based on Hald data and a simulation study are used to illustrate the results.     

Pitman-closeness of some preliminary test and shrinkage estimators

For the model X ～ N_p: (θ,I)preliminary test estimator (PTE), shrinkage and positive-rule versions of the MLE (X) of θare mutually compared in the light of the Pitman closeness measure. The usual dominance properties of these estimators pertaining to the conventional quadratic loss criterion are shown to remain intact in the current context too. In an asymptotic setup, the conclusions hold for a much wider class of estimators pertaining to general parametric and nonparametric models.     

Error misspecification and properties of the simple ridge estimator

This paper gives necessary and sufficient conditions for the ridge estimator applied to an error misspecified regression model to dominate the generalised least squares estimator. It is shown that the requirements for mean square error dominance are more stringent than in the correct specification case.     

Comparison of estimators of a dispersion matrix under generalized pitman nearness criterion

Some equivariant estimators of the dispersion matrix of a multivariate normal population are compared using the generalized Pitman nearness criterion based on the entropy loss function. It is shown that, under the group of lower triangular transformations, a best equivariant estimator does not exist. Existence of best estimators in certain subclasses are discussed and the performances of two commonly used estimators are compared. Some properties of central chi-square distributions are obtained and used to derive the main results.