Improved Estimation of the Pareto Location Parameter Under Squared Error Loss

Suppose two independent observations are drawn from Pareto distributions with known shape parameters and an order restriction on the unknown location parameters. An isotonic regression estimator of the smaller location parameter dominates a preferred marginal estimator under squared error loss, but fails to dominate under stochastic domination. The results expressed herein advance the theory of order restricted inference.     

Parameter estimation under orthant restrictions

The authors consider the estimation of linear functions of a multivariate parameter under orthant restrictions. These restrictions are considered both for location models and for the Poisson distribution. For these models, situations are characterized for which the restricted maximum likelihood estimator dominates the unrestricted one for the estimation of any linear function of the parameter. The results obtained point directly to the importance of the dimension of the parameter space, the central direction of the cone and its vertex in these cases. Special attention is given to examples, such as the one‐way analysis of variance, where the estimation of individual interesting linear functions of the parameter, as the coordinates and the differences between them, is also treated.     

Universal domination of stein-type estimators

For the problem of estimating the location parameter of a p-variate spherically symmetric distribution (p>3), Hwang (1985) established the dominance of some positive-part James-Stein (1961) estimators over the usual estimator simultaneously under a very general class of loss function. Vie show that many of his results can be extended to a class of positive-part Baranchik-type estimators (1970).     

Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Improved confidence estimators for Fieller's confidence sets

Fieller's confidence set C_F for ratios of location parameters, although of great importance in practice, is often cited as an example to criticize frequentist theory. The reason is that the set can consist of the whole parameter space and yet the confidence is γ = 1 – α in any case. In this paper, we study the problem of constructing data-dependent estimators better than γ₊, A reasonable estimator appears to be γ₊, which is one if C_F is the whole parameter space and γ otherwise. By using an estimated confidence approach and a squared-error loss, it is shown that γ₊ dominates γ. The risk improvement of γ₊ over γ can be sizable. Also, by numerically comparing γ₊ with a generalized Bayes estimator γ_L, which is shown to be admissible when one or two ratios are concerned, it is shown that γ₊ is nearly admissible. We also conclude that the common practice of reporting 1 – α only when C_F is not the whole parameter space is nearly admissible.     

Understanding Estimators of Treatment Effects in Regression Discontinuity Designs

In this paper, we propose two new estimators of treatment effects in regression discontinuity designs. These estimators can aid understanding of the existing estimators such as the local polynomial estimator and the partially linear estimator. The first estimator is the partially polynomial estimator which extends the partially linear estimator by further incorporating derivative differences of the conditional mean of the outcome on the two sides of the discontinuity point. This estimator is related to the local polynomial estimator by a relocalization effect. Unlike the partially linear estimator, this estimator can achieve the optimal rate of convergence even under broader regularity conditions. The second estimator is an instrumental variable estimator in the fuzzy design. This estimator will reduce to the local polynomial estimator if higher order endogeneities are neglected. We study the asymptotic properties of these two estimators and conduct simulation studies to confirm the theoretical analysis.     

A new estimator of entropy

Vasicek (1976) proposed an estimator of entropy based on spacings. A new estimator of entropy is proposed. This new estimator is based on local linear regression. Comparisons between this new estimator and Vasicek's estimator are made. The mean square error (MSE) of the new estimator is consistently smaller than the MSE of Vasicek's estimator.     

The small sample properties of the restricted principal component regression estimator in linear regression model

In regression analysis, to deal with the problem of multicollinearity, the restricted principal components regression estimator is proposed. In this paper, we compared the restricted principal components regression estimator, the principal components regression estimator, and the ordinary least-squares estimator with each other under the Pitman's closeness criterion. We showed that the restricted principal components regression estimator is always superior to the principal components regression estimator, under certain conditions the restricted principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion and under certain conditions the principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion.     

On weak consistency in linear models with equi-correlated random errors

A new estimator in linear models with equi-correlated random errors is postulated. Consistency properties of the proposed estimator and the ordinary least squares estimator are studied. It is shown that the new estimator has smaller variance than the usual least squares estimator under some mild conditions. In addition, it is observed that the new estimator tends to be weakly consistent in many cases where the usual least squares estimator is not.     

A modified Liu-type estimator with an intercept term under mixture experiments

We consider ridge regression with an intercept term under mixture experiments. We propose a new estimator which is shown to be a modified version of the Liu-type estimator. The so-called compound covariate estimator is applied to modify the Liu-type estimator. We then derive a formula of the total mean squared error (TMSE) of the proposed estimator. It is shown that the new estimator improves upon existing estimators in terms of the TMSE, and the performance of the new estimator is invariant under the change of the intercept term. We demonstrate the new estimator using a real dataset on mixture experiments.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

Risk performance of a pre-test estimator for normal variance with the Stein-variance estimator under the LINEX loss function

In this paper, we derive the exact formula of the risk function of a pre-test estimator for normal variance with the Stein-variance (PTSV) estimator when the asymmetric LINEX loss function is used. Fixing the critical value of the pre-test to unity which is a suggested critical value in some sense, we examine numerically the risk performance of the PTSV estimator based on the risk function derived. Our numerical results show that although the PTSV estimator does not dominate the usual variance estimator when under-estimation is more severe than over-estimation, the PTSV estimator dominates the usual variance estimator when over-estimation is more severe. It is also shown that the dominance of the PTSV estimator over the original Stein-variance estimator is robust to the extension from the quadratic loss function to the LINEX loss function.     

A Generalized Stochastic Restricted Ridge Regression Estimator

In this article, we introduce a new stochastic restricted estimator for the unknown vector parameter in the linear regression model when stochastic linear restrictions on the parameters hold. We show that the new estimator is a generalization of the ordinary mixed estimator (OME), Liu estimator (LE), ordinary ridge estimator (ORR), (k-d) class estimator, stochastic restricted Liu estimator (SRLE), and stochastic restricted ridge estimator (SRRE). Performance of the new estimator in comparison to other estimators in terms of the mean squares error matrix (MMSE) is examined. Numerical example from literature have been given to illustrate the results.     

The effects of the proxy information on the iterative Stein-rule estimator of the disturbance variance

In a regression model with proxy variables, we consider the iterative estimator of the disturbance variance to obtain more precise estimates. In the formula of the estimator of the disturbance variance, the estimator is obtained by using Stein-rule (SR) estimator instead of OLS (ordinary least squares) estimator is called Iterative estimator of the disturbance variance. It is shown that, in a regression model with proxy variables the mean square error (MSE) of the iterative estimator of the disturbance variance is greater than the MSE of the disturbance variance related to the OLS estimator under certain conditions.     

Bias Corrected Maximum Likelihood Estimator Under the Generalized Linear Model for a Binary Variable

Under the generalized linear models for a binary variable, an approximate bias of the maximum likelihood estimator of the coefficient, that is a special case of linear parameter in Cordeiro and McCullagh (1991), is derived without a calculation of the third-order derivative of the log likelihood function. Using the obtained approximate bias of the maximum likelihood estimator, a bias-corrected maximum likelihood estimator is defined. Through a simulation study, we show that the bias-corrected maximum likelihood estimator and its variance estimator have a better performance than the maximum likelihood estimator and its variance estimator.     

基于半参数方法的模型辅助抽样估计研究

在总结现有模型辅助估计方法的基础上,本文通过构造一种半参数超总体模型,同时结合广义差分估计思想提出一种新型的模型辅助估计量。该估计量比传统的非参数和半参数回归估计利用更少、更易得到的辅助信息,即只需利用和广义回归估计相同的辅助信息,但一般会比广义回归估计拥有更高的估计精度。理论证明了该估计量是渐近设计无偏和设计一致的,其渐近设计均方误差为广义差分估计量的方差。模拟结果显示：其至少与广义回归估计一样好;对于线性程度越低的超总体模型,其估计精度比广义回归估计有越明显的提高;就本文模拟而言,光滑参数在0.04～0.12间适当取值时其会取到相对较好的估计效果。     

A non stochastic ridge regression estimator and comparison with the James-Stein estimator

Abstract

This article presents a non-stochastic version of the Generalized Ridge Regression estimator that arises from a discussion of the properties of a Generalized Ridge Regression estimator whose shrinkage parameters are found to be close to their upper bounds. The resulting estimator takes the form of a shrinkage estimator that is superior to both the Ordinary Least Squares estimator and the James-Stein estimator under certain conditions. A numerical study is provided to investigate the range of signal to noise ratio under which the new estimator dominates the James-Stein estimator with respect to the prediction mean square error.     

A likelihood based estimator for vector autoregressive processes

A onestep estimator, which is an approximation to the unconditional maximum likelihood estimator (MLE) of the coefficient matrices of a Gaussian vector autoregressive process is presented. The onestep estimator is easy to compute and can be computed using standard software. Unlike the computation of the unconditional MLE, the computation of the onestep estimator does not require any iterative optimization and the computation is numerically stable. In finite samples the onestep estimator generally has smaller mean square error than the ordinary least squares estimator. In a simple model, where the unconditional MLE can be computed, numerical investigation shows that the onestep estimator is slightly worse than the unconditional MLE in terms of mean square error but superior to the ordinary least squares estimator. The limiting distribution of the onestep estimator for processes with some unit roots is derived.     

An inverse-probability-weighted approach to the estimation of distribution function with middle-censored data

In this article, we propose an inverse-probability-weighted (IPW) estimator of distribution function for middle-censored data. By Jammalamadaka and Mangalam (2003), the IPW estimator is the nonparametric maximum likelihood estimator (NPMLE) when all censored intervals contain at least one uncensored observation. The asymptotic properties of the IPW estimator are derived. A simulation study is conducted to compare the performance between the IPW estimator and the self-consistent estimator (SCE). Simulation results indicate that the performance of the IPW estimator is close to that of the SCE.     

A polar coordinate transformation for estimating bivariate survival functions with randomly censored and truncated data

This paper proposes a new estimator for bivariate distribution functions under random truncation and random censoring. The new method is based on a polar coordinate transformation, which enables us to transform a bivariate survival function to a univariate survival function. A consistent estimator for the transformed univariate function is proposed. Then the univariate estimator is transformed back to a bivariate estimator. The estimator converges weakly to a zero-mean Gaussian process with an easily estimated covariance function. Consistent truncation probability estimate is also provided. Numerical studies show that the distribution estimator and truncation probability estimator perform remarkably well.