Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Impacts of auxiliary information on outliers in regression

Iheil and Goldberger (1961) and Theil (1963) founded the mixed regression approach, Their mixed regression estimator is essentially a large class of estimators that includes ridge, generalized ridge and shrinkage estimators, Properties of these estimators when data contain outliers have not been examined extensively. The present investigation shows that the mixed regression estimator, when observationsare subject to shift in means and variances, is uniformly superior, in terms of squared bias and variance, to the least squares estimator.     

A comparison of mixed and minimax estimators of linear models

In this paper the stochastic properties of two estimators of linear models, mixed and minimax, based on different types of prior information, are compared using quadratic risk as the criterion for superiority. A necessary and sufficient condition for the minimax estimator to be superior to the comparable mixed estimator is derived as well as a simpler necessary but not sufficient condition.     

A synthesis of stein-rule and mixed regression procedures inlinear regression models under non-normality

Stein-rule philosophy and mixed regression technique are combined to develop two families of improved estimators of regression coefficients in the linear regression model under incomplete prior information. The properties of these estimators are studied when disturbances are small and non-normal. Conditions for their dominance over mixed regression estimator are derived taking risk as the criterion for performance.     

Exclusion restrictions in instrumental variables equations

In this paper we consider two-stage estimators of parameters of a structural equation in a model with recursive exclusion restrictions on the instrumental variables equations. The estimations considered are simple OLS and GLS estimators after substitution of estimates of the systematic part of the IV equations for the endogenous variables. It is known in the literature that neither imposing the restrictions in the first stage nor ignoring them will in general be more efficient than the alternative. We introduce a class of mixed instrumental variables estimators (MIV) with these possibilities as special cases which yields an estimator which is not only more efficient than the two stage estimators considered in the literature but as efficient as an efficient system estimator like 3SLS.     

Recovery of inter-block information: extensions in a two variance component model

For a two variance component mixed linear model, it is shown that under suitable conditions there exists a nonlinear unbiased estimator that is better than a best linear unbiased estimator defined with respect to a given singular covariance matrix. It is also shown how this result applies to improving on intra-block estimators and on estimators like the unweighted means estimator in a random one-way model.     

Exclusion restrictions in instrumental variables equations

In this paper we consider two-stage estimators of parameters of a structural equation in a model with recursive exclusion restrictions on the instrumental variables equations. The estimations considered are simple OLS and GLS estimators after substitution of estimates of the systematic part of the IV equations for the endogenous variables. It is known in the literature that neither imposing the restrictions in the first stage nor ignoring them will in general be more efficient than the alternative. We introduce a class of mixed instrumental variables estimators (MIV) with these possibilities as special cases which yields an estimator which is not only more efficient than the two stage estimators considered in the literature but as efficient as an efficient system estimator like 3SLS.     

Estimation in a linear regression model with stochastic linear restrictions: a new two-parameter-weighted mixed estimator

The present paper considers the weighted mixed regression estimation of the coefficient vector in a linear regression model with stochastic linear restrictions binding the regression coefficients. We introduce a new two-parameter-weighted mixed estimator (TPWME) by unifying the weighted mixed estimator of Schaffrin and Toutenburg [1] and the two-parameter estimator (TPE) of Özkale and Kaç?ranlar [2]. This new estimator is a general estimator which includes the weighted mixed estimator, the TPE and the restricted two-parameter estimator (RTPE) proposed by Özkale and Kaç?ranlar [2] as special cases. Furthermore, we compare the TPWME with the weighted mixed estimator and the TPE with respect to the matrix mean square error criterion. A numerical example and a Monte Carlo simulation experiment are presented by using different estimators of the biasing parameters to illustrate some of the theoretical results.     

Maximum likelihood drift estimation for a threshold diffusion

We study the maximum likelihood estimator of the drift parameters of a stochastic differential equation, with both drift and diffusion coefficients constant on the positive and negative axis, yet discontinuous at zero. This threshold diffusion is called drifted oscillating Brownian motion. For this continuously observed diffusion, the maximum likelihood estimator coincides with a quasi-likelihood estimator with constant diffusion term. We show that this estimator is the limit, as observations become dense in time, of the (quasi)-maximum likelihood estimator based on discrete observations. In long time, the asymptotic behaviors of the positive and negative occupation times rule the ones of the estimators. Differently from most known results of the literature, we do not restrict ourselves to the ergodic framework: indeed, depending on the signs of the drift, the process may be ergodic, transient, or null recurrent. For each regime, we establish whether or not the estimators are consistent; if they are, we prove the convergence in long time of the properly rescaled difference of the estimators towards a normal or mixed normal distribution. These theoretical results are backed by numerical simulations.     

Improvement of generalized difference-based mixed Liu estimator in partially linear model

In this paper, a generalized difference-based mixed Liu estimator in partially linear model is presented, when it is supposed that the regression parameter may be restricted to a subspace and compare the proposed estimators in the sense of matrix mean squared error criteria. Finally a simulation study is presented to show the performance of the estimators.     

Mixed Liu estimator in linear measurement error models

In this paper, we introduce mixed Liu estimator (MLE) for the vector of parameters in linear measurement error models by unifying the sample and the prior information. The MLE is a generalization of the mixed estimator (ME) and Liu estimator (LE). In particular, asymptotic normality properties of the estimators are discussed, and the performance of the MLE over the LE and ME are compared based on mean squared error matrix (MSEM). Finally, a Monte Carlo simulation and a numerical example are also presented for analysis.     

ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

Role of weights in improving the efficiency of Kim and Warde's mixed randomized response model

ABSTARCT

In this paper we have suggested a class of unbiased estimators of π_S, the proportion of respondents possessing a sensitive attribute A using mixed randomized response model. The variance of the proposed class of estimators has been obtained. In addition to Kim and Warde's (2005) estimator, several other acceptable estimators of π_S have been identified from the proposed class for suitable weights. It has been shown that the newly identified estimators are more efficient than the Kim and Warde's (2005) estimator. Numerical illustrations and graphs are also given in support of the present study.     

A new stochastic mixed Liu estimator in linear regression model

Abstract

To overcome multicollinearity, a new stochastic mixed Liu estimator is presented and its efficiency is considered. We also compare the proposed estimators in the sense of matrix mean squared error criteria. Finally a numerical example and a simulation study are given to show the performance of the estimators.     

Estimation of three-parameter exponentiated-Weibull distribution under type-II censoring

The present article obtains the point estimators of the exponentiated-Weibull parameters when all the three parameters of the distribution are unknown. Maximum likelihood estimator generalized maximum likelihood estimator and Bayes estimators are proposed for three-parameter exponentiated-Weibull distribution when available sample is type-II censored. Independent non-informative types of priors are considered for the unknown parameters to develop generalized maximum likelihood estimator and Bayes estimators. Although the proposed estimators cannot be expressed in nice closed forms, these can be easily obtained through the use of appropriate numerical techniques. The performances of these estimators are studied on the basis of their risks, computed separately under LINEX loss and squared error loss functions through Monte-Carlo simulation technique. An example is also considered to illustrate the estimators.     

Pairwise likelihood estimation for multivariate mixed Poisson models generated by Gamma intensities

Estimating the parameters of multivariate mixed Poisson models is an important problem in image processing applications, especially for active imaging or astronomy. The classical maximum likelihood approach cannot be used for these models since the corresponding masses cannot be expressed in a simple closed form. This paper studies a maximum pairwise likelihood approach to estimate the parameters of multivariate mixed Poisson models when the mixing distribution is a multivariate Gamma distribution. The consistency and asymptotic normality of this estimator are derived. Simulations conducted on synthetic data illustrate these results and show that the proposed estimator outperforms classical estimators based on the method of moments. An application to change detection in low-flux images is also investigated.     

Two Stochastic Restricted Principal Components Regression Estimator in Linear Regression

In this article, we propose two stochastic restricted principal components regression estimator by combining the approach followed in obtaining the ordinary mixed estimator and the principal components regression estimator in linear regression model. The performance of the two new estimators in terms of matrix MSE criterion is studied. We also give an example and a Monte Carlo simulation to show the theoretical results.     

k-Step shape estimators based on spatial signs and ranks

In this paper, the shape matrix estimators based on spatial sign and rank vectors are considered. The estimators considered here are slight modifications of the estimators introduced in Dümbgen (1998) and Oja and Randles (2004) and further studied for example in Sirkiä et al. (2009). The shape estimators are computed using pairwise differences of the observed data, therefore there is no need to estimate the location center of the data. When the estimator is based on signs, the use of differences also implies that the estimators have the so called independence property if the estimator, that is used as an initial estimator, has it. The influence functions and limiting distributions of the estimators are derived at the multivariate elliptical case. The estimators are shown to be highly efficient in the multinormal case, and for heavy-tailed distributions they outperform the shape estimator based on sample covariance matrix.     

Admissibility of linear estimators with respect to restricted parameter sets

In this paper the admissibility of a linear estimator for a linear regression parameter is characterized for such cases, where the considered parameter varies in an ellipsoid. We obtain a certain subset of the set of all linear estimators which are admissible with respect to the unrestricted parameter set. Furthermore, various linear estimators which have been proposed for improving the least squares estimator in cases of a restricted parameter set are investigated for admissibility. It turns out that only some shrunken estimators and some estimators of ridge type are admissible, whereas the KUKS-OLMAN estimator and all estimators of MARQUARDT type can be improved.     

Some Applications of the Rao Distance to Shrinkage Estimators

Bayesian statistics is concerned with how prior information influence inferences. This article studies this problem by comparing the value of the Rao distance between prior and posterior normal distributions. Particular cases include the linear Bayes estimator, the mixed estimator, and ridge-type estimators.