New shrinkage-type estimators in a linear regression model when multicollinearity is severe

For the linear regression model y=Xβ+e with severe multicollinearity, we put forward three shrinkage-type estimators based on the ordinary least-squares estimator including two types of independent factor estimators and a seemingly convex combination. The simulation study shows that the new estimators are not good enough when multicollinearity is mild to moderate, but perform very well when multicollinearity is severe to very severe.     

Best linear unbiased and invariant estimation in location-scale families based on double-ranked set sampling

Abstract

In this article, we propose the best linear unbiased estimators (BLUEs) and best linear invariant estimators (BLIEs) for the unknown parameters of location-scale family of distributions based on double-ranked set sampling (DRSS) using perfect and imperfect rankings. These estimators are then compared with the BLUEs and BLIEs based on ranked set sampling (RSS). It is shown that under perfect ranking, the proposed estimators are uniformly better than the BLUEs and BLIEs obtained via RSS. We also propose the best linear unbiased quantile (BLUQ) and the best linear invariant quantile (BLIQ) estimators for normal distribution under DRSS. It is observed that the proposed quantile estimators are more efficient than the BLUQ and BLIQ estimators based on RSS for both perfect and imperfect orderings.     

Superiority of the r-k class estimator over some estimators in a misspecified linear model

ABSTRACT

In this article, we discuss the superiority of r-k class estimator over some estimators in a misspecified linear model. We derive the necessary and sufficient conditions for the superiority of the r-k class estimator over each of these estimators under the Mahalanobis loss function by the average loss criterion in the misspecified linear model.     

Improved ridge estimators in a linear regression model

In this paper, the notion of the improved ridge estimator (IRE) is put forward in the linear regression model y=X β+e. The problem arises if augmenting the equation 0=c′α+ε instead of 0=C α+? to the model. Three special IREs are considered and studied under the mean-squared error criterion and the prediction error sum of squares criterion. The simulations demonstrate that the proposed estimators are effective and recommendable, especially when multicollinearity is severe.     

Best minimum bias linear estimators in gauss-markoff model

In this note we present a criterion for linear estimation which is similar to MV-MB-LE of Rao (1978) in Gauss-Markoff model (Y, XB, α²G). We call this criterion MMS-MB-LE (Minimum Mean Square Error-Minimum Bias-Linear Estimation)> Representations of solutions to such estimators similar to those of Rao (1978) are provided.     

Improved best linear unbiased estimators for the simple linear regression model using double ranked set sampling schemes

ABSTRACT

In this paper, we consider the best linear unbiased estimators (BLUEs) based on double ranked set sampling (DRSS) and ordered DRSS (ODRSS) schemes for the simple linear regression model with replicated observations. We assume three symmetric distributions for the random error term, i.e., normal, Laplace and some scale contaminated normal distributions. The proposed BLUEs under DRSS (BLUEs-DRSS) and ODRSS (BLUEs-ODRSS) are compared with the BLUEs based on ordered simple random sampling (OSRS), ranked set sampling (RSS), and ordered RSS (ORSS) schemes. These estimators are compared in terms of relative efficiency (RE), RE of determinant (RED), and RE of trace (RET). It is found that the BLUEs-ODRSS are uniformly better than the BLUEs based on OSRS, RSS, ORSS, and DRSS schemes. We also compare the estimators based on imperfect RSS (IRSS) schemes. It is worth mentioning here that the BLUEs under ordered imperfect DRSS (OIDRSS) are better than their counterparts based on IRSS, ordered IRSS (OIRSS), and imperfect DRSS (IDRSS) methods. Moreover, for sensitivity analysis of the BLUEs, we calculate REs and REDs of the BLUEs under the assumption of normality when in fact the parent distribution follows a non normal symmetric distribution. It turns out that even under violation of normality assumptions, BLUEs of the intercept and the slope parameters are found to be unbiased with equal REs under each sampling scheme. It is also observed that the BLUEs under ODRSS are more efficient than the existing BLUEs.     

Ordered partially ordered judgment subset sampling with applications to parametric inference

ABSTRACT

In this paper, we use the idea of order statistics from independent and non-identically distributed random variables to propose ordered partially ordered judgment subset sampling (OPOJSS) and then develop optimal linear parametric inferences. The best linear unbiased and invariant estimators of the location and scale parameters of a location-scale family are developed based on OPOJSS. It is shown that, despite the presence or absence of ranking errors, the proposed estimators with OPOJSS are uniformly better than the existing estimators with simple random sampling (SRS), ranked set sampling (RSS), ordered RSS (ORSS) and partially ordered judgment subset sampling (POJSS). Moreover, we also derive the best linear unbiased estimators (BLUEs) of the unknown parameters of the simple linear regression model with replicated observations using POJSS and OPOJSS. It is found that the BLUEs with OPOJSS are more precise than the BLUEs based on SRS, RSS, ORSS and POJSS.     

Best linear unbiased estimators of parameters of a simple linear regression model based on ordered ranked set samples

As an alternative to an estimation based on a simple random sample (BLUE-SRS) for the simple linear regression model, Moussa-Hamouda and Leone [E. Moussa-Hamouda and F.C. Leone, The o-blue estimators for complete and censored samples in linear regression, Technometrics, 16 (3) (1974), pp. 441–446.] discussed the best linear unbiased estimators based on order statistics (BLUE-OS), and showed that BLUE-OS is more efficient than BLUE-SRS for normal data. Using the ranked set sampling, Barreto and Barnett [M.C.M. Barreto and V. Barnett, Best linear unbiased estimators for the simple linear regression model using ranked set sampling. Environ. Ecoll. Stat. 6 (1999), pp. 119–133.] derived the best linear unbiased estimators (BLUE-RSS) for simple linear regression model and showed that BLUE-RSS is more efficient for the estimation of the regression parameters (intercept and slope) than BLUE-SRS for normal data, but not so for the estimation of the residual standard deviation in the case of small sample size. As an alternative to RSS, this paper considers the best linear unbiased estimators based on order statistics from a ranked set sample (BLUE-ORSS) and shows that BLUE-ORSS is uniformly more efficient than BLUE-RSS and BLUE-OS for normal data.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

Projectors and linear estimation in general linear models

The paper gives a self-contained account of minimum disper­sion linear unbiased estimation of the expectation vector in a linear model with the dispersion matrix belonging to some, rather arbitrary, set of nonnegative definite matrices. The approach to linear estimation in general linear models recommended here is a direct generalization of some ideas and results presented by Rao (1973, 19 74) for the case of a general Gauss-Markov model

A new insight into the nature of some estimation problems originaly arising in the context of a general Gauss-Markov model as well as the correspondence of results known in the literature to those obtained in the present paper for general linear models are also given. As preliminary results the theory of projectors defined by Rao (1973) is extended.     

Adaptive ridge estimator in a linear regression model with spherically symmetric error under constraint

Abstract

We consider adaptive ridge regression estimators in the general linear model with homogeneous spherically symmetric errors. A restriction on the parameter of regression is considered. We assume that all components are non negative (i.e. on the positive orthant). For this setting, we produce under general quadratic loss such estimators whose risk function dominates that of the least squares provided the number of regressors in the least fore.     

Jackknife Estimation for Smooth Functions of the Parametric Component in Partially Linear Regression Models

Abstract

It is known that due to the existence of the nonparametric component, the usual estimators for the parametric component or its function in partially linear regression models are biased. Sometimes this bias is severe. To reduce the bias, we propose two jackknife estimators and compare them with the naive estimator. All three estimators are shown to be asymptotically equivalent and asymptotically normally distributed under some regularity conditions. However, through simulation we demonstrate that the jackknife estimators perform better than the naive estimator in terms of bias when the sample size is small to moderate. To make our results more useful, we also construct consistent estimators of the asymptotic variance, which are robust against heterogeneity of the error variances.     

Partly linear models on Riemannian manifolds

In partly linear models, the dependence of the response y on (x ^T, t) is modeled through the relationship y=x ^T β+g(t)+?, where ? is independent of (x ^T, t). We are interested in developing an estimation procedure that allows us to combine the flexibility of the partly linear models, studied by several authors, but including some variables that belong to a non-Euclidean space. The motivating application of this paper deals with the explanation of the atmospheric SO₂ pollution incidents using these models when some of the predictive variables belong in a cylinder. In this paper, the estimators of β and g are constructed when the explanatory variables t take values on a Riemannian manifold and the asymptotic properties of the proposed estimators are obtained under suitable conditions. We illustrate the use of this estimation approach using an environmental data set and we explore the performance of the estimators through a simulation study.     

A new stochastic mixed Liu estimator in linear regression model

Abstract

To overcome multicollinearity, a new stochastic mixed Liu estimator is presented and its efficiency is considered. We also compare the proposed estimators in the sense of matrix mean squared error criteria. Finally a numerical example and a simulation study are given to show the performance of the estimators.     

Order statistics from extreme value distribution,ii: best linear unbiased estimates and some other uses

Let Y_r+1:n ≤ _Y:r+2:n ≤≤… <Y_n?6:n-<: TYPE-II censored sample from an extreme value population with µ and α as the location and scale parameters, respectively. Tables of coefficients for the best linear unbiased estimators (BLUEs) of µ and α are presented for various choices of censoring and sample sizes n = 2(1)15(5)30; variances and covariance of these estimators are also presented. The computational formulae and procedure used and some checks employed are explained. We finally illustrate some uses of the tables by taking examples.     

Model selection and post estimation based on a pretest for logistic regression models

ABSTRACT

This article addresses the problem of parameter estimation of the logistic regression model under subspace information via linear shrinkage, pretest, and shrinkage pretest estimators along with the traditional unrestricted maximum likelihood estimator and restricted estimator. We developed an asymptotic theory for the linear shrinkage and pretest estimators and compared their relative performance using the notion of asymptotic distributional bias and asymptotic quadratic risk. The analytical results demonstrated that the proposed estimation strategies outperformed the classical estimation strategies in a meaningful parameter space. Detailed Monte-Carlo simulation studies were conducted for different combinations and the performance of each estimation method was evaluated in terms of simulated relative efficiency. The results of the simulation study were in strong agreement with the asymptotic analytical findings. Two real-data examples are also given to appraise the performance of the estimators.     

Estimation on semi-functional linear errors-in-variables models

Abstract

Semi-functional linear regression models are important in practice. In this paper, their estimation is discussed when function-valued and real-valued random variables are all measured with additive error. By means of functional principal component analysis and kernel smoothing techniques, the estimators of the slope function and the non parametric component are obtained. To account for errors in variables, deconvolution is involved in the construction of a new class of kernel estimators. The convergence rates of the estimators of the unknown slope function and non parametric component are established under suitable norm and conditions. Simulation studies are conducted to illustrate the finite sample performance of our method.     

Monitoring multivariate simple linear profiles using robust estimators

Brief Abstract

This article focuses on estimation of multivariate simple linear profiles. While outliers may hamper the expected performance of the ordinary regression estimators, this study resorts to robust estimators as the remedy of the estimation problem in presence of contaminated observations. More specifically, three robust estimators M, S and MM are employed. Extensive simulation runs show that in the absence of outliers or for small amount of contamination, the robust methods perform as well as the classical least square method, while for medium and large amounts of contamination the proposed estimators perform considerably better than classical method.     

Local improvement of best linear unbiased estimation and admissibility under the weakly singular gauss-markov model

Under the weakly singular Gauss-Markov model, the class of linearly admissible estimators for the expectation of the observable random vector with respect to the mean square error criterion is considered. It is demonstrated that this class admits linearly admissible estimators for an arbitrary estimable parametric function, which locally improve the best linear estimator with respect to the mean square error matrix criterion.     

Improved estimation of scale parameters of morgenstern type bivariate uniform distribution using ranked set sampling

ABSTRACT

In this article we suggest some improved version of estimators of scale parameter of Morgenstern-type bivariate uniform distribution (MTBUD) based on the observations made on the units of the ranked set sampling regarding the study variable Y which is correlated with the auxiliary variable X, when (X, Y) follows a MTBUD. We also suggest some linear shrinkage estimators of scale parameter of Morgenstern type bivariate uniform distribution (MTBUD). Efficiency comparisons are also made in this work.