Best minimum bias linear estimators in gauss-markoff model

In this note we present a criterion for linear estimation which is similar to MV-MB-LE of Rao (1978) in Gauss-Markoff model (Y, XB, α²G). We call this criterion MMS-MB-LE (Minimum Mean Square Error-Minimum Bias-Linear Estimation)> Representations of solutions to such estimators similar to those of Rao (1978) are provided.     

Improved ridge estimators in a linear regression model

In this paper, the notion of the improved ridge estimator (IRE) is put forward in the linear regression model y=X β+e. The problem arises if augmenting the equation 0=c′α+ε instead of 0=C α+? to the model. Three special IREs are considered and studied under the mean-squared error criterion and the prediction error sum of squares criterion. The simulations demonstrate that the proposed estimators are effective and recommendable, especially when multicollinearity is severe.     

Improved best linear unbiased estimators for the simple linear regression model using double ranked set sampling schemes

ABSTRACT

In this paper, we consider the best linear unbiased estimators (BLUEs) based on double ranked set sampling (DRSS) and ordered DRSS (ODRSS) schemes for the simple linear regression model with replicated observations. We assume three symmetric distributions for the random error term, i.e., normal, Laplace and some scale contaminated normal distributions. The proposed BLUEs under DRSS (BLUEs-DRSS) and ODRSS (BLUEs-ODRSS) are compared with the BLUEs based on ordered simple random sampling (OSRS), ranked set sampling (RSS), and ordered RSS (ORSS) schemes. These estimators are compared in terms of relative efficiency (RE), RE of determinant (RED), and RE of trace (RET). It is found that the BLUEs-ODRSS are uniformly better than the BLUEs based on OSRS, RSS, ORSS, and DRSS schemes. We also compare the estimators based on imperfect RSS (IRSS) schemes. It is worth mentioning here that the BLUEs under ordered imperfect DRSS (OIDRSS) are better than their counterparts based on IRSS, ordered IRSS (OIRSS), and imperfect DRSS (IDRSS) methods. Moreover, for sensitivity analysis of the BLUEs, we calculate REs and REDs of the BLUEs under the assumption of normality when in fact the parent distribution follows a non normal symmetric distribution. It turns out that even under violation of normality assumptions, BLUEs of the intercept and the slope parameters are found to be unbiased with equal REs under each sampling scheme. It is also observed that the BLUEs under ODRSS are more efficient than the existing BLUEs.     

Why a time effect often has a limited impact on capture‐recapture estimates in closed populations

The author is concerned with log‐linear estimators of the size N of a population in a capture‐recapture experiment featuring heterogeneity in the individual capture probabilities and a time effect. He also considers models where the first capture influences the probability of subsequent captures. He derives several results from a new inequality associated with a dispersive ordering for discrete random variables. He shows that in a log‐linear model with inter‐individual heterogeneity, the estimator N is an increasing function of the heterogeneity parameter. He also shows that the inclusion of a time effect in the capture probabilities decreases N in models without heterogeneity. He further argues that a model featuring heterogeneity can accommodate a time effect through a small change in the heterogeneity parameter. He demonstrates these results using an inequality for the estimators of the heterogeneity parameters and illustrates them in a Monte Carlo experiment     

On biased linear estimators in models with arbitrary rank

In this paper we define a class of biased linear estimators for the unknown parameters in linear models with arbitrary rank. The feature of our approach is to reduce the estimation problem in arbitrary rank models to the one in full-rank models. Some important properties are discussed. As special cases of our class, we extend to deficient-rank models six known biased linear estimators.     

New shrinkage-type estimators in a linear regression model when multicollinearity is severe

For the linear regression model y=Xβ+e with severe multicollinearity, we put forward three shrinkage-type estimators based on the ordinary least-squares estimator including two types of independent factor estimators and a seemingly convex combination. The simulation study shows that the new estimators are not good enough when multicollinearity is mild to moderate, but perform very well when multicollinearity is severe to very severe.     

General linear estimators under the prediction error sum of squares criterion in a linear regression model

In this paper, the notion of the general linear estimator and its modified version are introduced using the singular value decomposition theorem in the linear regression model y=X β+e to improve some classical linear estimators. The optimal selections of the biasing parameters involved are theoretically given under the prediction error sum of squares criterion. A numerical example and a simulation study are finally conducted to illustrate the superiority of the proposed estimators.     

Trimmed likelihood estimators for lifetime experiments and their influence functions

We study the behaviour of trimmed likelihood estimators (TLEs) for lifetime models with exponential or lognormal distributions possessing a linear or nonlinear link function. In particular, we investigate the difference between two possible definitions for the TLE, one called original trimmed likelihood estimator (OTLE) and one called modified trimmed likelihood estimator (MTLE) which is the finite sample version of a form for location and linear regression used by Bednarski and Clarke [Trimmed likelihood estimation of location and scale of the normal distribution. Aust J Statist. 1993;35:141–153, Asymptotics for an adaptive trimmed likelihood location estimator. Statistics. 2002;36:1–8] and Bednarski et al. [Adaptive trimmed likelihood estimation in regression. Discuss Math Probab Stat. 2010;30:203–219]. The OTLE is always an MTLE but the MTLE may not be unique even in cases where the OLTE is unique. We compare especially the functional forms of both types of estimators, characterize the difference with the implicit function theorem and indicate situations where they coincide and where they do not coincide. Since the functional form of the MTLE has a simpler form, we use it then for deriving the influence function, again with the help of the implicit function theorem. The derivation of the influence function for the functional form of the OTLE is similar but more complicated.     

Two kinds of restricted modified estimators in linear regression model

In this paper, we introduce two kinds of new restricted estimators called restricted modified Liu estimator and restricted modified ridge estimator based on prior information for the vector of parameters in a linear regression model with linear restrictions. Furthermore, the performance of the proposed estimators in mean squares error matrix sense is derived and compared. Finally, a numerical example and a Monte Carlo simulation are given to illustrate some of the theoretical results.     

Improved versions of greenwood estimators under koziol-green model

ABSTRACT

It is well known that the Greenwood estimators underestimate the variances of the Nelson-Aalen estimator and the Kaplan-Meier estimator. In this article, we reveal some “improved” versions of the Greenwood estimators under the Koziol-Green model.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

Superiority of the r-k class estimator over some estimators in a misspecified linear model

ABSTRACT

In this article, we discuss the superiority of r-k class estimator over some estimators in a misspecified linear model. We derive the necessary and sufficient conditions for the superiority of the r-k class estimator over each of these estimators under the Mahalanobis loss function by the average loss criterion in the misspecified linear model.     

Best linear unbiased estimators of parameters of a simple linear regression model based on ordered ranked set samples

As an alternative to an estimation based on a simple random sample (BLUE-SRS) for the simple linear regression model, Moussa-Hamouda and Leone [E. Moussa-Hamouda and F.C. Leone, The o-blue estimators for complete and censored samples in linear regression, Technometrics, 16 (3) (1974), pp. 441–446.] discussed the best linear unbiased estimators based on order statistics (BLUE-OS), and showed that BLUE-OS is more efficient than BLUE-SRS for normal data. Using the ranked set sampling, Barreto and Barnett [M.C.M. Barreto and V. Barnett, Best linear unbiased estimators for the simple linear regression model using ranked set sampling. Environ. Ecoll. Stat. 6 (1999), pp. 119–133.] derived the best linear unbiased estimators (BLUE-RSS) for simple linear regression model and showed that BLUE-RSS is more efficient for the estimation of the regression parameters (intercept and slope) than BLUE-SRS for normal data, but not so for the estimation of the residual standard deviation in the case of small sample size. As an alternative to RSS, this paper considers the best linear unbiased estimators based on order statistics from a ranked set sample (BLUE-ORSS) and shows that BLUE-ORSS is uniformly more efficient than BLUE-RSS and BLUE-OS for normal data.     

A comparison of mixed and minimax estimators of linear models

In this paper the stochastic properties of two estimators of linear models, mixed and minimax, based on different types of prior information, are compared using quadratic risk as the criterion for superiority. A necessary and sufficient condition for the minimax estimator to be superior to the comparable mixed estimator is derived as well as a simpler necessary but not sufficient condition.     

Performance of the difference-based estimators in partially linear models

In this paper, we consider a commonly used partially linear model. We proposed a restricted difference-based ridge estimator for the vector of parameters β in a partially linear model with one smoothing term when additional linear restrictions on the parameter vector are assumed to hold. The ideas in the paper are illustrated in a real data set and in a Monte Carlo simulation study.     

Improved Liu estimator in a linear regression model

In this paper, we mainly aim to introduce the notion of improved Liu estimator (ILE) in the linear regression model y=Xβ+e. The selection of the biasing parameters is investigated under the PRESS criterion and the optimal selection is successfully derived. We make a simulation study to show the performance of ILE compared to the ordinary least squares estimator and the Liu estimator. Finally, the main results are applied to the Hald data.     

Improved set estimators for the coefficients of a linear model when the error distribution is spherically symmetric with unknown variances

The usual confidence set for p (p ≥ 3) coefficients of a linear model is known to be dominated by the James-Stein confidence sets under the assumption of spherical symmetric errors with known variance (Hwang and Chen 1986). For the same confidence-set problem but for the unknown-variance case, naturally one replaces the unknown variance by an estimator. For the normal case, many previous studies have shown numerically that the resultant James-Stein confidence sets dominate the resultant usual confidence sets, i.e., the F confidence sets. In this paper we provide a further asymptotic justification, and we discover the same advantage of the James-Stein confidence sets for normal error as well as spherically symmetric error.     

Preliminary phi-divergence test estimators for linear restrictions in a logistic regression model

The problem of estimation of the parameters in a logistic regression model is considered under multicollinearity situation when it is suspected that the parameter of the logistic regression model may be restricted to a subspace. We study the properties of the preliminary test based on the minimum ϕ -divergence estimator as well as in the ϕ -divergence test statistic. The minimum ϕ -divergence estimator is a natural extension of the maximum likelihood estimator and the ϕ -divergence test statistics is a family of the test statistics for testing the hypothesis that the regression coefficients may be restricted to a subspace.