Estimation in Singular Linear Models with Stochastic Linear Restrictions and Linear Equality Restrictions

This article is concerned with the parameter estimation in a singular linear regression model with stochastic linear restrictions and linear equality restrictions simultaneously. A new estimator is introduced and it is proved that the proposed estimator is superior to the least squares estimator and singular mixed estimator in the mean squared error sense under certain conditions.     

Two Kinds of Restricted Estimators in Singular Linear Regression

In this article, the parameter estimators in singular linear model with linear equality restrictions are considered. The restricted root estimator and the generalized restricted root estimator are proposed and some properties of the estimators are also studied. Furthermore, we compare them with the restricted unified least squares estimator and show their sufficient conditions under which their superior over the restricted unified least squares estimator in terms of mean squares error, and discuss the choice of the unknown parameters of the generalized restricted root estimator.     

The Superiorities of Bayes Linear Minimum Risk Estimation in Linear Model

In this article, the Bayes linear minimum risk estimator (BLMRE) of parameters is derived in linear model. The superiorities of the BLMRE over ordinary least square estimator (LSE) is studied in terms of the mean square error matrix (MSEM) criterion and Pitman closeness (PC) criterion.     

A Generalized Stochastic Restricted Ridge Regression Estimator

In this article, we introduce a new stochastic restricted estimator for the unknown vector parameter in the linear regression model when stochastic linear restrictions on the parameters hold. We show that the new estimator is a generalization of the ordinary mixed estimator (OME), Liu estimator (LE), ordinary ridge estimator (ORR), (k-d) class estimator, stochastic restricted Liu estimator (SRLE), and stochastic restricted ridge estimator (SRRE). Performance of the new estimator in comparison to other estimators in terms of the mean squares error matrix (MMSE) is examined. Numerical example from literature have been given to illustrate the results.     

Two Stochastic Restricted Principal Components Regression Estimator in Linear Regression

In this article, we propose two stochastic restricted principal components regression estimator by combining the approach followed in obtaining the ordinary mixed estimator and the principal components regression estimator in linear regression model. The performance of the two new estimators in terms of matrix MSE criterion is studied. We also give an example and a Monte Carlo simulation to show the theoretical results.     

Recovery of inter-block information: extensions in a two variance component model

For a two variance component mixed linear model, it is shown that under suitable conditions there exists a nonlinear unbiased estimator that is better than a best linear unbiased estimator defined with respect to a given singular covariance matrix. It is also shown how this result applies to improving on intra-block estimators and on estimators like the unweighted means estimator in a random one-way model.     

A Stochastic Restricted Two-Parameter Estimator in Linear Regression Model

Özkale and Kaciranlar (2007 Özakle , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 . [Google Scholar]) proposed a two-parameter estimator (TPE) for the unknown parameter vector in linear regression when exact restrictions are assumed to hold. In this article, under the assumption that the errors are not independent and identically distributed, we introduce a new estimator by combining the ideas underlying the mixed estimator (ME) and the two-parameter estimator when stochastic linear restrictions are assumed to hold. The new estimator is called the stochastic restricted two-parameter estimator (SRTPE) and necessary and sufficient conditions for the superiority of the SRTPE over the ME and TPE are derived by the mean squared error matrix (MSEM) criterion. Furthermore, selection of the biasing parameters is discussed and a numerical example is given to illustrate some of the theoretical results.     

An alternative stochastic restricted Liu estimator in linear regression

In this paper, we introduce an alternative stochastic restricted Liu estimator for the vector of parameters in a linear regression model when additional stochastic linear restrictions on the parameter vector are assumed to hold. The new estimator is a generalization of the ordinary mixed estimator (OME) (Durbin in J Am Stat Assoc 48:799–808, 1953; Theil and Goldberger in Int Econ Rev 2:65–78, 1961; Theil in J Am Stat Assoc 58:401–414, 1963) and Liu estimator proposed by Liu (Commun Stat Theory Methods 22:393–402, 1993). Necessary and sufficient conditions for the superiority of the new stochastic restricted Liu estimator over the OME, the Liu estimator and the estimator proposed by Hubert and Wijekoon (Stat Pap 47:471–479, 2006) in the mean squared error matrix (MSEM) sense are derived. Furthermore, a numerical example based on the widely analysed dataset on Portland cement (Woods et al. in Ind Eng Chem 24:1207–1241, 1932) and a Monte Carlo evaluation of the estimators are also given to illustrate some of the theoretical results.     

Some Matrix Norm Kantorovich Inequalities and Their Applications

In this article, we first present four matrix norm Kantorovich-type inequalities involving non negative definite matrix. Then, based on these inequalities, we propose four new efficiency criteria and present their lower bounds to make efficiency comparisons between the ordinary least squares estimator and the best linear unbiased estimator in a singular linear model.     

A Further Study of Predictions in Linear Mixed Models

This article is concerned with the prediction problems in linear mixed models (LMM). Both biased predictors and restricted predictors are introduced. It was found that the mean square error matrix (MSEM) of a predictor strongly depends on the MSEM of corresponding estimator of the fixed effects and precise formulas are obtained. As an application, we propose three new predictors to improve the best linear unbiased predictor (BLUP). The performance of the new predictors can be examined easily with the help of vast literature on the linear regression models (LM). We also illustrate our findings with a Monte Carlo simulation and a numerical example.     

Linear approximate ML estimation in scaled Type I generalized logistic distribution based on Type-II censored samples

The scaled (two-parameter) Type I generalized logistic distribution (GLD) is considered with the known shape parameter. The ML method does not yield an explicit estimator for the scale parameter even in complete samples. In this article, we therefore construct a new linear estimator for scale parameter, based on complete and doubly Type-II censored samples, by making linear approximations to the intractable terms of the likelihood equation using least-squares (LS) method, a new approach of linearization. We call this as linear approximate maximum likelihood estimator (LAMLE). We also construct LAMLE based on Taylor series method of linear approximation and found that this estimator is slightly biased than that based on the LS method. A Monte Carlo simulation is used to investigate the performance of LAMLE and found that it is almost as efficient as MLE, though biased than MLE. We also compare unbiased LAMLE with BLUE based on the exact variances of the estimators and interestingly this new unbiased LAMLE is found just as efficient as the BLUE in both complete and Type-II censored samples. Since MLE is known as asymptotically unbiased, in large samples we compare unbiased LAMLE with MLE and found that this estimator is almost as efficient as MLE. We have also discussed interval estimation of the scale parameter from complete and Type-II censored samples. Finally, we present some numerical examples to illustrate the construction of the new estimators developed here.     

On the weighted mixed Liu-type estimator under unbiased stochastic restrictions

In this article, we introduce the weighted mixed Liu-type estimator (WMLTE) based on the weighted mixed and Liu-type estimator (LTE) in linear regression model. We will also present necessary and sufficient conditions for superiority of the weighted mixed Liu-type estimator over the weighted mixed estimator (WME) and Liu type estimator (LTE) in terms of mean square error matrix (MSEM) criterion. Finally, a numerical example and a Monte Carlo simulation is also given to show the theoretical results.     

Mixed Liu estimator in linear measurement error models

In this paper, we introduce mixed Liu estimator (MLE) for the vector of parameters in linear measurement error models by unifying the sample and the prior information. The MLE is a generalization of the mixed estimator (ME) and Liu estimator (LE). In particular, asymptotic normality properties of the estimators are discussed, and the performance of the MLE over the LE and ME are compared based on mean squared error matrix (MSEM). Finally, a Monte Carlo simulation and a numerical example are also presented for analysis.     

A class of Stein‐rules in multivariate regression model with structural changes

In this paper, we consider an estimation problem of the matrix of the regression coefficients in multivariate regression models with unknown change‐points. More precisely, we consider the case where the target parameter satisfies an uncertain linear restriction. Under general conditions, we propose a class of estimators that includes as special cases shrinkage estimators (SEs) and both the unrestricted and restricted estimator. We also derive a more general condition for the SEs to dominate the unrestricted estimator. To this end, we extend some results underlying the multidimensional version of the mixingale central limit theorem as well as some important identities for deriving the risk function of SEs. Finally, we present some simulation studies that corroborate the theoretical findings.     

Linearized Ridge Regression Estimator in Linear Regression

In this article, we aim to study the linearized ridge regression (LRR) estimator in a linear regression model motivated by the work of Liu (1993). The LRR estimator and the two types of generalized Liu estimators are investigated under the PRESS criterion. The method of obtaining the optimal generalized ridge regression (GRR) estimator is derived from the optimal LRR estimator. We apply the Hald data as a numerical example and then make a simulation study to show the main results. It is concluded that the idea of transforming the GRR estimator as a complicated function of the biasing parameters to a linearized version should be paid more attention in the future.     

Singular Ridge Regression With Stochastic Constraints

This article considers the estimation of the restricted ridge regression parameter in singular models. The problem is commenced with considering elliptically contoured equality constrained and then followed by proposing the preliminary test estimator. Along with proposing some important properties of this estimator, a real example satisfying the elliptical assumption is also given to bring the problem into a noticeable issue.     

Estimation in a linear regression model with stochastic linear restrictions: a new two-parameter-weighted mixed estimator

The present paper considers the weighted mixed regression estimation of the coefficient vector in a linear regression model with stochastic linear restrictions binding the regression coefficients. We introduce a new two-parameter-weighted mixed estimator (TPWME) by unifying the weighted mixed estimator of Schaffrin and Toutenburg [1] and the two-parameter estimator (TPE) of Özkale and Kaç?ranlar [2]. This new estimator is a general estimator which includes the weighted mixed estimator, the TPE and the restricted two-parameter estimator (RTPE) proposed by Özkale and Kaç?ranlar [2] as special cases. Furthermore, we compare the TPWME with the weighted mixed estimator and the TPE with respect to the matrix mean square error criterion. A numerical example and a Monte Carlo simulation experiment are presented by using different estimators of the biasing parameters to illustrate some of the theoretical results.     

A weighted stochastic restricted ridge estimator in partially linear model

In this article, we consider the estimation of a partially linear model when stochastic linear restrictions on the parameter components are assumed to hold. Based on the weighted mixed estimator, profile least-squares method, and ridge method, a weighted stochastic restricted ridge estimator of the parametric component is introduced. The properties of the new estimator are also discussed. Finally, a simulation study is given to show the performance of the new estimator.     

Bridge Estimators in the Partially Linear Model with High Dimensionality

This article studies variable selection and parameter estimation in the partially linear model when the number of covariates in the linear part increases to infinity. Using the bridge penalty method, we succeed in selecting the important covariates of the linear part. Under regularity conditions, we have shown that the bridge penalized estimator of the parametric part enjoys the oracle property. We also obtain the convergence rate of the estimator of the nonparametric part. Simulation studies show that the bridge estimator performs as well as the oracle estimator for the partially linear model. An application is analyzed to illustrate the bridge procedure.     

Minimax Linear Smoothers

We consider the problem of estimating the mean of a multivariate distribution. As a general alternative to penalized least squares estimators, we consider minimax estimators for squared error over a restricted parameter space where the restriction is determined by the penalization term. For a quadratic penalty term, the minimax estimator among linear estimators can be found explicitly. It is shown that all symmetric linear smoothers with eigenvalues in the unit interval can be characterized as minimax linear estimators over a certain parameter space where the bias is bounded. The minimax linear estimator depends on smoothing parameters that must be estimated in practice. Using results in Kneip (1994), this can be done using Mallows' C _L -statistic and the resulting adaptive estimator is now asymptotically minimax linear. The minimax estimator is compared to the penalized least squares estimator both in finite samples and asymptotically.