On the cohen-sackrowitz estimator of a common mean

The paper reconsider certain estimators proposed by COHENand SACKROWITZ[Ann.Statist.(1974)2,1274-1282,Ann.Statist.4,1294]for the common mean of two normal distributions on the basis of independent samples of equal size from the two populations. It derives the ncecessary and sufficient condition for improvement over the first sample mean, under squared error loss, for any member of a class containing these. It shows that the estimator proposded by them for simultaneous improvement over botyh sample means has the desired property if and only if the common size of the samples is at least nine. The requirement is milder than that for any other estimator at the present state of knolwledge and may be constrasted with their result which implies the desired property of the estimator only if the common size of the samples is at least fifteen. Upper bounds for variances if the estimators derived by them are also improved     

Outlier-detection tests and robust estimators based on signs of residuals

The asymptotic structure of a vector of weighted sums of signs of residuals, in the general linear model, is studied. The vector can be used as a basis for outlier-detection tests, or alternatively, setting the vector to zero and solving for the parameter yields a class of robust estimators which are analogues of the sample median. Asymptotic results for both estimates and tests are obtained. The question of optimal weights is investigated, and the optimal estimators in the case of simple linear regression are found to coincide with estimators introduced by Adichie.     

Immaculating the inconsistent estimator of slope parameter in measurement error model with replicated data

ABSTRACT

The measurement error model with replicated data on study as well as explanatory variables is considered. The measurement error variance associated with the explanatory variable is estimated using the complete data and the grouped data which is used for the construction of the consistent estimators of regression coefficient. These estimators are further used in constructing an almost unbiased estimator of regression coefficient. The large sample properties of these estimators are derived without assuming any distributional form of the measurement errors and the random error component under the setup of an ultrastructural model.     

A new modified Jackknifed estimator for the Poisson regression model

The Poisson regression is very popular in applied researches when analyzing the count data. However, multicollinearity problem arises for the Poisson regression model when the independent variables are highly intercorrelated. Shrinkage estimator is a commonly applied solution to the general problem caused by multicollinearity. Recently, the ridge regression (RR) estimators and some methods for estimating the ridge parameter k in the Poisson regression have been proposed. It has been found that some estimators are better than the commonly used maximum-likelihood (ML) estimator and some other RR estimators. In this study, the modified Jackknifed Poisson ridge regression (MJPR) estimator is proposed to remedy the multicollinearity. A simulation study and a real data example are provided to evaluate the performance of estimators. Both mean-squared error and the percentage relative error are considered as the performance criteria. The simulation study and the real data example results show that the proposed MJPR method outperforms the Poisson ridge regression, Jackknifed Poisson ridge regression and the ML in all of the different situations evaluated in this paper.     

A new heteroskedasticity-consistent covariance matrix estimator and inference under heteroskedasticity

To solve the heteroscedastic problem in linear regression, many different heteroskedasticity-consistent covariance matrix estimators have been proposed, including HC0 estimator and its variants, such as HC1, HC2, HC3, HC4, HC5 and HC4m. Each variant of the HC0 estimator aims at correcting the tendency of underestimating the true variances. In this paper, a new variant of HC0 estimator, HC5m, which is a combination of HC5 and HC4m, is proposed. Both the numerical analysis and the empirical analysis show that the quasi-t inference based on HC5m is typically more reliable than inferences based on other covariance matrix estimators, regardless of the existence of high leverage points.     

A Note on Comparison of (Non) Linear Estimators Using Pitman's Measure of Closeness

We present some sufficient and necessary conditions under which some linear (or nonlinear) estimators (see Sections 2 and 3) dominate (are better than) others in the sense of PMC. Its applications in linear regressions are also discussed. Furthermore, we obtain results about the eigenvalues of two matrices, which seem to be hard to be prove through pure matrix theory.     

Estimation of the location and scale parameters of the extreme value distmbution based on multiply type-II censored samples

In this paper, we consider the problem of estimating the location and scale parameters of an extreme value distribution based on multiply Type-II censored samples. We first describe the best linear unbiased estimators and the maximum likelihood estimators of these parameters. After observing that the best linear unbiased estimators need the construction of some tables for its coefficients and that the maximum likelihood estimators do not exist in an explicit algebraic form and hence need to be found by numerical methods, we develop approximate maximum likelihood estimators by appropriately approximating the likelihood equations. In addition to being simple explicit estimators, these estimators turn out to be nearly as efficient as the best linear unbiased estimators and the maximum likelihood estimators. Next, we derive the asymptotic variances and covariance of these estimators in terms of the first two single moments and the product moments of order statistics from the standard extreme value distribution. Finally, we present an example in order to illustrate all the methods of estimation of parameters discussed in this paper.     

Developing a restricted two-parameter Liu-type estimator: A comparison of restricted estimators in the binary logistic regression model

In the context of estimating regression coefficients of an ill-conditioned binary logistic regression model, we develop a new biased estimator having two parameters for estimating the regression vector parameter β when it is subjected to lie in the linear subspace restriction Hβ = h. The matrix mean squared error and mean squared error (MSE) functions of these newly defined estimators are derived. Moreover, a method to choose the two parameters is proposed. Then, the performance of the proposed estimator is compared to that of the restricted maximum likelihood estimator and some other existing estimators in the sense of MSE via a Monte Carlo simulation study. According to the simulation results, the performance of the estimators depends on the sample size, number of explanatory variables, and degree of correlation. The superiority region of our proposed estimator is identified based on the biasing parameters, numerically. It is concluded that the new estimator is superior to the others in most of the situations considered and it is recommended to the researchers.     

Combining the unrestricted estimators into a single estimator and a simulation study on the unrestricted estimators

The purpose of this paper is to combine several regression estimators (ordinary least squares (OLS), ridge, contraction, principal components regression (PCR), Liu, r?k and r?d class estimators) into a single estimator. The conditions for the superiority of this new estimator over the PCR, the r?k class, the r?d class, β?(k, d), OLS, ridge, Liu and contraction estimators are derived by the scalar mean square error criterion and the estimators of the biasing parameters for this new estimator are examined. Also, a numerical example based on Hald data and a simulation study are used to illustrate the results.     

A pre-test like estimator dominating the least-squares method

We develop a pre-test type estimator of a deterministic parameter vector β$\mathit{\beta }$ in a linear Gaussian regression model. In contrast to conventional pre-test strategies, that do not dominate the least-squares (LS) method in terms of mean-squared error (MSE), our technique is shown to dominate LS when the effective dimension is greater than or equal to 4. Our estimator is based on a simple and intuitive approach in which we first determine the linear minimum MSE (MMSE) estimate that minimizes the MSE. Since the unknown vector β$\mathit{\beta }$ is deterministic, the MSE, and consequently the MMSE solution, will depend in general on β$\mathit{\beta }$ and therefore cannot be implemented. Instead, we propose applying the linear MMSE strategy with the LS substituted for the true value of β$\mathit{\beta }$ to obtain a new estimate. We then use the current estimate in conjunction with the linear MMSE solution to generate another estimate and continue iterating until convergence. As we show, the limit is a pre-test type method which is zero when the norm of the data is small, and is otherwise a non-linear shrinkage of LS.     

Asymptotic normality for a non parametric estimator of conditional quantile with left-truncated data

In this paper, we construct a non parametric estimator of conditional distribution function by the double-kernel local linear approach for left-truncated data, from which we derive the weighted double-kernel local linear estimator of conditional quantile. The asymptotic normality of the proposed estimators is also established. Finite-sample performance of the estimator is investigated via simulation.     

Generalized estimator of population mean by using conventional and non-conventional measures in the presence of measurement errors

In survey research, it is assumed that reported response by the individual is correct. However, given the issues of prestige bias, self-respect, respondent's reported data often produces estimated values which are highly deviated from the true values. This causes measurement error (ME) to be present in the sample estimates. In this article, the estimation of population mean in the presence of measurement error using information on a single auxiliary variable is studied. A generalized estimator of population mean is proposed. The class of estimators is obtained by using some conventional and non-conventional measures. Simulation and numerical study is also conducted to assess the performance of estimators in the presence and absence of measurement error.     

A note on minimum average risk estimators for coefficients in linear models

In this note, we have derived a set of necessary and sufficient conditions for the biased estimators analyzed by Swamy and Mehta (1976) to be better than the generalized least squares estimator of the coefficient vector in a standard linear regression model.     

A new estimator for the unit root

We compare the ordinary least squares, weighted symmetric, modified weighted symmetric (MWS), maximum likelihood, and our new modification for least squares (MLS) estimator for first-order autoregressive in the case of unit root using Monte Carlo method. The Monte Carlo study sheds some light on how well the estimators and the predictors perform on different samples sizes. We found that MLS estimator is less biased and has less mean squared error (MSE) than any other estimators, and MWS predictor error performs well, in the sense of MSE, than any other predictors’ methods. The sample percentiles for the distribution of the τ statistic for the first, second, and third periods in the future, for alternative estimators, are reported to know if it agrees with those of normal distribution or not.     

Added variable plots for linear regression with censored data

In linear regression the structure of the hat matrix plays an important part in regression diagnostics. In this note we investigate the properties of the hat matrix for regression with censored responses in the presence of one or more explanatory variables observed without censoring. The censored points in the scatterplot are renovated to positions had they been observed without censoring in a renovation process based on Buckley-James censored regression estimators. This allows natural links to be established with the structure of ordinary least squares estimators. In particular, we show that the renovated hat matrix may be partitioned in a manner which assists in deciding whether further explanatory variables should be added to the linear model. The added variable plot for regression with censored data is developed as a diagnostic tool for this decision process.     

Renovating inverval-censored responses

In this note we provide a general framework for describing interval-censored samples including estimation of the magnitude and rank positions of data that have been interval-censored so as to counteract the effect of censoring. This process of sample adjustment, or renovation, allows samples to be compared graphically, using diagrams (such as boxplots) which are based on ranks. The renovation process is based on Buckley-James regression estimators for linear regression with censored data.     

Setting confidence intervals by ratio estimator

For the survey population total of a variable y when values of an auxiliary variable x are available a popular procedure is to employ the ratio estimator on drawing a simple random sample without replacement (SRSWOR) especially when the size of the sample is large. To set up a confidence interval for the total, various variance estimators are available to pair with the ratio estimator. We add a few more variance estimators studded with asymptotic design-cum-model properties. The ratio estimator is traditionally known to be appropriate when the regression of y on x is linear through the origin and the conditional variance of y given x is proportional to x. But through a numerical exercise by simulation we find the confidence intervals to fare better if the regression line deviates from the origin or if the conditional variance is disproportionate with x. Also, comparing the confidence intervals using alternative variance estimators we find our newly proposed variance estimators to yield favourably competitive results.     

Testing non-nested log-linear models with pseudo estimator

As the number of random variables for the categorical data increases, the possible number of log-linear models which can be fitted to the data increases rapidly, so that various model selection methods are developed. However, we often found that some models chosen by different selection criteria do not coincide. In this paper, we propose a comparison method to test the final models which are non-nested. The statistic of Cox (1961, 1962) is applied to log-linear models for testing non-nested models, and the Kullback-Leibler measure of closeness (Pesaran 1987) is explored. In log-linear models, pseudo estimators for the expectation and the variance of Cox's statistic are not only derived but also shown to be consistent estimators.     

Heteroscedasticity and Distributional Assumptions in the Censored Regression Model

Data censoring causes ordinary least-square estimators of linear models to be biased and inconsistent. The Tobit estimator yields consistent estimators in the presence of data censoring if the errors are normally distributed. However, nonnormality or heteroscedasticity results in the Tobit estimators being inconsistent. Various estimators have been proposed for circumventing the normality assumption. Some of these estimators include censored least absolute deviations (CLAD), symmetrically censored least-square (SCLS), and partially adaptive estimators. CLAD and SCLS will be consistent in the presence of heteroscedasticity; however, SCLS performs poorly in the presence of asymmetric errors. This article extends the partially adaptive estimation approach to accommodate possible heteroscedasticity as well as nonnormality. A simulation study is used to investigate the estimators’ relative performance in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and appear to outperform the Tobit and semiparametric estimators for nonnormal error distributions and be less sensitive to the presence of heteroscedasticity. An empirical example is considered, which supports these results.     

Linearly admissible estimators of stochastic regression coefficient under balanced loss function

The admissibility of linear estimators in a linear model with stochastic regression coefficient is investigated under a balanced loss function. The sufficient and necessary conditions for linear estimators to be admissible in classes of homogeneous and non-homogeneous linear estimators are obtained, respectively.