Monitoring multivariate simple linear profiles using robust estimators

Brief Abstract

This article focuses on estimation of multivariate simple linear profiles. While outliers may hamper the expected performance of the ordinary regression estimators, this study resorts to robust estimators as the remedy of the estimation problem in presence of contaminated observations. More specifically, three robust estimators M, S and MM are employed. Extensive simulation runs show that in the absence of outliers or for small amount of contamination, the robust methods perform as well as the classical least square method, while for medium and large amounts of contamination the proposed estimators perform considerably better than classical method.     

Heteroscedasticity and Distributional Assumptions in the Censored Regression Model

Data censoring causes ordinary least-square estimators of linear models to be biased and inconsistent. The Tobit estimator yields consistent estimators in the presence of data censoring if the errors are normally distributed. However, nonnormality or heteroscedasticity results in the Tobit estimators being inconsistent. Various estimators have been proposed for circumventing the normality assumption. Some of these estimators include censored least absolute deviations (CLAD), symmetrically censored least-square (SCLS), and partially adaptive estimators. CLAD and SCLS will be consistent in the presence of heteroscedasticity; however, SCLS performs poorly in the presence of asymmetric errors. This article extends the partially adaptive estimation approach to accommodate possible heteroscedasticity as well as nonnormality. A simulation study is used to investigate the estimators’ relative performance in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and appear to outperform the Tobit and semiparametric estimators for nonnormal error distributions and be less sensitive to the presence of heteroscedasticity. An empirical example is considered, which supports these results.     

Preliminary test Liu-type estimators based on W,LR, and LM test statistics in a regression model

This article discusses the preliminary test approach for the regression parameter in multiple regression model. The preliminary test Liu-type estimators based on the Wald (W), Likelihood ratio (LR), and Lagrangian multiplier(LM) tests are presented, when it is supposed that the regression parameter may be restricted to a subspace. We also give the bias and mean squared error of the proposed estimators and the superior of the proposed estimators is also discussed.     

A variable-neighbourhood search algorithm for finding optimal run orders in the presence of serial correlation

The responses obtained from response surface designs that are run sequentially often exhibit serial correlation or time trends. The order in which the runs of the design are performed then has an impact on the precision of the parameter estimators. This article proposes the use of a variable-neighbourhood search algorithm to compute run orders that guarantee a precise estimation of the effects of the experimental factors. The importance of using good run orders is demonstrated by seeking D-optimal run orders for a central composite design in the presence of an AR(1) autocorrelation pattern.     

On the weighted least-squares,the ordinary least-squares and the best linear unbiased estimators under a restricted growth curve model

Necessary and sufficient conditions are given for a restricted growth curve model to be consistent. The general expressions of the weighted least-squares estimators (WLSEs), the ordinary least-squares estimators (OLSEs) and the best linear unbiased estimator (BLUE) under this model are also derived. Moreover, some algebraic and statistical properties of these estimators are presented by rank method.     

Near universal consistency of the maximum pseudolikelihood estimator for discrete models

Maximum pseudolikelihood (MPL) estimators are useful alternatives to maximum likelihood (ML) estimators when likelihood functions are more difficult to manipulate than their marginal and conditional components. Furthermore, MPL estimators subsume a large number of estimation techniques including ML estimators, maximum composite marginal likelihood estimators, and maximum pairwise likelihood estimators. When considering only the estimation of discrete models (on a possibly countably infinite support), we show that a simple finiteness assumption on an entropy-based measure is sufficient for assessing the consistency of the MPL estimator. As a consequence, we demonstrate that the MPL estimator of any discrete model on a bounded support will be consistent. Our result is valid in parametric, semiparametric, and nonparametric settings.     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Performance of some new preliminary test ridge regression estimators and their properties

The problem of estimation of the regression coefficients in a multiple regression model is considered under multicollinearity situation when it is suspected that the regression coefficients may be restricted to a subspace. We present the estimators of the regression coefficients combining the idea of preliminary test and ridge regression methodology. Accordingly, we consider three estimators, namely, the unrestricted ridge regression estimator (URRE), the restricted ridge regression estimator (RRRE), and finally, the preliminary test ridge regression estimator (PTRRE). The biases, variancematrices and mean square errors (mse) of the estimators are derived and compared with the usual estimators. Regions of optimality of the estimators are determined by studying the mse criterion. The conditions of superiority of the estimators over the traditional estimators as in Saleh and Han (1990) and Ali and Saleh (1991) have also been discussed.     

Empirical comparison of some regression and regression-type strategies

The main advantages of the regression estimator are that it can be used for both the situations of positively and negatively correlated variables and its precision is usually higher than the simple expansion (direct), ratio and product estimators. Extensive empirical studies on the properties of many types of ratio estimators have been undertaken in several papers, for example by Rao (1969), Rao and Rao (1971), Hutchinson (1971), Royall and Cumberland (1981), Wu and Deng (1983). However not much attention has been given to the use of similar methods for regression-type estimators. In this paper, an attempt has been made to compare the relative performances of some biased and unbiased regression-type strategies with the help of a wide variety of natural populations.     

A Class of Estimators of Population Variance Using Auxiliary Information in Sample Surveys

This article advocates the problem of estimating the population variance of the study variable using information on certain known parameters of an auxiliary variable. A class of estimators for population variance using information on an auxiliary variable has been defined. In addition to many estimators, usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999), and Kadilar and Cingi's (2006) estimators are shown as members of the proposed class of estimators. Asymptotic expressions for bias and mean square error of the proposed class of estimators have been obtained. An empirical study has been carried out to judge the performance of the various estimators of population variance generated from the proposed class of estimators over usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999) and Kadilar and Cingi's (2006) estimators.     

On the construction of nonparametric density function estimators using the bootstrap

The derivation of a new class of nonparametric density function estimators, the so-called bootstrap functional estimators (BFE's), is given. These estimators are shown to be strongly consistent under fairly nonrestrictive conditions. Some small-sample properties are discussed and a number of graphs are presented.     

On invariant quadratic unbiased estimation of variance components

The present study deals with three different invarint quadratic unbiased estimators (IQUE) for variance components namely quadratic least squares estimators (QLSE), weighted quadratic least squares estimators (WQLSE) and Mitra type estimators (MTE). The variance and covariances of these three different estimators are presented for unbalanced one-way random model. The relative performances of these estimators are assessed based on different optimality criteria like, D-optimality, T-optimality and M-optimality together with variances of these estimators. As a result, it has been shown that MTE has optimal properties.     

Estimator Choice and Fisher's Paradox: A Monte Carlo Study

This paper argues that Fisher's paradox can be explained away in terms of estimator choice. We analyse by means of Monte Carlo experiments the small sample properties of a large set of estimators (including virtually all available single-equation estimators), and compute the critical values based on the empirical distributions of the t-statistics, for a variety of Data Generation Processes (DGPs), allowing for structural breaks, ARCH effects etc. We show that precisely the estimators most commonly used in the literature, namely OLS, Dynamic OLS (DOLS) and non-prewhitened FMLS, have the worst performance in small samples, and produce rejections of the Fisher hypothesis. If one employs the estimators with the most desirable properties (i.e., the smallest downward bias and the minimum shift in the distribution of the associated t-statistics), or if one uses the empirical critical values, the evidence based on US data is strongly supportive of the Fisher relation, consistently with many theoretical models.     

The Information Geometric Structure of Generalized Empirical Likelihood Estimators

The generalized empirical likelihood (GEL) method produces a class of estimators of parameters defined via general estimating equations. This class includes several important estimators, such as empirical likelihood (EL), exponential tilting (ET), and continuous updating estimators (CUE). We examine the information geometric structure of GEL estimators. We introduce a class of estimators closely related to the class of minimum divergence (MD) estimators and show that there is a one-to-one correspondence between this class and the class GEL.     

A study of some ridge-type shrinkage estimators

In this paper,several ridge-type shrinkage estimators are studied with respect to their relative efficiency. Some interrelationships which exist among these estimators are pointed out. One of these estimators, T∞ based on the work of Mehta and Srinivasan (1971), is shown to be a flexible estimator, which has clear advantages over its competitors. A useful approximation for calculation of the relative efficiency of T∞ is also presented.     

Optimal minimax squared error risk estimation of the mean of a multivariate normal distribution

Minimax squared error risk estimators of the mean of a multivariate normal distribution are characterized which have smallest Bayes risk with respect to a spherically symmetric prior distribution for (i) squared error loss, and (ii) zero-one loss depending on whether or not estimates are consistent with the hypothesis that the mean is null. In (i), the optimal estimators are the usual Bayes estimators for prior distributions with special structure. In (ii), preliminary test estimators are optimal. The results are obtained by applying the theory of minimax-Bayes-compromise decision problems.     

Estimating the population mean in the case of missing data using simple random sampling

In this paper, we suggest three new ratio estimators of the population mean using quartiles of the auxiliary variable when there are missing data from the sample units. The suggested estimators are investigated under the simple random sampling method. We obtain the mean square errors equations for these estimators. The suggested estimators are compared with the sample mean and ratio estimators in the case of missing data. Also, they are compared with estimators in Singh and Horn [Compromised imputation in survey sampling, Metrika 51 (2000), pp. 267–276], Singh and Deo [Imputation by power transformation, Statist. Papers 45 (2003), pp. 555–579], and Kadilar and Cingi [Estimators for the population mean in the case of missing data, Commun. Stat.-Theory Methods, 37 (2008), pp. 2226–2236] and present under which conditions the proposed estimators are more efficient than other estimators. In terms of accuracy and of the coverage of the bootstrap confidence intervals, the suggested estimators performed better than other estimators.     

On difference-based variance estimation in nonparametric regression when the covariate is high dimensional

Summary.  We consider the problem of estimating the noise variance in homoscedastic nonparametric regression models. For low dimensional covariates t  ∈  R ^d ,  d =1, 2, difference-based estimators have been investigated in a series of papers. For a given length of such an estimator, difference schemes which minimize the asymptotic mean-squared error can be computed for d =1 and d =2. However, from numerical studies it is known that for finite sample sizes the performance of these estimators may be deficient owing to a large finite sample bias. We provide theoretical support for these findings. In particular, we show that with increasing dimension d this becomes more drastic. If d 4, these estimators even fail to be consistent. A different class of estimators is discussed which allow better control of the bias and remain consistent when d 4. These estimators are compared numerically with kernel-type estimators (which are asymptotically efficient), and some guidance is given about when their use becomes necessary.     

Nonparametric estimation of mean residual functions

Situations frequently arise in practice in which mean residual life (mrl) functions must be ordered. For example, in a clinical trial of three experiments, let e (1), e (2) and e (3) be the mrl functions, respectively, for the disease groups under the standard and experimental treatments, and for the disease-free group. The well-documented mrl functions e (1) and e (3) can be used to generate a better estimate for e (2) under the mrl restriction e (1) < or = e (2) < or = e (3). In this paper we propose nonparametric estimators of the mean residual life function where both upper and lower bounds are given. Small and large sample properties of the estimators are explored. Simulation study shows that the proposed estimators have uniformly smaller mean squared error compared to the unrestricted empirical mrl functions. The proposed estimators are illustrated using a real data set from a cancer clinical trial study.     

MSE performance of the weighted average estimators consisting of shrinkage estimators

In this paper, we consider a regression model and propose estimators which are the weighted averages of two estimators among three estimators; the Stein-rule (SR), the minimum mean squared error (MMSE), and the adjusted minimum mean-squared error (AMMSE) estimators. It is shown that one of the proposed estimators has smaller mean-squared error (MSE) than the positive-part Stein-rule (PSR) estimator over a moderate region of parameter space when the number of the regression coefficients is small (i.e., 3), and its MSE performance is comparable to the PSR estimator even when the number of the regression coefficients is not so small.