Understanding Estimators of Treatment Effects in Regression Discontinuity Designs

In this paper, we propose two new estimators of treatment effects in regression discontinuity designs. These estimators can aid understanding of the existing estimators such as the local polynomial estimator and the partially linear estimator. The first estimator is the partially polynomial estimator which extends the partially linear estimator by further incorporating derivative differences of the conditional mean of the outcome on the two sides of the discontinuity point. This estimator is related to the local polynomial estimator by a relocalization effect. Unlike the partially linear estimator, this estimator can achieve the optimal rate of convergence even under broader regularity conditions. The second estimator is an instrumental variable estimator in the fuzzy design. This estimator will reduce to the local polynomial estimator if higher order endogeneities are neglected. We study the asymptotic properties of these two estimators and conduct simulation studies to confirm the theoretical analysis.     

On the weighted mixed Liu-type estimator under unbiased stochastic restrictions

In this article, we introduce the weighted mixed Liu-type estimator (WMLTE) based on the weighted mixed and Liu-type estimator (LTE) in linear regression model. We will also present necessary and sufficient conditions for superiority of the weighted mixed Liu-type estimator over the weighted mixed estimator (WME) and Liu type estimator (LTE) in terms of mean square error matrix (MSEM) criterion. Finally, a numerical example and a Monte Carlo simulation is also given to show the theoretical results.     

Stein-type estimation using ranked set sampling

In this study, we consider the application of the James–Stein estimator for population means from a class of arbitrary populations based on ranked set sample (RSS). We consider a basis for optimally combining sample information from several data sources. We succinctly develop the asymptotic theory of simultaneous estimation of several means for differing replications based on the well-defined shrinkage principle. We showcase that a shrinkage-type estimator will have, under quadratic loss, a substantial risk reduction relative to the classical estimator based on simple random sample and RSS. Asymptotic distributional quadratic biases and risks of the shrinkage estimators are derived and compared with those of the classical estimator. A simulation study is used to support the asymptotic result. An over-riding theme of this study is that the shrinkage estimation method provides a powerful extension of its traditional counterpart for non-normal populations. Finally, we will use a real data set to illustrate the computation of the proposed estimators.     

Restricted ridge estimator in the logistic regression model

It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, Schaefer et al. presented a ridge estimator in the logistic regression model. Making use of the ridge estimator, when some linear restrictions are also present, we introduce a restricted ridge estimator in the logistic regression model. Statistical properties of this newly defined estimator will be studied and comparisons are done in the simulation study in the sense of mean squared error criterion. A real-data example and a simulation study are introduced to discuss the performance of this estimator.     

Analysis of the Gibbs sampler for a model related to James-Stein estimators

We analyse a hierarchical Bayes model which is related to the usual empirical Bayes formulation of James-Stein estimators. We consider running a Gibbs sampler on this model. Using previous results about convergence rates of Markov chains, we provide rigorous, numerical, reasonable bounds on the running time of the Gibbs sampler, for a suitable range of prior distributions. We apply these results to baseball data from Efron and Morris (1975). For a different range of prior distributions, we prove that the Gibbs sampler will fail to converge, and use this information to prove that in this case the associated posterior distribution is non-normalizable.     

Ban Estimation for Chi-Square Test Criteria in Categorical Data

This expository paper describes some recent work that further develops the theory of BAN estimators and the related chi-scuare test statistics.The extensions are in several directions: (a) the class of regular estimators is broadened by permitting extraneous random elements; (b) more general models are permitted under the constraint equations specification; and (c) BAN estimators are defined for general models combining features of two types of specification.In particular, WLS estimators are shown to be BAN.     

Stochastic approximation methods in linear regression models (with consideration of errors in the regressors) 1

Usually, the dependence in stationary processes is described by a set of coefficients. In this paper, a measure of dependence is proposed which can be used instead of the autocorrelation function, and another measure for the dependence between two processes instead of cross-correlation function and coherence coefficients. In the end, an improvement of extrapolation of a process is investigated which is caused by the knowledge of another related process.     

Improved estimation methods for unrelated question randomized response techniques

The randomized response technique (RRT) is an important tool, commonly used to avoid biased answers in survey on sensitive issues by preserving the respondents’ privacy. In this paper, we introduce a data collection method for survey on sensitive issues combining both the unrelated-question RRT and the direct question design. The direct questioning method is utilized to obtain responses to a non sensitive question that is related to the innocuous question from the unrelated-question RRT. These responses serve as additional information that can be used to improve the estimation of the prevalence of the sensitive behavior. Furthermore, we propose two new methods for the estimation of the proportion of respondents possessing the sensitive attribute under a missing data setup. More specifically, we develop the weighted estimator and the weighted conditional likelihood estimator. The performances of our estimators are studied numerically and compared with that of an existing one. Both proposed estimators are more efficient than the Greenberg's estimator. We illustrate our methods using real data from a survey study on illegal use of cable TV service in Taiwan.     

On the restricted almost unbiased estimators in linear regression

In this paper, the restricted almost unbiased ridge regression estimator and restricted almost unbiased Liu estimator are introduced for the vector of parameters in a multiple linear regression model with linear restrictions. The bias, variance matrices and mean square error (MSE) of the proposed estimators are derived and compared. It is shown that the proposed estimators will have smaller quadratic bias but larger variance than the corresponding competitors in literatures. However, they will respectively outperform the latter according to the MSE criterion under certain conditions. Finally, a simulation study and a numerical example are given to illustrate some of the theoretical results.     

On the performance of the Jackknifed Liu-type estimator in linear regression model

In this paper, we are proposing a modified jackknife Liu-type estimator (MJLTE) that was created by combining the ideas underlying both the Liu-type estimator (LTE) and the jackknifed Liu-type estimator (JLTE). We will also present the necessary and sufficient conditions for superiority of the MJLTE over the LTE and JLTE, in terms of mean square error matrix criterion. Finally, a real data example and a Monte Carlo simulation are also given to illustrate theoretical results.     

THE EXAMINATION AND ANALYSIS OF RESIDUALS FOR SOME BIASED ESTIMATORS IN LINEAR REGRESSION

In the presence of collinearity certain biased estimation procedures like ridge regression, generalized inverse estimator, principal component regression, Liu estimator, or improved ridge and Liu estimators are used to improve the ordinary least squares (OLS) estimates in the linear regression model. In this paper new biased estimator (Liu estimator), almost unbiased (improved) Liu estimator and their residuals will be analyzed and compared with OLS residuals in terms of mean-squared error.     

An Appreciation of Balanced Loss Functions Via Regret Loss

We examine balanced loss functions, which account for both estimation error and goodness of fit (or proximity to a “target” estimator), in terms of their regret losses, providing new insight and interpretations. This also shows a connection between quadratic balanced loss and usual quadratic loss, which easily converts frequentist and Bayesian results for quadratic loss to related results for quadratic balanced loss and vice versa. Some implications of these results for Stein-rule estimators under linear regression are discussed. We also examine regret losses corresponding to several non-quadratic balanced loss functions.     

Performances of the Positive-Rule Stein-Type Ridge Estimator in a Linear Regression Model with Spherically Symmetric Error Distributions

In this article, the positive-rule Stein-type ridge estimator (PSRE) is introduced for the parameters in a multiple linear regression model with spherically symmetric error distributions when it is suspected that the parameter vector may be restricted to a linear manifold. The bias and quadratic risk functions of the PSRE are derived and compared with some related competing estimators in literatures. Particularly, some sufficient conditions are derived for superiority of the PSRE over the ordinary ridge estimator, the restricted ridge estimator and the preliminary test ridge estimator, respectively. Furthermore, some graphical results are provided to illustrate some of the theoretical results.     

A Note on Regression-Type Estimators Using Multiple Auxiliary Information

Kiregyera (1984), Mukerjee, Rao & Vijayan (1987), and Tripathi & Ahmed (1995) considered a number of regression-type estimators where information on two auxiliary variables related to study variable is available at different levels. Mukerjee et al . (1987) suggested three estimators and computed their mean square errors, but the computations seem to be incorrect. This note corrects them, and finds their estimators are no better than that of Kiregyera (1984). The estimator suggested by Tripathi & Ahmed (1995) is the best in the sense of having the smallest mean square error.     

The Whittle Estimator for Strongly Dependent Stationary Gaussian Fields

In this article we generalize results on the asymptotic behaviour of the Whittle estimator for certain stationary Gaussian long range dependent fields. These results have been established in the one-dimensional case under very general conditions. They require controlling the estimation bias and also giving convergence theorems for certain quadratic forms of the observations. In the multidimensional setting, our main interest will be controlling the bias. This can be done for d ≤ 3 using taper functions, and, depending on the shape of the singularity, also introducing certain regularizing functions. In this last case, however, the estimator will no longer be efficient. We also present certain partial results concerning the convergence to a limiting Gaussian distribution of the associated quadratic forms.     

Improvement of the Liu estimator in linear regression model

In the presence of stochastic prior information, in addition to the sample, Theil and Goldberger (1961) introduced a Mixed Estimator for the parameter vector β in the standard multiple linear regression model (T,Xβ,σ² I). Recently, the Liu estimator which is an alternative biased estimator for β has been proposed by Liu (1993). In this paper we introduce another new Liu type biased estimator called Stochastic restricted Liu estimator for β, and discuss its efficiency. The necessary and sufficient conditions for mean squared error matrix of the Stochastic restricted Liu estimator to exceed the mean squared error matrix of the mixed estimator will be derived for the two cases in which the parametric restrictions are correct and are not correct. In particular we show that this new biased estimator is superior in the mean squared error matrix sense to both the Mixed estimator and to the biased estimator introduced by Liu (1993).     

A revised Cholesky decomposition to combat multicollinearity in multiple regression models

As known, the ordinary least-squares estimator (OLSE) is unbiased and also, has the minimum variance among all the linear unbiased estimators. However, under multicollinearity the estimator is generally unstable and poor in the sense that variance of the regression coefficients may be inflated and absolute values of the estimates may be too large. There are several classes of biased estimators in statistical literature to decrease the effect of multicollinearity in the design matrix. Here, based on the Cholesky decomposition, we propose such an estimator which makes the data to be slightly distorted. The exact risk expressions as well as the biases are derived for the proposed estimator. Also, some results demonstrating superiority of the suggested estimator over OLSE are obtained. Finally, a Monté-Carlo simulation study and a real data application related to acetylene data are presented to support our theoretical discussions.     

Statistical Inference of Type-II Progressively Hybrid Censored Data with Weibull Lifetimes

In this article, we discuss the maximum likelihood estimators and approximate maximum likelihood estimators of the parameters of the Weibull distribution with two different progressively hybrid censoring schemes. We also present the associated expressions of the expected total test time and the expected effective sample size which will be useful for experimental planning purpose. Finally, the efficiency of the point estimation of the parameters based on the two progressive hybrid censoring schemes are compared and the merits of each censoring scheme are discussed.     

Some maximum-indifference estimators for the slope of a univariate linear model

As known, the least-squares estimator of the slope of a univariate linear model sets to zero the covariance between the regression residuals and the values of the explanatory variable. To prevent the estimation process from being influenced by outliers, which can be theoretically modelled by a heavy-tailed distribution for the error term, one can substitute covariance with some robust measures of association, for example Kendall's tau in the popular Theil–Sen estimator. In a scarcely known Italian paper, Cifarelli [(1978), ‘La Stima del Coefficiente di Regressione Mediante l'Indice di Cograduazione di Gini’, Rivista di matematica per le scienze economiche e sociali, 1, 7–38. A translation into English is available at http://arxiv.org/abs/1411.4809 and will appear in Decisions in Economics and Finance] shows that a gain of efficiency can be obtained by using Gini's cograduation index instead of Kendall's tau. This paper introduces a new estimator, derived from another association measure recently proposed. Such a measure is strongly related to Gini's cograduation index, as they are both built to vanish in the general framework of indifference. The newly proposed estimator is shown to be unbiased and asymptotically normally distributed. Moreover, all considered estimators are compared via their asymptotic relative efficiency and a small simulation study. Finally, some indications about the performance of the considered estimators in the presence of contaminated normal data are provided.     

The Restricted and Unrestricted Two-Parameter Estimators

In this article, we introduce a new two-parameter estimator by grafting the contraction estimator into the modified ridge estimator proposed by Swindel (1976 Swindel , B. F. ( 1976 ). Good ridge estimators based on prior information . Commun. Statist. Theor. Meth. A5 : 1065 – 1075 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). This new two-parameter estimator is a general estimator which includes the ordinary least squares, the ridge, the Liu, and the contraction estimators as special cases. Furthermore, by setting restrictions Rβ = r on the parameter values we introduce a new restricted two-parameter estimator which includes the well-known restricted least squares, the restricted ridge proposed by Groß (2003 Groß , J. ( 2003 ). Restricted ridge estimation . Statist. Probab. Lett. 65 : 57 – 64 .[Crossref], [Web of Science ®] , [Google Scholar]), the restricted contraction estimators, and a new restricted Liu estimator which we call the modified restricted Liu estimator different from the restricted Liu estimator proposed by Kaç?ranlar et al. (1999 Kaç?ranlar , S. , Sakall?o?lu , S. , Akdeniz , F. , Styan , G. P. H. , Werner , H. J. ( 1999 ). A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland cement . Sankhya Ser. B., Ind. J. Statist. 61 : 443 – 459 . [Google Scholar]). We also obtain necessary and sufficient condition for the superiority of the new two-parameter estimator over the ordinary least squares estimator and the comparison of the new restricted two-parameter estimator to the new two-parameter estimator is done by the criterion of matrix mean square error. The estimators of the biasing parameters are given and a simulation study is done for the comparison as well as the determination of the biasing parameters.