Minimum Variance Quadratic Unbiased Estimation for the Variance Components in Simple Linear Regression with Onefold Nested Error

The explicit forms of the minimum variance quadratic unbiased estimators (MIVQUEs) of the variance components are given for simple linear regression with onefold nested error. The resulting estimators are more efficient as the ratio of the initial variance components estimates increases and are asymptotically efficient as the ratio tends to infinity.     

A Note on Asymptotic Behavior of the Nonparametric Density Estimators in Multivariate Mixtures

The asymptotic behavior of the nonparametric density estimator has been given for a multivariate mixture model. It has been observed that the estimator is asymptotically normally distributed with bias of size h ² and variance of size (nh)^?1.     

Non-Diagonal-Type Estimator in Linear Regression

This short article mainly aims to introduce the notion of the non-diagonal-type estimator (NDTE) by means of the singular value decomposition theorem in the linear regression model to improve some classical linear estimators that can be called the diagonal-type estimators. We derive the optimal NDTE under the mean squared error criterion and its iterative version through matrix techniques. A simulation study is finally conducted to illustrate the theoretical results.     

A New Two-Parameter Estimator in Linear Regression

This article is concerned with the parameter estimation in linear regression model. To overcome the multicollinearity problem, a new two-parameter estimator is proposed. This new estimator is a general estimator which includes the ordinary least squares (OLS) estimator, the ridge regression (RR) estimator, and the Liu estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the OLS, RR, Liu estimators, and the two-parameter estimator proposed by Ozkale and Kaciranlar (2007 Ozkale , M. R. , Kaciranlar , S. ( 2007 ). The restricted and unrestricted two-parameter estimators . Commun. Statist. Theor. Meth. 36 : 2707 – 2725 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in the mean squared error matrix (MSEM) sense are derived. Furthermore, we obtain the estimators of the biasing parameters and give a numerical example to illustrate some of the theoretical results.     

The influence function of the optimal bandwidth for kernel density estimation

Theories about the bandwidth of kernel density estimation have been well established by many statisticians. However, the influence function of the bandwidth has not been well investigated. The influence function of the optimal bandwidth that minimizes the mean integrated square error is derived and the asymptotic property of the bandwidth selectors based on the influence function is provided.     

Nonparametric Estimation of Variance Function for Functional Data Under Mixing Conditions

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite dimensional case, our asymptotic result shows the smoothness of the unknown mean function has an effect on the rate of convergence. Our simulation studies demonstrate that estimator based on residuals performs much better than that based on conditional second moment of the responses.     

Small-Sample Quantile Estimators in a Large Nonparametric Model

The large nonparametric model in this note is a statistical model with the family ? of all continuous and strictly increasing distribution functions. In the abundant literature of the subject, there are many proposals for nonparametric estimators that are applicable in the model. Typically the kth order statistic X _k:n is taken as a simplest estimator, with k = [nq], or k = [(n + 1)q], or k = [nq] + 1, etc. Often a linear combination of two consecutive order statistics is considered. In more sophisticated constructions, different L-statistics (e.g., Harrel–Davis, Kaigh–Lachenbruch, Bernstein, kernel estimators) are proposed. Asymptotically the estimators do not differ substantially, but if the sample size n is fixed, which is the case of our concern, differences may be serious. A unified treatment of quantile estimators in the large, nonparametric statistical model is developed.     

From Ordinary to Shrinkage Square-Root Estimators

Consider a skewed population. Suppose an intelligent guess could be made about an interval that contains the population mean. There may exist biased estimators with smaller mean squared error than the arithmetic mean within such an interval. This article indicates when it is advisable to shrink the arithmetic mean towards a guessed interval using root estimators. The goal is to obtain an estimator that is better near the average of natural origins. An estimator proposed. This estimator contains the Thompson (1968 Thompson , J. R. ( 1968 ). Accuracy borrowing in the estimation of the mean by shrinkage towards an interval . J. Amer. Statist. Assoc. 63 : 953 – 963 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ordinary shrinkage estimator, the Jenkins et al. (1973 Jenkins , O. C. , Ringer , L. J. , Hartley , H. O. ( 1973 ). Root estimators . J Amer. Statist. Assoc. 68 : 414 – 419 . [CSA] [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) square-root estimator, and the arithmetic sample mean as special cases. The bias and the mean squared error of the proposed more general estimator is compared with the three special cases. Shrinkage coefficients that yield minimum mean squared error estimators are obtained. The proposed estimator is considerably more efficient than the three special cases. This remains true for highly skewed populations. The merits of the proposed shrinkage square-root estimator are supported by the results of numerical and simulation studies.     

Efficient Ratio and Product Estimators in Stratified Random Sampling

This paper suggests an efficient class of ratio and product estimators for estimating the population mean in stratified random sampling using auxiliary information. It is interesting to mention that, in addition to many, Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]), Kadilar and Cingi (2003 Kadilar , C. , Cingi , H. ( 2003 ). Ratio estimator in stratified sampling . Biometr. J. 45 : 218 – 225 .[Crossref], [Web of Science ®] , [Google Scholar], 2005 Kadilar , C. , Cingi , H. ( 2005 ). A new estimator in stratified random sampling . Commun. Statist. Theor. Meth. 34 : 597 – 602 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), and Singh and Vishwakarma (2007 Singh , H. P. , Vishwakarma , G. K. ( 2007 ). Modified exponential ratio and product estimators for finite population mean in double sampling . Austr. J. Statist. 36 ( 3 ): 217 – 225 . [Google Scholar]) estimators are identified as members of the proposed class of estimators. The expressions of bias and mean square error (MSE) of the proposed estimators are derived under large sample approximation in general form. Asymptotically optimum estimator (AOE) in the class is identified alongwith its MSE formula. It has been shown that the proposed class of estimators is more efficient than combined regression estimator and Koyuncu and Kadilar (2009 Koyuncu , N. , Kadilar , C. ( 2009 ). Ratio and product estimators in stratified random sampling . J. Statist. Plann. Infer. 139 : 2552 – 2558 .[Crossref], [Web of Science ®] , [Google Scholar]) estimator. Moreover, theoretical findings are supported through a numerical example.     

Monte Carlo Simulation Study of Biased Estimators in the Linear Regression Models with Correlated or Heteroscedastic Errors

In this study, the performance of the estimators proposed in the presence of multicollinearity in the linear regression model with heteroscedastic or correlated or both error terms is investigated under the matrix mean square error criterion. Structures of the autocorrelated error terms are given and a Monte Carlo simulation study is conducted to examine the relative efficiency of the estimators against each other.     

Relative error prediction via kernel regression smoothers

In this article, we introduce and study local constant and local linear nonparametric regression estimators when it is appropriate to assess performance in terms of mean squared relative error of prediction. We give asymptotic results for both boundary and non-boundary cases. These are special cases of more general asymptotic results that we provide concerning the estimation of the ratio of conditional expectations of two functions of the response variable. We also provide a good bandwidth selection method for the estimators. Examples of application, limited simulation results and discussion of related problems and approaches are also given.     

The Research on Two Kinds of Restricted Biased Estimators Based on Mean Squared Error Matrix

Sakall?oglu et al. (2001 Sakall?oglu , Kaç?ranlar , Akdeniz ( 2001 ). Mean squared error comparisons of some biased estimators . Commun. Statist. Theor. Meth. 30 : 347 – 361 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) dealt with the comparisons among the ridge estimator, Liu estimator, and iteration estimator. Akdeniz and Erol (2003 Akdeniz , F. , Erol , H. ( 2003 ). Mean squared error matrix comparisons of some biased estimators in linear regression . Commun. Statist. Theor. Meth. 32 : 2389 – 2413 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have compared the (almost unbiased) generalized ridge regression estimator with the (almost unbiased) generalized Liu estimator in the matrix mean squared error sense. In this article, we study the ridge estimator and Liu estimator with respect to linear equality restriction, and establish some sufficient conditions for the superiority of the restricted ridge estimator over the restricted Liu estimator and the superiority of the restricted Liu estimator over the restricted ridge estimator under mean squared error matrix, respectively. Furthermore, we give a numerical example.     

On the Principal Component Liu-type Estimator in Linear Regression

In this article, we present a principal component Liu-type estimator (LTE) by combining the principal component regression (PCR) and LTE to deal with the multicollinearity problem. The superiority of the new estimator over the PCR estimator, the ordinary least squares estimator (OLSE) and the LTE are studied under the mean squared error matrix. The selection of the tuning parameter in the proposed estimator is also discussed. Finally, a numerical example is given to explain our theoretical results.     

Kernel Survival Function Estimation Based on Doubly Censored Data

This work concerns the estimation of a smooth survival function based on doubly censored data. We establish strong consistency and asymptotic normality for a kernel estimator. Moreover, we also obtain an asymptotic expression for the mean integrated squared error, which yields an optimum bandwidth in terms of readily estimable quantities.     

Relative efficiencies of kernel and local likelihood density estimators

Summary. Local likelihood methods enjoy advantageous properties, such as good performance in the presence of edge effects, that are rarely found in other approaches to nonparametric density estimation. However, as we argue in this paper, standard kernel methods can have distinct advantages when edge effects are not present. We show that, whereas the integrated variances of the two methods are virtually identical, the integrated squared bias of a conventional kernel estimator is less than that of a local log-linear estimator by as much as a factor of 4. Moreover, the greatest bias improvements offered by kernel methods occur when they are needed most—i.e. when the effect of bias is particularly high. Similar comparisons can also be made when high degree local log-polynomial fits are assessed against high order kernel methods. For example, although (as is well known) high degree local polynomial fits offer potentially infinite efficiency gains relative to their kernel competitors, the converse is also true. Indeed, the asymptotic value of the integrated squared bias of a local log-quadratic estimator can exceed any given constant multiple of that for the competing kernel method. In all cases the densities that suffer problems in the context of local log-likelihood methods can be chosen to be symmetric, either unimodal or bimodal, either infinitely or compactly supported, and to have arbitrarily many derivatives as functions on the real line. They are not pathological. However, our results reveal quantitative differences between global performances of local log-polynomial estimators applied to unimodal or multimodal distributions.     

Improvement of the Liu Estimator in Weighted Mixed Regression

ABSTRACT

The maximum likelihood approach to the proportional hazards model is considered. The purpose is to find a general approach to the analysis of the proportional hazards model, whether the baseline distribution is absolutely continuous, discrete, or a mixture. The advantage is that ties are treated without pain, while the performance for continuous data is almost the same as Cox's partial likelihood. The potential disadvantage with many nuisance parameters is taken care of by profiling them out for risk sets containing only one failure.     

On boundary correction in kernel density estimation

It is well known now that kernel density estimators are not consistent when estimating a density near the finite end points of the support of the density to be estimated. This is due to boundary effects that occur in nonparametric curve estimation problems. A number of proposals have been made in the kernel density estimation context with some success. As of yet there appears to be no single dominating solution that corrects the boundary problem for all shapes of densities. In this paper, we propose a new general method of boundary correction for univariate kernel density estimation. The proposed method generates a class of boundary corrected estimators. They all possess desirable properties such as local adaptivity and non-negativity. In simulation, it is observed that the proposed method perform quite well when compared with other existing methods available in the literature for most shapes of densities, showing a very important robustness property of the method. The theory behind the new approach and the bias and variance of the proposed estimators are given. Results of a data analysis are also given.     

Two Kinds of Restricted Estimators in Singular Linear Regression

In this article, the parameter estimators in singular linear model with linear equality restrictions are considered. The restricted root estimator and the generalized restricted root estimator are proposed and some properties of the estimators are also studied. Furthermore, we compare them with the restricted unified least squares estimator and show their sufficient conditions under which their superior over the restricted unified least squares estimator in terms of mean squares error, and discuss the choice of the unknown parameters of the generalized restricted root estimator.