Statistical inference on asymptotic properties of two estimators for the partially linear single-index models

The outer product of gradients (OPG) estimation procedure based on least squares (LS) approach has been presented by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] to estimate the single-index parameter in partially linear single-index models (PLSIM). However, its asymptotic property has not been established yet and the efficiency of LS-based method can be significantly affected by outliers and heavy-tailed distributions. In this paper, we firstly derive the asymptotic property of OPG estimator developed by Xia et al. [An adaptive estimation of dimension reduction space. J Roy Statist Soc Ser B. 2002;64:363–410] in theory, and a novel robust estimation procedure combining the ideas of OPG and local rank (LR) inference is further developed for PLSIM along with its theoretical property. Then, we theoretically derive the asymptotic relative efficiency (ARE) of the proposed LR-based procedure with respect to LS-based method, which is shown to possess an expression that is closely related to that of the signed-rank Wilcoxon test in comparison with the t-test. Moreover, we demonstrate that the new proposed estimator has a great efficiency gain across a wide spectrum of non-normal error distributions and almost not lose any efficiency for the normal error. Even in the worst case scenarios, the ARE owns a lower bound equalling to 0.864 for estimating the single-index parameter and a lower bound being 0.8896 for estimating the nonparametric function respectively, versus the LS-based estimators. Finally, some Monte Carlo simulations and a real data analysis are conducted to illustrate the finite sample performance of the estimators.     

Variable Selection for Partially Linear Models with Randomly Censored Data

This article proposes a variable selection procedure for partially linear models with right-censored data via penalized least squares. We apply the SCAD penalty to select significant variables and estimate unknown parameters simultaneously. The sampling properties for the proposed procedure are investigated. The rate of convergence and the asymptotic normality of the proposed estimators are established. Furthermore, the SCAD-penalized estimators of the nonzero coefficients are shown to have the asymptotic oracle property. In addition, an iterative algorithm is proposed to find the solution of the penalized least squares. Simulation studies are conducted to examine the finite sample performance of the proposed method.     

Penalized inverse probability weighted estimators for weighted rank regression with missing covariates

Abstract

In this article, we study the variable selection and estimation for linear regression models with missing covariates. The proposed estimation method is almost as efficient as the popular least-squares-based estimation method for normal random errors and empirically shown to be much more efficient and robust with respect to heavy tailed errors or outliers in the responses and covariates. To achieve sparsity, a variable selection procedure based on SCAD is proposed to conduct estimation and variable selection simultaneously. The procedure is shown to possess the oracle property. To deal with the covariates missing, we consider the inverse probability weighted estimators for the linear model when the selection probability is known or unknown. It is shown that the estimator by using estimated selection probability has a smaller asymptotic variance than that with true selection probability, thus is more efficient. Therefore, the important Horvitz-Thompson property is verified for penalized rank estimator with the covariates missing in the linear model. Some numerical examples are provided to demonstrate the performance of the estimators.     

The MLE of Geometric Parameter for a Geometric Process

In this article, we provide the MLE of the ratio parameter of a geometric process and discuss its consistency and asymptotic normality.     

Ridge Estimation to the Restricted Linear Model

This article is concerned with the problem of multicollinearity in a linear model with linear restrictions. After introducing a spheral restricted condition, a new restricted ridge estimation method is proposed by minimizing the sum of squared residuals. The property of the new estimator in its superiority over the ordinary restricted least squares estimation is then theoretically analyzed. Furthermore, a sufficient and necessary condition for selecting the ridge parameter k is obtained. To simplify the selection of the ridge parameter, a sufficient condition is also given. Finally, a numerical example demonstrates the merit of the new method in the aspect of solving the multicollinearity over the ordinary restricted least squares estimation.     

The Research on Two Kinds of Restricted Biased Estimators Based on Mean Squared Error Matrix

Sakall?oglu et al. (2001 Sakall?oglu , Kaç?ranlar , Akdeniz ( 2001 ). Mean squared error comparisons of some biased estimators . Commun. Statist. Theor. Meth. 30 : 347 – 361 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) dealt with the comparisons among the ridge estimator, Liu estimator, and iteration estimator. Akdeniz and Erol (2003 Akdeniz , F. , Erol , H. ( 2003 ). Mean squared error matrix comparisons of some biased estimators in linear regression . Commun. Statist. Theor. Meth. 32 : 2389 – 2413 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have compared the (almost unbiased) generalized ridge regression estimator with the (almost unbiased) generalized Liu estimator in the matrix mean squared error sense. In this article, we study the ridge estimator and Liu estimator with respect to linear equality restriction, and establish some sufficient conditions for the superiority of the restricted ridge estimator over the restricted Liu estimator and the superiority of the restricted Liu estimator over the restricted ridge estimator under mean squared error matrix, respectively. Furthermore, we give a numerical example.     

Ridge Regression Estimation for Survey Samples

This paper describes procedure for constructing a vector of regression weights. Under the regression superpopulation model, the ridge regression estimator that has minimum model mean squared error is derived. Through a simulation study, we compare the ridge regression weights, regression weights, quadratic programming weights, and raking ratio weights. The ridge regression procedure with weights bounded by zero performed very well.     

Shortest prediction intervals for the birnbaum-saunders distribution

Shortest prediction intervals for a future observation from the Birnbaum-Saunders distribution are obtained from both frequentist and Bayesian perspectives. Comparisons are made with alternative intervals obtained via inversion. Monte Carlo simulations are performed to assess the approximate intervals.     

A brief proof on the generalized variance bound of the relative efficiency in statistics

In this paper, we obtain a brief proof on the generalized varance bound of the relative efficiency that was simultaneously given by Bloomfield and Watson(1975) and by Knott (1975).     

De-aliasing effects using semifoldover techniques

Semifoldover designs, obtained by semifolding a regular two-level factorial design, have been discussed recently in the literature. In this article, with the use of indicator functions, we investigate various semifoldover designs that are obtained from a general two-level factorial design. We discuss when a main factor or a two-factor interaction can be de-aliased from their aliased two-factor interactions, and extend some of the existing results from regular designs to non-regular designs. Finally, we present some examples to illustrate the results developed here.