Bridge Estimators in the Partially Linear Model with High Dimensionality

This article studies variable selection and parameter estimation in the partially linear model when the number of covariates in the linear part increases to infinity. Using the bridge penalty method, we succeed in selecting the important covariates of the linear part. Under regularity conditions, we have shown that the bridge penalized estimator of the parametric part enjoys the oracle property. We also obtain the convergence rate of the estimator of the nonparametric part. Simulation studies show that the bridge estimator performs as well as the oracle estimator for the partially linear model. An application is analyzed to illustrate the bridge procedure.     

Restricted Estimation in Partially Linear Errors-in-Variables Models

As a compromise between parametric regression and nonparametric regression, partially linear models are frequently used in statistical modelling. This article considers statistical inference for this semiparametric model when the linear covariate is measured with additive error and some additional linear restrictions on the parametric component are assumed to hold. We propose a restricted corrected profile least-squares estimator for the parametric component, and study the asymptotic normality of the estimator. To test hypothesis on the parametric component, we construct a Wald test statistic and obtain its limiting distribution. Some simulation studies are conducted to illustrate our approaches.     

Jackknife Estimation for Smooth Functions of the Parametric Component in Partially Linear Regression Models

Abstract

It is known that due to the existence of the nonparametric component, the usual estimators for the parametric component or its function in partially linear regression models are biased. Sometimes this bias is severe. To reduce the bias, we propose two jackknife estimators and compare them with the naive estimator. All three estimators are shown to be asymptotically equivalent and asymptotically normally distributed under some regularity conditions. However, through simulation we demonstrate that the jackknife estimators perform better than the naive estimator in terms of bias when the sample size is small to moderate. To make our results more useful, we also construct consistent estimators of the asymptotic variance, which are robust against heterogeneity of the error variances.     

Statistical Inference on Partially Linear Additive Models with Missing Response Variables and Error-prone Covariates

This paper considers statistical inference for the partially linear additive models, which are useful extensions of additive models and partially linear models. We focus on the case where some covariates are measured with additive errors, and the response variable is sometimes missing. We propose a profile least-squares estimator for the parametric component and show that the resulting estimator is asymptotically normal. To construct a confidence region for the parametric component, we also propose an empirical-likelihood-based statistic, which is shown to have a chi-squared distribution asymptotically. Furthermore, a simulation study is conducted to illustrate the performance of the proposed methods.     

Covariate-Adjusted Partially Linear Regression Models

Motivated by covariate-adjusted regression (CAR) proposed by Sentürk and Müller (2005 Sentürk , D. , Müller , H. G. ( 2005 ). Covariate-adjusted regression . Biometrika 92 : 75 – 89 .[Crossref], [Web of Science ®] , [Google Scholar]) and an application problem, in this article we introduce and investigate a covariate-adjusted partially linear regression model (CAPLM), in which both response and predictor vector can only be observed after being distorted by some multiplicative factors, and an additional variable such as age or period is taken into account. Although our model seems to be a special case of covariate-adjusted varying coefficient model (CAVCM) given by Sentürk (2006 Sentürk , D. ( 2006 ). Covariate-adjusted varying coefficient models . Biostatistics 7 : 235 – 251 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), the data types of CAPLM and CAVCM are basically different and then the methods for inferring the two models are different. In this article, the estimate method motivated by Cui et al. (2008 Cui , X. , Guo , W. S. , Lin , L. , Zhu , L. X. ( 2008 ). Covariate-adjusted nonlinear regression . Ann. Statist. 37 : 1839 – 1870 . [Google Scholar]) is employed to infer the new model. Furthermore, under some mild conditions, the asymptotic normality of estimator for the parametric component is obtained. Combined with the consistent estimate of asymptotic covariance, we obtain confidence intervals for the regression coefficients. Also, some simulations and a real data analysis are made to illustrate the new model and methods.     

Empirical-likelihood-based Test for Partially Linear Single-index Models with Error-prone Linear Covariates

In this article, we consider whether the empirical likelihood ratio (ELR) test is applicable to testing for serial correlation in the partially linear single-index models (PLSIM) with error-prone linear covariates. It is shown that under the null hypothesis the proposed ELR statistic follows asymptotically a χ²-distribution with the scale constant and the degrees of freedom. A comparison between the ELR and the normal approximation method is also considered. Both simulated and real data examples are used to illustrate our proposed methodology.     

Estimation for Partially Linear Single-index Instrumental Variables Models

In this article, we generalize the partially linear single-index models to the scenario with some endogenous covariates variables. It is well known that the estimators based on the existing methods are often inconsistent because of the endogeneity of covariates. To deal with the endogenous variables, we introduce some auxiliary instrumental variables. A three-stage estimation procedure is proposed for partially linear single-index instrumental variables models. The first stage is to obtain a linear projection of endogenous variables on a set of instrumental variables, the second stage is to estimate the link function by using local linear smoother for given constant parameters, and the last stage is to obtain the estimators of constant parameters based on the estimating equation. Asymptotic normality is established for the proposed estimators. Some simulation studies are undertaken to assess the finite sample performance of the proposed estimation procedure.     

Estimation in Partially Linear Single-Index Models with Missing Covariates

In this article, we consider a partially linear single-index model Y = g(Z ^τθ₀) + X ^τβ₀ + ? when the covariate X may be missing at random. We propose weighted estimators for the unknown parametric and nonparametric part by applying weighted estimating equations. We establish normality of the estimators of the parameters and asymptotic expansion for the estimator of the nonparametric part when the selection probabilities are unknown. Simulation studies are also conducted to illustrate the finite sample properties of these estimators.     

Asymptotic Normality for the Partially Linear EV Models with Longitudinal Data

In this article, we consider a partially linear EV regression model under longitudinal data. By using a weighted kernel method and modified least-squared method, the estimators of unknown parameter, the unknown function are constructed and the asymptotic normality of the estimators are derived. Simulation studies are conducted to illustrate the finite-sample performance of the proposed method.     

Comparison of Nonparametric Components in Two Partially Linear Models

In this article, we are concerned with whether the nonparametric functions are parallel from two partial linear models, and propose a test statistic to check the difference of the two functions. The unknown constant α is estimated by using moment method under null models. Nonparametric functions under both null and full models are estimated by using local linear method. The asymptotic properties of parametric and nonparametric components are derived. The test statistic under the null hypothesis is calculated and shown to be asymptotically normal.     

Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models

In this article, the partially linear covariate-adjusted regression models are considered, and the penalized least-squares procedure is proposed to simultaneously select variables and estimate the parametric components. The rate of convergence and the asymptotic normality of the resulting estimators are established under some regularization conditions. With the proper choices of the penalty functions and tuning parameters, it is shown that the proposed procedure can be as efficient as the oracle estimators. Some Monte Carlo simulation studies and a real data application are carried out to assess the finite sample performances for the proposed method.     

两个部分线性模型的比较

内容提要:对于两个部分线性模型参数部分中模型系数是否相等的检验问题,本文基于比较原假设与备择假设下模型拟合的残差平方和的思想构造了检验统计量,并给出了计算检验_^p* 值的F分布逼近法。     

Empirical Likelihood Inference for the Parameter in Additive Partially Linear EV Models

In this article, we consider empirical likelihood inference for the parameter in the additive partially linear models when the linear covariate is measured with error. By correcting for attenuation, a corrected-attenuation empirical log-likelihood ratio statistic for the unknown parameter β, which is of primary interest, is suggested. We show that the proposed statistic is asymptotically standard chi-square distribution without requiring the undersmoothing of the nonparametric components, and hence it can be directly used to construct the confidence region for the parameter β. Some simulations indicate that, in terms of comparison between coverage probabilities and average lengths of the confidence intervals, the proposed method performs better than the profile-based least-squares method. We also give the maximum empirical likelihood estimator (MELE) for the unknown parameter β, and prove the MELE is asymptotically normal under some mild conditions.     

Joint Mean-Covariance Models with Applications to Longitudinal Data in Partially Linear Model

Semiparametric regression models and estimating covariance functions are very useful in longitudinal study. Unfortunately, challenges arise in estimating the covariance function of longitudinal data collected at irregular time points. In this article, for mean term, a partially linear model is introduced and for covariance structure, a modified Cholesky decomposition approach is proposed to heed the positive-definiteness constraint. We estimate the regression function by using the local linear technique and propose quasi-likelihood estimating equations for both the mean and covariance structures. Moreover, asymptotic normality of the resulting estimators is established. Finally, simulation study and real data analysis are used to illustrate the proposed approach.     

Empirical Likelihood for Semiparametric Varying-Coefficient Heteroscedastic Partially Linear Errors-in-Variables Models

The purpose of this article is to use the empirical likelihood method to study construction of the confidence region for the parameter of interest in semiparametric varying-coefficient heteroscedastic partially linear errors-in-variables models. When the variance functions of the errors are known or unknown, we propose the empirical log-likelihood ratio statistics for the parameter of interest. For each case, a nonparametric version of Wilks’ theorem is derived. The results are then used to construct confidence regions of the parameter. A simulation study is carried out to assess the performance of the empirical likelihood method.     

Smoothing Spline Estimation for Partially Linear Single-index Models

In this article, the partially linear single-index models are discussed based on smoothing spline and average derivative estimation method. This proposed technique consists of two stages: one is to estimate the vector parameter in the linear part using the smoothing cubic spline method, simultaneously, obtaining the estimator of unknown single-index function; the other is to estimate the single-index coefficients in the single-index part by the using average derivative estimator procedure. Some simulated and real examples are presented to illustrate the performance of this method.     

Adjustive Liu-Type Estimators in Linear Regression Models

In this article, we aim to put forward the notion of adjustive Liu-type estimator (ALTE) in the linear regression model. First, the explicit expression of the optimal selection of the adjustive factors is derived under the PRESS criterion through matrix techniques. Then, the results are applied to the dataset on Portland cement. Moreover, to select biasing parameters from the theoretical point of view, we extend ALTE to the generalized version (GALTE) and obtained the optimal ones. The results of the Portland cement data show that ALTE's and GALTE's can substantially improve the ordinary least squares estimator and Liu-type estimators.     

Testing Serial Correlation in Partially Linear Additive Errors-in-variables Models

This article considers testing serial correlation in partially linear additive errors-in-variables model. Based on the empirical likelihood based approach, a test statistic was proposed, and it was shown to follow asymptotically a chi-square distribution under the null hypothesis of no serial correlation. Finally, some simulation studies are conducted to illustrate the performance of the proposed method.     

Testing Serial Correlation in Partially Linear Single-Index Errors-in-Variables Models

In this article, we propose two test statistics for testing the underlying serial correlation in a partially linear single-index model Y = η(Z ^τα) + X ^τβ + ? when X is measured with additive error. The proposed test statistics are shown to have asymptotic normal or chi-squared distributions under the null hypothesis of no serial correlation. Monte Carlo experiments are also conducted to illustrate the finite sample performance of the proposed test statistics. The simulation results confirm that these statistics perform satisfactorily in both estimated sizes and powers.     

Preliminary Test Estimators Induced by Three Large Sample Tests for Stochastic Constraints in a Regression Model with Multivariate Student-t Error

In this article, we consider the preliminary test approach to the estimation of the regression parameter in a multiple regression model with multivariate Student-t distribution. The preliminary test estimators (PTE) based on the Wald (W), Likelihood Ratio (LR), and Lagrangian Multiplier (LM) tests are given under the suspicion of stochastic constraints occurring. The bias, mean square error matr ix (MSEM), and weighted mean square error (WMSE) of the proposed estimators are derived and compared. The conditions of superiority of the proposed estimators are obtained. Finally, we conclude that the optimum choice of the level of significance becomes the traditional choice by using the W test.