Root-n-consistent semiparametric estimation of partially linear models based on k-nn method

In the context of the partially linear semiparametric model examined by Robinson (1988), we show that root-n-consisten estimation results established using kernel and series methods can also be obtained by using k-nearest-neighbor (k-nn) method.     

Liu-type estimator in semiparametric partially linear additive models

Partially linear additive model is useful in statistical modelling as a multivariate nonparametric fitting technique. This paper considers statistical inference for the semiparametric model in the presence of multicollinearity. Based on the profile least-squares (PL) approach and Liu estimation method, we propose a PL Liu estimator for the parametric component. When some additional linear restrictions on the parametric component are available, the corresponding restricted Liu estimator for the parametric component is constructed. The properties of the proposed estimators are derived. Some simulations are conducted to assess the performance of the proposed procedures and the results are satisfactory. Finally, a real data example is analysed.     

Root-n-consistent semiparametric estimation of partially linear models based on k-nn method

In the context of the partially linear semiparametric model examined by Robinson (1988), we show that root-n-consisten estimation results established using kernel and series methods can also be obtained by using k-nearest-neighbor (k-nn) method.     

Principal components regression estimator of the parameters in partially linear models

ABSTRACT

As a compromise between parametric regression and non-parametric regression models, partially linear models are frequently used in statistical modelling. This paper is concerned with the estimation of partially linear regression model in the presence of multicollinearity. Based on the profile least-squares approach, we propose a novel principal components regression (PCR) estimator for the parametric component. When some additional linear restrictions on the parametric component are available, we construct a corresponding restricted PCR estimator. Some simulations are conducted to examine the performance of our proposed estimators and the results are satisfactory. Finally, a real data example is analysed.     

General partially linear varying-coefficient transformation models for ranking data

In this paper,we propose a class of general partially linear varying-coefficient transformation models for ranking data. In the models, the functional coefficients are viewed as nuisance parameters and approximated by B-spline smoothing approximation technique. The B-spline coefficients and regression parameters are estimated by rank-based maximum marginal likelihood method. The three-stage Monte Carlo Markov Chain stochastic approximation algorithm based on ranking data is used to compute estimates and the corresponding variances for all the B-spline coefficients and regression parameters. Through three simulation studies and a Hong Kong horse racing data application, the proposed procedure is illustrated to be accurate, stable and practical.     

Empirical likelihood based diagnostics for heteroscedasticity in semiparametric varying-coefficient partially linear errors-in-variables models

In this paper, we propose an empirical likelihood based diagnostic technique for heteroscedasticity in the semiparametric varying-coefficient partially linear errors-in-variables models. Under mild conditions, a nonparametric version of Wilk’s theorem is derived. Simulation results reveal that our test performs well in both size and power.     

Estimation of the mixtures of GLMs with covariate-dependent mixing proportions

ABSTRACT

In this article, we study the estimation for a class of semiparametric mixtures of generalized linear models where mixing proportions depend on a covariate non parametrically. We investigate a backfitting estimation procedure and show the asymptotic normality of the proposed estimators under mild conditions. We conduct simulation to show the good performance of our methodology and give a real data analysis as an illustration.     

Estimation and diagnostic for skew-normal partially linear models

Partially linear models (PLMs) are an important tool in modelling economic and biometric data and are considered as a flexible generalization of the linear model by including a nonparametric component of some covariate into the linear predictor. Usually, the error component is assumed to follow a normal distribution. However, the theory and application (through simulation or experimentation) often generate a great amount of data sets that are skewed. The objective of this paper is to extend the PLMs allowing the errors to follow a skew-normal distribution [A. Azzalini, A class of distributions which includes the normal ones, Scand. J. Statist. 12 (1985), pp. 171–178], increasing the flexibility of the model. In particular, we develop the expectation-maximization (EM) algorithm for linear regression models and diagnostic analysis via local influence as well as generalized leverage, following [H. Zhu and S. Lee, Local influence for incomplete-data models, J. R. Stat. Soc. Ser. B 63 (2001), pp. 111–126]. A simulation study is also conducted to evaluate the efficiency of the EM algorithm. Finally, a suitable transformation is applied in a data set on ragweed pollen concentration in order to fit PLMs under asymmetric distributions. An illustrative comparison is performed between normal and skew-normal errors.     

Automatic structure discovery for varying-coefficient partially linear models

Varying-coefficient partially linear models provide a useful tools for modeling of covariate effects on the response variable in regression. One key question in varying-coefficient partially linear models is the choice of model structure, that is, how to decide which covariates have linear effect and which have non linear effect. In this article, we propose a profile method for identifying the covariates with linear effect or non linear effect. Our proposed method is a penalized regression approach based on group minimax concave penalty. Under suitable conditions, we show that the proposed method can correctly determine which covariates have a linear effect and which do not with high probability. The convergence rate of the linear estimator is established as well as the asymptotical normality. The performance of the proposed method is evaluated through a simulation study which supports our theoretical results.     

An asymptotic theory for semiparametric generalized least squares estimation in partially linear regression models

Consider a partially linear regression model with an unknown vector parameter β, an unknown functiong(·), and unknown heteroscedastic error variances. In this paper we develop an asymptotic semiparametric generalized least squares estimation theory under some weak moment conditions. These moment conditions are satisfied by many of the error distributions encountered in practice, and our theory does not require the number of replications to go to infinity.     

Estimation for the censored partially linear quantile regression models

In this article, we develop estimation procedures for partially linear quantile regression models, where some of the responses are censored by another random variable. The nonparametric function is estimated by basis function approximations. The estimation procedure is easy to implement through existing weighted quantile regression, and it requires no specification of the error distributions. We show the large-sample properties of the resulting estimates, the proposed estimator of the regression parameter is root-n consistent and asymptotically normal and the estimator of the functional component achieves the optimal convergence rate of the nonparametric function. The proposed method is studied via simulations and illustrated with the analysis of a primary biliary cirrhosis (BPC) data.     

Semiparametric partially linear regression models for functional data

In the context of longitudinal data analysis, a random function typically represents a subject that is often observed at a small number of time point. For discarding this restricted condition of observation number of each subject, we consider the semiparametric partially linear regression models with mean function x^?β$x^{?}\beta$ + g(z), where x and z   are functional data. The estimations of β$\beta$ and g(z) are presented and some asymptotic results are given. It is shown that the estimator of the parametric component is asymptotically normal. The convergence rate of the estimator of the nonparametric component is also obtained. Here, the observation number of each subject is completely flexible. Some simulation study is conducted to investigate the finite sample performance of the proposed estimators.     

Model selection and model averaging for semiparametric partially linear models with missing data

We study model selection and model averaging in semiparametric partially linear models with missing responses. An imputation method is used to estimate the linear regression coefficients and the nonparametric function. We show that the corresponding estimators of the linear regression coefficients are asymptotically normal. Then a focused information criterion and frequentist model average estimators are proposed and their theoretical properties are established. Simulation studies are performed to demonstrate the superiority of the proposed methods over the existing strategies in terms of mean squared error and coverage probability. Finally, the approach is applied to a real data case.     

Fitting mixtures of linear regressions

In most applications, the parameters of a mixture of linear regression models are estimated by maximum likelihood using the expectation maximization (EM) algorithm. In this article, we propose the comparison of three algorithms to compute maximum likelihood estimates of the parameters of these models: the EM algorithm, the classification EM algorithm and the stochastic EM algorithm. The comparison of the three procedures was done through a simulation study of the performance (computational effort, statistical properties of estimators and goodness of fit) of these approaches on simulated data sets.

Simulation results show that the choice of the approach depends essentially on the configuration of the true regression lines and the initialization of the algorithms.     

Block empirical likelihood for longitudinal partially linear regression models

The authors propose a block empirical likelihood procedure to accommodate the within‐group correlation in longitudinal partially linear regression models. This leads them to prove a nonparametric version of the Wilks theorem. In comparison with normal approximations, their method does not require a consistent estimator for the asymptotic covariance matrix, which makes it easier to conduct inference on the parametric component of the model. An application to a longitudinal study on fluctuations of progesterone level in a menstrual cycle is used to illustrate the procedure developed here.     

Estimation and inference for varying coefficient partially nonlinear errors-in-variables models

In this article, we study the varying coefficient partially nonlinear model with measurement errors in the nonparametric part. A local corrected profile nonlinear least-square estimation procedure is proposed and the asymptotic properties of the resulting estimators are established. Further, a generalized likelihood ratio (GLR) statistic is proposed to test whether the varying coefficients are constant. The asymptotic null distribution of the statistic is obtained and a residual-based bootstrap procedure is employed to compute the p-value of the statistic. Some simulations are conducted to evaluate the performance of the proposed methods. The results show that the estimating and testing procedures work well in finite samples.     

Empirical likelihood for generalized partially linear varying-coefficient models

Generalized partially linear varying-coefficient models (GPLVCM) are frequently used in statistical modeling. However, the statistical inference of the GPLVCM, such as confidence region/interval construction, has not been very well developed. In this article, empirical likelihood-based inference for the parametric components in the GPLVCM is investigated. Based on the local linear estimators of the GPLVCM, an estimated empirical likelihood-based statistic is proposed. We show that the resulting statistic is asymptotically non-standard chi-squared. By the proposed empirical likelihood method, the confidence regions for the parametric components are constructed. In addition, when some components of the parameter are of particular interest, the construction of their confidence intervals is also considered. A simulation study is undertaken to compare the empirical likelihood and the other existing methods in terms of coverage accuracies and average lengths. The proposed method is applied to a real example.     

Test for high dimensional regression coefficients of partially linear models

Abstract

Partially linear models attract much attention to investigate the association between predictors and the response variable when the dependency on some predictors may be nonlinear. However, the hypothesis test for significance of predictors is still challenging, especially when the number of predictors is larger than sample size. In this paper, we reconsider the test procedure of Zhong and Chen (2011 Zhong, P., and S. Chen. 2011. Tests for high-dimensional regression coefficients with factorial designs. Journal of the American Statistical Association 106 (493):260–74. doi:10.1198/jasa.2011.tm10284.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) when regression models have nonlinear components, and propose a generalized U-statistic for testing the linear components of the high dimensional partially linear models. The asymptotic properties of test statistic are obtained under null and alternative hypotheses, where the effect of nonlinear components should be considered and thus is different from that in linear models. Through simulation studies, we demonstrate good finite-sample performance of the proposed test in comparison with the existing methods. The practical utility of our proposed method is illustrated by a real data example.     

Estimation and hypothesis testing in multivariate linear regression models under non normality

This paper discusses the problem of statistical inference in multivariate linear regression models when the errors involved are non normally distributed. We consider multivariate t-distribution, a fat-tailed distribution, for the errors as alternative to normal distribution. Such non normality is commonly observed in working with many data sets, e.g., financial data that are usually having excess kurtosis. This distribution has a number of applications in many other areas of research as well. We use modified maximum likelihood estimation method that provides the estimator, called modified maximum likelihood estimator (MMLE), in closed form. These estimators are shown to be unbiased, efficient, and robust as compared to the widely used least square estimators (LSEs). Also, the tests based upon MMLEs are found to be more powerful than the similar tests based upon LSEs.     

Nonlinear semiparametric autoregressive model with finite mixtures of scale mixtures of skew normal innovations

We propose data generating structures which can be represented as the nonlinear autoregressive models with single and finite mixtures of scale mixtures of skew normal innovations. This class of models covers symmetric/asymmetric and light/heavy-tailed distributions, so provide a useful generalization of the symmetrical nonlinear autoregressive models. As semiparametric and nonparametric curve estimation are the approaches for exploring the structure of a nonlinear time series data set, in this article the semiparametric estimator for estimating the nonlinear function of the model is investigated based on the conditional least square method and nonparametric kernel approach. Also, an Expectation–Maximization-type algorithm to perform the maximum likelihood (ML) inference of unknown parameters of the model is proposed. Furthermore, some strong and weak consistency of the semiparametric estimator in this class of models are presented. Finally, to illustrate the usefulness of the proposed model, some simulation studies and an application to real data set are considered.