Polynomial Regression and Estimating Functions in the Presence of Multiplicative Measurement Error

We consider the polynomial regression model in the presence of multiplicative measurement error in the predictor. Two general methods are considered, with the methods differing in their assumptions about the distributions of the predictor and the measurement errors. Consistent parameter estimates and asymptotic standard errors are derived by using estimating equation theory. Diagnostics are presented for distinguishing additive and multiplicative measurement error. Data from a nutrition study are analysed by using the methods. The results from a simulation study are presented and the performances of the methods are compared.     

Estimating a Convex Function in Nonparametric Regression

Abstract.  A new nonparametric estimate of a convex regression function is proposed and its stochastic properties are studied. The method starts with an unconstrained estimate of the derivative of the regression function, which is firstly isotonized and then integrated. We prove asymptotic normality of the new estimate and show that it is first order asymptotically equivalent to the initial unconstrained estimate if the regression function is in fact convex. If convexity is not present, the method estimates a convex function whose derivative has the same L ^p -norm as the derivative of the (non-convex) underlying regression function. The finite sample properties of the new estimate are investigated by means of a simulation study and it is compared with a least squares approach of convex estimation. The application of the new method is demonstrated in two data examples.     

Additive Nonparametric Regression in the Presence of Endogenous Regressors

In this article we consider nonparametric estimation of a structural equation model under full additivity constraint. We propose estimators for both the conditional mean and gradient which are consistent, asymptotically normal, oracle efficient, and free from the curse of dimensionality. Monte Carlo simulations support the asymptotic developments. We employ a partially linear extension of our model to study the relationship between child care and cognitive outcomes. Some of our (average) results are consistent with the literature (e.g., negative returns to child care when mothers have higher levels of education). However, as our estimators allow for heterogeneity both across and within groups, we are able to contradict many findings in the literature (e.g., we do not find any significant differences in returns between boys and girls or for formal versus informal child care). Supplementary materials for this article are available online.     

Nonparametric Testing of an Exclusion Restriction in Quantile Regression

Using the framework proposed by Bickel et al. (2006 Bickel , P. J. , Ritov , Y. , Stoker , T. ( 2006 ). Tailor-made tests for goodness-of-fit to semiparametric hypotheses . Ann. Stat. 34 ( 2 ): 721 – 741 . [Google Scholar]), we provide a score-based testing method to check the exclusion restriction in quantile regression, i.e., H: ν_α(Y|U, V) = ν_α(Y|U) w.p.1, where ν_α denotes the αth (0 < α < 1) quantile. A subsampling method is suggested to acquire the critical values and justified. The tests are all found to be consistent against fixed alternatives and have discriminating power against local alternatives at root-n scale. We address this particular problem as a representative among a wide family of semiparametric model checking problems. The methodology can be carried over to other goodness-of-fit testing of semiparametric models, possibly involve non smooth functions.     

Tests for Symmetric Error Distribution in Linear and Nonparametric Regression Models

In linear and nonparametric regression models, the problem of testing for symmetry of the distribution of errors is considered. We propose a test statistic which utilizes the empirical characteristic function of the corresponding residuals. The asymptotic null distribution of the test statistic as well as its behavior under alternatives is investigated. A simulation study compares bootstrap versions of the proposed test to other more standard procedures.     

Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models

In this paper we propose a test for the significance of categorical predictors in nonparametric regression models. The test is fully data-driven and employs cross-validated smoothing parameter selection while the null distribution of the test is obtained via bootstrapping. The proposed approach allows applied researchers to test hypotheses concerning categorical variables in a fully nonparametric and robust framework, thereby deflecting potential criticism that a particular finding is driven by an arbitrary parametric specification. Simulations reveal that the test performs well, having significantly better power than a conventional frequency-based nonparametric test. The test is applied to determine whether OECD and non-OECD countries follow the same growth rate model or not. Our test suggests that OECD and non-OECD countries follow different growth rate models, while the tests based on a popular parametric specification and the conventional frequency-based nonparametric estimation method fail to detect any significant difference.     

Cox Regression with Covariate Measurement Error

This article deals with parameter estimation in the Cox proportional hazards model when covariates are measured with error. We consider both the classical additive measurement error model and a more general model which represents the mis-measured version of the covariate as an arbitrary linear function of the true covariate plus random noise. Only moment conditions are imposed on the distributions of the covariates and measurement error. Under the assumption that the covariates are measured precisely for a validation set, we develop a class of estimating equations for the vector-valued regression parameter by correcting the partial likelihood score function. The resultant estimators are proven to be consistent and asymptotically normal with easily estimated variances. Furthermore, a corrected version of the Breslow estimator for the cumulative hazard function is developed, which is shown to be uniformly consistent and, upon proper normalization, converges weakly to a zero-mean Gaussian process. Simulation studies indicate that the asymptotic approximations work well for practical sample sizes. The situation in which replicate measurements (instead of a validation set) are available is also studied.     

Estimating the Conditional Error Distribution in Non‐parametric Regression

Abstract. We consider a general non‐parametric regression model, where the distribution of the error, given the covariate, is modelled by a conditional distribution function. For the estimation, a kernel approach as well as the (kernel based) empirical likelihood method are discussed. The latter method allows for incorporation of additional information on the error distribution into the estimation. We show weak convergence of the corresponding empirical processes to Gaussian processes and compare both approaches in asymptotic theory and by means of a simulation study.     

Testing for the Equality of Two Nonparametric Regression Curves with Long Memory Errors

This article discusses the problem of testing the equality of two nonparametric regression functions against two-sided alternatives for uniform design on [0,1] with long memory moving average errors. The standard deviations and the long memory parameters are possibly different for the two errors. The article adapts the partial sum process idea used in the independent observations settings to construct the tests and derives their asymptotic null distributions. The article also shows that these tests are consistent for general alternatives and obtains their limiting distributions under a sequence of local alternatives. Since the limiting null distributions of these tests are unknown, we first conducted a Monte Carlo simulation study to obtain a few selected critical values of the proposed tests. Then based on these critical values, another Monte Carlo simulation is conducted to study the finite sample level and power behavior of these tests at some alternatives. The article also contains a simulation study that assesses the effect of estimating the nonparametric regression function on an estimate of the long memory parameter of the errors. It is observed that the estimate based on direct observations is generally preferable over the one based on the estimated nonparametric residuals.     

Estimation and Testing in Elliptical Functional Measurement Error Models

The purpose of this article is to investigate estimation and hypothesis testing by maximum likelihood and method of moments in functional models within the class of elliptical symmetric distributions. The main results encompass consistency and asymptotic normality of the method of moments estimators. Also, the asymptotic covariance matrix of the maximum likelihood estimator is derived, extending some existing results in elliptical distributions. A measure of asymptotic relative efficiency is reported. Wald-type statistics are considered and numerical results obtained by Monte Carlo simulation to investigate the performance of estimators and tests are provided for Student-t and contaminated normal distributions. An application to a real dataset is also included.     

带测量误差的分位数回归模型的参数估计研究

近年来,研究预测变量带测量误差的分位数回归模型的参数估计问题已逐渐成为统计学中的一大热点问题,但由于带测量误差的分位数回归模型的参数估计十分复杂,所以相关研究很少,而目前的研究主要集中于误差分布为球形对称分布的正交回归法和误差分布自由的校正损失函数法等。在回归误差分布为正态分布的假设下,提出修正因子得分法(CFS),即在因子得分法的基础上进行参数估计,并对估计偏差进行修正得到最终估计;通过模拟研究,比较修正因子得分法相对正交回归估计(H-L估计)的优劣,并对修正因子得分法进行综合评价。     

参数与非参数回归在FDI中的比较分析

文章在对参数回归及非参数回归方法进行介绍的基础上,采用线性回归模型、引入虚拟变量的非线性回归模型以及N-W核权函数回归估计,对1983-2014年我国外商直接投资总额与GDP关系进行探讨.最后分别给出3类方法的拟合值以及MAE和MSE.从拟合效果来看,相对于线性回归模型,引入虚拟变量的非线性回归模型以及非参数回归方法更能有效地拟合FDI与GDP之间的关系,且窗宽为0.25的非参数估计效果更优.     

Adjusted Confidence Bands in Nonparametric Regression

Suppose we have {(x _i , y _i )} i = 1, 2,…, n, a sequence of independent observations. We wish to find approximate 1 ? α simultaneous confidence bands for the regression curve. Many previous confidence bands in the literature have practical difficulties. In this article, the local linear smoother is used to estimate the regression curve. The bias of the estimator is considered. Different methods of constructing confidence bands are discussed. Finally, a possible method incorporating logistic regression in an innovative way is proposed to construct the bands for random designs. Simulations are used to study the performance or properties of the methods. The procedure for constructing confidence bands is entirely data-driven. The advantage of the proposed method is that it is simple to use and can be applied to random designs. It can be considered as a practically useful and efficient method.     

Monotone Nonparametric Regression and Confidence Intervals

Several variations of monotone nonparametric regression have been developed over the past 30 years. One approach is to first apply nonparametric regression to data and then monotone smooth the initial estimates to “iron out” violations to the assumed order. Here, such estimators are considered, where local polynomial regression is first used, followed by either least squares isotonic regression or a monotone method using simple averages. The primary focus of this work is to evaluate different types of confidence intervals for these monotone nonparametric regression estimators through Monte Carlo simulation. Most of the confidence intervals use bootstrap or jackknife procedures. Estimation of a response variable as a function of two continuous predictor variables is considered, where the estimation is performed at the observed values of the predictors (instead of on a grid). The methods are then applied to data involving subjects that worked at plants that use beryllium metal who have developed chronic beryllium disease.     

Compound Regression and Constrained Regression: Nonparametric Regression Frameworks for EIV Models

Abstract

Errors-in-variable (EIV) regression is often used to gauge linear relationship between two variables both suffering from measurement and other errors, such as, the comparison of two measurement platforms (e.g., RNA sequencing vs. microarray). Scientists are often at a loss as to which EIV regression model to use for there are infinite many choices. We provide sound guidelines toward viable solutions to this dilemma by introducing two general nonparametric EIV regression frameworks: the compound regression and the constrained regression. It is shown that these approaches are equivalent to each other and, to the general parametric structural modeling approach. The advantages of these methods lie in their intuitive geometric representations, their distribution free nature, and their ability to offer candidate solutions with various optimal properties when the ratio of the error variances is unknown. Each includes the classic nonparametric regression methods of ordinary least squares, geometric mean regression (GMR), and orthogonal regression as special cases. Under these general frameworks, one can readily uncover some surprising optimal properties of the GMR, and truly comprehend the benefit of data normalization. Supplementary materials for this article are available online.     

About the Nonparametric Estimation of the Bernoulli Regression

The nonparametric estimation of the Bernoulli regression function is studied. The uniform consistency conditions are established and the limit theorems are proved for continuous functionals on C[a, 1 ? a], 0 < a < 1/2.     

Adaptive Nonparametric Comparison of Regression Curves

In this article, we develop a new and novel kernel density estimator for a sum of weighted averages from a single population based on utilizing the well defined kernel density estimator in conjunction with classic inversion theory. This idea is further developed for a kernel density estimator for the difference of weighed averages from two independent populations. The resulting estimator is “bootstrap-like” in terms of its properties with respect to the derivation of approximate confidence intervals via a “plug-in” approach. This new approach is distinct from the bootstrap methodology in that it is analytically and computationally feasible to provide an exact estimate of the distribution function through direct calculation. Thus, our approach eliminates the error due to Monte Carlo resampling that arises within the context of simulation based approaches that are oftentimes necessary in order to derive bootstrap-based confidence intervals for statistics involving weighted averages of i.i.d. random variables. We provide several examples and carry forth a simulation study to show that our kernel density estimator performs better than the standard central limit theorem based approximation in term of coverage probability.     

Data-Driven Model Choice in Multivariate Nonparametric Regression

The problem of choosing between different regression models, is investigated. A completely automatic model selection procedure is defined and asymptotic optimality results are shown. These results are stated in a general framework including as well nested as unnested situations, including as well i.i.d. as dependent samples, and without specifying any class of non-parametric smoothers. Because of the well-known curse of dimensionality, model selection is of particular interest in multivariate regression settings, and it will be discussed how the previous general model choice approach can be used in several different highdimensional situations.     

A Nonparametric Test of the Predictive Regression Model

This article considers testing the significance of a regressor with a near unit root in a predictive regression model. The procedures discussed in this article are nonparametric, so one can test the significance of a regressor without specifying a functional form. The results are used to test the null hypothesis that the entire function takes the value of zero. We show that the standardized test has a normal distribution regardless of whether there is a near unit root in the regressor. This is in contrast to tests based on linear regression for this model where tests have a nonstandard limiting distribution that depends on nuisance parameters. Our results have practical implications in testing the significance of a regressor since there is no need to conduct pretests for a unit root in the regressor and the same procedure can be used if the regressor has a unit root or not. A Monte Carlo experiment explores the performance of the test for various levels of persistence of the regressors and for various linear and nonlinear alternatives. The test has superior performance against certain nonlinear alternatives. An application of the test applied to stock returns shows how the test can improve inference about predictability.     

Objective Priors for Parameters in a Normal Linear Regression with Measurement Error

We investigate certain objective priors for the parameters in a normal linear regression models with one of the explanatory variables subject to measurement error. We first show that the use of the standard non informative prior for normal linear regression without measurement error leads to an improper posterior in the measurement error model. We then derive the Jeffreys prior and reference priors, and show that they lead to proper posteriors. We use simulation study to compare the frequentist performance of the estimates derived using these priors, and the MLE.