On nonparametric regression estimators based on regression quantiles

In the ciassical regression model Y_i=h(x_i) + ? _i, i=1,…,n, Cheng (1984) introduced linear combinations of regression quantiles as a new class of estimators for the unknown regression function h(x). The asymptotic properties studied in Cheng (1984) are reconsidered. We obtain a sharper scrong consistency rate and we improve on the conditions for asymptotic normality by proving a new result on the remainder term in the Bahadur representation for regression quantiles.     

Covariate-Adjusted Partially Linear Regression Models

Motivated by covariate-adjusted regression (CAR) proposed by Sentürk and Müller (2005 Sentürk , D. , Müller , H. G. ( 2005 ). Covariate-adjusted regression . Biometrika 92 : 75 – 89 .[Crossref], [Web of Science ®] , [Google Scholar]) and an application problem, in this article we introduce and investigate a covariate-adjusted partially linear regression model (CAPLM), in which both response and predictor vector can only be observed after being distorted by some multiplicative factors, and an additional variable such as age or period is taken into account. Although our model seems to be a special case of covariate-adjusted varying coefficient model (CAVCM) given by Sentürk (2006 Sentürk , D. ( 2006 ). Covariate-adjusted varying coefficient models . Biostatistics 7 : 235 – 251 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), the data types of CAPLM and CAVCM are basically different and then the methods for inferring the two models are different. In this article, the estimate method motivated by Cui et al. (2008 Cui , X. , Guo , W. S. , Lin , L. , Zhu , L. X. ( 2008 ). Covariate-adjusted nonlinear regression . Ann. Statist. 37 : 1839 – 1870 . [Google Scholar]) is employed to infer the new model. Furthermore, under some mild conditions, the asymptotic normality of estimator for the parametric component is obtained. Combined with the consistent estimate of asymptotic covariance, we obtain confidence intervals for the regression coefficients. Also, some simulations and a real data analysis are made to illustrate the new model and methods.     

Comment on hoerl and kennard's ridge regression simulation methodology

Ridge regression has received strong support in several Monte carlo studies, leading some authors to advocate its general use. It is argued, however, that these studies were strongly biased in favor of ridge regression by simulating regression coefficient vectors centered at the origin; a condition well suited for a shrinkage technique. Studies which modeled some non-zero regression coefficients and which showed only qualified support for ridge regression are cited in support of this argument. It is concluded that only to the extent that ridge regression type coefficient vectors actually underlie real data sets -a poorly understood phenomenon - will ridge regression be of use.     

Nonparametric local polynomial approximation of the time-varying frequency and amplitude

The problem of estimating the time-varying frequency, phase and amplitude of a real-valued harmonic signal is considered. It is assumed that the frequency and amplitude are unspecified rapidly time-varying functions of time. The technique is based on fitting a local polynomial approximation of the phase and amplitude which implements a high-order nonlinear nonparametric estimator. The estimator is shown to be strongly consistent and Gaussian. In particular, the convergence ratesO(h^-3/2 )and O(h^-5/2 ), where $i;h$ei; is the number of observations, are obtained for the frequency estimator when the amplitude is unknown constant or linear in time respectively. The orders of the bias and Gaussian distribution are obtained for a class of the time-varying frequency and amplitude with bounded second derivatives. The a priori amplitude information about the unknown time-varying frequency and amplitude and their derivatives can be incorporated to improve the accuracy of the estimation. Simulation results are given.     

空间回归模型估计中的最小二乘法

空间回归模型由于引入了空间地理信息而使得其参数估计变得复杂,因为主要采用最大似然法,致使一般人认为在空间回归模型参数估计中不存在最小二乘法。通过分析空间回归模型的参数估计技术,研究发现,最小二乘法和最大似然法分别用于估计空间回归模型的不同的参数,只有将两者结合起来才能快速有效地完成全部的参数估计。数理论证结果表明,空间回归模型参数最小二乘估计量是最佳线性无偏估计量。空间回归模型的回归参数可以在估计量为正态性的条件下而实施显著性检验,而空间效应参数则不可以用此方法进行检验。     

Calibration of predictions in regression

A regression predictor is well-calibrated if the predictions it gives are equal to the average responses that would be observed in an independent sample. The usual least squares predictor does not have this property, but its calibration can be improved by shrinking the predictions by a factor which depends on the signal-to-noise ratio of the regression model. We suggest a semi-Bayesian approach to estimating this factor, giving an estimate closely related to the so-called Stein Shririkasre Factor. The results are illustrated on a large medical data set.     

Alternative estimators in logistic regression when the data are collinear

Logistic regression using conditional maximum likelihood estimation has recently gained widespread use. Many of the applications of logistic regression have been in situations in which the independent variables are collinear. It is shown that collinearity among the independent variables seriously effects the conditional maximum likelihood estimator in that the variance of this estimator is inflated in much the same way that collinearity inflates the variance of the least squares estimator in multiple regression. Drawing on the similarities between multiple and logistic regression several alternative estimators, which reduce the effect of the collinearity and are easy to obtain in practice, are suggested and compared in a simulation study.     

Rank-based ridge estimation in multiple linear regression

Multicollinearity and model misspecification are frequently encountered problems in practice that produce undesirable effects on classical ordinary least squares (OLS) regression estimator. The ridge regression estimator is an important tool to reduce the effects of multicollinearity, but it is still sensitive to a model misspecification of error distribution. Although rank-based statistical inference has desirable robustness properties compared to the OLS procedures, it can be unstable in the presence of multicollinearity. This paper introduces a rank regression estimator for regression parameters and develops tests for general linear hypotheses in a multiple linear regression model. The proposed estimator and the tests have desirable robustness features against the multicollinearity and model misspecification of error distribution. Asymptotic behaviours of the proposed estimator and the test statistics are investigated. Real and simulated data sets are used to demonstrate the feasibility and the performance of the estimator and the tests.     

An optimization interpretation of integration and back-fitting estimators for separable nonparametric models

We provide an optimization interpretation of both back-fitting and integration estimators for additive nonparametric regression. We find that the integration estimator is a projection with respect to a product measure. We also provide further understanding of the back-fitting method.     

分位数回归技术综述

普通最小二乘回归建立了在自变量X=x下因变量Y的条件均值与X的关系的线性模型。而分位数回归（Quantile Regression）则利用自变量X和因变量y的条件分位数进行建模。与普通的均值回归相比,它能充分反映自变量X对于因变量y的分布的位置、刻度和形状的影响,有着十分广泛的应用,尤其是对于一些非常关注尾部特征的情况。文章介绍了分位数回归的概念以及分位数回归的估计、检验和拟合优度,回顾了分位数回归的发展过程以及其在一些经济研究领域中的应用,最后做了总结。     

Computational and statistical efficiency of semiparametric gls estimators

In this note, we report a dramatic improvement in the computational efficiency of semiparametric generalized least squares(SGLS) estimation. Computation of SGLS estimates no longer presents serious problems with data sets of moderate size. We also correct a numerical error in the standard errors of the SGLS estimates reported in our recent paper in this journal (Horowitz and Neumann, 1987). The corrected standard errors of SGLS are comparable to those we reported for quantile estimates.     

Computational and statistical efficiency of semiparametric gls estimators

In this note, we report a dramatic improvement in the computational efficiency of semiparametric generalized least squares(SGLS) estimation. Computation of SGLS estimates no longer presents serious problems with data sets of moderate size. We also correct a numerical error in the standard errors of the SGLS estimates reported in our recent paper in this journal (Horowitz and Neumann, 1987). The corrected standard errors of SGLS are comparable to those we reported for quantile estimates.     

Bias in Small-Sample Inference With Count-Data Models

Abstract

Both Poisson and negative binomial regression can provide quasi-likelihood estimates for coefficients in exponential-mean models that are consistent in the presence of distributional misspecification. It has generally been recommended, however, that inference be carried out using asymptotically robust estimators for the parameter covariance matrix. As with linear models, such robust inference tends to lead to over-rejection of null hypotheses in small samples. Alternative methods for estimating coefficient estimator variances are considered. No one approach seems to remove all test bias, but the results do suggest that the use of the jackknife with Poisson regression tends to be least biased for inference.     

A graphical procedure for distinguishing between two data analysis pitfalls

This paper presents a graphical procedure for simultaneously distinguishing between two commonly encountered data anomaliesWhen applied in the context of one anomaly, a family of parallel lines will be estimated, and when applied in the contextofthe second anomaly, a family of lines, whose members all pass through the same point, will be estimated. It is shown that the procedure can be applied effectively using samples containing as few as two hundred bivariate observations.     

Strong uniform consistency results of the weighted average of conditional artificial data points

In this paper, we study strong uniform consistency of a weighted average of artificial data points. This is especially useful when information is incomplete (censored data, missing data …). In this case, reconstruction of the information is often achieved nonparametrically by using a local preservation of mean criterion for which the corresponding mean is estimated by a weighted average of new data points. The present approach enlarges the possible scope for applications beyond just the incomplete data context and can also be useful to treat the estimation of the conditional mean of specific functions of complete data points. As a consequence, we establish the strong uniform consistency of the Nadaraya–Watson [Nadaraya, E.A., 1964. On estimating regression. Theory Probab. Appl. 9, 141–142; Watson, G.S., 1964. Smooth regression analysis. Sankhyā Ser. A 26, 359–372] estimator for general transformations of the data points. This result generalizes the one of Härdle et al. [Strong uniform consistency rates for estimators of conditional functionals. Ann. Statist. 16, 1428–1449]. In addition, the strong uniform consistency of a modulus of continuity will be obtained for this estimator. Applications of those two results are detailed for some popular estimators.     

Composite kernel quantile regression

The composite quantile regression (CQR) has been developed for the robust and efficient estimation of regression coefficients in a liner regression model. By employing the idea of the CQR, we propose a new regression method, called composite kernel quantile regression (CKQR), which uses the sum of multiple check functions as a loss in reproducing kernel Hilbert spaces for the robust estimation of a nonlinear regression function. The numerical results demonstrate the usefulness of the proposed CKQR in estimating both conditional nonlinear mean and quantile functions.     

A note on non-negative mean square error estimation of regression estimators in randomized response surveys

Generalized regression estimators are considered for the survey population total of a quantitative sensitive variable based on randomized responses. Formulae are presented for ‘non-negative’ estimators of approximate mean square errors of these biased estimators when population and sample sizes are large.     

Nonparametric Wavelet Regression Based on Biased Data

The estimation of the regression function in the biased nonparametric regression model is investigated. We propose and develop a new wavelet-based methodology for this problem. In particular, an adaptive hard thresholding wavelet estimator is constructed. Under mild assumptions on the model, we prove that it enjoys powerful mean integrated squared error properties over Besov balls.