A Quantile Regression Model for Time-Series Data in the Presence of Additive Components

In this article, we propose a kernel-based estimator for the finite-dimensional parameter of a partially additive linear quantile regression model. For dependent processes that are strictly stationary and absolutely regular, we establish a precise convergent rate and show that the estimator is root-n consistent and asymptotically normal. To help facilitate inferential procedures, a consistent estimator for the asymptotic variance is also provided. In addition to conducting a simulation experiment to evaluate the finite sample performance of the estimator, an application to US inflation is presented. We use the real-data example to motivate how partially additive linear quantile models can offer an alternative modeling option for time-series data.     

About the Nonparametric Estimation of the Bernoulli Regression

The nonparametric estimation of the Bernoulli regression function is studied. The uniform consistency conditions are established and the limit theorems are proved for continuous functionals on C[a, 1 ? a], 0 < a < 1/2.     

Nonparametric Estimation of the Conditional Distribution at Regression Boundary Points

Abstract

Nonparametric regression is a standard statistical tool with increased importance in the Big Data era. Boundary points pose additional difficulties but local polynomial regression can be used to alleviate them. Local linear regression, for example, is easy to implement and performs quite well both at interior and boundary points. Estimating the conditional distribution function and/or the quantile function at a given regressor point is immediate via standard kernel methods but problems ensue if local linear methods are to be used. In particular, the distribution function estimator is not guaranteed to be monotone increasing, and the quantile curves can “cross.” In the article at hand, a simple method of correcting the local linear distribution estimator for monotonicity is proposed, and its good performance is demonstrated via simulations and real data examples. Supplementary materials for this article are available online.     

Nonparametric Regression as an Example of Model Choice

Nonparametric regression can be considered as a problem of model choice. In this article, we present the results of a simulation study in which several nonparametric regression techniques including wavelets and kernel methods are compared with respect to their behavior on different test beds. We also include the taut-string method whose aim is not to minimize the distance of an estimator to some “true” generating function f but to provide a simple adequate approximation to the data. Test beds are situations where a “true” generating f exists and in this situation it is possible to compare the estimates of f with f itself. The measures of performance we use are the L²- and the L^∞-norms and the ability to identify peaks.     

Relative Errors of Difference-Based Variance Estimators in Nonparametric Regression

Difference-based estimators for the error variance are popular since they do not require the estimation of the mean function. Unlike most existing difference-based estimators, new estimators proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Tong and Wang (2005 Tong , T. , Wang , Y. ( 2005 ). Estimating residual variance in nonparametric regression using least squares . Biometrika 92 : 821 – 830 .[Crossref], [Web of Science ®] , [Google Scholar]) achieved the asymptotic optimal rate as residual-based estimators. In this article, we study the relative errors of these difference-based estimators which lead to better understanding of the differences between them and residual-based estimators. To compute the relative error of the covariate-matched U-statistic estimator proposed by Müller et al. (2003 Müller , U. , Schick , A. , Wefelmeyer , W. ( 2003 ). Estimating the error variance in nonparametric regression by a covariate-matched U-statistic . Statistics 37 : 179 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), we develop a modified version by using simpler weights. We further investigate its asymptotic property for both equidistant and random designs and show that our modified estimator is asymptotically efficient.     

A Bootstrap Stationarity Test for Predictive Regression Invalidity

In order for predictive regression tests to deliver asymptotically valid inference, account has to be taken of the degree of persistence of the predictors under test. There is also a maintained assumption that any predictability in the variable of interest is purely attributable to the predictors under test. Violation of this assumption by the omission of relevant persistent predictors renders the predictive regression invalid, and potentially also spurious, as both the finite sample and asymptotic size of the predictability tests can be significantly inflated. In response, we propose a predictive regression invalidity test based on a stationarity testing approach. To allow for an unknown degree of persistence in the putative predictors, and for heteroscedasticity in the data, we implement our proposed test using a fixed regressor wild bootstrap procedure. We demonstrate the asymptotic validity of the proposed bootstrap test by proving that the limit distribution of the bootstrap statistic, conditional on the data, is the same as the limit null distribution of the statistic computed on the original data, conditional on the predictor. This corrects a long-standing error in the bootstrap literature whereby it is incorrectly argued that for strongly persistent regressors and test statistics akin to ours the validity of the fixed regressor bootstrap obtains through equivalence to an unconditional limit distribution. Our bootstrap results are therefore of interest in their own right and are likely to have applications beyond the present context. An illustration is given by reexamining the results relating to U.S. stock returns data in Campbell and Yogo (2006 Campbell, J. Y. and Yogo, M. (2006), “Efficient Tests of Stock Return Predictability,” Journal of Financial Economics, 81, 27–60.[Crossref], [Web of Science ®] , [Google Scholar]). Supplementary materials for this article are available online.     

Tests for Symmetric Error Distribution in Linear and Nonparametric Regression Models

In linear and nonparametric regression models, the problem of testing for symmetry of the distribution of errors is considered. We propose a test statistic which utilizes the empirical characteristic function of the corresponding residuals. The asymptotic null distribution of the test statistic as well as its behavior under alternatives is investigated. A simulation study compares bootstrap versions of the proposed test to other more standard procedures.     

Nonparametric Trend Estimation for Periodic Autoregressive Time Series

A periodically stationary time series has seasonal variances. A local linear trend estimation is proposed to accommodate unequal variances. A comparison of this proposed estimator with the estimator commonly used for a stationary time series is provided. The optimal bandwidth selection for this new trend estimator is discussed.     

Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models

In this paper we propose a test for the significance of categorical predictors in nonparametric regression models. The test is fully data-driven and employs cross-validated smoothing parameter selection while the null distribution of the test is obtained via bootstrapping. The proposed approach allows applied researchers to test hypotheses concerning categorical variables in a fully nonparametric and robust framework, thereby deflecting potential criticism that a particular finding is driven by an arbitrary parametric specification. Simulations reveal that the test performs well, having significantly better power than a conventional frequency-based nonparametric test. The test is applied to determine whether OECD and non-OECD countries follow the same growth rate model or not. Our test suggests that OECD and non-OECD countries follow different growth rate models, while the tests based on a popular parametric specification and the conventional frequency-based nonparametric estimation method fail to detect any significant difference.     

A Smooth Nonparametric,Multivariate, Mixed-Data Location-Scale Test

Abstract

A number of tests have been proposed for assessing the location-scale assumption that is often invoked by practitioners. Existing approaches include Kolmogorov–Smirnov and Cramer–von Mises statistics that each involve measures of divergence between unknown joint distribution functions and products of marginal distributions. In practice, the unknown distribution functions embedded in these statistics are typically approximated using nonsmooth empirical distribution functions (EDFs). In a recent article, Li, Li, and Racine establish the benefits of smoothing the EDF for inference, though their theoretical results are limited to the case where the covariates are observed and the distributions unobserved, while in the current setting some covariates and their distributions are unobserved (i.e., the test relies on population error terms from a location-scale model) which necessarily involves a separate theoretical approach. We demonstrate how replacing the nonsmooth distributions of unobservables with their kernel-smoothed sample counterparts can lead to substantial power improvements, and extend existing approaches to the smooth multivariate and mixed continuous and discrete data setting in the presence of unobservables. Theoretical underpinnings are provided, Monte Carlo simulations are undertaken to assess finite-sample performance, and illustrative applications are provided.     

Finite Sample Performances of the Model Selection Approach in Nonparametric Model Specification for Time Series

Nonparametric model specification for stationary time series involves selections of the smoothing parameter (bandwidth), the lag structure and the functional form (linear vs. nonlinear). In real life problems, none of these factors are known and the choices are interdependent. In this article, we recommend to accomplish these choices in one step via the model selection approach. Two procedures are considered; one based on the information criterion and the other based on the least squares cross validation. The Monte Carlo simulation results show that both procedures have good finite sample performances and are easy to implement compared to existing two-step probabilistic testing procedures.     

Uniform Test for Predictive Regression With AR Errors

Testing predictability is of importance in economics and finance. Based on a predictive regression model with independent and identically distributed errors, some uniform tests have been proposed in the literature without distinguishing whether the predicting variable is stationary or nearly integrated. In this article, we extend the empirical likelihood methods of Zhu, Cai, and Peng with independent errors to the case of an AR error process. Again, the proposed new tests do not need to know whether the predicting variable is stationary or nearly integrated, and whether it has a finite variance or an infinite variance. A simulation study shows the new methodologies perform well in finite sample.     

一类基于非参数回归的条件异方差检验

现有基于参数模型构造的条件异方差检验往往存在模型设定偏误问题。为了避免模型误设对检验结果的影响,并且同时捕获多种条件异方差现象,本文基于非参数回归构造了不依赖于特定模型形式的条件异方差检验统计量。该统计量可视作条件方差和无条件方差之间差异的加权平均,在原假设成立时渐近服从标准正态分布。数值模拟结果一方面表明本文统计量具有良好的有限样本性质,另一方面也说明条件均值模型误设会导致错误地拒绝条件同方差的原假设,凸显了本文引入非参数方法构造条件异方差检验的必要性。实证分析采用本文统计量探讨了国际主要股指收益率的条件异方差现象,得到了与Engle (1982)不同的检验结果,可能意味着股指收益率呈现出非线性动态特征。     

非参数固定效应Panel Data模型的分位数回归推断

利用分位数回归方法,讨论了非参数固定效应Panel Data模型的估计和检验问题,得到了参数估计的渐近正态性及收敛速度。同时,建立一个秩得分(rank score)统计量来检验模型的固定效应,并证明了这个统计量渐近服从标准正态分布。     

Performance of Kibria's Method for the Heteroscedastic Ridge Regression Model: Some Monte Carlo Evidence

It is common for a linear regression model that the error terms display some form of heteroscedasticity and at the same time, the regressors are also linearly correlated. Both of these problems have serious impact on the ordinary least squares (OLS) estimates. In the presence of heteroscedasticity, the OLS estimator becomes inefficient and the similar adverse impact can also be found on the ridge regression estimator that is alternatively used to cope with the problem of multicollinearity. In the available literature, the adaptive estimator has been established to be more efficient than the OLS estimator when there is heteroscedasticity of unknown form. The present article proposes the similar adaptation for the ridge regression setting with an attempt to have more efficient estimator. Our numerical results, based on the Monte Carlo simulations, provide very attractive performance of the proposed estimator in terms of efficiency. Three different existing methods have been used for the selection of biasing parameter. Moreover, three different distributions of the error term have been studied to evaluate the proposed estimator and these are normal, Student's t and F distribution.     

Covariate-Adjusted Regression for Time Series

The main purpose of this article is to consider the covariate-adjusted regression (CAR) model for time series. The CAR model was initially proposed by Sentürk and Müller (2005 Sentürk , D. , Müller , H. G. ( 2005 ). Covariate-adjusted regression . Biometrika 92 : 75 – 89 .[Crossref], [Web of Science ®] , [Google Scholar]) for such situations where predictor and response variables are not directly observed, but are distorted by some common observable covariate. Despite CAR being originally designed for independent cross-sectional data, multiple works have extended this method to dependent data setting. In this article, the authors extend CAR to the distorted time series setting. This extension is meaningful in many fields such as econometrics, mathematical finance, and signal processing. The estimates of regression parameters are proposed by establishing connection with functional-coefficient time series model. The consistency and asymptotic normality of the proposed estimates are investigated under the α-mixing conditions. Real data and simulated examples are provided for illustration.     

A New Regression Model: Modal Linear Regression

The mode of a distribution provides an important summary of data and is often estimated on the basis of some non‐parametric kernel density estimator. This article develops a new data analysis tool called modal linear regression in order to explore high‐dimensional data. Modal linear regression models the conditional mode of a response Y given a set of predictors x as a linear function of x . Modal linear regression differs from standard linear regression in that standard linear regression models the conditional mean (as opposed to mode) of Y as a linear function of x . We propose an expectation–maximization algorithm in order to estimate the regression coefficients of modal linear regression. We also provide asymptotic properties for the proposed estimator without the symmetric assumption of the error density. Our empirical studies with simulated data and real data demonstrate that the proposed modal regression gives shorter predictive intervals than mean linear regression, median linear regression and MM‐estimators.     

A Nonparametric Test for Deviation from Randomness with Applications to Stock Market Index Data

The proposed test detects deviations from randomness, without a priori distributional assumption, when observations are not independent and identically distributed (i.i.d.), which is suitable for our motivating stock market index data. Departures from i.i.d. are tested by subdividing data into subintervals and then using a conditional probability measure within intervals as a binomial test. This nonparametric test is designed to detect deviations of neighboring observations from randomness when the dataset consists of time series observations. Simulation results and a comparison with Lo and MacKinlay's (1988 Lo, A. W. and MacKinlay, A. C. 1988. Stock market prices do not follow random walks: Evidence from a simple specification test. The Review of Financial Studies, 1: 41–66. [Crossref], [Web of Science ®] , [Google Scholar]) variance ratio test showed that our proposed test is a competitive alternative.     

Model Identification in Dynamic Regression (Distributed Lag) Models

Dynamic regression models (also known as distributed lag models) are widely used in engineering for quality control and in economics for forecasting. In this article I propose a procedure for specifying such models in practice. The proposed procedure requires no prewhitening and can directly handle the nonstationary series. Furthermore, the procedure cross-validates prior beliefs about causal relationships between variables with empirical findings to ensure the suitability of model structure. An illustrative example is given.     

Nonparametric Estimation of the Multivariate Distribution Function in a Censored Regression Model with Applications

In a regression model with univariate censored responses, a new estimator of the joint distribution function of the covariates and response is proposed, under the assumption that the response and the censoring variable are independent conditionally to the covariates. This estimator is based on the conditional Kaplan–Meier estimator of Beran (1981 Beran , R. ( 1981 ). Nonparametric regression with randomly censored survival data. Technical Report, University of California, Berkeley, California . [Google Scholar]), and happens to be an extension of the multivariate empirical distribution function used in the uncensored case. We derive asymptotic i.i.d. representations for the integrals with respect to the measure defined by this estimated distribution function. These representations hold even in the case where the covariates are multidimensional under some additional assumption on the censoring. Applications to censored regression and to density estimation are considered.