Nonparametric forecasting: a comparison of three kernel-based methods

In this paper the use of three kernel-based nonparametric forecasting methods - the conditional mean, the conditional median, and the conditional mode -is explored in detail. Several issues related to the estimation of these methods are discussed, including the choice of the bandwidth and the type of kernel function. The out-of-sample forecasting performance of the three nonparametric methods is investigated using 60 real time series. We find that there is no superior forecast method for series having approximately less than 100 observations. However, when a time series is long or when its conditional density is bimodal there is quite a difference between the forecasting performance of the three kernel-based forecasting methods.     

Sequential design for nonparametric inference

The performance of nonparametric function estimates often depends on the choice of design points. Based on the mean integrated squared error criterion, we propose a sequential design procedure that updates the model knowledge and optimal design density sequentially. The methodology is developed under a general framework covering a wide range of nonparametric inference problems, such as conditional mean and variance functions, the conditional distribution function, the conditional quantile function in quantile regression, functional coefficients in varying coefficient models and semiparametric inferences. Based on our empirical studies, nonparametric inference based on the proposed sequential design is more efficient than the uniform design and its performance is close to the true but unknown optimal design. The Canadian Journal of Statistics 40: 362–377; 2012 © 2012 Statistical Society of Canada     

Smooth Conditional Distribution Function and Quantiles under Random Censorship

We consider a nonparametric random design regression model in which the response variable is possibly right censored. The aim of this paper is to estimate the conditional distribution function and the conditional -quantile of the response variable. We restrict attention to the case where the response variable as well as the explanatory variable are unidimensional and continuous. We propose and discuss two classes of estimators which are smooth with respect to the response variable as well as to the covariate. Some simulations demonstrate that the new methods have better mean square error performances than the generalized Kaplan-Meier estimator introduced by Beran (1981) and considered in the literature by Dabrowska (1989, 1992) and Gonzalez-Manteiga and Cadarso-Suarez (1994).     

A permutation test for umbrella alternatives

There is a wide variety of stochastic ordering problems where K groups (typically ordered with respect to time) are observed along with a (continuous) response. The interest of the study may be on finding the change-point group, i.e. the group where an inversion of trend of the variable under study is observed. A change point is not merely a maximum (or a minimum) of the time-series function, but a further requirement is that the trend of the time-series is monotonically increasing before that point, and monotonically decreasing afterwards. A suitable solution can be provided within a conditional approach, i.e. by considering some suitable nonparametric combination of dependent tests for simple stochastic ordering problems. The proposed procedure is very flexible and can be extended to trend and/or repeated measure problems. Some comparisons through simulations and examples with the well known Mack & Wolfe test for umbrella alternative and with Page’s test for trend problems with correlated data are investigated.     

A Projection-Based Nonparametric Test of Conditional Quantile Independence

Abstract

This paper proposes a nonparametric procedure for testing conditional quantile independence using projections. Relative to existing smoothed nonparametric tests, the resulting test statistic: (i) detects the high frequency local alternatives that converge to the null hypothesis in probability at faster rate and, (ii) yields improvements in the finite sample power when a large number of variables are included under the alternative. In addition, it allows the researcher to include qualitative information and, if desired, direct the test against specific subsets of alternatives without imposing any functional form on them. We use the weighted Nadaraya-Watson (WNW) estimator of the conditional quantile function avoiding the boundary problems in estimation and testing and prove weak uniform consistency (with rate) of the WNW estimator for absolutely regular processes. The procedure is applied to a study of risk spillovers among the banks. We show that the methodology generalizes some of the recently proposed measures of systemic risk and we use the quantile framework to assess the intensity of risk spillovers among individual financial institutions.     

Nonparametric tests for conditional independence using conditional distributions

The concept of causality is naturally defined in terms of conditional distribution, however almost all the empirical works focus on causality in mean. This paper aims to propose a nonparametric statistic to test the conditional independence and Granger non-causality between two variables conditionally on another one. The test statistic is based on the comparison of conditional distribution functions using an L₂ metric. We use Nadaraya–Watson method to estimate the conditional distribution functions. We establish the asymptotic size and power properties of the test statistic and we motivate the validity of the local bootstrap. We ran a simulation experiment to investigate the finite sample properties of the test and we illustrate its practical relevance by examining the Granger non-causality between S&P 500 Index returns and VIX volatility index. Contrary to the conventional t-test which is based on a linear mean-regression, we find that VIX index predicts excess returns both at short and long horizons.     

Conditional tests in a competing risks model

Testing for equality of competing risks based on their cumulative incidence functions (CIFs) or their cause specific hazard rates (CSHRs) has been considered by many authors. The finite sample distributions of the existing test statistics are in general complicated and the use of their asymptotic distributions can lead to conservative tests. In this paper we show how to perform some of these tests using the conditional distributions of their corresponding test statistics instead (conditional on the observed data). The resulting conditional tests are initially developed for the case of k = 2 and are then extended to k > 2 by performing a sequence of two sample tests and by combining several risks into one. A simulation study to compare the powers of several tests based on their conditional and asymptotic distributions shows that using conditional tests leads to a gain in power. A real life example is also discussed to show how to implement such conditional tests.     

Functional data: local linear estimation of the conditional density and its application

In this paper, we introduce a new nonparametric estimation procedure of the conditional density of a scalar response variable given a random variable taking values in a semi-metric space. Under some general conditions, we establish both the pointwise and the uniform almost-complete consistencies with convergence rates of the conditional density estimator related to this estimation procedure. Moreover, we give some particular cases of our results which can also be considered as novel in the finite-dimensional setting. Notice also that the results of this paper are used to derive some asymptotic properties of the local linear estimator of the conditional mode.     

Uniform in bandwidth consistency for various kernel estimators involving functional data

The paper investigates various nonparametric models including regression, conditional distribution, conditional density and conditional hazard function, when the covariates are infinite dimensional. The main contribution is to prove uniform in bandwidth asymptotic results for kernel estimators of these functional operators. Then, the application issues, involving data-driven bandwidth selection, are discussed.     

A review and some new results on permutation testing for multivariate problems

In recent years permutation testing methods have increased both in number of applications and in solving complex multivariate problems. When available permutation tests are essentially of an exact nonparametric nature in a conditional context, where conditioning is on the pooled observed data set which is often a set of sufficient statistics in the null hypothesis. Whereas, the reference null distribution of most parametric tests is only known asymptotically. Thus, for most sample sizes of practical interest, the possible lack of efficiency of permutation solutions may be compensated by the lack of approximation of parametric counterparts. There are many complex multivariate problems, quite common in empirical sciences, which are difficult to solve outside the conditional framework and in particular outside the method of nonparametric combination (NPC) of dependent permutation tests. In this paper we review such a method and its main properties along with some new results in experimental and observational situations (robust testing, multi-sided alternatives and testing for survival functions).     

Combining Univariate Tests for Multivariate Location Problem

In this article, three methods of combining dependent univariate tests are studied. The Bahadur approximate efficiencies are derived under the asymptotic normal assumption. These procedures are applied to the multivariate location problem and compared with two Hotelling-type tests. A Monte Carlo study indicates that in certain cases the powers of the combination methods are much better than Hotelling's T ² and other multivariate nonparametric tests.     

Testing for spherical symmetry via the empirical characteristic function

Kolmogorov–Smirnov-type and Cramér–von Mises-type goodness-of-fit tests are proposed for the null hypothesis that the distribution of a random vector X is spherically symmetric. The test statistics utilize the fact that X has a spherical symmetric distribution if, and only if, the characteristic function of X is constant over surfaces of spheres centred at the origin. Both tests come in convenient forms that are straightforwardly applicable with the computer. The asymptotic null distribution of the test statistics as well as the consistency of the tests is investigated under general conditions. Since both the finite sample and the asymptotic null distribution depend on the unknown distribution of the Euclidean norm of X, a conditional Monte Carlo procedure is used to actually carry out the tests. Results on the behaviour of the test in finite-samples are included along with a real-data example.     

A note on nonparametric estimation of circular conditional densities

ABSTRACT

The conditional density offers the most informative summary of the relationship between explanatory and response variables. We need to estimate it in place of the simple conditional mean when its shape is not well-behaved. A motivation for estimating conditional densities, specific to the circular setting, lies in the fact that a natural alternative of it, like quantile regression, could be considered problematic because circular quantiles are not rotationally equivariant. We treat conditional density estimation as a local polynomial fitting problem as proposed by Fan et al. [Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika. 1996;83:189–206] in the Euclidean setting, and discuss a class of estimators in the cases when the conditioning variable is either circular or linear. Asymptotic properties for some members of the proposed class are derived. The effectiveness of the methods for finite sample sizes is illustrated by simulation experiments and an example using real data.     

Asymptotic normality of a conditional hazard function estimate in the single index for quasi-associated data

Abstract

The main goal of this paper is to study the estimation of the conditional hazard function of a scalar response variable Y given a hilbertian random variable X in functional single-index model. We construct an estimator of this nonparametric function and we study its asymptotic properties, under quasi-associated structure. Precisely, we establish the asymptotic normality of the constructed estimator. We carried out simulation experiments to examine the behavior of this asymptotic property over finite sample data.     

Bootstrapping the conditional copula

This paper is concerned with inference about the dependence or association between two random variables conditionally upon the given value of a covariate. A way to describe such a conditional dependence is via a conditional copula function. Nonparametric estimators for a conditional copula then lead to nonparametric estimates of conditional association measures such as a conditional Kendall's tau. The limiting distributions of nonparametric conditional copula estimators are rather involved. In this paper we propose a bootstrap procedure for approximating these distributions and their characteristics, and establish its consistency. We apply the proposed bootstrap procedure for constructing confidence intervals for conditional association measures, such as a conditional Blomqvist beta and a conditional Kendall's tau. The performances of the proposed methods are investigated via a simulation study involving a variety of models, ranging from models in which the dependence (weak or strong) on the covariate is only through the copula and not through the marginals, to models in which this dependence appears in both the copula and the marginal distributions. As a conclusion we provide practical recommendations for constructing bootstrap-based confidence intervals for the discussed conditional association measures.     

A Nonparametric Test for Autoregressive Conditional Heteroscedasticity: A Markov-Chain Approach

In this article we propose a nonparametric test for autoregressive conditional heteroscedasticity based on finite-state Markov chains. A simple Monte Carlo experiment suggests that in finite samples it performs comparably to the Lagrange multiplier test under conditional normality and is superior for the t, lognormal, and exponential distributions. As an illustration, we apply both tests to Canadian/U.S. forward foreign exchange data.     

A Goodness-of-Fit Test for a Class of Autoregressive Conditional Duration Models

This article develops a method for testing the goodness-of-fit of a given parametric autoregressive conditional duration model against unspecified nonparametric alternatives. The test statistics are functions of the residuals corresponding to the quasi maximum likelihood estimate of the given parametric model, and are easy to compute. The limiting distributions of the test statistics are not free from nuisance parameters. Hence, critical values cannot be tabulated for general use. A bootstrap procedure is proposed to implement the tests, and its asymptotic validity is established. The finite sample performances of the proposed tests and several other competing ones in the literature, were compared using a simulation study. The tests proposed in this article performed well consistently throughout, and they were either the best or close to the best. None of the tests performed uniformly the best. The tests are illustrated using an empirical example.     

Preliminary test of fit in a general class of conditionally heteroscedastic nonlinear time series

This article is concerned with a general class of conditionally heteroscedastic time series including possibly nonlinear and asymmetric autoregressive conditional heteroscedastic (ARCH) and generalized ARCH models. A problem of preliminary test of fit (PTF, hereafter) within the broad class under consideration is discussed. It is noted that contrary to usual tests in the literature of conditionally heteroscedastic time series, PTF does not require any specification of the conditional variance in advance. Based on the joint limit distributions of sample autocorrelations, a certain Portmanteau-type statistic for PTF is proposed, and its limit is shown to be a chi-square distribution. In addition, some simulation studies, under various innovations, are reported to support our theoretical results.     

Local comparison of empirical distributions via nonparametric regression

Given two independent samples of size n and m drawn from univariate distributions with unknown densities f and g, respectively, we are interested in identifying subintervals where the two empirical densities deviate significantly from each other. The solution is built by turning the nonparametric density comparison problem into a comparison of two regression curves. Each regression curve is created by binning the original observations into many small size bins, followed by a suitable form of root transformation to the binned data counts. Turned as a regression comparison problem, several nonparametric regression procedures for detection of sparse signals can be applied. Both multiple testing and model selection methods are explored. Furthermore, an approach for estimating larger connected regions where the two empirical densities are significantly different is also derived, based on a scale-space representation. The proposed methods are applied on simulated examples as well as real-life data from biology.     

The Extensively Corrected Score for Measurement Error Models

In measurement error problems, two major and consistent estimation methods are the conditional score and the corrected score. They are functional methods that require no parametric assumptions on mismeasured covariates. The conditional score requires that a suitable sufficient statistic for the mismeasured covariate can be found, while the corrected score requires that the object score function can be estimated without bias. These assumptions limit their ranges of applications. The extensively corrected score proposed here is an extension of the corrected score. It yields consistent estimations in many cases when neither the conditional score nor the corrected score is feasible. We demonstrate its constructions in generalized linear models and the Cox proportional hazards model, assess its performances by simulation studies and illustrate its implementations by two real examples.