An omnibus test of goodness-of-fit for conditional distributions with applications to regression models

We introduce an omnibus goodness-of-fit test for statistical models for the conditional distribution of a random variable. In particular, this test is useful for assessing whether a regression model fits a data set on all its assumptions. The test is based on a generalization of the Cramér–von Mises statistic and involves a local polynomial estimator of the conditional distribution function. First, the uniform almost sure consistency of this estimator is established. Then, the asymptotic distribution of the test statistic is derived under the null hypothesis and under contiguous alternatives. The extension to the case where unknown parameters appear in the model is developed. A simulation study shows that the test has good power against some common departures encountered in regression models. Moreover, its power is comparable to that of other nonparametric tests designed to examine only specific departures.     

Distribution-free test in Tobit mean regression model

This paper discusses the problem of fitting a parametric model in Tobit mean regression models. The proposed test is based on the supremum of the Khamaladze-type transformation of a partial sum process of calibrated residuals. The asymptotic null distribution of this transformed process is shown to be the same as that of a time-transformed standard Brownian motion. Consistency of this sequence of tests against some fixed alternatives and asymptotic power under some local nonparametric alternatives are also discussed. Simulation studies are conducted to assess the finite sample performance of the proposed test. The power comparison with some existing tests shows some superiority of the proposed test at the chosen alternatives.     

Testing parametric models in linear‐directional regression

This paper presents a goodness‐of‐fit test for parametric regression models with scalar response and directional predictor, that is, a vector on a sphere of arbitrary dimension. The testing procedure is based on the weighted squared distance between a smooth and a parametric regression estimator, where the smooth regression estimator is obtained by a projected local approach. Asymptotic behaviour of the test statistic under the null hypothesis and local alternatives is provided, jointly with a consistent bootstrap algorithm for application in practice. A simulation study illustrates the performance of the test in finite samples. The procedure is applied to test a linear model in text mining.     

A Lagrange multiplier test for testing the adequacy of constant conditional correlation GARCH model

ABSTRACT

A Lagrange multiplier test for testing the parametric structure of a constant conditional correlation-generalized autoregressive conditional heteroskedasticity (CCC-GARCH) model is proposed. The test is based on decomposing the CCC-GARCH model multiplicatively into two components, one of which represents the null model, whereas the other one describes the misspecification. A simulation study shows that the test has good finite sample properties. We compare the test with other tests for misspecification of multivariate GARCH models. The test has high power against alternatives where the misspecification is in the GARCH parameters and is superior to other tests. The test is not greatly affected by misspecification in the conditional correlations and is therefore well suited for considering misspecification of GARCH equations.     

Specification testing in nonparametric AR‐ARCH models

In this paper, an autoregressive time series model with conditional heteroscedasticity is considered, where both conditional mean and conditional variance function are modeled nonparametrically. Tests for the model assumption of independence of innovations from past time series values are suggested. Tests based on weighted L²‐distances of empirical characteristic functions are considered as well as a Cramér–von Mises‐type test. The asymptotic distributions under the null hypothesis of independence are derived, and the consistency against fixed alternatives is shown. A smooth autoregressive residual bootstrap procedure is suggested, and its performance is shown in a simulation study.     

Lack-of-fit testing of a regression model with response missing at random

This paper proposes a class of lack-of-fit tests for fitting a linear regression model when some response variables are missing at random. These tests are based on a class of minimum integrated square distances between a kernel type estimator of a regression function and the parametric regression function being fitted. These tests are shown to be consistent against a large class of fixed alternatives. The corresponding test statistics are shown to have asymptotic normal distributions under null hypothesis and a class of nonparametric local alternatives. Some simulation results are also presented.     

The power of the exponential scores test for an ordinary renewal process against trend alternatives

The power properties of a statistic based on the use of exponential scores which may be used for testing whether a series of events occurring in time form an ordinary renewal process against trend alternatives are examined. Small sample power comparisons under a Lehmann trend alternative are made with an alternative nonparametric test based on a rank trend statistic and with the parametric test when the intervals are exponentially distributed. Finally, some asymptotic efficiency results are developed for limiting trend alternatives.     

Testing the information matrix equality with robust estimators

The information matrix (IM) equality can be used to test for misspecification of a parametric model. We study the behavior of the IM test when the maximum-likelihood (ML) estimators used in the construction of this test are replaced with robust estimators. The latter do not suffer from the masking effect in the presence of outliers and can improve the power of the IM test. At the normal location-scale model, the IM test using the ML estimators is known as the Jarque–Bera test, and uses skewness and kurtosis to detect deviations from normality. When robust estimators are employed to test the IM equality, a robust version of the Jarque–Bera test emerges. We investigate in detail the local asymptotic power of the IM test, for various estimators and under a variety of local alternatives. For the normal regression model, it is shown by simulations under fixed alternatives that in many cases the use of robust estimators substantially increases the power of the IM test.     

A Goodness-of-Fit Test for a Class of Autoregressive Conditional Duration Models

This article develops a method for testing the goodness-of-fit of a given parametric autoregressive conditional duration model against unspecified nonparametric alternatives. The test statistics are functions of the residuals corresponding to the quasi maximum likelihood estimate of the given parametric model, and are easy to compute. The limiting distributions of the test statistics are not free from nuisance parameters. Hence, critical values cannot be tabulated for general use. A bootstrap procedure is proposed to implement the tests, and its asymptotic validity is established. The finite sample performances of the proposed tests and several other competing ones in the literature, were compared using a simulation study. The tests proposed in this article performed well consistently throughout, and they were either the best or close to the best. None of the tests performed uniformly the best. The tests are illustrated using an empirical example.     

Smoothing for discrete-valued time series

We deal with smoothed estimators for conditional probability functions of discrete-valued time series { Y_t } under two different settings. When the conditional distribution of Y_t given its lagged values falls in a parametric family and depends on exogenous random variables, a smoothed maximum (partial) likelihood estimator for the unknown parameter is proposed. While there is no prior information on the distribution, various nonparametric estimation methods have been compared and the adjusted Nadaraya–Watson estimator stands out as it shares the advantages of both Nadaraya–Watson and local linear regression estimators. The asymptotic normality of the estimators proposed has been established in the manner of sparse asymptotics, which shows that the smoothed methods proposed outperform their conventional, unsmoothed, parametric counterparts under very mild conditions. Simulation results lend further support to this assertion. Finally, the new method is illustrated via a real data set concerning the relationship between the number of daily hospital admissions and the levels of pollutants in Hong Kong in 1994–1995. An ad hoc model selection procedure based on a local Akaike information criterion is proposed to select the significant pollutant indices.     

Conditional Score Tests for Heteroscedasticity in the Two-Way Error Components Model

This paper extends the one-way heteroskedasticity score test of Holly and Gardiol (2000, In: Krishnakumar, J, Ronchetti, E (Eds.), Panel Data Econometrics: Future Directions, North-Holland, Amsterdam, pp. 199–211) to two conditional Lagrange Multiplier (LM) tests of heteroskedasticity under contiguous alternatives within the two-way error components model framework. In each case, the derivation of Rao's efficient score statistics for testing heteroskedasticity is first obtained. Then, based on a specific set of assumptions, the asymptotic distribution of the score under contiguous alternatives is established. Finally, the expression for the score test statistic in the presence of heteroskedasticity and related asymptotic local powers of these score test statistics are derived and discussed.     

An empirical likelihood goodness-of-fit test for time series

Summary. Standard goodness-of-fit tests for a parametric regression model against a series of nonparametric alternatives are based on residuals arising from a fitted model. When a parametric regression model is compared with a nonparametric model, goodness-of-fit testing can be naturally approached by evaluating the likelihood of the parametric model within a nonparametric framework. We employ the empirical likelihood for an α -mixing process to formulate a test statistic that measures the goodness of fit of a parametric regression model. The technique is based on a comparison with kernel smoothing estimators. The empirical likelihood formulation of the test has two attractive features. One is its automatic consideration of the variation that is associated with the nonparametric fit due to empirical likelihood's ability to Studentize internally. The other is that the asymptotic distribution of the test statistic is free of unknown parameters, avoiding plug-in estimation. We apply the test to a discretized diffusion model which has recently been considered in financial market analysis.     

A joint test for parametric specification and independence in nonlinear regression models

This paper develops a testing procedure to simultaneously check (i) the independence between the error and the regressor(s), and (ii) the parametric specification in nonlinear regression models. This procedure generalizes the existing work of Sen and Sen [“Testing Independence and Goodness-of-fit in Linear Models,” Biometrika, 101, 927–942.] to a regression setting that allows any smooth parametric form of the regression function. We establish asymptotic theory for the test procedure under both conditional homoscedastic error and heteroscedastic error. The derived tests are easily implementable, asymptotically normal, and consistent against a large class of fixed alternatives. Besides, the local power performance is investigated. To calibrate the finite sample distribution of the test statistics, a smooth bootstrap procedure is proposed and found work well in simulation studies. Finally, two real data examples are analyzed to illustrate the practical merit of our proposed tests.     

Nonparametric testing for no covariate effects in conditional copulas

In dependence modelling using conditional copulas, one often imposes the working assumption that the covariate influences the conditional copula solely through the marginal distributions. This so-called (pairwise) simplifying assumption is almost standardly made in vine copula constructions. However, in recent literature evidence was provided that such an assumption might not be justified. Among the first issues is thus to test for its appropriateness. In this paper nonparametric tests for the null hypothesis of the simplifying assumption are proposed, and their asymptotic behaviours, under the null hypothesis and under some local alternatives, are established. The tests are fully nonparametric in nature: not requiring choices of copula families nor knowledge of the marginals. In a simulation study, the finite-sample size and power performances of the tests are investigated, and compared with these of the few available tests. A real data application illustrates the use of the tests.     

Kendall's tau for serial dependence

The authors show how Kendall's tau can be adapted to test against serial dependence in a univariate time series context. They provide formulas for the mean and variance of circular and noncircular versions of this statistic, and they prove its asymptotic normality under the hypothesis of independence. They present also a Monte Carlo study comparing the power and size of a test based on Kendall's tau with the power and size of competing procedures based on alternative parametric and nonparametric measures of serial dependence. In particular, their simulations indicate that Kendall's tau outperforms Spearman's rho in detecting first‐order autoregressive dependence, despite the fact that these two statistics are asymptotically equivalent under the null hypothesis, as well as under local alternatives.     

Testing for the Equality of Two Autoregressive Functions Using Quasi-Residuals

This article discusses the problem of testing the equality of two nonparametric autoregressive functions against one-sided alternatives. The heteroscedastic errors and stationary densities of the two independent strong mixing strictly stationary time series can be possibly different. The article adapts the idea of using sum of quasi-residuals to construct the test and derives its asymptotic null distributions. The article also shows that the test is consistent for general alternatives and obtains its limiting distributions under a sequence of local alternatives. Then a Monte Carlo simulation is conducted to study the finite sample level and power behavior of these tests at some alternatives. We also compare the test to an existing lag matched test theoretically and by Monte Carlo experiments.     

Non‐parametric Regression Tests Using Dimension Reduction Techniques

Abstract. Testing for parametric structure is an important issue in non‐parametric regression analysis. A standard approach is to measure the distance between a parametric and a non‐parametric fit with a squared deviation measure. These tests inherit the curse of dimensionality from the non‐parametric estimator. This results in a loss of power in finite samples and against local alternatives. This article proposes to circumvent the curse of dimensionality by projecting the residuals under the null hypothesis onto the space of additive functions. To estimate this projection, the smooth backfitting estimator is used. The asymptotic behaviour of the test statistic is derived and the consistency of a wild bootstrap procedure is established. The finite sample properties are investigated in a simulation study.     

On the Power of Bootstrapped Specification Tests

Abstract

Decisions based on econometric model estimates may not have the expected effect if the model is misspecified. Thus, specification tests should precede any analysis. Bierens' specification test is consistent and has optimality properties against some local alternatives. A shortcoming is that the test statistic is not distribution free, even asymptotically. This makes the test unfeasible. There have been many suggestions to circumvent this problem, including the use of upper bounds for the critical values. However, these suggestions lead to tests that lose power and optimality against local alternatives. In this paper we show that bootstrap methods allow us to recover power and optimality of Bierens' original test. Bootstrap also provides reliable p-values, which have a central role in Fisher's theory of hypothesis testing. The paper also includes a discussion of the properties of the bootstrap Nonlinear Least Squares Estimator under local alternatives.     

On Semiparametric Mode Regression Estimation

It has been found that, for a variety of probability distributions, there is a surprising linear relation between mode, mean, and median. In this article, the relation between mode, mean, and median regression functions is assumed to follow a simple parametric model. We propose a semiparametric conditional mode (mode regression) estimation for an unknown (unimodal) conditional distribution function in the context of regression model, so that any m-step-ahead mean and median forecasts can then be substituted into the resultant model to deliver m-step-ahead mode prediction. In the semiparametric model, Least Squared Estimator (LSEs) for the model parameters and the simultaneous estimation of the unknown mean and median regression functions by the local linear kernel method are combined to infer about the parametric and nonparametric components of the proposed model. The asymptotic normality of these estimators is derived, and the asymptotic distribution of the parameter estimates is also given and is shown to follow usual parametric rates in spite of the presence of the nonparametric component in the model. These results are applied to obtain a data-based test for the dependence of mode regression over mean and median regression under a regression model.     

A distribution free test to detect general dependence between a response variable and a covariate in the presence of heteroscedastic treatment effects

In this paper, we present a test of independence between the response variable, which can be discrete or continuous, and a continuous covariate after adjusting for heteroscedastic treatment effects. The method involves first augmenting each pair of the data for all treatments with a fixed number of nearest neighbours as pseudo‐replicates. Then a test statistic is constructed by taking the difference of two quadratic forms. The statistic is equivalent to the average lagged correlations between the response and nearest neighbour local estimates of the conditional mean of response given the covariate for each treatment group. This approach effectively eliminates the need to estimate the nonlinear regression function. The asymptotic distribution of the proposed test statistic is obtained under the null and local alternatives. Although using a fixed number of nearest neighbours pose significant difficulty in the inference compared to that allowing the number of nearest neighbours to go to infinity, the parametric standardizing rate for our test statistics is obtained. Numerical studies show that the new test procedure has robust power to detect nonlinear dependency in the presence of outliers that might result from highly skewed distributions. The Canadian Journal of Statistics 38: 408–433; 2010 © 2010 Statistical Society of Canada