Checks of model adequacy for univariate time series models and their application to econometric relationships

Tests derived from time series analysis play an important role in many empirical studies. These tests are frequently applied to the residuals obtained by fitting an econometric model using some standard estimator. We focus attention here on tests developed for univariate time series models. Various approaches to testing the adequacy of such models are discussed and compared. The validity and sefulness of applying these tests to econometric residuals are then examined and some Monte Carlo evidence is reported.     

Theory & Methods: Residual Diagnostic Plots for Checking for Model Mis‐specification in Time Series Regression

This paper considers residuals for time series regression. Despite much literature on visual diagnostics for uncorrelated data, there is little on the autocorrelated case. To examine various aspects of the fitted time series regression model, three residuals are considered. The fitted regression model can be checked using orthogonal residuals; the time series error model can be analysed using marginal residuals; and the white noise error component can be tested using conditional residuals. When used together, these residuals allow identification of outliers, model mis‐specification and mean shifts. Due to the sensitivity of conditional residuals to model mis‐specification, it is suggested that the orthogonal and marginal residuals be examined first.     

Testing for spurious and cointegrated regressions: A wavelet approach

This paper proposes a wavelet-based approach to analyze spurious and cointegrated regressions in time series. The approach is based on the properties of the wavelet covariance and correlation in Monte Carlo studies of spurious and cointegrated regression. In the case of the spurious regression, the null hypotheses of zero wavelet covariance and correlation for these series across the scales fail to be rejected. Conversely, these null hypotheses across the scales are rejected for the cointegrated bivariate time series. These nonresidual-based tests are then applied to analyze if any relationship exists between the extraterrestrial phenomenon of sunspots and the earthly economic time series of oil prices. Conventional residual-based tests appear sensitive to the specification in both the cointegrating regression and the lag order in the augmented Dickey–Fuller tests on the residuals. In contrast, the wavelet tests, with their bootstrap t-statistics and confidence intervals, detect the spuriousness of this relationship.     

The Sensitivity of Detrended Long-Memory Processes

Long-memory tests are often complicated by the presence of deterministic trends. Hence, an additional step of detrending the data is necessary. The typical way to detrend a suspected long-memory series is to use OLS or BSP residuals. Applying the method of sensitivity analysis we address the of question of how robust these residuals are in presence of potential long memory components. Unlike short-memory ARMA process long-memory I(d) processes causes sensitivity to OLS/BSP residuals. Therefore, we develop a finite sample measure of the sensitivity of a detrended series based on the residuals. Based on our sensitivity measure we propose a “rule of thumb” for practitioners to choose between the two methods of detrending, has been provided in this article.     

Local Fourier tests for structural change based on residuals

We propose a structural change test based on the recursive residuals with the local Fourier series estimators. The statistical properties of the proposed test are derived and the empirical properties are shown via simulation. We also consider other structural change tests based on CUSUM, MOSUM, moving estimates (ME), and empirical distribution functions with the recursive residuals and the ordinary residuals. Empirical powers are calculated in various structural change models for the comparison of those tests. These structural change tests are applied to South Korea's gross domestic product (GDP), South Korean Won to US Dollar currency exchange rates, and South Korea's Okun's law.     

On testing for causality in variance between two multivariate time series

Verifying the existence of a relationship between two multivariate time series represents an important consideration. In this article, the procedure developed by Cheung and Ng [A causality-in-variance test and its application to financial market prices, J. Econom. 72 (1996), pp. 33–48] designed to test causality in variance for univariate time series is generalized in several directions. A first approach proposes test statistics based on residual cross-covariance matrices of squared (standardized) residuals and cross products of (standardized) residuals. In a second approach, transformed residuals are defined for each residual vector time series, and test statistics are constructed based on the cross-correlations of these transformed residuals. Test statistics at individual lags and portmanteau-type test statistics are developed. Conditions are given under which the new test statistics converge in distribution towards chi-square distributions. The proposed methodology can be used to determine the directions of causality in variance, and appropriate test statistics are presented. Monte Carlo simulation results show that the new test statistics offer satisfactory empirical properties. An application with two bivariate financial time series illustrates the methods.     

Bootstrap Procedures for Online Monitoring of Changes in Autoregressive Models

We compare the behavior of several bootstrap procedures for monitoring changes in the error distribution of autoregressive time series. The proposed procedures are designed to control the overall significance level and include classical tests based on the empirical distribution function as well as Fourier-type methods that utilize the empirical characteristic function, both functions being computed on the basis of properly estimated residuals. The Monte Carlo study incorporates different estimators and a variety of sampling situations with and without outliers.     

On testing for independence between the innovations of several time series

Test statistics for checking the independence between the innovations of several time series are developed. The time series models considered allow for general specifications for the conditional mean and variance functions that could depend on common explanatory variables. In testing for independence between more than two time series, checking pairwise independence does not lead to consistent procedures. Thus a finite family of empirical processes relying on multivariate lagged residuals are constructed, and we derive their asymptotic distributions. In order to obtain simple asymptotic covariance structures, Möbius transformations of the empirical processes are studied, and simplifications occur. Under the null hypothesis of independence, we show that these transformed processes are asymptotically Gaussian, independent, and with tractable covariance functions not depending on the estimated parameters. Various procedures are discussed, including Cramér–von Mises test statistics and tests based on non‐parametric measures. The ranks of the residuals are considered in the new methods, giving test statistics which are asymptotically margin‐free. Generalized cross‐correlations are introduced, extending the concept of cross‐correlation to an arbitrary number of time series; portmanteau procedures based on them are discussed. In order to detect the dependence visually, graphical devices are proposed. Simulations are conducted to explore the finite sample properties of the methodology, which is found to be powerful against various types of alternatives when the independence is tested between two and three time series. An application is considered, using the daily log‐returns of Apple, Intel and Hewlett‐Packard traded on the Nasdaq financial market. The Canadian Journal of Statistics 40: 447–479; 2012 © 2012 Statistical Society of Canada     

Oracle model selection for correlated data via residuals

This paper concerns model selection for autoregressive time series when the observations are contaminated with trend. We propose an adaptive least absolute shrinkage and selection operator (LASSO) type model selection method, in which the trend is estimated by B-splines, the detrended residuals are calculated, and then the residuals are used as if they were observations to optimize an adaptive LASSO type objective function. The oracle properties of such an adaptive LASSO model selection procedure are established; that is, the proposed method can identify the true model with probability approaching one as the sample size increases, and the asymptotic properties of estimators are not affected by the replacement of observations with detrended residuals. The intensive simulation studies of several constrained and unconstrained autoregressive models also confirm the theoretical results. The method is illustrated by two time series data sets, the annual U.S. tobacco production and annual tree ring width measurements.     

Unit root tests: the autoregressive approach in comparison with the periodogram regression

In Monte Carlo sudies we investigate unit root tests in line with Dickey/Fuller (1979). In case of positively autocorrelated MA(1) residuals their experimental power is extremely poor. Next we compare different versions of periodogram regression suggested in the literature. Their experimental behaviour is investigated with fractionally integrated processes. It is demonstrated how unit root tests may be based on periodogram regression. There is simulation evidence that those tests may do better in terms of power than the autoregressive tests, especially when testing ARMA(1,1) series against a linear time trend.     

Residual-based CUSUM of squares test for Poisson integer-valued GARCH models

This study considers the problem of testing for a parameter change in integer-valued time series models in which the conditional density of current observations is assumed to follow a Poisson distribution. As a test, we consider the CUSUM of the squares test based on the residuals from INGARCH models and find that the test converges weakly to the supremum of a Brownian bridge. A simulation study demonstrates its superiority to the residual and standardized residual-based CUSUM tests of Kang and Lee [Parameter change test for Poisson autoregressive models. Scand J Statist. 2014;41:1136–1152] and Lee and Lee [CUSUM tests for general nonlinear inter-valued GARCH models: comparison study. Ann Inst Stat Math. 2019;71:1033–1057.] as well as the CUSUM of squares test based on standardized residuals.     

Using the Residual White Noise Autoregressive Order Determination Criterion to Identify Unit Roots in Arima Models

We present a simplified form of a univariate identification approach for time series models based on the residual white noise autoregressive order determination criterion and linear estimation methods. We also show how the procedure can be used to identify the degree of differencing necessary to induce stationarity in data. The performance of this approach is also contrasted with Portmanteau tests for detection of white noise residuals and with Dickey-Fuller and Bayesian procedures for detection of unit roots. Simulated and economic data are used to demonstrate the capabilities of the modified approach.     

基于Markov区制转换模型的极值风险度量研究

将马尔科夫区制转换模型与极值理论相结合研究金融风险度量问题.首先用SWARCH-t模型捕捉收益率序列的剧烈波动和结构变换特征,然后将收益序列转化为标准残差序列,在此基础上通过SWARCH-t模型与极值理论相结合拟合标准残差的尾部分布,进而构建基于SWARCH- t- EVT的动态VaR模型,最后对模型的有效性进行检验.研究表明,SWARCH-t-EVT模型能够有效识别上证综指的波动区制特征,且能有效合理地测度上证综指收益风险,尤其在高的置信水平下表现更好.     

Efficient inference for parameters of unobservable periodic autoregressive time series

This paper considers estimating the model coefficients when the observed periodic autoregressive time series is contaminated by a trend. The proposed Yule–Walker estimators are obtained by a two-step procedure. In the first step, the trend is estimated by a weighted local polynomial, and the residuals are obtained by subtracting the trend estimates from the observations; in the second step, the model coefficients are estimated by the well-known Yule–Walker method via the residuals. It is shown that under certain conditions such Yule–Walker estimators are oracally efficient, i.e., they are asymptotically equivalent to those obtained from periodic autoregressive time series without a trend. An easy-to-use implementation procedure is provided. The performance of the estimators is illustrated by simulation studies and real data analysis. In particular, the simulation studies show that the proposed estimator outperforms that obtained from the residuals when the trend is estimated by kernel smoothing without taking the heteroscedasticity into consideration.     

Granger-causal analysis of GARCH models: A Bayesian approach

A multivariate GARCH model is used to investigate Granger causality in the conditional variance of time series. Parametric restrictions for the hypothesis of noncausality in conditional variances between two groups of variables, when there are other variables in the system as well, are derived. These novel conditions are convenient for the analysis of potentially large systems of economic variables. To evaluate hypotheses of noncausality, a Bayesian testing procedure is proposed. It avoids the singularity problem that may appear in the Wald test, and it relaxes the assumption of the existence of higher-order moments of the residuals required in classical tests.     

Linear and nonlinear causality tests in an LSTAR model: wavelet decomposition in a nonlinear environment

In this paper, we use simulated data to investigate the power of different causality tests in a two-dimensional vector autoregressive (VAR) model. The data are presented in a nonlinear environment that is modelled using a logistic smooth transition autoregressive function. We use both linear and nonlinear causality tests to investigate the unidirection causality relationship and compare the power of these tests. The linear test is the commonly used Granger causality F test. The nonlinear test is a non-parametric test based on Baek and Brock [A general test for non-linear Granger causality: Bivariate model. Tech. Rep., Iowa State University and University of Wisconsin, Madison, WI, 1992] and Hiemstra and Jones [Testing for linear and non-linear Granger causality in the stock price–volume relation, J. Finance 49(5) (1994), pp. 1639–1664]. When implementing the nonlinear test, we use separately the original data, the linear VAR filtered residuals, and the wavelet decomposed series based on wavelet multiresolution analysis. The VAR filtered residuals and the wavelet decomposition series are used to extract the nonlinear structure of the original data. The simulation results show that the non-parametric test based on the wavelet decomposition series (which is a model-free approach) has the highest power to explore the causality relationship in nonlinear models.     

Diagnostic checks for integer-valued autoregressive models using expected residuals

Integer-valued time series models make use of thinning operators for coherency in the nature of count data. However, the thinning operators make residuals unobservable and are the main difficulty in developing diagnostic tools for autocorrelated count data. In this regard, we introduce a new residual, which takes the form of predictive distribution functions, to assess probabilistic forecasts, and this new residual is supplemented by a modified usual residuals. Under integer-valued autoregressive (INAR) models, the properties of these two residuals are investigated and used to evaluate the predictive performance and model adequacy of the INAR models. We compare our residuals with the existing residuals through simulation studies and apply our method to select an appropriate INAR model for an over-dispersed real data.     

Testing Monotonicity of Regression Functions – An Empirical Process Approach

We propose several new tests for monotonicity of regression functions based on different empirical processes of residuals and pseudo‐residuals. The residuals are obtained from an unconstrained kernel regression estimator whereas the pseudo‐residuals are obtained from an increasing regression estimator. Here, in particular, we consider a recently developed simple kernel‐based estimator for increasing regression functions based on increasing rearrangements of unconstrained non‐parametric estimators. The test statistics are estimated distance measures between the regression function and its increasing rearrangement. We discuss the asymptotic distributions, consistency and small sample performances of the tests.     

Lack of fit tests based on sums of ordered residuals for linear models

Christensen & Lin ( 2015 ) suggested two lack of fit tests to assess the adequacy of a linear model based on partial sums of residuals. In particular, their tests evaluated the adequacy of the mean function. Their tests relied on asymptotic results without requiring small sample normality. We propose four new tests, find their asymptotic distributions, and propose an alternative simulation method for defining tests that is remarkably robust to the distribution of the errors. To assess their strengths and weaknesses, the Christensen & Lin ( 2015 ) tests and the new tests were compared in different scenarios by simulation. In particular, the new tests include two based on partial sums of absolute residuals. Previous partial sums of residuals tests have used signed residuals whose values when summed can cancel each other out. The use of absolute residuals requires small sample normality, but allows detection of lack of fit that was previously not possible with partial sums of residuals.     

Diagnostic Checking of Unobserved-Components Time Series Models

Diagnostic checking of the specification of time series models is normally carried out using the innovations—that is, the one-step-ahead prediction errors. In an unobserved-components model, other sets of residuals are available. These auxiliary residuals are estimators of the disturbances associated with the unobserved components. They can often yield information that is less apparent from the innovations, but they suffer from the disadvantage that they are serially correlated even in a correctly specified model with known parameters. This article shows how the properties of the auxiliary residuals may be obtained, how they are related to each other and to the innovations, and how they can be used to construct test statistics. Applications are presented showing how residuals can be used to detect and distinguish between outliers and structural change.