Checks of model adequacy for univariate time series models and their application to econometric relationships

Tests derived from time series analysis play an important role in many empirical studies. These tests are frequently applied to the residuals obtained by fitting an econometric model using some standard estimator. We focus attention here on tests developed for univariate time series models. Various approaches to testing the adequacy of such models are discussed and compared. The validity and sefulness of applying these tests to econometric residuals are then examined and some Monte Carlo evidence is reported.     

CRITICAL VALUE APPROXIMATIONS FOR TESTS OF LINEAR REGRESSION DISTURBANCES

Two important classes of tests for non-spherical disturbances in the linear regression model involve test statistics whose null distributions and hence critical values depend on the regressors. This paper investigates the accuracy of the normal, two moment beta and four moment beta approximations to the critical values of such tests. An empirical experiment aimed at evaluating the accuracy of the approximations for a variety of tests against autocorrelation and heteroscedasticity is conducted. Overall the approximations are found to provide reasonably accurate critical values with skewness being a factor determining the degree of accuracy.     

Comparison of Times Series with Unequal Length in the Frequency Domain

In statistical data analysis it is often important to compare, classify, and cluster different time series. For these purposes various methods have been proposed in the literature, but they usually assume time series with the same sample size. In this article, we propose a spectral domain method for handling time series of unequal length. The method make the spectral estimates comparable by producing statistics at the same frequency. The procedure is compared with other methods proposed in the literature by a Monte Carlo simulation study. As an illustrative example, the proposed spectral method is applied to cluster industrial production series of some developed countries.     

Regression analysis of autocorrelated poisson-distribution) data

A regression model assuming Poisson-dia distributed data. with autocorrelated errors falls into the class of regression models that; have the error structure which is both heteroscedastic and autocorrelated. In general, this class of regression models are not estimable. However, due to the properties of the Poisson distribution that the variance is equal to the mean, this regression model on Poisson-distributed data with autocorrelated. errors is estimable. In this note the special structure of the covarlance matrix of the model with the first order auto-correlated error Is derived utilizing this property, A method based on the least squares method of Frome, Kutner, and Beauchamp (1973), supplemented by steps for handling autocorrelation in studies of time series analysis, nonlinear regression, and econometrics is presented for obtaining generalized least squares estimates for the parameters of the model.     

PARAMETER ESTIMATION FOR LOW-ORDER AUTO-REGRESSIVE MODELS WITH MISSING VALUES

Longitudinal data analysis in epidemiological settings is complicated by large multiplicities of short time series and the occurrence of missing observations. To handle such difficulties Rosner & Muñoz (1988) developed a weighted non-linear least squares algorithm for estimating parameters for first-order autoregressive (AR1) processes with time-varying covariates. This method proved efficient when compared to complete case procedures. Here that work is extended by (1) introducing a different estimation procedure based on the EM algorithm, and (2) formulating estimation techniques for second-order autoregressive models. The second development is important because some of the intended areas of application (adult pulmonary function decline, childhood blood pressure) have autocorrelation functions which decay more slowly than the geometric rate imposed by an AR1 model. Simulation studies are used to compare the three methodologies (non-linear, EM based and complete case) with respect to bias, efficiency and coverage both in the presence and in the absence of time-varying covariates. Differing degrees and mechanisms of missingness are examined. Preliminary results indicate the non-linear approach to be the method of choice: it has high efficiency and is easily implemented. An illustrative example concerning pulmonary function decline in the Netherlands is analyzed using this method.     

THE CONVERGENCE OF AUTOCORRELATIONS AND AUTOREGRESSIONS1

For a general class of scalar stationary processes, essentially those for which the best linear predictor is the best predictor (in the mean square sense), it is shown that, under fairly minor additional conditions, the sample autocorrelations converge to the true values almost surely and hniformly in the lag, t, at a rate (T^-1log T)^1/2, where T is the sample size. For ARMA processes, if |t|(log T)^a, a < ∞, the rate is the best possible, namely (T^-1log log T)^1/2. In particular the somewhat implausible condition, on the innovations, that E{ε(t)²| F_t-l} is constant is avoided in these results. The theorems are used to discuss autoregressive approximation. When the stationary process is a vector process the condition on the innovation sequence, ε(t), that E{ε(t)ε(t)| F_t-l} be constant, cannot be entirely avoided in relation to autoregressive approximation. This is also discussed.     

Comparison of spline estimator at various levels of autocorrelation in smoothing spline non parametric regression for longitudinal data

The purpose of this research are: (1) to obtain spline function estimation in non parametric regression for longitudinal data with and without considering the autocorrelation between data of observation within subject, (2) to develop the algorithm that generates simulation data with certain autocorrelation level based on size of sample (N) and error variance (EV), and (3) to establish shape of spline estimator in non parametric regression for longitudinal data to simulation with various level of autocorrelation, as well as compare DM and TM approaches in predicting spline estimator in the data simulation with different of autocorrelation observational data on within subject. The results of the application are as follows: (a) implementation of smoothing spline with penalized weighted least square (PWLS) approach with or without consideration of autocorrelation in general (in all sizes and all error variances levels) provides significantly different spline estimator when the autocorrelation level >0.8; (b) based on size comparison, spline estimator in non parametric regression smoothing spline with PLS approach with (DM), or without (DM) consideration of autocorrelation showed significantly different result in level of autocorrelation > 0.8 (in overall size, moderate and large sample size), and > 0.7 (in small sample size); (c) based on level of variance, spline estimator in non parametric regression smoothing spline with PLS approach with (DM), or without (DM) consideration of autocorrelation showed significantly different result in level of autocorrelation > 0.8 (in overall level of variance, moderate and large variance), and > 0.7 (in small variance).     

Frequency Domain Log-linear Models; Air Pollution and Mortality

Motivated by a study of the association between counts of daily mortality and air pollution, we present a frequency domain estimation approach for log-linear models that accounts for both overdispersion and autocorrelation. The methods also allow for the discounting or downweighting of information at particular frequencies at which, for example, confounding variables are likely to have greatest influence. This allows flexible sensitivity analyses to be carried out to assess the possible effect of confounders on the estimated effect. We apply the methods to estimate the association between counts of mortality and the concentration of airborne particles in Philadelphia, USA, for the years 1974–1988. We obtain an estimated effect of particulate air pollution on mortality that is significantly greater than zero but less than that obtained by a standard log-linear analysis.     

Imputation of attributes in networked data using Bayesian autocorrelation regression models

Misspecification in network autocorrelation models poses a challenge for parameter estimation, which is amplified by missing data. Model misspecification has been a focus of recent work in the statistics literature and new robust procedures have been developed, in particular cutting feedback. This paper shows how this helps in a misspecified network autocorrelation model. Where model misspecification is mild and the traits are fully observed, Bayesian imputation is routine. In settings with high missingness, Bayesian inference can fail, but a closely related cut model is robust. We illustrate this on a data set of graduate students using a Facebook-like messaging app.     

On a mixture autoregressive model

We generalize the Gaussian mixture transition distribution (GMTD) model introduced by Le and co-workers to the mixture autoregressive (MAR) model for the modelling of non-linear time series. The models consist of a mixture of K stationary or non-stationary AR components. The advantages of the MAR model over the GMTD model include a more full range of shape changing predictive distributions and the ability to handle cycles and conditional heteroscedasticity in the time series. The stationarity conditions and autocorrelation function are derived. The estimation is easily done via a simple EM algorithm and the model selection problem is addressed. The shape changing feature of the conditional distributions makes these models capable of modelling time series with multimodal conditional distributions and with heteroscedasticity. The models are applied to two real data sets and compared with other competing models. The MAR models appear to capture features of the data better than other competing models do.