Estimating function method for product autoregressive models

The first-order product autoregressive (PAR(1)) model introduced by McKenzie in 1982 McKenzie, E. D. (1982). Product autoregression: A time series characterization of the gamma distribution. Journal of Applied Probability 19:463–468. [Google Scholar] did not attract the attention of practitioners due to the unavailability of a proper estimation method. This article proposes an estimating function (EF) method to fill the gap. In particular, we suggest an optimal combination of linear and quadratic EFs to overcome the problem of parameter identification. The procedure is applied to Weibull and Gamma PAR(1) models. Simulation and data analysis show that the proposed method performs better than the existing methods.     

A nonparametric test of conditional autoregressive heteroscedasticity for threshold autoregressive models

Threshold autoregressive models are widely used in time‐series applications. When building or using such a model, it is important to know whether conditional heteroscedasticity exists. The authors propose a nonparametric test of this hypothesis. They develop the large‐sample theory of a test of nonlinear conditional heteroscedasticity adapted to nonlinear autoregressive models and study its finite‐sample properties through simulations. They also provide percentage points for carrying out this test, which is found to have very good power overall.     

A diagnostic statistic for functional-coefficient autoregressive models

In this paper, functional coefficient autoregressive (FAR) models proposed by Chen and Tsay (1993) are considered. We propose a diagnostic statistic for FAR models constructed by comparing between parametric and nonparametric estimators of the functional form of the FAR models. We show asymptotic properties of our statistic mathematically and it can be applied to the estimation of the delay parameter and the specification of the functional form of FAR models.     

A divergence test for autoregressive time series models

In this paper, we study the normality test for the innovations of unstable autoregressive models based on the divergence test. In order to investigate the asymptotic behavior of the tests, we use the link between the divergence test and the residual empirical process. Simulation results are provided for illustration.     

First-order optimal designs for non-linear models

This paper presents D-optimal experimental designs for a variety of non-linear models which depend on an arbitrary number of covariates but assume a positive prior mean and a Fisher information matrix satisfying particular properties. It is argued that these optimal designs can be regarded as a first-order approximation of the asymptotic increase of Shannon information. The efficiency of this approximation is compared in some examples, which show how the results can be further used to compute the Bayesian optimal design, when the approximate solution is not accurate enough.     

Two-stage generalized moment method approach for bidimensional random coefficient autoregressive models

ABSTRACT

A two-dimensionally indexed random coefficients autoregressive models (2D ? RCAR) and the corresponding statistical inference are important tools for the analysis of spatial lattice data. The study of such models is motivated by their second-order properties that are similar to those of 2D ? (G)ARCH which play an important role in spatial econometrics. In this article, we study the asymptotic properties of two-stage generalized moment method (2S ? GMM) under general asymptotic framework for 2D ? RCA models. So, the efficiency, strong consistency, the asymptotic normality, and hypothesis tests of 2S ? GMM estimation are derived. A simulation experiment is presented to highlight the theoretical results.     

Adaptive order selection for autoregressive models

Autoregressive model is a popular method for analysing the time dependent data, where selection of order parameter is imperative. Two commonly used selection criteria are the Akaike information criterion (AIC) and the Bayesian information criterion (BIC), which are known to suffer the potential problems regarding overfit and underfit, respectively. To our knowledge, there does not exist a criterion in the literature that can satisfactorily perform under various situations. Therefore, in this paper, we focus on forecasting the future values of an observed time series and propose an adaptive idea to combine the advantages of AIC and BIC but to mitigate their weaknesses based on the concept of generalized degrees of freedom. Instead of applying a fixed criterion to select the order parameter, we propose an approximately unbiased estimator of mean squared prediction errors based on a data perturbation technique for fairly comparing between AIC and BIC. Then use the selected criterion to determine the final order parameter. Some numerical experiments are performed to show the superiority of the proposed method and a real data set of the retail price index of China from 1952 to 2008 is also applied for illustration.     

A study of quadratic inference functions with alternative weighting matrices

Quadratic inference function (QIF) is an alternative methodology to the popular generalized estimating equations (GEE) approach, it does not involve direct estimation of the correlation parameter, and thus remains optimal even if the working correlation structure is misspecified. The idea is to represent the inverse of the working correlation matrix by a linear combination of some basis matrices. In this article, we present a modification of QIF with a robust variance estimator of the extended score function. Theoretical and numerical results show that the modified QIF attains better efficiency and achieves better small sample performance than the original QIF method.     

Integer-valued autoregressive models for counts showing underdispersion

The Poisson distribution is a simple and popular model for count-data random variables, but it suffers from the equidispersion requirement, which is often not met in practice. While models for overdispersed counts have been discussed intensively in the literature, the opposite phenomenon, underdispersion, has received only little attention, especially in a time series context. We start with a detailed survey of distribution models allowing for underdispersion, discuss their properties and highlight possible disadvantages. After having identified two model families with attractive properties as well as only two model parameters, we combine these models with the INAR(1) model (integer-valued autoregressive), which is particularly well suited to obtain auotocorrelated counts with underdispersion. Properties of the resulting stationary INAR(1) models and approaches for parameter estimation are considered, as well as possible extensions to higher order autoregressions. Three real-data examples illustrate the application of the models in practice.     

Control charts for multivariate spatial autoregressive models

This paper deals with spatial detection of changes in model parameters of spatial autoregressive processes. The respective sequential testing problems are formulated. Moreover, we introduce characteristic quantities to monitor means or covariances of multivariate spatial autoregressive processes. Additionally, we also take into account the simultaneous surveillance of the mean vector and the covariance matrix. The aim is to apply control charts, important tools of sequential analysis, to these quantities. The considered control procedures are based on either cumulative sums or exponential smoothing. Further, we illustrate the methodology of statistical process control studying the spectrum of additive colors in a satellite photograph. Via simulation studies, the proposed control procedures are calibrated for a predefined average run length. In addition, we compare the performance of the control procedures considering the out-of-control situation. Eventually, the control charts are applied, and the signals of the different schemes are visualized. The final results are critically discussed.     

Nonparametric likelihood inference for general autoregressive models

This paper shows how nonparametric likelihood inference for autoregressive models can be based on the family of “empirical” Cressie–Read statistics. The results of the paper apply to possibly nonstationary autoregressive models with innovations that form a martingale difference sequence, and can accommodate multiple and complex unit roots, as well as deterministic components. As an application, the paper considers nonparametric likelihood-based tests for seasonal unit roots and for double unit roots. Monte Carlo evidence seems to suggest that the proposed tests have competitive finite sample properties.     

Maximum likelihood estimation for directional conditionally autoregressive models

A spatial process observed over a lattice or a set of irregular regions is usually modeled using a conditionally autoregressive (CAR) model. The neighborhoods within a CAR model are generally formed using only the inter-distances or boundaries between the regions. To accommodate directional spatial variation, a new class of spatial models is proposed using different weights given to neighbors in different directions. The proposed model generalizes the usual CAR model by accounting for spatial anisotropy. Maximum likelihood estimators are derived and shown to be consistent under some regularity conditions. Simulation studies are presented to evaluate the finite sample performance of the new model as compared to the CAR model. Finally, the method is illustrated using a data set on the crime rates of Columbus, OH and on the elevated blood lead levels of children under the age of 72 months observed in Virginia in the year of 2000.     

Linear bootstrap methods for vector autoregressive moving-average models

We provide the theoretical justification of bootstrapping stationary invertible echelon vector autoregressive moving-average (VARMA) models using linear methods. The asymptotic validity of the bootstrap is established with strong white noise under parametric and nonparametric assumptions. Our methods are practical and useful for building reliable simulation-based inference and forecasting without implementing nonlinear estimation techniques such as ML which is usually burdensome, time demanding or impractical, particularly in big or highly persistent systems. The relevance of our procedures is more pronounced in the context of dynamic simulation-based techniques such as maximized Monte Carlo (MMC) tests [see Dufour J-M. Monte Carlo tests with nuisance parameters: a general approach to finite-sample inference and nonstandard asymptotics in econometrics. J Econom. 2006;133(2):443–477 and Dufour J-M, Jouini T. Finite-sample simulation-based tests in VAR models with applications to Granger causality testing. J Econom. 2006;135(1–2):229–254 for the VAR case]. Simulation evidence shows that, compared with conventional asymptotics, our bootstrap methods have good finite-sample properties in approximating the actual distribution of the studentized echelon VARMA parameter estimates, and in providing echelon parameter confidence sets with satisfactory coverage.     

Monitoring parameter changes for random coefficient autoregressive models

In this paper, we develop a monitoring procedure for an early detection of parameter changes in random coefficient autoregressive models. It is shown that the stopping rule signaling a parameter change satisfies the desired asymptotic property as seen in Lee, Lee, and Na (submitted for publication). Simulation results are provided for illustration.     

EM-based algorithms for autoregressive models with t-distributed innovations

This paper considers the estimation of parameters of AR(p) models for time series with t-distribution via EM-based algorithms. The paper develops asymptotic properties for the estimation to show that the estimators are efficient. Also testing theory for the estimators is considered. The robustness of the estimators and various tests to deviations from an assumed model is investigated. The study shows that the algorithms have equal estimation efficiency even if the error distribution is miss-specified or perturbed by outliers. Interestingly, the estimators from these algorithms performed better than that of the Modified Maximum Likelihood (MML) considered in Tiku et al. (2000 Tiku, M. L., Wong, W. K., Vaughan, D. C., Bian, G. (2000). Time series models in non-normal situations: Symmetric innovations. Journal of Time Series Analysis, 21: 571–596. [Google Scholar]).     

Bootstrap prediction intervals for autoregressive conditional duration models

In the recent past, the autoregressive conditional duration (ACD) models have gained popularity in modelling the durations between successive events. The aim of this paper is to propose a simple and distribution free re-sampling procedure for developing the forecast intervals of linear ACD Models. We use the conditional least squares method to estimate the parameters of the ACD Model instead of the conditional Maximum Likelihood Estimation or Quasi-Maximum Likelihood Estimation and show that they are consistent for large samples. The properties of the proposed procedure are illustrated by a simulation study and an application to two real data sets.     

Exact joint forecast regions for vector autoregressive models

Assume that a k-element vector time series follows a vector autoregressive (VAR) model. Obtaining simultaneous forecasts of the k elements of the vector time series is an important problem. Based on the Bonferroni inequality, Lutkepohl (1991) derived the procedures which construct the conservative joint forecast regions for the VAR model. In this paper, we propose to use an exact method which provides shorter prediction intervals than does the Bonferroni method. Three illustrative examples are given for comparison of the various VAR forecasting procedures.     

A test of linearity against functional coefficient autoregressive models

Our object in this paper is to propose a powerful test for detecting a broad class of nonlinearity of time series as one application of the method by Matsuda (1998). Consider autoregresive models X_t=Φ₁X_t?1+…+Φ_ρX_t?ρ+ε_t and we propose a statistic for testing whether or not Φ_i depends on delayed values X_t?d for some i. We compare the power of our test with that of tests proposed by Luukkonen, Saikkonen and Teräsvirta (1988a) and Hjellvik and TjΦstheim (1995) by simulation studies and our test is shown to be satisfactory.     

Parameter change test for zero-inflated generalized Poisson autoregressive models

In this paper, we consider the problem of testing for parameter change in zero-inflated generalized Poisson (ZIGP) autoregressive models. We verify that the ZIGP process is stationary and ergodic and that the conditional maximum likelihood estimator (CMLE) is strongly consistent and asymptotically normal. Based on these results, we construct CMLE- and residual-based cumulative sum tests and show that their limiting null distributions are a function of independent Brownian bridges. The simulation results are provided for illustration. A real data analysis is performed on some crime data of Australia.