Inference for linear and nonlinear stable error processes via estimating functions

This paper describes an estimating function approach for parameter estimation in linear and nonlinear times series models with infinite variance stable errors. Joint estimates of location and scale parameters are derived for classes of autoregressive (AR) models and random coefficient autoregressive (RCA) models with stable errors, as well as for AR models with stable autoregressive conditionally heteroscedastic (ARCH) errors. Fast, on-line, recursive parametric estimation for the location parameter based on estimating functions is discussed using simulation studies. A real financial time series is also discussed in some detail.     

Nonparametric likelihood inference for general autoregressive models

This paper shows how nonparametric likelihood inference for autoregressive models can be based on the family of “empirical” Cressie–Read statistics. The results of the paper apply to possibly nonstationary autoregressive models with innovations that form a martingale difference sequence, and can accommodate multiple and complex unit roots, as well as deterministic components. As an application, the paper considers nonparametric likelihood-based tests for seasonal unit roots and for double unit roots. Monte Carlo evidence seems to suggest that the proposed tests have competitive finite sample properties.     

Goodness-of-fit tests for binomial AR(1) processes

The binomial AR(1) model describes a nonlinear process with a first-order autoregressive (AR(1)) structure and a binomial marginal distribution. To develop goodness-of-fit tests for the binomial AR(1) model, we investigate the observed marginal distribution of the binomial AR(1) process, and we tackle its autocorrelation structure. Motivated by the family of power-divergence statistics for handling discrete multivariate data, we derive the asymptotic distribution of certain categorized power-divergence statistics for the case of a binomial AR(1) process. Then we consider Bartlett's formula, which is widely used in time series analysis to provide estimates of the asymptotic covariance between sample autocorrelations, but which is not applicable when the underlying process is nonlinear. Hence, we derive a novel Bartlett-type formula for the asymptotic distribution of the sample autocorrelations of a binomial AR(1) process, which is then applied to develop tests concerning the autocorrelation structure. Simulation studies are carried out to evaluate the size and power of the proposed tests under diverse alternative process models. Several real examples are used to illustrate our methods and findings.     

The marked empirical process to test nonlinear time series against a large class of alternatives when the random vectors are nonstationary and absolutely regular

In this paper, we propose a method for testing absolutely regular and possibly nonstationary nonlinear time-series, with application to general AR-ARCH models. Our test statistic is based on a marked empirical process of residuals which is shown to converge to a Gaussian process with respect to the Skohorod topology. This testing procedure was first introduced by Stute [Nonparametric model checks for regression, Ann. Statist. 25 (1997), pp. 613–641] and then widely developed by Ngatchou-Wandji [Weak convergence of some marked empirical processes: Application to testing heteroscedasticity, J. Nonparametr. Stat. 14 (2002), pp. 325–339; Checking nonlinear heteroscedastic time series models, J. Statist. Plann. Inference 133 (2005), pp. 33–68; Local power of a Cramer-von Mises type test for parametric autoregressive models of order one, Compt. Math. Appl. 56(4) (2008), pp. 918–929] under more general conditions. Applications to general AR-ARCH models are given.     

A time series approach to life table construction

This paper deals with the construction of the life table. A discussion of basic facts about the life table is followed by the proposal of a nonstationary, autoregressive model for the life table. The moment structure of the nonstationary, autoregressive model is developed. Some estimation procedures are proposed followed by several examples.     

A comparison of LS/ML and GMM estimation in a simple AR(1) model

This paper compares least squares (LS)/maximum likelihood (ML) and generalised method of moments (GMM) estimation in a simple. Gaussian autoregressive of order one (AR(1)) model. First, we show that the usual LS/ML estimator is a corner solution to a general minimisation problem that involves two moment conditions, while the new GMM we devise is not. Secondly, we examine asymptotic and finite sample properties of the new GMM estimator in comparison to the usual LS/ML estimator in a simple AR(1) model. For both stable and unstable (unit root) specifications, we show asymptotic equivalence of the distributions of the two estimators. However, in finite samples, the new GMM estimator performs better.     

Binomial AR(1) processes: moments,cumulants, and estimation

The modelling and analysis of count-data time series are areas of emerging interest with various applications in practice. We consider the particular case of the binomial AR(1) model, which is well suited for describing binomial counts with a first-order autoregressive serial dependence structure. We derive explicit expressions for the joint (central) moments and cumulants up to order 4. Then, we apply these results for expressing moments and asymptotic distribution of the squared difference estimator as an alternative to the sample autocovariance. We also analyse the asymptotic distribution of the conditional least-squares estimators of the parameters of the binomial AR(1) model. The finite-sample performance of these estimators is investigated in a simulation study, and we apply them to real data about computerized workstations.     

Multivariate autoregressive time semes modeling: one scalar autoregressive model at-A-time

Multivariate (or interchangeably multichannel) autoregressive (MCAR) modeling of stationary and nonstationary time series data is achieved doing things one channel at-a-time using only scalar computations on instantaneous data. The one channel at-a-time modeling is achieved as an instantaneous response multichannel autoregressive model with orthogonal innovations variance. Conventional MCAR models are expressible as linear algebraic transformations of the instantaneous response orthogonal innovations models. By modeling multichannel time series one channel at-a-time, the problems of modeling multichannel time series are reduced to problems in the modeling of scalar autoregressive time series. The three longstanding time series modeling problems of achieving a relatively parsimonious MCAR representation, of multichannel stationary time series spectral estimation and of the modeling of nonstationary covariance time series are addressed using this paradigm.     

An Adaptive Functional Autoregressive Forecast Model to Predict Electricity Price Curves

We propose an adaptive functional autoregressive (AFAR) forecast model to predict electricity price curves. With time-varying operators, the AFAR model can be safely used in both stationary and nonstationary situations. A closed-form maximum likelihood (ML) estimator is derived under stationarity. The result is further extended for nonstationarity, where the time-dependent operators are adaptively estimated under local homogeneity. We provide theoretical results of the ML estimator and the adaptive estimator. Simulation study illustrates nice finite sample performance of the AFAR modeling. The AFAR model also exhibits a superior accuracy in the forecast exercise of the California electricity daily price curves compared to several alternatives.     

A note on properties of spatial yule-walker estimators

For two-dimensional spatial autoregressive (AR) models, asymptotic properties of the spatial Yule-Walker (YW) estimators (Tjøstheim, 1978) are studied. These estimators although consistent, are shown to be asymptotically biased. Estimators from the first-order spatial bilateral AR model are looked at in more detail and the spatial YW estimators for this model are compared with the exact maximum likelihood estimators. Small sample properties of both estimators are also discussed briefly and some simulation results are presented.     

Double AR model without intercept: An alternative to modeling nonstationarity and heteroscedasticity

This paper presents a double AR model without intercept (DARWIN model) and provides us a new way to study the nonstationary heteroscedastic time series. It is shown that the DARWIN model is always nonstationary and heteroscedastic, and its sample properties depend on the Lyapunov exponent. An easy-to-implement estimator is proposed for the Lyapunov exponent, and it is unbiased, strongly consistent, and asymptotically normal. Based on this estimator, a powerful test is constructed for testing the ordinary oscillation of the model. Moreover, this paper proposes the quasi-maximum likelihood estimator (QMLE) for the DARWIN model, which has an explicit form. The strong consistency and asymptotic normality of the QMLE are established regardless of the sign of the Lyapunov exponent. Simulation studies are conducted to assess the performance of the estimation and testing, and an empirical example is given for illustrating the usefulness of the DARWIN model.     

Risk efficient estimation of fully dependent random coefficient autoregressive models of general order

We consider a stochastic dynamic model with autoregressive progression. The drift coefficients of the autoregressive model are random where the randomness in the coefficients can have any dependence structure. We propose a two-step sequential estimator and study the asymptotic behavior of few important properties. Paradigm of sequential estimation has its own advantage in reducing sample size and plugging estimates of nuisance parameters while inferring about the main parameters. Our proposed estimator is asymptotically optimal as the predictive risk of the proposed estimator attains the risk of the oracle that assumes known nuisance parameters. Extensive simulation confirms our results.     

Oracle model selection for correlated data via residuals

This paper concerns model selection for autoregressive time series when the observations are contaminated with trend. We propose an adaptive least absolute shrinkage and selection operator (LASSO) type model selection method, in which the trend is estimated by B-splines, the detrended residuals are calculated, and then the residuals are used as if they were observations to optimize an adaptive LASSO type objective function. The oracle properties of such an adaptive LASSO model selection procedure are established; that is, the proposed method can identify the true model with probability approaching one as the sample size increases, and the asymptotic properties of estimators are not affected by the replacement of observations with detrended residuals. The intensive simulation studies of several constrained and unconstrained autoregressive models also confirm the theoretical results. The method is illustrated by two time series data sets, the annual U.S. tobacco production and annual tree ring width measurements.     

On a mixture vector autoregressive model

The authors show how to extend univariate mixture autoregressive models to a multivariate time series context. Similar to the univariate case, the multivariate model consists of a mixture of stationary or nonstationary autoregressive components. The authors give the first and second order stationarity conditions for a multivariate case up to order 2. They also derive the second order stationarity condition for the univariate mixture model up to arbitrary order. They describe an EM algorithm for estimation, as well as a diagnostic checking procedure. They study the performance of their method via simulations and include a real application.     

Discussion of ‘An analysis of global warming in the Alpine region based on nonlinear nonstationary time series models’ by Battaglia and Protopapas

This discussion focuses on threshold nonstationary?Cnonlinear time series modelling; it raises various issues to do with identifiability and model complexity. It also gives some background history concerning smooth threshold/transition autoregressive models and hidden Markov switching models.     

A novel and fast methodology for simultaneous multiple structural break estimation and variable selection for nonstationary time series models

A class of nonstationary time series such as locally stationary time series can be approximately modeled by piecewise stationary autoregressive (PSAR) processes. But the number and locations of the piecewise autoregressive segments, as well as the number of nonzero coefficients in each autoregressive process, are unknown. In this paper, by connecting the multiple structural break detection with a variable selection problem for a linear model with a large number of regression coefficients, a novel and fast methodology utilizing modern penalized model selection is introduced for detecting multiple structural breaks in a PSAR process. It also simultaneously performs variable selection for each autoregressive model and hence the order selection. To further its performance, an algorithm is given, which remains very fast in computation. Numerical results from simulation and a real data example show that the algorithm has excellent empirical performance.     

DISTRIBUTION OF THE LEAST SQUARES ESTIMATOR IN A FIRST-ORDER AUTOREGRESSIVE MODEL

This paper investigates the finite sample distribution of the least squares estimator of the autoregressive parameter in a first-order autoregressive model. A uniform asymptotic expansion for the distribution applicable to both stationary and nonstationary cases is obtained. Accuracy of the approximation to the distribution by a first few terms of this expansion is then investigated. It is found that the leading term of this expansion approximates well the distribution. The approximation is, in almost all cases, accurate to the second decimal place throughout the distribution. In the literature, there exist a number of approximations to this distribution which are specifically designed to apply in some special cases of this model. The present approximation compares favorably with those approximations and in fact, its accuracy is, with almost no exception, as good as or better than these other approximations. Convenience of numerical computations seems also to favor the present approximations over the others. An application of the finding is illustrated with examples.     

On least-squares bias in the AR(p) models: Bias correction using the bootstrap methods

In the case where the lagged dependent variables are included in the regression model, it is known that the ordinary least squares estimates (OLSE) are biased in small sample and that the bias increases as the number of the irrelevant variables increases. In this paper, based on the bootstrap methods, an attempt is made to obtain the unbiased estimates in autoregressive and non-Gaussian cases. We propose the residual-based bootstrap method in this paper. Some simulation studies are performed to examine whether the proposed estimation procedure works well or not. We obtain the results that it is possible to recover the true parameter values and that the proposed procedure gives us the less biased estimators than OLSE. This paper is a substantial revision of Tanizaki (2000). The normality assumption is adopted in Tanizaki (2000), but it is not required in this paper. The authors are grateful to an anonymous referee for valuable suggestions and comments. This research was partially supported by Japan Society for the Promotion of Science, Grants-in-Aid for Scientific Research (C)(2) #14530033, 2002–2005, for H. Tanizaki and Grants-in-Aid for the 21st Century COE Program.     

Bootstrap-based bias corrections for INAR count time series

Integer-valued autoregressive (INAR) processes form a very useful class of processes suitable to model time series of counts. Several practically relevant estimators based on INAR data are known to be systematically biased away from their population values, e.g. sample autocovariances, sample autocorrelations, or the dispersion index. We propose to do bias correction for such estimators by using a recently proposed INAR-type bootstrap scheme that is tailor-made for INAR processes, and which has been proven to be asymptotically consistent under general conditions. This INAR bootstrap allows an implementation with and without parametrically specifying the innovations' distribution. To judge the potential of corresponding bias correction, we compare these bootstraps in simulations to several competitors that include the AR bootstrap and block bootstrap. Finally, we conclude with an illustrative data application.