A ROLE FOR VARIOGRAMS

In time series texts and journals, variograms are mentioned seldom, if at all. The autocovariance function is preferred. However there are situations where the variogram can be estimated with moderate precision but the autocovariance function cannot, because the variance of the process is not well known. If the problem to be solved does not require the process variance for its solution then it is generally more straightforward to use the variogram rather than the autocovariance function in solving this problem.     

On flat-top kernel spectral density estimators for homogeneous random fields

The problem of nonparametric estimation of the spectral density function of a partially observed homogeneous random field is addressed. In particular, a class of estimators with favorable asymptotic performance (bias, variance, rate of convergence) is proposed. The proposed estimators are actually shown to be √N-consistent if the autocovariance function of the random field is supported on a compact set, and close to √N-consistent if the autocovariance function decays to zero sufficiently fast for increasing lags.     

Empirical study of robust estimation methods for PAR models with application to the air quality area

Abstract

This paper compares three estimators for periodic autoregressive (PAR) models. The first is the classical periodic Yule-Walker estimator (YWE). The second is a robust version of YWE (RYWE) which uses the robust autocovariance function in the periodic Yule-Walker equations, and the third is the robust least squares estimator (RLSE) based on iterative least squares with robust versions of the original time series. The daily mean particulate matter concentration (PM10) data is used to illustrate the methodologies in a real application, that is, in the Air Quality area.     

Spectral analysis of Markov switching GARCH models with statistical inference

We derive matrix expressions in closed form for the autocovariance function and the spectral density of Markov switching GARCH models and their powers. For this, we apply the Riesz–Fischer theorem which defines the spectral representation as the Fourier transform of the autocovariance function. Under suitable assumptions, we prove that the sample estimator of the spectral density is consistent and asymptotically normally distributed. Further statistical implications in terms of order identification and parameter estimation are discussed. A simulation study confirms the validity of the asymptotic properties. These methods are also well suited for financial market applications, and in particular for the analysis of time series in the frequency domain, as shown in some proposed real-world examples.     

Autocovariance Estimation in Regression with a Discontinuous Signal and m‐Dependent Errors: A Difference‐Based Approach

We discuss a class of difference‐based estimators for the autocovariance in nonparametric regression when the signal is discontinuous and the errors form a stationary m‐dependent process. These estimators circumvent the particularly challenging task of pre‐estimating such an unknown regression function. We provide finite‐sample expressions of their mean squared errors for piecewise constant signals and Gaussian errors. Based on this, we derive biased‐optimized estimates that do not depend on the unknown autocovariance structure. Notably, for positively correlated errors, that part of the variance of our estimators that depend on the signal is minimal as well. Further, we provide sufficient conditions for ‐consistency; this result is extended to piecewise Hölder regression with non‐Gaussian errors. We combine our biased‐optimized autocovariance estimates with a projection‐based approach and derive covariance matrix estimates, a method that is of independent interest. An R package, several simulations and an application to biophysical measurements complement this paper.     

A Short Note on the Dependence Structure of a Stochastic Process Generated by the Asymmetric Cusp Map

Intermittency maps are well-known to be capable of generating stochastic processes with slowly decaying cross covariances. The present paper considers the asymmetric cusp map and derives an asymptotic lower bound of the autocovariance function of a stochastic process generated by this map. As a consequence, such a stochastic process is shown to belong to the class of long memory processes.     

Nonnegative Definiteness of the Sample Autocovariance Function

Various textbooks on time series analysis assert that the usual version of the sample autocovariance function (1) is nonnegative definite. Two simple proofs of this result are presented.     

On Markov-switching periodic ARMA models

In this work, we propose a generalization of the classical Markov-switching ARMA models to the periodic time-varying case. Specifically, we propose a Markov-switching periodic ARMA (MS-PARMA) model. In addition of capturing regime switching often encountered during the study of many economic time series, this new model also captures the periodicity feature in the autocorrelation structure. We first provide some probabilistic properties of this class of models, namely the strict periodic stationarity and the existence of higher-order moments. We thus propose a procedure for computing the autocovariance function where we show that the autocovariances of the MS-PARMA model satisfy a system of equations similar to the PARMA Yule–Walker equations. We propose also an easily implemented algorithm which can be used to obtain parameter estimates for the MS-PARMA model. Finally, a simulation study of the performance of the proposed estimation method is provided.     

Dependence Estimation for High‐frequency Sampled Multivariate CARMA Models

The paper considers high‐frequency sampled multivariate continuous‐time autoregressive moving average (MCARMA) models and derives the asymptotic behaviour of the sample autocovariance function to a normal random matrix. Moreover, we obtain the asymptotic behaviour of the cross‐covariances between different components of the model. We will see that the limit distribution of the sample autocovariance function has a similar structure in the continuous‐time and in the discrete‐time model. As a special case, we consider a CARMA (one‐dimensional MCARMA) process. For a CARMA process, we prove Bartlett's formula for the sample autocorrelation function. Bartlett's formula has the same form in both models; only the sums in the discrete‐time model are exchanged by integrals in the continuous‐time model. Finally, we present limit results for multivariate MA processes as well, which are not known in this generality in the multivariate setting yet.     

Spectral representation and autocovariance structure of Markov switching DSGE models

Abstract

We investigate the L²-structure of Markov switching Dynamic Stochastic General Equilibrium (MS DSGE) models and derive conditions for strict and second-order stationarity. Then we determine the autocovariance function of the process driven by a stationary MS DSGE model and give a stable VARMA representation of it. It turns out that the autocovariance structure of the process coincides with that of a standard VARMA. Finally, we propose a method to derive the spectral density in a matrix closed-form of MS DSGE models. Our results relate with the works of Francq and Zakoian, Krolzig, Zhang and Stine. Numerical and empirical illustrations complete the article.     

Derivation of the theoretical autocovariance and autocorrelation function of autoregessive moving average processes

Closed form expressions for the theoretical autocovariance and autocorrelation function of mixed autoregressive moving average processes are presented. The results provide insight into the construction of autocovariances and autocorrelatians and are useful in theoretical analysis, model identification as well as in implementing maximum likelihood estimation algorithms.     

Calculating the autocovariances and the likelihood for periodic V ARMA models

This paper concerns the autocovariance calculation and likelihood evaluation for periodic vector ARMA models (PV ARMA). Based on a state space representation of PV ARMA models, we derive an algorithm for computing the PV ARMA autocovariances. The proposed method computes the autocovariances for distinct seasons separately, thereby facilitating efficient calculation for models with a large period. As a result, the obtained autocovariance calculation procedure is exploited in a periodic Chandrasekhar-type filter to evaluate the exact likelihood for Gaussian PV ARMA series. Empirical evidence shows the superiority of the periodic Chandrasekhar algorithm for likelihood evaluation over the Kalman-based one.     

Block bootstrap for periodic characteristics of periodically correlated time series

This research is dedicated to the study of periodic characteristics of periodically correlated time series such as seasonal means, seasonal variances and autocovariance functions. Two bootstrap methods are used: the extension of the usual Moving Block Bootstrap (EMBB) and the Generalised Seasonal Block Bootstrap (GSBB). The first approach is proposed, because the usual Moving Block Bootstrap does not preserve the periodic structure contained in the data and cannot be applied for the considered problems. For the aforementioned periodic characteristics the bootstrap estimators are introduced and consistency of the EMBB in all cases is obtained. Moreover, the GSBB consistency results for seasonal variances and autocovariance function are presented. Additionally, the bootstrap consistency of both considered techniques for smooth functions of the parameters of interest is obtained. Finally, the simultaneous bootstrap confidence intervals are constructed. A simulation study to compare their actual coverage probabilities is provided. A real data example is presented.     

Large deviation properties for empirical quantile-type production functions

Three examples of point processes are given where the autocovariance decays in an inverse power law, but which are not fractal.     

NONPARAMETRIC AUTOCOVARIANCE FUNCTION ESTIMATION

Nonparametric estimators of autocovariance functions for non-stationary time series are developed. The estimators are based on straightforward nonparametric mean function estimation ideas and allow use of any linear smoother (e.g. smoothing spline, local polynomial). The paper studies the properties of the estimators, and illustrates their usefulness through application to some meteorological and seismic time series.     

Spatial discrimination and classification maps

A method of constructing maps through spatial discrimination is given. The discrimination depends basically on the assumption of local spatial continuity, and a factorized covariance matrix. Given an autocovariance function, this formulation in particular, leads to a deeper insight into the pioneering work of Switzer (1980). Certain windows for the maps are examined, and choice of window size is discussed in relation to the classification error when the variables are dependent versus independent. When a training data is given, we give a method of estimating the parameters in the model. Some numerical examples are also given.     

Nonparametric Estimation of Average Growth Curve with General Nonstationary Error Process

The nonparametric estimation of the growth curve has been extensively studied in both stationary and some nonstationary particular situations. In this work, we consider the statistical problem of estimating the average growth curve for a fixed design model with nonstationary error process. The nonstationarity considered here is of a general form, and this article may be considered as an extension of previous results. The optimal bandwidth is shown to depend on the singularity of the autocovariance function of the error process along the diagonal. A Monte Carlo study is conducted in order to assess the influence of the number of subjects and the number of observations per subject on the estimation.     

An algorithm for the exact likelihood of periodic autoregressive moving average models

An algorithm to compute the autocovariance functions of periodic autoregressive moving average models is proposed. As a result, an easily implemented algorithm for the exact likelihood of these models is rendered possible.     

On the asymptotic distributions of mean,autocovariance, autocorrelation,crossgovariancb and impulse response estimators of a stationary multidimensional random field

Asymptotic properties of mean, autocovariance, autocorrelation, crosscovariance and impulse response estimators of a stationary M-dimensionai (M-D) random field are studied. It is shown that only unbiased-type estimators of autocovariances, autocorrelations, crosscovariances and impulse responses have the asymptotic distributions when M≧ 2. Moreover, the asymptotic distributions of mean, autocovariance, autocorrelation, crosscovariance and impulse response estimators are presented.     

Maximum likelihood estimation of linear continuous time long memory processes with discrete time data

Summary.  We develop a new class of time continuous autoregressive fractionally integrated moving average (CARFIMA) models which are useful for modelling regularly spaced and irregu-larly spaced discrete time long memory data. We derive the autocovariance function of a stationary CARFIMA model and study maximum likelihood estimation of a regression model with CARFIMA errors, based on discrete time data and via the innovations algorithm. It is shown that the maximum likelihood estimator is asymptotically normal, and its finite sample properties are studied through simulation. The efficacy of the approach proposed is demonstrated with a data set from an environmental study.