Goodness-of-fit tests for binomial AR(1) processes

The binomial AR(1) model describes a nonlinear process with a first-order autoregressive (AR(1)) structure and a binomial marginal distribution. To develop goodness-of-fit tests for the binomial AR(1) model, we investigate the observed marginal distribution of the binomial AR(1) process, and we tackle its autocorrelation structure. Motivated by the family of power-divergence statistics for handling discrete multivariate data, we derive the asymptotic distribution of certain categorized power-divergence statistics for the case of a binomial AR(1) process. Then we consider Bartlett's formula, which is widely used in time series analysis to provide estimates of the asymptotic covariance between sample autocorrelations, but which is not applicable when the underlying process is nonlinear. Hence, we derive a novel Bartlett-type formula for the asymptotic distribution of the sample autocorrelations of a binomial AR(1) process, which is then applied to develop tests concerning the autocorrelation structure. Simulation studies are carried out to evaluate the size and power of the proposed tests under diverse alternative process models. Several real examples are used to illustrate our methods and findings.     

Estimation du comportement asymptotique des autocovariances et autocorrelations empiriques de processus multivariéeas

Statistics based on the sample autocovariances are widely used in time-series analysis. Estimators of the asymptotic covariance between the sample autocovariances are commonly derived from the so-called Bartlett's formula. However, this formula essentially holds for linear processes. This entails that for a wide range of nonlinear time series the above-mentioned estimators are not suitable. In this paper the behaviour of an alternative estimator is studied within the framework of centered or uncentered multivariate strongly mixing processes. Applications to differential functions of sample autocovariances, such as the sample autocorrelations, are considered.     

A new discrete distribution induced by the Luria–Delbrück mutation model

In this paper, we study a limiting distribution induced by Bartlett's formulation of the Luria–Delbrück mutation model. We establish the validity of the probability generating function and devise an algorithm for computing the probability mass function. Maximum-likelihood estimation and asymptotic behaviour of the distribution are considered.     

Sample moments of the autocorrelations of moving average processes and a modification to bartlett'sasymptotic variance formula

In this paper we express the sample autocorrelations for a moving average process of order q as a function of its own theoretical autocorrelations and the sample autocorrelations for the generating white noise series. Approximate analytic expressions are then obtained forthe moments of the sample autocorrelations of the moving average process.

Using these expressions, together with numerical evidence, we show that Bartlett's asymptotic formula for the variance of the sample autocorrelations of moving average processes, which is used widely in identifying these processes, is a large overestimate when considering finitesample sizes.

Our approach is for motivational purposes and so is purely formal, the amount of mathematics presented being kept to a minimum.     

Sampled autocovariance and autocorrelation results for linear time processes

We derive an exact formula for the covariance between the sampled autocovariances at any two lags for a finite time series realisation from a general stationary autoregressive moving average process. We indicate, through one particular example, how this result can be used to deduce analogous formulae for any nonstationary model of the ARUMA class, a generalisation of the ARIMA models. Such formulae then allow us to obtain approximate expressions for the convariances between all pairs of serial correlations for finite realisations from the ARUMA model. We also note that, in the limit as the series length n → ∞, our results for the ARMA class retrieve those of Bartlett (1946). Finally, we investigate an improvement to the approximation that is obtained by applying Bartlett's general asymptotic formula to finite series realisations. That such an improvement should exist can immediately be seen by consideration of out results for the simplest case of a white noise process. However, we deduce the final improved approapproximation, for general models, in two ways - from (corrected) results due to Davies and Newbold (1980), and by an alternative approach to theirs.     

A note on non-negative continuous time processes

Summary.  Recently there has been much work on developing models that are suitable for analysing the volatility of a continuous time process. One general approach is to define a volatility process as the convolution of a kernel with a non-decreasing Lévy process, which is non-negative if the kernel is non-negative. Within the framework of time continuous autoregressive moving average (CARMA) processes, we derive a necessary and sufficient condition for the kernel to be non-negative. This condition is in terms of the Laplace transform of the CARMA kernel, which has a simple form. We discuss some useful consequences of this result and delineate the parametric region of stationarity and non-negative kernel for some lower order CARMA models.     

Maximum likelihood estimation of linear continuous time long memory processes with discrete time data

Summary.  We develop a new class of time continuous autoregressive fractionally integrated moving average (CARFIMA) models which are useful for modelling regularly spaced and irregu-larly spaced discrete time long memory data. We derive the autocovariance function of a stationary CARFIMA model and study maximum likelihood estimation of a regression model with CARFIMA errors, based on discrete time data and via the innovations algorithm. It is shown that the maximum likelihood estimator is asymptotically normal, and its finite sample properties are studied through simulation. The efficacy of the approach proposed is demonstrated with a data set from an environmental study.     

Statistical Analysis Of Mixture Vector Autoregressive Models

In this paper, we reconsider the mixture vector autoregressive model, which was proposed in the literature for modelling non‐linear time series. We complete and extend the stationarity conditions, derive a matrix formula in closed form for the autocovariance function of the process and prove a result on stable vector autoregressive moving‐average representations of mixture vector autoregressive models. For these results, we apply techniques related to a Markovian representation of vector autoregressive moving‐average processes. Furthermore, we analyse maximum likelihood estimation of model parameters by using the expectation–maximization algorithm and propose a new iterative algorithm for getting the maximum likelihood estimates. Finally, we study the model selection problem and testing procedures. Several examples, simulation experiments and an empirical application based on monthly financial returns illustrate the proposed procedures.     

A central limit theorem for the sample autocorrelations of a Lévy driven continuous time moving average process

In this article we consider Lévy driven continuous time moving average processes observed on a lattice, which are stationary time series. We show asymptotic normality of the sample mean, the sample autocovariances and the sample autocorrelations. A comparison with the classical setting of discrete moving average time series shows that in the last case a correction term should be added to the classical Bartlett formula that yields the asymptotic variance. An application to the asymptotic normality of the estimator of the Hurst exponent of fractional Lévy processes is also deduced from these results.     

Tests of serial independence based on Kendall's process

The authors propose new rank statistics for testing the white noise hypothesis in a time series. These statistics are Cramér‐von Mises and Kolmogorov‐Smirnov functionals of an empirical distribution function whose mean is related to a serial version of Kendall's tau through a linear transform. The authors determine the asymptotic behaviour of the underlying serial process and the large‐sample distribution of the proposed statistics under the null hypothesis of white noise. They also present simulation results showing the power of their tests.     

A Model Specification Test For GARCH(1,1) Processes

We provide a consistent specification test for generalized autoregressive conditional heteroscedastic (GARCH (1,1)) models based on a test statistic of Cramér‐von Mises type. Because the limit distribution of the test statistic under the null hypothesis depends on unknown quantities in a complicated manner, we propose a model‐based (semiparametric) bootstrap method to approximate critical values of the test and to verify its asymptotic validity. Finally, we illuminate the finite sample behaviour of the test by some simulations.     

Asymptotic Properties of QML Estimators for VARMA Models with Time‐dependent Coefficients

This paper is about vector autoregressive‐moving average models with time‐dependent coefficients to represent non‐stationary time series. Contrary to other papers in the univariate case, the coefficients depend on time but not on the series' length n. Under appropriate assumptions, it is shown that a Gaussian quasi‐maximum likelihood estimator is almost surely consistent and asymptotically normal. The theoretical results are illustrated by means of two examples of bivariate processes. It is shown that the assumptions underlying the theoretical results apply. In the second example, the innovations are marginally heteroscedastic with a correlation ranging from ?0.8 to 0.8. In the two examples, the asymptotic information matrix is obtained in the Gaussian case. Finally, the finite‐sample behaviour is checked via a Monte Carlo simulation study for n from 25 to 400. The results confirm the validity of the asymptotic properties even for short series and the asymptotic information matrix deduced from the theory.     

Multivariate regression models for discrete and continuous repeated measurements

A general class of multivariate regression models is considered for repeated measurements with discrete and continuous outcome variables. The proposed model is based on the seemingly unrelated regression model (Zellner, 1962) and an extension of the model of Park and Woolson(1992). The regression parameters of the model are consistently estimated using the two-stage least squares method. When the out come variables are multivariate normal, the two-stage estimator reduces to Zellner’s two-stage estimator. As a special case, we consider the marginal distribution described by Liang and Zeger (1986). Under this this distributional assumption, we show that the two-stage estimator has similar asymptotic properties and comparable small sample properties to Liang and Zeger's estimator. Since the proposed approach is based on the least squares method, however, any distributional assumption is not required for variables outcome variables. As a result, the proposed estimator is more robust to the marginal distribution of outcomes.     

Spectral analysis of Markov switching GARCH models with statistical inference

We derive matrix expressions in closed form for the autocovariance function and the spectral density of Markov switching GARCH models and their powers. For this, we apply the Riesz–Fischer theorem which defines the spectral representation as the Fourier transform of the autocovariance function. Under suitable assumptions, we prove that the sample estimator of the spectral density is consistent and asymptotically normally distributed. Further statistical implications in terms of order identification and parameter estimation are discussed. A simulation study confirms the validity of the asymptotic properties. These methods are also well suited for financial market applications, and in particular for the analysis of time series in the frequency domain, as shown in some proposed real-world examples.     

Spectral representation and autocovariance structure of Markov switching DSGE models

Abstract

We investigate the L²-structure of Markov switching Dynamic Stochastic General Equilibrium (MS DSGE) models and derive conditions for strict and second-order stationarity. Then we determine the autocovariance function of the process driven by a stationary MS DSGE model and give a stable VARMA representation of it. It turns out that the autocovariance structure of the process coincides with that of a standard VARMA. Finally, we propose a method to derive the spectral density in a matrix closed-form of MS DSGE models. Our results relate with the works of Francq and Zakoian, Krolzig, Zhang and Stine. Numerical and empirical illustrations complete the article.     

A general central limit theorem and a subsampling variance estimator for α‐mixing point processes

We establish a central limit theorem for multivariate summary statistics of nonstationary α‐mixing spatial point processes and a subsampling estimator of the covariance matrix of such statistics. The central limit theorem is crucial for establishing asymptotic properties of estimators in statistics for spatial point processes. The covariance matrix subsampling estimator is flexible and model free. It is needed, for example, to construct confidence intervals and ellipsoids based on asymptotic normality of estimators. We also provide a simulation study investigating an application of our results to estimating functions.     

An empirical saddlepoint approximation based method for smoothing survival functions under right censoring

The Kaplan–Meier (KM) estimator is ubiquitously used for estimating survival functions, but it provides only a discrete approximation at the observation times and does not deliver a proper distribution if the largest observation is censored. Using KM as a starting point, we devise an empirical saddlepoint approximation‐based method for producing a smooth survival function that is unencumbered by choice of tuning parameters. The procedure inverts the moment generating function (MGF) defined through a Riemann–Stieltjes integral with respect to an underlying mixed probability measure consisting of the discrete KM mass function weights and an absolutely continuous exponential right‐tail completion. Uniform consistency, and weak and strong convergence results are established for the resulting MGF and its derivatives, thus validating their usage as inputs into the saddlepoint routines. Relevant asymptotic results are also derived for the density and distribution function estimates. The performance of the resulting survival approximations is examined in simulation studies, which demonstrate a favourable comparison with the log spline method (Kooperberg & Stone, 1992) in small sample settings. For smoothing survival functions we argue that the methodology has no immediate competitors in its class, and we illustrate its application on several real data sets. The Canadian Journal of Statistics 47: 238–261; 2019 © 2019 Statistical Society of Canada     

Bayesian density regression for discrete outcomes

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining conditional densities from the multivariate ones. The approach to multivariate mixed scale outcome density estimation that we describe represents discrete variables, either responses or covariates, as discretised versions of continuous latent variables. We present and compare several models for obtaining these thresholds in the challenging context of count data analysis where the response may be over‐ and/or under‐dispersed in some of the regions of the covariate space. We utilise a nonparametric mixture of multivariate Gaussians to model the directly observed and the latent continuous variables. The paper presents a Markov chain Monte Carlo algorithm for posterior sampling, sufficient conditions for weak consistency, and illustrations on density, mean and quantile regression utilising simulated and real datasets.     

Continuous-Time Stochastic Processes with Cyclical Long-Range Dependence

This paper introduces continuous‐time random processes whose spectral density is unbounded at some non‐zero frequencies. The discretized versions of these processes have asymptotic properties similar to those of discrete‐time Gegenbauer processes. The paper presents some properties of the covariance function and spectral density as well as a theory of statistical estimation of the mean and covariance function of such processes. Some directions for further generalizations of the results are indicated.     

A semi‐Markov model for binary longitudinal responses subject to misclassification

The authors propose a two‐state continuous‐time semi‐Markov model for an unobservable alternating binary process. Another process is observed at discrete time points that may misclassify the true state of the process of interest. To estimate the model's parameters, the authors propose a minimum Pearson chi‐square type estimating approach based on approximated joint probabilities when the true process is in equilibrium. Three consecutive observations are required to have sufficient degrees of freedom to perform estimation. The methodology is demonstrated on parasitic infection data with exponential and gamma sojourn time distributions.