Continuous processes derived from the solution of generalized Langevin equation: theoretical properties and estimation

ABSTRACT

In this paper we present a class of continuous-time processes arising from the solution of the generalized Langevin equation and show some of its properties. We define the theoretical and empirical codifference as a measure of dependence for stochastic processes. As an alternative dependence measure we also consider the spectral covariance. These dependence measures replace the autocovariance function when it is not well defined. Results for the theoretical codifference and theoretical spectral covariance functions for the mentioned process are presented. The maximum likelihood estimation procedure is proposed to estimate the parameters of the process arising from the classical Langevin equation, i.e. the Ornstein–Uhlenbeck process, and of the so-called Cosine process. We also present a simulation study for particular processes arising from this class showing the generation, and the theoretical and empirical counterpart for both codifference and spectral covariance measures.     

Characterization of discrete scale invariant Markov sequences

ABSTRACT

Some special sampling of discrete scale invariant (DSI) processes are presented to provide a multi-dimensional self-similar process in correspondence. By imposing Markov property we show that the covariance functions of such Markov DSI sequences are characterized by variance, and covariance of adjacent samples in the first scale interval. We also provide a theoretical method for estimating spectral density matrix of corresponding multi-dimensional self-similar Markov process. Some examples such as simple Brownian motion (sBm) with drift and scale invariant autoregressive model are presented and these properties are investigated. We present two new method to estimate Hurst parameter of DSI processes and apply them to some sBm and also to the SP500 indices for some period which has DSI property. We compare our estimates with the maximum-likelihood and rescaled range (R/S) method which are applied to the corresponding multi-dimensional self-similar processes.     

Non‐stationary Cross‐Covariance Models for Multivariate Processes on a Globe

Abstract. In geophysical and environmental problems, it is common to have multiple variables of interest measured at the same location and time. These multiple variables typically have dependence over space (and/or time). As a consequence, there is a growing interest in developing models for multivariate spatial processes, in particular, the cross‐covariance models. On the other hand, many data sets these days cover a large portion of the Earth such as satellite data, which require valid covariance models on a globe. We present a class of parametric covariance models for multivariate processes on a globe. The covariance models are flexible in capturing non‐stationarity in the data yet computationally feasible and require moderate numbers of parameters. We apply our covariance model to surface temperature and precipitation data from an NCAR climate model output. We compare our model to the multivariate version of the Matérn cross‐covariance function and models based on coregionalization and demonstrate the superior performance of our model in terms of AIC (and/or maximum loglikelihood values) and predictive skill. We also present some challenges in modelling the cross‐covariance structure of the temperature and precipitation data. Based on the fitted results using full data, we give the estimated cross‐correlation structure between the two variables.     

MOMENT ESTIMATION IN THE CLASS OF BISEXUAL BRANCHING PROCESSES WITH POPULATION–SIZE DEPENDENT MATING

This paper concerns the estimation of the offspring mean vector, the covariance matrix and the growth rate in the class of bisexual branching processes with population‐size dependent mating. For the proposed estimators, some unconditional moments and some conditioned to non‐extinction are determined and asymptotic properties are established. Confidence intervals are obtained and, as illustration, a simulation example is given.     

SPECTRAL REPRESENTATION AND ERGODICITY OF ASYMPTOTICALLY STATIONARY PROCESSES

A second order process with mean zero and covariance is asymptotically stationary if lim ds exists for every; this limit then defines the covariance function of the process. The paper establishes the spectral representation for the covariance function and a mean ergodic theorem for the process. When stationarity is assumed, the results reduce to the well-known corresponding theorems for stationary processes.     

Approximate reference priors for Gaussian random fields

Reference priors are theoretically attractive for the analysis of geostatistical data since they enable automatic Bayesian analysis and have desirable Bayesian and frequentist properties. But their use is hindered by computational hurdles that make their application in practice challenging. In this work, we derive a new class of default priors that approximate reference priors for the parameters of some Gaussian random fields. It is based on an approximation to the integrated likelihood of the covariance parameters derived from the spectral approximation of stationary random fields. This prior depends on the structure of the mean function and the spectral density of the model evaluated at a set of spectral points associated with an auxiliary regular grid. In addition to preserving the desirable Bayesian and frequentist properties, these approximate reference priors are more stable, and their computations are much less onerous than those of exact reference priors. Unlike exact reference priors, the marginal approximate reference prior of correlation parameter is always proper, regardless of the mean function or the smoothness of the correlation function. This property has important consequences for covariance model selection. An illustration comparing default Bayesian analyses is provided with a dataset of lead pollution in Galicia, Spain.     

On the estimation of the spectral density for continuous spatial processes

In this work, we study the asymptotic properties of smoothed nonparametric kernel spectral density estimators for the spatial spectral density. We consider the case of continuous stationary spatial processes under a shrinking asymptotic framework. Expressions for the bias and the covariance structure are obtained and the implications for the edge effect bias of the choice of the kernel, bandwidth and spacing parameter in the design are also discussed, both for tapered and untapered estimates. Results are illustrated with a simulation study.     

Testing Semiparametric Hypotheses in Locally Stationary Processes

In this paper, we investigate the problem of testing semiparametric hypotheses in locally stationary processes. The proposed method is based on an empirical version of the L₂‐distance between the true time varying spectral density and its best approximation under the null hypothesis. As this approach only requires estimation of integrals of the time varying spectral density and its square, we do not have to choose a smoothing bandwidth for the local estimation of the spectral density – in contrast to most other procedures discussed in the literature. Asymptotic normality of the test statistic is derived both under the null hypothesis and the alternative. We also propose a bootstrap procedure to obtain critical values in the case of small sample sizes. Additionally, we investigate the finite sample properties of the new method and compare it with the currently available procedures by means of a simulation study. Finally, we illustrate the performance of the new test in two data examples, one regarding log returns of the S&P 500 and the other a well‐known series of weekly egg prices.     

Optimal estimation in functional linear regression for sparse noise‐contaminated data

In this article, we propose a novel approach to fit a functional linear regression in which both the response and the predictor are functions. We consider the case where the response and the predictor processes are both sparsely sampled at random time points and are contaminated with random errors. In addition, the random times are allowed to be different for the measurements of the predictor and the response functions. The aforementioned situation often occurs in longitudinal data settings. To estimate the covariance and the cross‐covariance functions, we use a regularization method over a reproducing kernel Hilbert space. The estimate of the cross‐covariance function is used to obtain estimates of the regression coefficient function and of the functional singular components. We derive the convergence rates of the proposed cross‐covariance, the regression coefficient, and the singular component function estimators. Furthermore, we show that, under some regularity conditions, the estimator of the coefficient function has a minimax optimal rate. We conduct a simulation study and demonstrate merits of the proposed method by comparing it to some other existing methods in the literature. We illustrate the method by an example of an application to a real‐world air quality dataset. The Canadian Journal of Statistics 47: 524–559; 2019 © 2019 Statistical Society of Canada     

A class of correlated weighted Poisson processes

In this paper, we propose new classes of correlated Poisson processes and correlated weighted Poisson processes on the interval [0,1], which generalize the class of weighted Poisson processes defined by Balakrishnan and Kozubowski (2008), by incorporating a dependence structure between the standard uniform variables used in the construction. In this manner, we obtain another process that we refer to as correlated weighted Poisson process. Various properties of this process such as marginal and joint distributions, stationarity of the increments, moments, and the covariance function, are studied. The results are then illustrated through some examples, which include processes with length-biased Poisson, exponentially weighted Poisson, negative binomial, and COM-Poisson distributions.     

Spectral analysis of Markov switching GARCH models with statistical inference

We derive matrix expressions in closed form for the autocovariance function and the spectral density of Markov switching GARCH models and their powers. For this, we apply the Riesz–Fischer theorem which defines the spectral representation as the Fourier transform of the autocovariance function. Under suitable assumptions, we prove that the sample estimator of the spectral density is consistent and asymptotically normally distributed. Further statistical implications in terms of order identification and parameter estimation are discussed. A simulation study confirms the validity of the asymptotic properties. These methods are also well suited for financial market applications, and in particular for the analysis of time series in the frequency domain, as shown in some proposed real-world examples.     

A generalization of a Gaussian semiparametric estimator on multivariate long-range dependent processes

In this paper, we propose and study a general class of Gaussian semiparametric estimators (GSE) of the fractional differencing parameter in the context of long-range dependent multivariate time series. We establish large sample properties of the estimator without assuming Gaussianity. The class of models considered here satisfies simple conditions on the spectral density function, restricted to a small neighbourhood of the zero frequency and includes important class of vector autoregressive fractionally integrated moving average processes. We also present a simulation study to assess the finite sample properties of the proposed estimator based on a smoothed version of the GSE which supports its competitiveness.     

Estimation of the Spectral Density with Assigned Risk

It is well known that adaptive sequential nonparametric estimation of differentiable functions with assigned mean integrated squared error and minimax expected stopping time is impossible. In other words, no sequential estimator can compete with an oracle estimator that knows how many derivatives an estimated curve has. Differentiable functions are typical in probability density and regression models but not in spectral density models, where considered functions are typically smoother. This paper shows that for a large class of spectral densities, which includes spectral densities of classical autoregressive moving average processes, an adaptive minimax sequential estimation with assigned mean integrated squared error is possible. Furthermore, a two‐stage sequential procedure is proposed, which is minimax and adaptive to smoothness of an underlying spectral density.     

Statistical methods for regular monitoring data

Summary.  Meteorological and environmental data that are collected at regular time intervals on a fixed monitoring network can be usefully studied combining ideas from multiple time series and spatial statistics, particularly when there are little or no missing data. This work investigates methods for modelling such data and ways of approximating the associated likelihood functions. Models for processes on the sphere crossed with time are emphasized, especially models that are not fully symmetric in space–time. Two approaches to obtaining such models are described. The first is to consider a rotated version of fully symmetric models for which we have explicit expressions for the covariance function. The second is based on a representation of space–time covariance functions that is spectral in just the time domain and is shown to lead to natural partially nonparametric asymmetric models on the sphere crossed with time. Various models are applied to a data set of daily winds at 11 sites in Ireland over 18 years. Spectral and space–time domain diagnostic procedures are used to assess the quality of the fits. The spectral-in-time modelling approach is shown to yield a good fit to many properties of the data and can be applied in a routine fashion relative to finding elaborate parametric models that describe the space–time dependences of the data about as well.     

Frequency domain bootstrap for ratio statistics under long-range dependence

A frequency domain bootstrap (FDB) is a common technique to apply Efron’s independent and identically distributed resampling technique (Efron, 1979) to periodogram ordinates – especially normalized periodogram ordinates – by using spectral density estimates. The FDB method is applicable to several classes of statistics, such as estimators of the normalized spectral mean, the autocorrelation (but not autocovariance), the normalized spectral density function, and Whittle parameters. While this FDB method has been extensively studied with respect to short-range dependent time processes, there is a dearth of research on its use with long-range dependent time processes. Therefore, we propose an FDB methodology for ratio statistics under long-range dependence, using semi- and nonparametric spectral density estimates as a normalizing factor. It is shown that the FDB approximation allows for valid distribution estimation for a broad class of stationary, long-range (or short-range) dependent linear processes, without any stringent assumptions on the distribution of the underlying process. The results of a large simulation study show that the FDB approximation using a semi- or nonparametric spectral density estimator is often robust for various values of a long-memory parameter reflecting magnitude of dependence. We apply the proposed procedure to two data examples.     

An additive–multiplicative mean model for panel count data with dependent observation and dropout processes

This paper discusses regression analysis of panel count data with dependent observation and dropout processes. For the problem, a general mean model is presented that can allow both additive and multiplicative effects of covariates on the underlying point process. In addition, the proportional rates model and the accelerated failure time model are employed to describe possible covariate effects on the observation process and the dropout or follow‐up process, respectively. For estimation of regression parameters, some estimating equation‐based procedures are developed and the asymptotic properties of the proposed estimators are established. In addition, a resampling approach is proposed for estimating a covariance matrix of the proposed estimator and a model checking procedure is also provided. Results from an extensive simulation study indicate that the proposed methodology works well for practical situations, and it is applied to a motivating set of real data.     

Models for Extremal Dependence Derived from Skew‐symmetric Families

Skew‐symmetric families of distributions such as the skew‐normal and skew‐t represent supersets of the normal and t distributions, and they exhibit richer classes of extremal behaviour. By defining a non‐stationary skew‐normal process, which allows the easy handling of positive definite, non‐stationary covariance functions, we derive a new family of max‐stable processes – the extremal skew‐t process. This process is a superset of non‐stationary processes that include the stationary extremal‐t processes. We provide the spectral representation and the resulting angular densities of the extremal skew‐t process and illustrate its practical implementation.     

Bayesian spatio‐temporal models based on discrete convolutions

Abstract: The authors consider a class of models for spatio‐temporal processes based on convolving independent processes with a discrete kernel that is represented by a lower triangular matrix. They study two families of models. In the first one, spatial Gaussian processes with isotropic correlations are convoluted with a kernel that provides temporal dependencies. In the second family, AR(p) processes are convoluted with a kernel providing spatial interactions. The covariance structures associated with these two families are quite rich. Their covariance functions that are stationary and separable in space and time as well as time dependent nonseparable and nonisotropic ones.     

A Note on a Specification Test for Time Series Models Based on Spectral Density Estimation

In a recent paper, Paparoditis [Scand. J. Statist. 27 (2000) 143] proposed a new goodness‐of‐fit test for time series models based on spectral density estimation. The test statistic is based on the distance between a kernel estimator of the ratio of the true and the hypothesized spectral density and the expected value of the estimator under the null and provides a quantification of how well the parametric density fits the sample spectral density. In this paper, we give a detailed asymptotic analysis of the corresponding procedure under fixed alternatives.     

Memory properties and aggregation of spatial autoregressive models

A random field displays long (resp. short) memory when its covariance function is absolutely non-summable (resp. summable), or alternatively when its spectral density (spectrum) is unbounded (resp. bounded) at some frequencies. Drawing on the spectrum approach, this paper characterizes both short and long memory features in the spatial autoregressive model. The data generating process is presented as a sequence of spatial autoregressive micro-relationships. The study elaborates the exact conditions under which short and long memories emerge for micro-relationships and for the aggregated field as well. To study the spectrum of the aggregated field, we develop a new general concept referred to as the ‘root order of a function’. This concept might be usefully applied in studying the convergence of some special integrals. We illustrate our findings with simulation experiments and an empirical application based on Gross Domestic Product data for 100 countries spanning over 1960–2004.