Geometric stick-breaking processes for continuous-time Bayesian nonparametric modeling

We propose a new class of time dependent random probability measures and show how this can be used for Bayesian nonparametric inference in continuous time. By means of a nonparametric hierarchical model we define a random process with geometric stick-breaking representation and dependence structure induced via a one dimensional diffusion process of Wright-Fisher type. The sequence is shown to be a strongly stationary measure-valued process with continuous sample paths which, despite the simplicity of the weights structure, can be used for inferential purposes on the trajectory of a discretely observed continuous-time phenomenon. A simple estimation procedure is presented and illustrated with simulated and real financial data.     

Two population classification in Gaussian process

The problem is to classify an individual into one of two populations based on an observation on the individual which follows a stationary Gaussian process and the populations are two distinct time points. Plug-in likelihood ratio rules are considered using samples from the process. The distribution of associated classification statistics are derived. For the special case when the mis-classification probabilities are equal, the nature of dependence between the population distributions on the probability of correct classification is studied. Lower bounds and iterative method of evaluation of the optimal correlation between the populations are obtained.     

A statistical uncertainty principle for estimating the time of a discrete shift in the mean of a continuous time random process

The purpose of this article is to present a statistical uncertainty principle that can be used when localizing a single change in the mean of a band-limited stationary random process. The statistical model investigated is a continuous time process that experiences a shift in its mean. This continuous time process is presumed to be sampled using an ideal low-pass filter. The least squares estimate of the location of the change in mean is asymptotically Gaussian. The standard deviation of the least squares estimate of the location of the change-point provides a physical limit to the accuracy of the estimate of the time of the mean shift which cannot be bettered.     

Statistical hypothesis testing for the shape of impulse response function

The problem of estimation of unknown response function of a time-invariant continuous linear system is considered. Integral sample input–output cross-correlogram is taken as an estimator of the response function. The inputs are supposed to be zero-mean stationary Gaussian process. A criterion on the shape of impulse response function is given. For this purpose, we apply a theory of square–Gaussian random processes and estimate the probability that supremum of square–Gaussian process exceeds the level specified by some function.     

Gaussian pseudo-likelihood estimation for stationary processes on a lattice

For a wide class of second-order stationary spatial processes on a lattice, the statistical properties of the maximum Gaussian pseudo-likelihood estimators are studied. The estimators are natural as they imitate the theoretical prototypes of spatial best linear prediction. Under certain conditions, their asymptotic normality is established with the elements of the asymptotic variance matrix being simple functions of the variable auto-covariances. A short simulation study and a data example favor the use of the Gaussian pseudo-likelihood when the spatial covariance dependence is to be estimated.     

Poisson-Driven Stationary Markov Models

ABSTRACT

We propose a simple yet powerful method to construct strictly stationary Markovian models with given but arbitrary invariant distributions. The idea is based on a Poisson-type transform modulating the dependence structure in the model. An appealing feature of our approach is the possibility to control the underlying transition probabilities and, therefore, incorporate them within standard estimation methods. Given the resulting representation of the transition density, a Gibbs sampler algorithm based on the slice method is proposed and implemented. In the discrete-time case, special attention is placed to the class of generalized inverse Gaussian distributions. In the continuous case, we first provide a brief treatment of the class of gamma distributions, and then extend it to cover other invariant distributions, such as the generalized extreme value class. The proposed approach and estimation algorithm are illustrated with real financial datasets. Supplementary materials for this article are available online.     

Extremes Values of Discrete and Continuous Time Strongly Dependent Gaussian Processes

The joint limit distribution of the maximum of a continuous, strongly dependent stationary Gaussian process and the maximum of this process sampled at discrete time points is studied. It is shown that these two extreme values are asymptotically totally dependent if the grid of the discrete time points is sufficiently dense, and asymptotically dependent if the the grid points are sparse or Pickands grids. Our results are motivated by the deep contributions Piterbarg (2004 Piterbarg , V. I. ( 2004 ). Discrete and continuous time extremes of Gaussian processes . Extremes 7 : 161 – 177 .[Crossref] , [Google Scholar]) and Hüsler (2004 Hüsler , J. ( 2004 ). Dependence between extreme values of discrete and continuous time locally stationary Gaussian processes . Extremes 7 : 179 – 190 .[Crossref] , [Google Scholar]).     

Estimating and Testing Nonlinear Local Dependence Between Two Time Series

ABSTRACT

The most common measure of dependence between two time series is the cross-correlation function. This measure gives a complete characterization of dependence for two linear and jointly Gaussian time series, but it often fails for nonlinear and non-Gaussian time series models, such as the ARCH-type models used in finance. The cross-correlation function is a global measure of dependence. In this article, we apply to bivariate time series the nonlinear local measure of dependence called local Gaussian correlation. It generally works well also for nonlinear models, and it can distinguish between positive and negative local dependence. We construct confidence intervals for the local Gaussian correlation and develop a test based on this measure of dependence. Asymptotic properties are derived for the parameter estimates, for the test functional and for a block bootstrap procedure. For both simulated and financial index data, we construct confidence intervals and we compare the proposed test with one based on the ordinary correlation and with one based on the Brownian distance correlation. Financial indexes are examined over a long time period and their local joint behavior, including tail behavior, is analyzed prior to, during and after the financial crisis. Supplementary material for this article is available online.     

HAC Corrections for Strongly Autocorrelated Time Series

Applied work routinely relies on heteroscedasticity and autocorrelation consistent (HAC) standard errors when conducting inference in a time series setting. As is well known, however, these corrections perform poorly in small samples under pronounced autocorrelations. In this article, I first provide a review of popular methods to clarify the reasons for this failure. I then derive inference that remains valid under a specific form of strong dependence. In particular, I assume that the long-run properties can be approximated by a stationary Gaussian AR(1) model, with coefficient arbitrarily close to one. In this setting, I derive tests that come close to maximizing a weighted average power criterion. Small sample simulations show these tests to perform well, also in a regression context.     

Shrinkage Estimation of the Memory Parameter in Stationary Gaussian Processes

The correct and efficient estimation of memory parameters in a stationary Gaussian processes is an important issue, since otherwise, forecasts based on the resulting time series would be misleading. On the other hand, if the memory parameters are suspected to fall in a smaller subspace through some hypothesis restrictions, it becomes a hard decision whether to use estimators based on the restricted spaces or to use unrestricted estimators over the full parameter space. In this article, we propose James-Stein-type estimators of the memory parameters of a stationary Gaussian times series process, which can efficiently incorporate the hypothetical restrictions. We show theoretically that the proposed estimators are more efficient than the usual unrestricted maximum likelihood estimators over the entire parameter space.     

Statistical properties of detrended fluctuation analysis

The main goal of this work is to consider the detrended fluctuation analysis (DFA), proposed by Peng et al. [Mosaic organization of DNA nucleotides, Phys. Rev. E. 49(5) (1994), 1685–1689]. This is a well-known method for analysing the long-range dependence in non-stationary time series. Here we describe the DFA method and we prove its consistency and its exact distribution, based on the usual i.i.d. assumption, as an estimator for the fractional parameter d. In the literature it is well established that the nucleotide sequences present long-range dependence property. In this work, we analyse the long dependence property in view of the autoregressive moving average fractionally integrated ARFIMA(p, d, q) processes through the analysis of four nucleotide sequences. For estimating the fractional parameter d we consider the semiparametric regression method based on the periodogram function, in both classical and robust versions; the semiparametric R/S(n) method, proposed by Hurst [Long term storage in reservoirs, Trans. Am. Soc. Civil Eng. 116 (1986), 770–779] and the maximum likelihood method (see [R. Fox and M.S. Taqqu, Large-sample properties of parameter estimates for strongly dependent stationary Gaussian time series, Ann. Statist. 14 (1986), 517–532]), by considering the approximation suggested by Whittle [Hypothesis Testing in Time Series Analysis (1953), Hafner, New York].     

Equivalence of Gaussian measures for some nonstationary random fields

Gaussian random fields whose covariance structures are described by a power law model provide a simple and flexible class of models for isotropic random fields. This class includes fractional Brownian fields as a special case. Because these random fields are nonstationary, the extensive results available on equivalence of Gaussian measures for stationary models do not apply to them. This work shows that results on equivalence for two stationary Gaussian random field models extend in a natural way to the equivalence of a stationary model and a power law model. This result is used to show that if we use a power law model for predicting a random field at unobserved locations when in fact the random field is stationary, we can obtain asymptotically optimal predictions as long as the high frequency behavior of the true spectral density is sufficiently close to the high frequency behavior of the spectral density of the power law model.     

An approximate fractional Gaussian noise model with $$\mathcal {O}(n)$$ O ( n ) computational cost

Statistics and Computing - Fractional Gaussian noise (fGn) is a stationary time series model with long-memory properties applied in various fields like econometrics, hydrology and climatology. The...     

Edgeworth Expansion for Linear Regression Processes with Long-Memory Errors

This article provides an Edgeworth expansion for the distribution of the log-likelihood derivative LLD of the parameter of a time series generated by a linear regression model with Gaussian, stationary, and long-memory errors. Under some sets of conditions on the regression coefficients, the spectral density function, and the parameter values, an Edgeworth expansion of the density as well as the distribution function of a vector of centered and normalized derivatives of the plug-in log-likelihood PLL function of arbitrarily large order is established. This is done by extending the results of Lieberman et al. (2003 Lieberman , O. , Rousseau , J. , Zucker , D. M. ( 2003 ). Valid edgeworth expansions for the maximum likelihood estimator of the parameter of a stationary. gaussian, strongly dependent processes. it Ann. Statist. 31:586–612 . [Google Scholar]), who provided an Edgeworth expansion for the Gaussian stationary long-memory case, to our present model, which is a linear regression process with stationary Gaussian long-memory errors.     

Autoregressiv model identification for multivariate time series

A procedure is developed for the identification of autoregressive models for stationary invertible multivariate Gaussian time series. Model selection is based on either the AIC information criterion or on a statistic called CVR, cross-validatory residual sum of squares. An example is given to show that the forecasts generated by these models compare favorably with those generated by other common time series modeling techniques.     

Correlation in a Bayesian framework

The authors consider the correlation between two arbitrary functions of the data and a parameter when the parameter is regarded as a random variable with given prior distribution. They show how to compute such a correlation and use closed form expressions to assess the dependence between parameters and various classical or robust estimators thereof, as well as between p‐values and posterior probabilities of the null hypothesis in the one‐sided testing problem. Other applications involve the Dirichlet process and stationary Gaussian processes. Using this approach, the authors also derive a general nonparametric upper bound on Bayes risks.     

Weak convergence of functionals of stationary long memory processes to Rosenblatt-type distributions

We provide an asymptotic result for the distribution of functionals of continuous Gaussian processes with long memory. Much of the existing literature on the subject resorts to asymptotic representations based on stochastic integrals. However, the method of proof used here, based on characteristic functions, enables one to extend the class of functionals for which we are able to provide an asymptotic representation. Next, we study the properties of the asymptotic process and finally, as an application, we consider the case of continuous regression where the process of errors follows a Gamma process with long-range dependence.     

A Non‐Parametric Estimator of the Spectral Density of a Continuous‐Time Gaussian Process Observed at Random Times

Abstract. In numerous applications data are observed at random times and an estimated graph of the spectral density may be relevant for characterizing and explaining phenomena. By using a wavelet analysis, one derives a non‐parametric estimator of the spectral density of a Gaussian process with stationary increments (or a stationary Gaussian process) from the observation of one path at random discrete times. For every positive frequency, this estimator is proved to satisfy a central limit theorem with a convergence rate depending on the roughness of the process and the moment of random durations between successive observations. In the case of stationary Gaussian processes, one can compare this estimator with estimators based on the empirical periodogram. Both estimators reach the same optimal rate of convergence, but the estimator based on wavelet analysis converges for a different class of random times. Simulation examples and an application to biological data are also provided.     

Non‐Gaussian geostatistical modeling using (skew) t processes

We propose a new model for regression and dependence analysis when addressing spatial data with possibly heavy tails and an asymmetric marginal distribution. We first propose a stationary process with t marginals obtained through scale mixing of a Gaussian process with an inverse square root process with Gamma marginals. We then generalize this construction by considering a skew‐Gaussian process, thus obtaining a process with skew‐t marginal distributions. For the proposed (skew) t process, we study the second‐order and geometrical properties and in the t case, we provide analytic expressions for the bivariate distribution. In an extensive simulation study, we investigate the use of the weighted pairwise likelihood as a method of estimation for the t process. Moreover we compare the performance of the optimal linear predictor of the t process versus the optimal Gaussian predictor. Finally, the effectiveness of our methodology is illustrated by analyzing a georeferenced dataset on maximum temperatures in Australia.     

Almost sure limit theorem for stationary Gaussian random fields

We obtain an almost sure version of a maximum limit theorem for stationary Gaussian random fields under some covariance conditions. As a by-product, we also obtain a weak convergence of the stationary Gaussian random field maximum, which is interesting independently.