Spatio‐temporal Ornstein–Uhlenbeck Processes: Theory,Simulation and Statistical Inference

Spatio‐temporal modelling is an increasingly popular topic in Statistics. Our paper contributes to this line of research by developing the theory, simulation and inference for a spatio‐temporal Ornstein–Uhlenbeck process. We conduct detailed simulation studies and demonstrate the practical relevance of these processes in an empirical study of radiation anomaly data. Finally, we describe how predictions can be carried out in the Gaussian setting.     

Distribution of the mean reversion estimator in the Ornstein–Uhlenbeck process

ABSTRACT

We derive the exact distribution of the maximum likelihood estimator of the mean reversion parameter (κ) in the Ornstein–Uhlenbeck process using numerical integration through analytical evaluation of a joint characteristic function. Different scenarios are considered: known or unknown drift term, fixed or random start-up value, and zero or positive κ. Monte Carlo results demonstrate the remarkably reliable performance of our exact approach across all the scenarios. In comparison, misleading results may arise under the asymptotic distributions, including the advocated infill asymptotic distribution, which performs poorly in the tails when there is no intercept in the regression and the starting value of the process is nonzero.     

Tempered stable Ornstein– Uhlenbeck processes: A practical view

We study the one-dimensional Ornstein–Uhlenbeck (OU) processes with marginal law given by tempered stable and tempered infinitely divisible distributions. We investigate the transition law between consecutive observations of these processes and evaluate the characteristic function of integrated tempered OU processes with a view toward practical applications. We then analyze how to draw a random sample from this class of processes by considering both the classical inverse transform algorithm and an acceptance–rejection method based on simulating a stable random sample. Using a maximum likelihood estimation method based on the fast Fourier transform, we empirically assess the simulation algorithm performance.     

Estimation for Non-Negative Lévy-Driven CARMA Processes

Continuous-time autoregressive moving average (CARMA) processes with a nonnegative kernel and driven by a nondecreasing Lévy process constitute a useful and very general class of stationary, nonnegative continuous-time processes that have been used, in particular, for the modeling of stochastic volatility. Brockwell, Davis, and Yang (2007) derived efficient estimates of the parameters of a nonnegative Lévy-driven CAR(1) process and showed how the realization of the underlying Lévy process can be estimated from closely-spaced observations of the process itself. In this article we show how the ideas of that article can be generalized to higher order CARMA processes with nonnegative kernel, the key idea being the decomposition of the CARMA process into a sum of dependent Ornstein–Uhlenbeck processes.     

Parametric Estimation for Subordinators and Induced OU Processes

Abstract.  Consider a stationary sequence of random variables with infinitely divisible marginal law, characterized by its Lévy density. We analyse the behaviour of a so-called cumulant M-estimator, in case this Lévy density is characterized by a Euclidean (finite dimensional) parameter. Under mild conditions, we prove consistency and asymptotic normality of the estimator. The estimator is considered in the situation where the data are increments of a subordinator as well as the situation where the data consist of a discretely sampled Ornstein–Uhlenbeck (OU) process induced by the subordinator. We illustrate our results for the Gamma-process and the Inverse-Gaussian OU process. For these processes we also explain how the estimator can be computed numerically.     

Unrestricted consumption under a deterministic wealth and an Ornstein–Uhlenbeck process as a discount rate

We consider an individual or household endowed with an initial capital and an income, modeled as a linear function of time. Assuming that the discount rate evolves as an Ornstein–Uhlenbeck process, we target to find an unrestricted consumption strategy such that the value of the expected discounted consumption is maximized. Differently than in the case with restricted consumption rates, we can determine the optimal strategy and the value function.     

Estimation of the linear mixed integrated Ornstein–Uhlenbeck model

The linear mixed model with an added integrated Ornstein–Uhlenbeck (IOU) process (linear mixed IOU model) allows for serial correlation and estimation of the degree of derivative tracking. It is rarely used, partly due to the lack of available software. We implemented the linear mixed IOU model in Stata and using simulations we assessed the feasibility of fitting the model by restricted maximum likelihood when applied to balanced and unbalanced data. We compared different (1) optimization algorithms, (2) parameterizations of the IOU process, (3) data structures and (4) random-effects structures. Fitting the model was practical and feasible when applied to large and moderately sized balanced datasets (20,000 and 500 observations), and large unbalanced datasets with (non-informative) dropout and intermittent missingness. Analysis of a real dataset showed that the linear mixed IOU model was a better fit to the data than the standard linear mixed model (i.e. independent within-subject errors with constant variance).     

Estimation in Discretely Observed Diffusions Killed at a Threshold

Abstract. Parameter estimation in diffusion processes from discrete observations up to a first‐passage time is clearly of practical relevance, but does not seem to have been studied so far. In neuroscience, many models for the membrane potential evolution involve the presence of an upper threshold. Data are modelled as discretely observed diffusions which are killed when the threshold is reached. Statistical inference is often based on a misspecified likelihood ignoring the presence of the threshold causing severe bias, e.g. the bias incurred in the drift parameters of the Ornstein–Uhlenbeck model for biological relevant parameters can be up to 25–100 per cent. We compute or approximate the likelihood function of the killed process. When estimating from a single trajectory, considerable bias may still be present, and the distribution of the estimates can be heavily skewed and with a huge variance. Parametric bootstrap is effective in correcting the bias. Standard asymptotic results do not apply, but consistency and asymptotic normality may be recovered when multiple trajectories are observed, if the mean first‐passage time through the threshold is finite. Numerical examples illustrate the results and an experimental data set of intracellular recordings of the membrane potential of a motoneuron is analysed.     

Infinite Variation Tempered Stable Ornstein–Uhlenbeck Processes with Discrete Observations

We investigate transition law between consecutive observations of Ornstein–Uhlenbeck processes of infinite variation with tempered stable stationary distribution. Thanks to the Markov autoregressive structure, the transition law can be written in the exact sense as a convolution of three random components; a compound Poisson distribution and two independent tempered stable distributions, one with stability index in (0, 1) and the other with index in (1, 2). We discuss simulation techniques for those three random elements. With the exact transition law and proposed simulation techniques, sample paths simulation proves significantly more efficient, relative to the known approximative technique based on infinite shot noise series representation of tempered stable Lévy processes.     

LAN property for an ergodic Ornstein–Uhlenbeck process with Poisson jumps

In this article, we consider an ergodic Ornstein–Uhlenbeck process with jumps driven by a Brownian motion and a compensated Poisson process, whose drift and diffusion coefficients as well as its jump intensity depend on unknown parameters. Considering the process discretely observed at high frequency, we derive the local asymptotic normality property. To obtain this result, Malliavin calculus and Girsanov’s theorem are applied to write the log-likelihood ratio in terms of sums of conditional expectations, for which a central limit theorem for triangular arrays can be applied.     

Continuous processes derived from the solution of generalized Langevin equation: theoretical properties and estimation

ABSTRACT

In this paper we present a class of continuous-time processes arising from the solution of the generalized Langevin equation and show some of its properties. We define the theoretical and empirical codifference as a measure of dependence for stochastic processes. As an alternative dependence measure we also consider the spectral covariance. These dependence measures replace the autocovariance function when it is not well defined. Results for the theoretical codifference and theoretical spectral covariance functions for the mentioned process are presented. The maximum likelihood estimation procedure is proposed to estimate the parameters of the process arising from the classical Langevin equation, i.e. the Ornstein–Uhlenbeck process, and of the so-called Cosine process. We also present a simulation study for particular processes arising from this class showing the generation, and the theoretical and empirical counterpart for both codifference and spectral covariance measures.     

Inference for a change-point problem under an OU setting with unequal and unknown volatilities

An Ornstein–Uhlenbeck (OU) process is employed as a versatile model to capture the mean-reverting and stochastic evolution of many variables in various fields of applications including finance and economics. Within the OU setting, we develop a new estimation method to determine the unknown change-point location under the assumption that the volatilities before and after the change point in a time series are unequal. Our method hinges on the concept of a weighted least sum of squared errors approach and enhanced by a fusion of an iterative algorithm. The consistency of the change-point estimator is established. This article highlights a numerical implementation on simulated and observed financial market data demonstrating the significant flexibility and accuracy of our proposed modelling and estimation method. The Canadian Journal of Statistics 48: 62–78; 2020 © 2019 Statistical Society of Canada     

Semi-parametric estimation of the autoregressive parameter in non-Gaussian Ornstein–Uhlenbeck processes

ABSTRACT

This paper considers the problem of estimating the autoregressive parameter in discretely observed Ornstein–Uhlenbeck processes. Two consistent estimators are proposed: one obtained by maximizing a kernel-based likelihood function, and another by minimizing a Kolmogorov-type distance from independence. After establishing the consistency of these estimators, their finite-sample performance and possible normality in large samples, is investigated by means of extensive simulations. An illustrative example to credit rating is discussed.     

Stochastic Volatility Models Based on OU-Gamma Time Change: Theory and Estimation

We consider stochastic volatility models that are defined by an Ornstein–Uhlenbeck (OU)-Gamma time change. These models are most suitable for modeling financial time series and follow the general framework of the popular non-Gaussian OU models of Barndorff-Nielsen and Shephard. One current problem of these otherwise attractive nontrivial models is, in general, the unavailability of a tractable likelihood-based statistical analysis for the returns of financial assets, which requires the ability to sample from a nontrivial joint distribution. We show that an OU process driven by an infinite activity Gamma process, which is an OU-Gamma process, exhibits unique features, which allows one to explicitly describe and exactly sample from relevant joint distributions. This is a consequence of the OU structure and the calculus of Gamma and Dirichlet processes. We develop a particle marginal Metropolis–Hastings algorithm for this type of continuous-time stochastic volatility models and check its performance using simulated data. For illustration we finally fit the model to S&P500 index data.     

Estimation of the Hurst parameter in some fractional processes

We propose to estimate the Hurst parameter involved in fractional processes via a method based on the Karhunen–Loève expansion of a Gaussian process. We specifically investigate the cases of the fractional Brownian motion, the fractional Ornstein–Uhlenbeck family and the fractional Brownian bridge. We numerically compare our results with the ones obtained by the maximum-likelihood method, which show the validity of our proposal.     

New perspective on the benefits of the gene–environment independence in case–control studies

We study the benefit of exploiting the gene–environment independence (GEI) assumption for inferring the joint effect of genotype and environmental exposure on disease risk in a case–control study. By transforming the problem into a constrained maximum likelihood estimation problem we derive the asymptotic distribution of the maximum likelihood estimator (MLE) under the GEI assumption (MLE‐GEI) in a closed form. Our approach uncovers a transparent explanation of the efficiency gained by exploiting the GEI assumption in more general settings, thus bridging an important gap in the existing literature. Moreover, we propose an easy‐to‐implement numerical algorithm for estimating the model parameters in practice. Finally, we conduct simulation studies to compare the proposed method with the traditional prospective logistic regression method and the case‐only estimator. The Canadian Journal of Statistics 47: 473–486; 2019 © 2019 Statistical Society of Canada     

A multifactor transformed diffusion model with applications to VIX and VIX futures

Abstract

Transformed diffusions (TDs) have become increasingly popular in financial modeling for their model flexibility and tractability. While existing TD models are predominately one-factor models, empirical evidence often prefers models with multiple factors. We propose a novel distribution-driven nonlinear multifactor TD model with latent components. Our model is a transformation of a underlying multivariate Ornstein–Uhlenbeck (MVOU) process, where the transformation function is endogenously specified by a flexible parametric stationary distribution of the observed variable. Computationally efficient exact likelihood inference can be implemented for our model using a modified Kalman filter algorithm and the transformed affine structure also allows us to price derivatives in semi-closed form. We compare the proposed multifactor model with existing TD models for modeling VIX and pricing VIX futures. Our results show that the proposed model outperforms all existing TD models both in the sample and out of the sample consistently across all categories and scenarios of our comparison.     

Semiparametric Time Series Models with Log‐concave Innovations: Maximum Likelihood Estimation and its Consistency

We study semiparametric time series models with innovations following a log‐concave distribution. We propose a general maximum likelihood framework that allows us to estimate simultaneously the parameters of the model and the density of the innovations. This framework can be easily adapted to many well‐known models, including autoregressive moving average (ARMA), generalized autoregressive conditionally heteroscedastic (GARCH), and ARMA‐GARCH models. Furthermore, we show that the estimator under our new framework is consistent in both ARMA and ARMA‐GARCH settings. We demonstrate its finite sample performance via a thorough simulation study and apply it to model the daily log‐return of the FTSE 100 index.     

Parameter estimation for Ornstein–Uhlenbeck processes of the second kind driven by α-stable Lévy motions

In this article, we study the problem of parameter estimation for Ornstein–Uhlenbeck processes of the second kind driven by α-stable Lévy motions, based on continuous and discrete observations, respectively. Using the trajectory fitting method combined with the weighted least-squares technique, we discuss the consistency and the asymptotic distributions of the estimators for general weights in both the ergodic and the non ergodic cases.     

On drift parameter estimation in models with fractional Brownian motion

We consider a stochastic differential equation involving standard and fractional Brownian motion with unknown drift parameter to be estimated. We investigate the standard maximum likelihood estimate of the drift parameter, two non-standard estimates and three estimates for the sequential estimation. Model strong consistency and some other properties are proved. The linear model and Ornstein–Uhlenbeck model are studied in detail. As an auxiliary result, an asymptotic behaviour of the fractional derivative of the fractional Brownian motion is established.