A Class of Non-Gaussian State Space Models With Exact Likelihood Inference

The likelihood function of a general nonlinear, non-Gaussian state space model is a high-dimensional integral with no closed-form solution. In this article, I show how to calculate the likelihood function exactly for a large class of non-Gaussian state space models that include stochastic intensity, stochastic volatility, and stochastic duration models among others. The state variables in this class follow a nonnegative stochastic process that is popular in econometrics for modeling volatility and intensities. In addition to calculating the likelihood, I also show how to perform filtering and smoothing to estimate the latent variables in the model. The procedures in this article can be used for either Bayesian or frequentist estimation of the model’s unknown parameters as well as the latent state variables. Supplementary materials for this article are available online.     

Time series analysis of non-Gaussian observations based on state space models from both classical and Bayesian perspectives

The analysis of non-Gaussian time series by using state space models is considered from both classical and Bayesian perspectives. The treatment in both cases is based on simulation using importance sampling and antithetic variables; Markov chain Monte Carlo methods are not employed. Non-Gaussian disturbances for the state equation as well as for the observation equation are considered. Methods for estimating conditional and posterior means of functions of the state vector given the observations, and the mean-square errors of their estimates, are developed. These methods are extended to cover the estimation of conditional and posterior densities and distribution functions. The choice of importance sampling densities and antithetic variables is discussed. The techniques work well in practice and are computationally efficient. Their use is illustrated by applying them to a univariate discrete time series, a series with outliers and a volatility series.     

Identification of arma models with non-gaussian innovations

The problem of modelling time series driven by non-Gaussian innovation has been considered recently by Li and McLeod (1988). In this paper we have discussed the problem of identification of ARMA models with non-Gaussian innovations. Simulation experiments are used to study the applicability of theoretical results.     

Combining estimating functions for volatility

Accurate estimates of volatility are needed in risk management. Generalized autoregressive conditional heteroscedastic (GARCH) models and random coefficient autoregressive (RCA) models have been used for volatility modelling. Following Heyde [1997. Quasi-likelihood and its Applications. Springer, New York], volatility estimates are obtained by combining two different estimating functions. It turns out that the combined estimating function for the parameter in autoregressive processes with GARCH errors and RCA models contains maximum information. The combination of the least squares (LS) estimating function and the least absolute deviation (LAD) estimating function with application to GARCH model error identification is discussed as an application.     

The Gibbs sampler with particle efficient importance sampling for state-space models*

We consider Particle Gibbs (PG) for Bayesian analysis of non-linear non-Gaussian state-space models. As a Monte Carlo (MC) approximation of the Gibbs procedure, PG uses sequential MC (SMC) importance sampling inside the Gibbs to update the latent states. We propose to combine PG with the Particle Efficient Importance Sampling (PEIS). By using SMC sampling densities which are approximately globally fully adapted to the targeted density of the states, PEIS can substantially improve the simulation efficiency of the PG relative to existing PG implementations. The efficiency gains are illustrated in PG applications to a non-linear local-level model and stochastic volatility models.     

The Added Variable Plot for a Time Series of Counts

The issue of modelling non-Gaussian time series data is one that has been examined by several authors in recent years. Zeger (1988) introduced a parameter-driven model for a time series of counts as well as a more general observation-driven model for non-Gaussian data (Zeger & Qaqish, 1988). This paper examines the application of the added variable plot to these two models. This plot is useful for determining the strength of relationships and the detection of influential or outlying observations.     

Characteristic function estimation of non-Gaussian Ornstein–Uhlenbeck processes

Continuous non-Gaussian stationary processes of the OU-type are becoming increasingly popular given their flexibility in modelling stylized features of financial series such as asymmetry, heavy tails and jumps. The use of non-Gaussian marginal distributions makes likelihood analysis of these processes unfeasible for virtually all cases of interest. This paper exploits the self-decomposability of the marginal laws of OU processes to provide explicit expressions of the characteristic function which can be applied to several models as well as to develop efficient estimation techniques based on the empirical characteristic function. Extensions to OU-based stochastic volatility models are provided.     

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

Summary.  Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalized) linear models, (generalized) additive models, smoothing spline models, state space models, semiparametric regression, spatial and spatiotemporal models, log-Gaussian Cox processes and geostatistical and geoadditive models. We consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models , where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form owing to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, in terms of both convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo sampling is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations is computational: where Markov chain Monte Carlo algorithms need hours or days to run, our approximations provide more precise estimates in seconds or minutes. Another advantage with our approach is its generality, which makes it possible to perform Bayesian analysis in an automatic, streamlined way, and to compute model comparison criteria and various predictive measures so that models can be compared and the model under study can be challenged.     

Multiparameter evidence synthesis in epidemiology and medical decision-making: current approaches

Summary.  Alongside the development of meta-analysis as a tool for summarizing research literature, there is renewed interest in broader forms of quantitative synthesis that are aimed at combining evidence from different study designs or evidence on multiple parameters. These have been proposed under various headings: the confidence profile method, cross-design synthesis, hierarchical models and generalized evidence synthesis. Models that are used in health technology assessment are also referred to as representing a synthesis of evidence in a mathematical structure. Here we review alternative approaches to statistical evidence synthesis, and their implications for epidemiology and medical decision-making. The methods include hierarchical models, models informed by evidence on different functions of several parameters and models incorporating both of these features. The need to check for consistency of evidence when using these powerful methods is emphasized. We develop a rationale for evidence synthesis that is based on Bayesian decision modelling and expected value of information theory, which stresses not only the need for a lack of bias in estimates of treatment effects but also a lack of bias in assessments of uncertainty. The increasing reliance of governmental bodies like the UK National Institute for Clinical Excellence on complex evidence synthesis in decision modelling is discussed.     

Integrated OU Processes and Non-Gaussian OU-based Stochastic Volatility Models

Abstract. In this paper, we study the detailed distributional properties of integrated non-Gaussian Ornstein–Uhlenbeck (intOU) processes. Both exact and approximate results are given. We emphasize the study of the tail behaviour of the intOU process. Our results have many potential applications in financial economics, as OU processes are used as models of instantaneous variance in stochastic volatility (SV) models. In this case, an intOU process can be regarded as a model of integrated variance. Hence, the tail behaviour of the intOU process will determine the tail behaviour of returns generated by SV models.     

A Stochastic Simulation Approach to Model Selection for Stochastic Volatility Models

Stochastic volatility models have been widely appreciated in empirical finance such as option pricing, risk management, etc. Recent advances of Markov chain Monte Carlo (MCMC) techniques made it possible to fit all kinds of stochastic volatility models of increasing complexity within Bayesian framework. In this article, we propose a new Bayesian model selection procedure based on Bayes factor and a classical thermodynamic integration technique named path sampling to select an appropriate stochastic volatility model. The performance of the developed procedure is illustrated with an application to the daily pound/dollar exchange rates data set.     

Heterogenous market hypothesis evaluation using multipower variation volatility

High-frequency trading activities are one of the common phenomena in nowadays financial markets. Enormous amounts of high-frequency trading data are generated by huge numbers of market participants in every trading day. The availability of this information allows researchers to further examine the statistical properties of informationally efficient market hypothesis (EMH). Heterogenous market hypothesis (HMH) is one of the important extensions of EMH literature. HMH introduced nonlinear trading behaviors of heterogenous market participants instead of normality assumption under the EMH homogenous market participants. In this study, we attempt to explore more high-frequency volatility estimators in the HMH examination. These include the bipower, tripower, and quadpower variation integrated volatility estimates using Heterogenous AutoRegressive (HAR) models. The empirical findings show that these alternatives multipower variation (MPV) estimators provide better estimation and out-of-sample forecast evaluations as compared to the standard realized volatility. In other words, the usage of MPV estimators is able to better explain the HMH statistically. At last, a market risk determination is illustrated using value-at-risk approach.     

Monte Carlo Likelihood Estimation for Three Multivariate Stochastic Volatility Models

Estimating parameters in a stochastic volatility (SV) model is a challenging task. Among other estimation methods and approaches, efficient simulation methods based on importance sampling have been developed for the Monte Carlo maximum likelihood estimation of univariate SV models. This paper shows that importance sampling methods can be used in a general multivariate SV setting. The sampling methods are computationally efficient. To illustrate the versatility of this approach, three different multivariate stochastic volatility models are estimated for a standard data set. The empirical results are compared to those from earlier studies in the literature. Monte Carlo simulation experiments, based on parameter estimates from the standard data set, are used to show the effectiveness of the importance sampling methods.     

Monte Carlo Likelihood Estimation for Three Multivariate Stochastic Volatility Models

Estimating parameters in a stochastic volatility (SV) model is a challenging task. Among other estimation methods and approaches, efficient simulation methods based on importance sampling have been developed for the Monte Carlo maximum likelihood estimation of univariate SV models. This paper shows that importance sampling methods can be used in a general multivariate SV setting. The sampling methods are computationally efficient. To illustrate the versatility of this approach, three different multivariate stochastic volatility models are estimated for a standard data set. The empirical results are compared to those from earlier studies in the literature. Monte Carlo simulation experiments, based on parameter estimates from the standard data set, are used to show the effectiveness of the importance sampling methods.     

On conditional risk estimation considering model risk

Usually, parametric procedures used for conditional variance modelling are associated with model risk. Model risk may affect the volatility and conditional value at risk estimation process either due to estimation or misspecification risks. Hence, non-parametric artificial intelligence models can be considered as alternative models given that they do not rely on an explicit form of the volatility. In this paper, we consider the least-squares support vector regression (LS-SVR), weighted LS-SVR and Fixed size LS-SVR models in order to handle the problem of conditional risk estimation taking into account issues of model risk. A simulation study and a real application show the performance of proposed volatility and VaR models.     

A Note on Whittle's Likelihood

The approximate likelihood function introduced by Whittle has been used to estimate the spectral density and certain parameters of a variety of time series models. In this note we attempt to empirically quantify the loss of efficiency of Whittle's method in nonstandard settings. A recently developed representation of some first-order non-Gaussian stationary autoregressive process allows a direct comparison of the true likelihood function with that of Whittle. The conclusion is that Whittle's likelihood can produce unreliable estimates in the non-Gaussian case, even for moderate sample sizes. Moreover, for small samples, and if the autocorrelation of the process is high, Whittle's approximation is not efficient even in the Gaussian case. While these facts are known to some extent, the present study sheds more light on the degree of efficiency loss incurred by using Whittle's likelihood, in both Gaussian and non-Gaussian cases.     

Affine LIBOR models driven by real-valued affine processes

The class of affine LIBOR models is appealing since it satisfies three central requirements of interest rate modeling. It is arbitrage-free, interest rates are nonnegative, and caplet and swaption prices can be calculated analytically. In order to guarantee nonnegative interest rates affine LIBOR models are driven by nonnegative affine processes, a restriction that makes it hard to produce volatility smiles. We modify the affine LIBOR models in such a way that real-valued affine processes can be used without destroying the nonnegativity of interest rates. Numerical examples show that in this class of models, pronounced volatility smiles are possible.     

Generalized EGARCH Random Effect Models Application to Financial Time Series

In this article, we propose a simple alternative model to analyze the volatility of the financial time series. In the applications, the performance of this model is compared with the performance of the GARCH type models. Using GARCH, EGARCH, and the proposed models, we analyze the time series of the Bovespa and Dow Jones Industrial Average indexes. In the applications we can see that the proposed models have good performance compared with the usual GARCH type model.     

贝叶斯非线性混合效应模型及其应用研究

由于常用的线性混合效应模型对具有非线性关系的纵向数据建模具有一定的局限性,因此对线性混合效应模型进行扩展,根据变量间的非线性关系建立不同的非线性混合效应模型,并根据因变量的分布特征建立混合分布模型。基于一组实际的保险损失数据,建立多项式混合效应模型、截断多项式混合效应模型和B样条混合效应模型。研究结果表明,非线性混合效应模型能够显著改进对保险损失数据的建模效果,对非寿险费率厘定具有重要参考价值。     

Nonlinear recursive estimation of volatility via estimating functions

For certain volatility models, the conditional moments that depend on the parameter are of interest. Following Godambe and Heyde (1987), the combined estimating function method has been used to study inference when the conditional mean and conditional variance are functions of the parameter of interest (See Ghahramani and Thavaneswaran [Combining Estimating Functions for Volatility. Journal of Statistical Planning and Inference, 2009, 139, 1449-1461] for details). However, for application purposes, the resulting estimates are nonlinear functions of the observations and no closed form expressions of the estimates are available. As an alternative, in this paper, a recursive estimation approach based on the combined estimating function is proposed and applied to various classes of time series models, including certain volatility models.