VARIATIONAL BAYESIAN ANALYSIS FOR HIDDEN MARKOV MODELS

The variational approach to Bayesian inference enables simultaneous estimation of model parameters and model complexity. An interesting feature of this approach is that it also leads to an automatic choice of model complexity. Empirical results from the analysis of hidden Markov models with Gaussian observation densities illustrate this. If the variational algorithm is initialized with a large number of hidden states, redundant states are eliminated as the method converges to a solution, thereby leading to a selection of the number of hidden states. In addition, through the use of a variational approximation, the deviance information criterion for Bayesian model selection can be extended to the hidden Markov model framework. Calculation of the deviance information criterion provides a further tool for model selection, which can be used in conjunction with the variational approach.     

多变量随机波动率模型及在中国股市的应用

文章在一维随机渡动率(SV)模型基础上,通过扩展,建立了多个多变量随机波动率(MSV)模型.首次将MSV模型大规模应用于中国沪深两市指数周收益率数据,利用MCMC方法进行模型估计,选用DIC准则进行模型比较,得出拟合程度最好的MSV模型.结果显示,加入波动率单边Granger因果关系的MSVGt-AR(1)模型对沪深两市的拟合能力最好.     

Bayes Analysis and Comparison of Accelerated Weibull and Accelerated Birnbaum–Saunders Models

Several models are proposed in the literature for modeling fatigue data resulting from materials subject to cyclic stress and strain. Accelerated Weibull and accelerated Birnbaum–Saunders distributions are most commonly used models. Whereas the accelerated Weibull model is easier compared to accelerated Birnbaum–Saunders, it fails to represent the situation equally well. The present article focuses on Bayes analysis of the two models and provides a comparison based on some important Bayesian tools. Model compatibility study using predictive simulation ideas is preceded by the said comparison. Throughout, the posterior simulations are carried out by Markov chain Monte Carlo procedure.     

BAYESIAN HIDDEN MARKOV MODELS FOR LONGITUDINAL COUNTS

This paper describes a Bayesian approach to modelling carcinogenity in animal studies where the data consist of counts of the number of tumours present over time. It compares two autoregressive hidden Markov models. One of them models the transitions between three latent states: an inactive transient state, a multiplying state for increasing counts and a reducing state for decreasing counts. The second model introduces a fourth tied state to describe non‐zero observations that are neither increasing nor decreasing. Both these models can model the length of stay upon entry of a state. A discrete constant hazards waiting time distribution is used to model the time to onset of tumour growth. Our models describe between‐animal‐variability by a single hierarchy of random effects and the within‐animal variation by first‐order serial dependence. They can be extended to higher‐order serial dependence and multi‐level hierarchies. Analysis of data from animal experiments comparing the influence of two genes leads to conclusions that differ from those of Dunson (2000). The observed data likelihood defines an information criterion to assess the predictive properties of the three‐ and four‐state models. The deviance information criterion is appropriately defined for discrete parameters.     

A Bayes comparison of Weibull extension and modified Weibull models for data showing bathtub hazard rate

A number of models have been proposed in the literature to model data reflecting bathtub-shaped hazard rate functions. Mixture distributions provide the obvious choice for modelling such data sets but these contain too many parameters and hamper the accuracy of the inferential procedures particularly when the data are meagre. Recently, a few distributions have been proposed which are simply generalizations of the two-parameter Weibull model and are capable of producing bathtub behaviour of the hazard rate function. The Weibull extension and the modified Weibull models are two such families. This study focuses on comparing these two distributions for data sets exhibiting bathtub shape of the hazard rate. Bayesian tools are preferred due to their wide range of applicability in various nested and non-nested model comparison problems. Real data illustrations are provided so that a particular model can be recommended based on various tools of model comparison discussed in the paper.     

Detection of structural breaks in a time-varying heteroskedastic regression model

A Bayesian method for estimating a time-varying regression model subject to the presence of structural breaks is proposed. Heteroskedastic dynamics, via both GARCH and stochastic volatility specifications, and an autoregressive factor, subject to breaks, are added to generalize the standard return prediction model, in order to efficiently estimate and examine the relationship and how it changes over time. A Bayesian computational method is employed to identify the locations of structural breaks, and for estimation and inference, simultaneously accounting for heteroskedasticity and autocorrelation. The proposed methods are illustrated using simulated data. Then, an empirical study of the Taiwan and Hong Kong stock markets, using oil and gas price returns as a state variable, provides strong support for oil prices being an important explanatory variable for stock returns.     

Bayesian comparative study on binary time series

In this paper, we consider the Bayesian analysis of binary time series with different priors, namely normal, Students' t, and Jeffreys prior, and compare the results with the frequentist methods through some simulation experiments and one real data on daily rainfall in inches at Mount Washington, NH. Among Bayesian methods, our results show that the Jeffreys prior perform better in most of the situations for both the simulation and the rainfall data. Furthermore, among weakly informative priors considered, Student's t prior with 7 degrees of freedom fits the data most adequately.     

A model selection criterion based on the BHHJ measure of divergence

The aim of this work is the discussion and investigation of measures of divergence and model selection criteria. A recently introduced measure of divergence, the so-called BHHJ measure (Basu, A., Harris, I.R., Hjort, N.L., Jones, M.C., 1998. Robust and efficient estimation by minimising a density power divergence. Biometrika 85, 549–559) is investigated and a new model selection criterion the divergence information criterion (DIC) based on this measure is proposed. Simulations are performed to check the appropriateness of the proposed criterion.     

A comparison of ordinal logistic regression models using Classical and Bayesian approaches in an analysis of factors associated with diabetic retinopathy

Estimating the risk factors of a disease such as diabetic retinopathy (DR) is one of the important research problems among bio-medical and statistical practitioners as well as epidemiologists. Incidentally many studies have focused in building models with binary outcomes, that may not exploit the available information. This article has investigated the importance of retaining the ordinal nature of the response variable (e.g. severity level of a disease) while determining the risk factors associated with DR. A generalized linear model approach with appropriate link functions has been studied using both Classical and Bayesian frameworks. From the result of this study, it can be observed that the ordinal logistic regression with probit link function could be more appropriate approach in determining the risk factors of DR. The study has emphasized the ways to handle the ordinal nature of the response variable with better model fit compared to other link functions.     

Assessing inter- and intra-agreement for dependent binary data: a Bayesian hierarchical correlation approach

Agreement measures are designed to assess consistency between different instruments rating measurements of interest. When the individual responses are correlated with multilevel structure of nestings and clusters, traditional approaches are not readily available to estimate the inter- and intra-agreement for such complex multilevel settings. Our research stems from conformity evaluation between optometric devices with measurements on both eyes, equality tests of agreement in high myopic status between monozygous twins and dizygous twins, and assessment of reliability for different pathologists in dysplasia. In this paper, we focus on applying a Bayesian hierarchical correlation model incorporating adjustment for explanatory variables and nesting correlation structures to assess the inter- and intra-agreement through correlations of random effects for various sources. This Bayesian generalized linear mixed-effects model (GLMM) is further compared with the approximate intra-class correlation coefficients and kappa measures by the traditional Cohen’s kappa statistic and the generalized estimating equations (GEE) approach. The results of comparison studies reveal that the Bayesian GLMM provides a reliable and stable procedure in estimating inter- and intra-agreement simultaneously after adjusting for covariates and correlation structures, in marked contrast to Cohen’s kappa and the GEE approach.