Bayesian methods for dealing with missing data problems

Missing data, a common but challenging issue in most studies, may lead to biased and inefficient inferences if handled inappropriately. As a natural and powerful way for dealing with missing data, Bayesian approach has received much attention in the literature. This paper reviews the recent developments and applications of Bayesian methods for dealing with ignorable and non-ignorable missing data. We firstly introduce missing data mechanisms and Bayesian framework for dealing with missing data, and then introduce missing data models under ignorable and non-ignorable missing data circumstances based on the literature. After that, important issues of Bayesian inference, including prior construction, posterior computation, model comparison and sensitivity analysis, are discussed. Finally, several future issues that deserve further research are summarized and concluded.     

Implicit Estimation for the Stochastic Volatility Model

Efficient, accurate, and fast Markov Chain Monte Carlo estimation methods based on the Implicit approach are proposed. In this article, we introduced the notion of Implicit method for the estimation of parameters in Stochastic Volatility models.

Implicit estimation offers a substantial computational advantage for learning from observations without prior knowledge and thus provides a good alternative to classical inference in Bayesian method when priors are missing.

Both Implicit and Bayesian approach are illustrated using simulated data and are applied to analyze daily stock returns data on CAC40 index.     

Sparse Markov Chains for Sequence Data

Finite memory sources and variable‐length Markov chains have recently gained popularity in data compression and mining, in particular, for applications in bioinformatics and language modelling. Here, we consider denser data compression and prediction with a family of sparse Bayesian predictive models for Markov chains in finite state spaces. Our approach lumps transition probabilities into classes composed of invariant probabilities, such that the resulting models need not have a hierarchical structure as in context tree‐based approaches. This can lead to a substantially higher rate of data compression, and such non‐hierarchical sparse models can be motivated for instance by data dependence structures existing in the bioinformatics context. We describe a Bayesian inference algorithm for learning sparse Markov models through clustering of transition probabilities. Experiments with DNA sequence and protein data show that our approach is competitive in both prediction and classification when compared with several alternative methods on the basis of variable memory length.     

On Some Optimal Bayesian Nonparametric Rules for Estimating Distribution Functions

In this paper, we present a novel approach to estimating distribution functions, which combines ideas from Bayesian nonparametric inference, decision theory and robustness. Given a sample from a Dirichlet process on the space (𝒳, A), with parameter η in a class of measures, the sampling distribution function is estimated according to some optimality criteria (mainly minimax and regret), when a quadratic loss function is assumed. Estimates are then compared in two examples: one with simulated data and one with gas escapes data in a city network.     

基于Pair-Copula贝叶斯网络模型的金融危机传播效应研究

为克服传统Copula函数建模的复杂性,采用Pair-Copula贝叶斯网络方法,将Copula函数与贝叶斯网络的优势相结合,有效降低了高维Copula函数参数估计的复杂程度,解决了连续型贝叶斯网络非正态下边际分布难以控制的问题,有利于捕捉网络结点间的非对称相依结构,从而构建了国际8个代表性股票市场在次贷危机爆发前、中、后各个时期的概率网络模型,对危机在主要国际市场上的传播效应问题及传播路径识别问题进行实证研究。研究结果表明:金融危机在国际金融市场上具有明显的区域性传播特征;香港市场在金融危机发生前后一直都是亚洲市场的连接枢纽,是风险防范的关键节点;危机发生后欧洲市场与亚洲市场间的紧密程度加强;金融危机减缓了全球一体化的进程,但经济全球化的趋势势不可挡。     

On the generalized process capability under simple and mixture models

Process capability (PC) indices measure the ability of a process of interest to meet the desired specifications under certain restrictions. There are a variety of capability indices available in literature for different interest variables such as weights, lengths, thickness, and the life time of items among many others. The goal of this article is to study the generalized capability indices from the Bayesian view point under different symmetric and asymmetric loss functions for the simple and mixture of generalized lifetime models. For our study purposes, we have covered a simple and two component mixture of Maxwell distribution as a special case of the generalized class of models. A comparative discussion of the PC with the mixture models under Laplace and inverse Rayleigh are also included. Bayesian point estimation of maintenance performance of the system is also part of the study (considering the Maxwell failure lifetime model and the repair time model). A real-life example is also included to illustrate the procedural details of the proposed method.     

Bayesian penalized smoothing approaches in models specified using differential equations with unknown error distributions

A full Bayesian approach based on ordinary differential equation (ODE)-penalized B-splines and penalized Gaussian mixture is proposed to jointly estimate ODE-parameters, state function and error distribution from the observation of some state functions involved in systems of affine differential equations. Simulations inspired by pharmacokinetic (PK) studies show that the proposed method provides comparable results to the method based on the standard ODE-penalized B-spline approach (i.e. with the Gaussian error distribution assumption) and outperforms the standard ODE-penalized B-splines when the distribution is not Gaussian. This methodology is illustrated on a PK data set.     

Bayesian age-stratified joinpoint regression model: an application to lung and brain cancer mortality

Joinpoint regression model identifies significant changes in the trends of the incidence, mortality, and survival of a specific disease in a given population. The purpose of the present study is to develop an age-stratified Bayesian joinpoint regression model to describe mortality trend assuming that the observed counts are probabilistically characterized by the Poisson distribution. The proposed model is based on Bayesian model selection criteria with the smallest number of joinpoints that are sufficient to explain the Annual Percentage Change. The prior probability distributions are chosen in such a way that they are automatically derived from the model index contained in the model space. The proposed model and methodology estimates the age-adjusted mortality rates in different epidemiological studies to compare the trends by accounting the confounding effects of age. In developing the subject methods, we use the cancer mortality counts of adult lung and bronchus cancer, and brain and other Central Nervous System cancer patients obtained from the Surveillance Epidemiology and End Results data base of the National Cancer Institute.     

On Variational Bayes Estimation and Variational Information Criteria for Linear Regression Models

Variational Bayes (VB) estimation is a fast alternative to Markov Chain Monte Carlo for performing approximate Baesian inference. This procedure can be an efficient and effective means of analyzing large datasets. However, VB estimation is often criticised, typically on empirical grounds, for being unable to produce valid statistical inferences. In this article we refute this criticism for one of the simplest models where Bayesian inference is not analytically tractable, that is, the Bayesian linear model (for a particular choice of priors). We prove that under mild regularity conditions, VB based estimators enjoy some desirable frequentist properties such as consistency and can be used to obtain asymptotically valid standard errors. In addition to these results we introduce two VB information criteria: the variational Akaike information criterion and the variational Bayesian information criterion. We show that variational Akaike information criterion is asymptotically equivalent to the frequentist Akaike information criterion and that the variational Bayesian information criterion is first order equivalent to the Bayesian information criterion in linear regression. These results motivate the potential use of the variational information criteria for more complex models. We support our theoretical results with numerical examples.