Reversible jump, birth-and-death and more general continuous time Markov chain Monte Carlo samplers

Summary. Reversible jump methods are the most commonly used Markov chain Monte Carlo tool for exploring variable dimension statistical models. Recently, however, an alternative approach based on birth-and-death processes has been proposed by Stephens for mixtures of distributions. We show that the birth-and-death setting can be generalized to include other types of continuous time jumps like split-and-combine moves in the spirit of Richardson and Green. We illustrate these extensions both for mixtures of distributions and for hidden Markov models. We demonstrate the strong similarity of reversible jump and continuous time methodologies by showing that, on appropriate rescaling of time, the reversible jump chain converges to a limiting continuous time birth-and-death process. A numerical comparison in the setting of mixtures of distributions highlights this similarity.     

BAYESIAN ESTIMATION OF RUIN PROBABILITIES WITH A HETEROGENEOUS AND HEAVY-TAILED INSURANCE CLAIM-SIZE DISTRIBUTION

This paper describes a Bayesian approach to make inference for risk reserve processes with an unknown claim‐size distribution. A flexible model based on mixtures of Erlang distributions is proposed to approximate the special features frequently observed in insurance claim sizes, such as long tails and heterogeneity. A Bayesian density estimation approach for the claim sizes is implemented using reversible jump Markov chain Monte Carlo methods. An advantage of the considered mixture model is that it belongs to the class of phase‐type distributions, and thus explicit evaluations of the ruin probabilities are possible. Furthermore, from a statistical point of view, the parametric structure of the mixtures of the Erlang distribution offers some advantages compared with the whole over‐parametrized family of phase‐type distributions. Given the observed claim arrivals and claim sizes, we show how to estimate the ruin probabilities, as a function of the initial capital, and predictive intervals that give a measure of the uncertainty in the estimations.     

Asymptotic Confidence Intervals for a New Inequality Measure

This work aims at assessing, by simulation methods, the performance of asymptotic confidence intervals for Zenga's new inequality measure. The results are compared with those obtained on Gini's measure, perhaps the most widely used index for measuring inequality in income and wealth distributions. Our findings show that the coverage accuracy and the size of the confidence intervals for the two measures are very similar in samples from economic size distributions.     

Reversible jump methods for generalised linear models and generalised linear mixed models

A reversible jump algorithm for Bayesian model determination among generalised linear models, under relatively diffuse prior distributions for the model parameters, is proposed. Orthogonal projections of the current linear predictor are used so that knowledge from the current model parameters is used to make effective proposals. This idea is generalised to moves of a reversible jump algorithm for model determination among generalised linear mixed models. Therefore, this algorithm exploits the full flexibility available in the reversible jump method. The algorithm is demonstrated via two examples and compared to existing methods.     

Testing for Covariate Effect in the Cox Proportional Hazards Regression Model

This article presents methods for testing covariate effect in the Cox proportional hazards model based on Kullback–Leibler divergence and Renyi's information measure. Renyi's measure is referred to as the information divergence of order γ (γ ≠ 1) between two distributions. In the limiting case γ → 1, Renyi's measure becomes Kullback–Leibler divergence. In our case, the distributions correspond to the baseline and one possibly due to a covariate effect. Our proposed statistics are simple transformations of the parameter vector in the Cox proportional hazards model, and are compared with the Wald, likelihood ratio and score tests that are widely used in practice. Finally, the methods are illustrated using two real-life data sets.     

Full Bayesian Analysis for a Class of Jump-Diffusion Models

The Full Bayesian Significance Test (FBST) is adjusted for jump detection in a diffusion process. Under a natural parameterization, pure diffusion can be seen as a precise hypothesis. The evidence measure defined by FBST deals with absolutely continuous posterior distributions, when posterior rates for precise hypotheses are not appropriate. Applications to simulated and real data are shown.     

Bayesian estimation for the M/G/1 queue using a phase-type approximation

This article deals with Bayesian inference and prediction for M/G/1 queueing systems. The general service time density is approximated with a class of Erlang mixtures which are phase-type distributions. Given this phase-type approximation, an explicit evaluation of measures such as the stationary queue size, waiting time and busy period distributions can be obtained. Given arrival and service data, a Bayesian procedure based on reversible jump Markov Chain Monte Carlo methods is proposed to estimate system parameters and predictive distributions.     

A semi-parametric method for estimating the beta coefficients of the hidden two-sided asset return jumps

ABSTRACT

We introduce a new methodology for estimating the parameters of a two-sided jump model, which aims at decomposing the daily stock return evolution into (unobservable) positive and negative jumps as well as Brownian noise. The parameters of interest are the jump beta coefficients which measure the influence of the market jumps on the stock returns, and are latent components. For this purpose, at first we use the Variance Gamma (VG) distribution which is frequently used in modeling financial time series and leads to the revelation of the hidden market jumps' distributions. Then, our method is based on the central moments of the stock returns for estimating the parameters of the model. It is proved that the proposed method provides always a solution in terms of the jump beta coefficients. We thus achieve a semi-parametric fit to the empirical data. The methodology itself serves as a criterion to test the fit of any sets of parameters to the empirical returns. The analysis is applied to NASDAQ and Google returns during the 2006–2008 period.     

Sequential Monte Carlo with transformations

This paper examines methodology for performing Bayesian inference sequentially on a sequence of posteriors on spaces of different dimensions. For this, we use sequential Monte Carlo samplers, introducing the innovation of using deterministic transformations to move particles effectively between target distributions with different dimensions. This approach, combined with adaptive methods, yields an extremely flexible and general algorithm for Bayesian model comparison that is suitable for use in applications where the acceptance rate in reversible jump Markov chain Monte Carlo is low. We use this approach on model comparison for mixture models, and for inferring coalescent trees sequentially, as data arrives.     

Testing symmetry under a skew Laplace model

We develop tests of hypothesis about symmetry based on samples from possibly asymmetric Laplace distributions and present exact and limiting distribution of the test statistics. We postulate that the test statistic derived under the Laplace model is a rational choice as a measure of skewness and can be used in testing symmetry for other, quite general classes of skew distributions. Our results are applied to foreign exchange rates for 15 currencies.     

A new Bayesian wavelet thresholding estimator of nonparametric regression

The methods of estimation of nonparametric regression function are quite common in statistical application. In this paper, the new Bayesian wavelet thresholding estimation is considered. The new mixture prior distributions for the estimation of nonparametric regression function by applying wavelet transformation are investigated. The reversible jump algorithm to obtain the appropriate prior distributions and value of thresholding is used. The performance of the proposed estimator is assessed with simulated data from well-known test functions by comparing the convergence rate of the proposed estimator with respect to another by evaluating the average mean square error and standard deviations. Finally by applying the developed method, density function of galaxy data is estimated.     

Sequential Bayesian inference in hidden Markov stochastic kinetic models with application to detection and response to seasonal epidemics

We study sequential Bayesian inference in stochastic kinetic models with latent factors. Assuming continuous observation of all the reactions, our focus is on joint inference of the unknown reaction rates and the dynamic latent states, modeled as a hidden Markov factor. Using insights from nonlinear filtering of continuous-time jump Markov processes we develop a novel sequential Monte Carlo algorithm for this purpose. Our approach applies the ideas of particle learning to minimize particle degeneracy and exploit the analytical jump Markov structure. A motivating application of our methods is modeling of seasonal infectious disease outbreaks represented through a compartmental epidemic model. We demonstrate inference in such models with several numerical illustrations and also discuss predictive analysis of epidemic countermeasures using sequential Bayes estimates.     

Consistency of Generalized Maximum Spacing Estimates

General methods for the estimation of distributions can be derived from approximations of certain information measures. For example, both the maximum likelihood (ML) method and the maximum spacing (MSP) method can be obtained from approximations of the Kullback–Leibler information. The ideas behind the MSP method, whereby an estimation method for continuous univariate distributions is obtained from an approximation based on spacings of an information measure, were used by Ranneby & Ekstrom (1997) (using simple spacings) and Ekstrom (1997b) (using high order spacings) to obtain a class of methods, called generalized maximum spacing (GMSP) methods. In the present paper, GMSP methods will be shown to give consistent estimates under general conditions, comparable to those of Bahadur (1971) for the ML method, and those of Shao & Hahn (1999) for the MSP method. In particular, it will be proved that GMSP methods give consistent estimates in any family of distributions with unimodal densities, without any further conditions on the distributions.     

Jump-diffusion models of German stock returns

This paper discusses the statistical properties of jump-diffusion processes and reports on parameter estimates for the DAX stock index and 48 German stocks with traded options. It is found that a Poisson-type jump-diffusion process can explain the high levels of kurtosis and skewness of observed return distributions of German stocks. Furthermore, we demonstrate that the return dynamics of the DAX include a statistically significant jump component except for a few sample subperiods. This finding is seen to be inconsistent with asset pricing models assuming that the jump component of the stock's return is unsystematic and diversifiable in the market portfolio.     

On functional central limit theorems of Bayesian nonparametric priors

A general approach to derive the weak convergence, when centered and rescaled, of certain Bayesian nonparametric priors is proposed. This method may be applied to a wide range of processes including, for instance, nondecreasing nonnegative pure jump Lévy processes and normalized nondecreasing nonnegative pure jump Lévy processes with known finite dimensional distributions. Examples clarifying this approach involve the beta process in latent feature models and the Dirichlet process.     

Bayesian change points analysis on the seismic activity in northeastern Taiwan

Bayesian change points analysis on the seismic activity in northeastern Taiwan is studied via the reversible jump Markov chain Monte Carlo simulation. An epidemic model is considered with Gamma prior distributions for the parameters. The prior distributions are essentially determined based on an earlier period of the seismic data in the same region. It is investigated that there exist two change points during the time period considered. This result is also confirmed by the BIC criteria.     

Time-Varying Systemic Risk: Evidence From a Dynamic Copula Model of CDS Spreads

This article proposes a new class of copula-based dynamic models for high-dimensional conditional distributions, facilitating the estimation of a wide variety of measures of systemic risk. Our proposed models draw on successful ideas from the literature on modeling high-dimensional covariance matrices and on recent work on models for general time-varying distributions. Our use of copula-based models enables the estimation of the joint model in stages, greatly reducing the computational burden. We use the proposed new models to study a collection of daily credit default swap (CDS) spreads on 100 U.S. firms over the period 2006 to 2012. We find that while the probability of distress for individual firms has greatly reduced since the financial crisis of 2008–2009, the joint probability of distress (a measure of systemic risk) is substantially higher now than in the precrisis period. Supplementary materials for this article are available online.     

Reversible jump Markov chain Monte Carlo algorithms for Bayesian variable selection in logistic mixed models

In this article, to reduce computational load in performing Bayesian variable selection, we used a variant of reversible jump Markov chain Monte Carlo methods, and the Holmes and Held (HH) algorithm, to sample model index variables in logistic mixed models involving a large number of explanatory variables. Furthermore, we proposed a simple proposal distribution for model index variables, and used a simulation study and real example to compare the performance of the HH algorithm with our proposed and existing proposal distributions. The results show that the HH algorithm with our proposed proposal distribution is a computationally efficient and reliable selection method.     

A proportional hazards regression model with change-points in the baseline function

In this article, we consider a new regression model for counting processes under a proportional hazards assumption. This model is motivated by the need of understanding the evolution of the booking process of a railway company. The main novelty of the approach consists in assuming that the baseline hazard function is piecewise constant, with unknown times of jump (these times of jump are estimated from the data as model parameters). Hence, the parameters of the model can be separated into two different types: parameters that measure the influence of the covariates, and parameters from a multiple change-point model for the baseline. Cox??s semiparametric regression can be seen as a limit case of our model. We develop an iterative procedure to estimate the different parameters, and a test procedure that allows to perform change-point detection in the baseline. Our technique is supported by simulation studies and a real data analysis, which show that our model can be a reasonable alternative to Cox??s regression model, particularly in the presence of tied event times.     

Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions

Summary. The major implementational problem for reversible jump Markov chain Monte Carlo methods is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure in the parameter space to guide our choice. We consider mechanisms for guiding the choice of proposal. The first group of methods is based on an analysis of acceptance probabilities for jumps. Essentially, these methods involve a Taylor series expansion of the acceptance probability around certain canonical jumps and turn out to have close connections to Langevin algorithms. The second group of methods generalizes the reversible jump algorithm by using the so-called saturated space approach. These allow the chain to retain some degree of memory so that, when proposing to move from a smaller to a larger model, information is borrowed from the last time that the reverse move was performed. The main motivation for this paper is that, in complex problems, the probability that the Markov chain moves between such spaces may be prohibitively small, as the probability mass can be very thinly spread across the space. Therefore, finding reasonable jump proposals becomes extremely important. We illustrate the procedure by using several examples of reversible jump Markov chain Monte Carlo applications including the analysis of autoregressive time series, graphical Gaussian modelling and mixture modelling.