Efficient Bayesian inference in generalized inverse gamma processes for stochastic volatility

This paper develops a novel and efficient algorithm for Bayesian inference in inverse Gamma stochastic volatility models. It is shown that by conditioning on auxiliary variables, it is possible to sample all the volatilities jointly directly from their posterior conditional density, using simple and easy to draw from distributions. Furthermore, this paper develops a generalized inverse gamma process with more flexible tails in the distribution of volatilities, which still allows for simple and efficient calculations. Using several macroeconomic and financial datasets, it is shown that the inverse gamma and generalized inverse gamma processes can greatly outperform the commonly used log normal volatility processes with Student’s t errors or jumps in the mean equation.     

Evaluating estimators using stochastic dominance rules:the variance of a normal distribution

The paper presents an application of stochastic dominance approach to estimator evaluation. This new approach is general and applicable when a monetary loss function is defined over the deviation of a sample estimate from the appropriate parameter. The paper applies this approach to the evaluation of alternative estimators of the normal distribution variance     

Statistical inference for a relaxation index of stochastic dominance under density ratio model

Stochastic dominance is usually used to rank random variables by comparing their distributions, so it is widely applied in economics and finance. In actual applications, complete stochastic dominance is too demanding to meet, so relaxation indexes of stochastic dominance have attracted more attention. The π index, the biggest gap between two distributions, can be a measure of the degree of deviation from complete dominance. The traditional estimation method is to use the empirical distribution functions to estimate it. Considering the populations under comparison are generally of the same nature, we can link the populations through density ratio model under certain condition. Based on this model, we propose a new estimator and establish its statistical inference theory. Simulation results show that the proposed estimator substantially improves estimation efficiency and power of the tests and coverage probabilities satisfactorily match the confidence levels of the tests, which show the superiority of the proposed estimator. Finally we apply our method to a real example of the Chinese household incomes.     

Some remarks on Lorenz ordering-preserving functionals

Basing on two well-known characterization results on stochastic dominance and continuous majorization relation, the ordering-preserving property-with respect to Lorenz ordering-is deduced for a wide class of families of functionals on a class of distributions. As a consequence the isotonicity ofZ Zenga concentration index is deduced as an immediate application of a characterization result, in particular of the first degree stochastic dominance relation. Moreover it is also shown that a classical inequality by Fan and Lorenz is a basic reference for the determination of a wide class of Lorenz ordering-preserving functionals. Isotonicity ofZ could also be seen as a straighforward application of Fan and Lorenz inequality.     

Signed binomial approximation of binomial mixtures via differential calculus for linear operators

We obtain sharp estimates in signed binomial approximation of binomial mixtures with respect to the total variation distance. We provide closed form expressions for the leading terms, and show that the corresponding leading coefficients depend on the zeros of appropriate Krawtchouk polynomials. The special case of Pólya–Eggenberger distributions is discussed in detail. Our approach is based on a differential calculus for linear operators represented by stochastic processes, which allows us to give unified proofs.     

On predictive distributions and Bayesian networks

In this paper we are interested in discrete prediction problems for a decision-theoretic setting, where the task is to compute the predictive distribution for a finite set of possible alternatives. This question is first addressed in a general Bayesian framework, where we consider a set of probability distributions defined by some parametric model class. Given a prior distribution on the model parameters and a set of sample data, one possible approach for determining a predictive distribution is to fix the parameters to the instantiation with the maximum a posteriori probability. A more accurate predictive distribution can be obtained by computing the evidence (marginal likelihood), i.e., the integral over all the individual parameter instantiations. As an alternative to these two approaches, we demonstrate how to use Rissanen's new definition of stochastic complexity for determining predictive distributions, and show how the evidence predictive distribution with Jeffrey's prior approaches the new stochastic complexity predictive distribution in the limit with increasing amount of sample data. To compare the alternative approaches in practice, each of the predictive distributions discussed is instantiated in the Bayesian network model family case. In particular, to determine Jeffrey's prior for this model family, we show how to compute the (expected) Fisher information matrix for a fixed but arbitrary Bayesian network structure. In the empirical part of the paper the predictive distributions are compared by using the simple tree-structured Naive Bayes model, which is used in the experiments for computational reasons. The experimentation with several public domain classification datasets suggest that the evidence approach produces the most accurate predictions in the log-score sense. The evidence-based methods are also quite robust in the sense that they predict surprisingly well even when only a small fraction of the full training set is used.     

Tail exponent estimation via broadband log density-quantile regression

Heavy tail probability distributions are important in many scientific disciplines such as hydrology, geology, and physics and therefore feature heavily in statistical practice. Rather than specifying a family of heavy-tailed distributions for a given application, it is more common to use a nonparametric approach, where the distributions are classified according to the tail behavior. Through the use of the logarithm of Parzen's density-quantile function, this work proposes a consistent, flexible estimator of the tail exponent. The approach we develop is based on a Fourier series estimator and allows for separate estimates of the left and right tail exponents. The theoretical properties for the tail exponent estimator are determined, and we also provide some results of independent interest that may be used to establish weak convergence of stochastic processes. We assess the practical performance of the method by exploring its finite sample properties in simulation studies. The overall performance is competitive with classical tail index estimators, and, in contrast, with these our method obtains somewhat better results in the case of lighter heavy-tailed distributions.     

Bayesian analysis of multivariate stochastic volatility with skew return distribution

Multivariate stochastic volatility models with skew distributions are proposed. Exploiting Cholesky stochastic volatility modeling, univariate stochastic volatility processes with leverage effect and generalized hyperbolic skew t-distributions are embedded to multivariate analysis with time-varying correlations. Bayesian modeling allows this approach to provide parsimonious skew structure and to easily scale up for high-dimensional problem. Analyses of daily stock returns are illustrated. Empirical results show that the time-varying correlations and the sparse skew structure contribute to improved prediction performance and Value-at-Risk forecasts.     

Normal Inverse Gaussian Distributions and Stochastic Volatility Modelling

The normal inverse Gaussian distribution is defined as a variance-mean mixture of a normal distribution with the inverse Gaussian as the mixing distribution. The distribution determines an homogeneous Lévy process, and this process is representable through subordination of Brownian motion by the inverse Gaussian process. The canonical, Lévy type, decomposition of the process is determined. As a preparation for developments in the latter part of the paper the connection of the normal inverse Gaussian distribution to the classes of generalized hyperbolic and inverse Gaussian distributions is briefly reviewed. Then a discussion is begun of the potential of the normal inverse Gaussian distribution and Lévy process for modelling and analysing statistical data, with particular reference to extensive sets of observations from turbulence and from finance. These areas of application imply a need for extending the inverse Gaussian Lévy process so as to accommodate certain, frequently observed, temporal dependence structures. Some extensions, of the stochastic volatility type, are constructed via an observation-driven approach to state space modelling. At the end of the paper generalizations to multivariate settings are indicated.     

Stochastic volatility modelling in continuous time with general marginal distributions: Inference,prediction and model selection

We compare results for stochastic volatility models where the underlying volatility process having generalized inverse Gaussian (GIG) and tempered stable marginal laws. We use a continuous time stochastic volatility model where the volatility follows an Ornstein–Uhlenbeck stochastic differential equation driven by a Lévy process. A model for long-range dependence is also considered, its merit and practical relevance discussed. We find that the full GIG and a special case, the inverse gamma, marginal distributions accurately fit real data. Inference is carried out in a Bayesian framework, with computation using Markov chain Monte Carlo (MCMC). We develop an MCMC algorithm that can be used for a general marginal model.     

Conditional Stochastic Dominance Testing

This article proposes bootstrap-based stochastic dominance tests for nonparametric conditional distributions and their moments. We exploit the fact that a conditional distribution dominates the other if and only if the difference between the marginal joint distributions is monotonic in the explanatory variable at each value of the dependent variable. The proposed test statistic compares restricted and unrestricted estimators of the difference between the joint distributions, and it can be implemented under minimal smoothness requirements on the underlying nonparametric curves and without resorting to smooth estimation. The finite sample properties of the proposed test are examined by means of a Monte Carlo study. We illustrate the test by studying the impact on postintervention earnings of the National Supported Work Demonstration, a randomized labor training program carried out in the 1970s.     

Bayesian semiparametric modeling for stochastic precedence,with applications in epidemiology and survival analysis

We propose a prior probability model for two distributions that are ordered according to a stochastic precedence constraint, a weaker restriction than the more commonly utilized stochastic order constraint. The modeling approach is based on structured Dirichlet process mixtures of normal distributions. Full inference for functionals of the stochastic precedence constrained mixture distributions is obtained through a Markov chain Monte Carlo posterior simulation method. A motivating application involves study of the discriminatory ability of continuous diagnostic tests in epidemiologic research. Here, stochastic precedence provides a natural restriction for the distributions of test scores corresponding to the non-infected and infected groups. Inference under the model is illustrated with data from a diagnostic test for Johne’s disease in dairy cattle. We also apply the methodology to the comparison of survival distributions associated with two distinct conditions, and illustrate with analysis of data on survival time after bone marrow transplantation for treatment of leukemia.     

Stochastic volatility in mean models with scale mixtures of normal distributions and correlated errors: A Bayesian approach

A stochastic volatility in mean model with correlated errors using the symmetrical class of scale mixtures of normal distributions is introduced in this article. The scale mixture of normal distributions is an attractive class of symmetric distributions that includes the normal, Student-t, slash and contaminated normal distributions as special cases, providing a robust alternative to estimation in stochastic volatility in mean models in the absence of normality. Using a Bayesian paradigm, an efficient method based on Markov chain Monte Carlo (MCMC) is developed for parameter estimation. The methods developed are applied to analyze daily stock return data from the São Paulo Stock, Mercantile & Futures Exchange index (IBOVESPA). The Bayesian predictive information criteria (BPIC) and the logarithm of the marginal likelihood are used as model selection criteria. The results reveal that the stochastic volatility in mean model with correlated errors and slash distribution provides a significant improvement in model fit for the IBOVESPA data over the usual normal model.     

Tests for Parameter Instability in Regressions with 1(1) Processes

This article derives the large-sample distributions of Lagrange multiplier (LM) tests for parameter instability against several alternatives of interest in the context of cointegrated regression models. The fully modified estimator of Phillips and Hansen is extended to cover general models with stochastic and deterministic trends. The test statistics considered include the SupF test of Quandt, as well as the LM tests of Nyblom and of Nabeya and Tanaka. It is found that the asymptotic distributions depend on the nature of the regressor processes—that is, if the regressors are stochastic or deterministic trends. The distributions are noticeably different from the distributions when the data are weakly dependent. It is also found that the lack of cointegration is a special case of the alternative hypothesis considered (an unstable intercept), so the tests proposed here may also be viewed as a test of the null of cointegration against the alternative of no cointegration. The tests are applied to three data sets—an aggregate consumption function, a present value model of stock prices and dividends, and the term structure of interest rates.     

Accelerated Degradation Models for Failure Based on Geometric Brownian Motion and Gamma Processes

Based on a generalized cumulative damage approach with a stochastic process describing degradation, new accelerated life test models are presented in which both observed failures and degradation measures can be considered for parametric inference of system lifetime. Incorporating an accelerated test variable, we provide several new accelerated degradation models for failure based on the geometric Brownian motion or gamma process. It is shown that in most cases, our models for failure can be approximated closely by accelerated test versions of Birnbaum–Saunders and inverse Gaussian distributions. Estimation of model parameters and a model selection procedure are discussed, and two illustrative examples using real data for carbon-film resistors and fatigue crack size are presented.     

A test for second order stochastic dominance

In this paper we propose a test for second order stochastic dominance (SSD), for the case where both distribution functions are unknown. This is a generalization of a test proposed by Deshpande and Singh (1985), who compare a new random prospect with a known distribution function. We then show that our test is based on comparing the mean minus one half of Gini's mean difference of the distributions, which is known to be a necessary condition for SSD, as developed in the economics literature (Yitzhaki, 1982).     

Matrix‐Exponential Distributions: Calculus and Interpretations via Flows

By considering randomly stopped deterministic flow models, we develop an intuitively appealing way to generate probability distributions with rational Laplace–Stieltjes transforms on [0,∞). That approach includes and generalizes the formalism of PH-distributions. That generalization results in the class of matrix-exponential probability distributions. To illustrate the novel way of thinking that is required to use these in stochastic models, we retrace the derivations of some results from matrix-exponential renewal theory and prove a new extension of a result from risk theory. Essentially the flow models allows for keeping track of the dynamics of a mechanism that generates matrix-exponential distributions in a similar way to the probabilistic arguments used for phase-type distributions involving transition rates. We also sketch a generalization of the Markovian arrival process (MAP) to the setting of matrix-exponential distribution. That process is known as the Rational arrival process (RAP).     

Bayesian outlier analysis in binary regression

We propose alternative approaches to analyze residuals in binary regression models based on random effect components. Our preferred model does not depend upon any tuning parameter, being completely automatic. Although the focus is mainly on accommodation of outliers, the proposed methodology is also able to detect them. Our approach consists of evaluating the posterior distribution of random effects included in the linear predictor. The evaluation of the posterior distributions of interest involves cumbersome integration, which is easily dealt with through stochastic simulation methods. We also discuss different specifications of prior distributions for the random effects. The potential of these strategies is compared in a real data set. The main finding is that the inclusion of extra variability accommodates the outliers, improving the adjustment of the model substantially, besides correctly indicating the possible outliers.     

Two‐Sample Test Against One‐Sided Alternatives

Abstract. This paper proposes, implements and investigates a new non‐parametric two‐sample test for detecting stochastic dominance. We pose the question of detecting the stochastic dominance in a non‐standard way. This is motivated by existing evidence showing that standard formulations and pertaining procedures may lead to serious errors in inference. The procedure that we introduce matches testing and model selection. More precisely, we reparametrize the testing problem in terms of Fourier coefficients of well‐known comparison densities. Next, the estimated Fourier coefficients are used to form a kind of signed smooth rank statistic. In such a setting, the number of Fourier coefficients incorporated into the statistic is a smoothing parameter. We determine this parameter via some flexible selection rule. We establish the asymptotic properties of the new test under null and alternative hypotheses. The finite sample performance of the new solution is demonstrated through Monte Carlo studies and an application to a set of survival times.     

Estimation of error probabilities in stochastic dominance

The process of using data to infer the existence of stochastic dominance is subject to sampling error. Kroll and Levy (1980), among others, have presented simulation results for several normal and lognormal distributions which show high error probabilities for a wide range of parameter values. This paper continues this line of research and uses simulation to estimate error probabilities. Distributions considered are a pair of normals and a pair of lognormals. Analysis of these distributions is made computationally feasible through theoretical results which reduce the number of parameters of the pair of distributions from four to two.