On the matrix-variate generalized hyperbolic distribution and its Bayesian applications

In the first part of the paper, we introduce the matrix-variate generalized hyperbolic distribution by mixing the matrix normal distribution with the matrix generalized inverse Gaussian density. The p-dimensional generalized hyperbolic distribution of [Barndorff-Nielsen, O. (1978). Hyperbolic distributions and distributions on hyperbolae. Scand. J. Stat., 5, 151–157], the matrix-T distribution and many well-known distributions are shown to be special cases of the new distribution. Some properties of the distribution are also studied. The second part of the paper deals with the application of the distribution in the Bayesian analysis of the normal multivariate linear model.     

A matching prior for extreme quantile estimation of the generalized Pareto distribution

Extreme quantile estimation plays an important role in risk management and environmental statistics among other applications. A popular method is the peaks-over-threshold (POT) model that approximate the distribution of excesses over a high threshold through generalized Pareto distribution (GPD). Motivated by a practical financial risk management problem, we look for an appropriate prior choice for Bayesian estimation of the GPD parameters that results in better quantile estimation. Specifically, we propose a noninformative matching prior for the parameters of a GPD so that a specific quantile of the Bayesian predictive distribution matches the true quantile in the sense of Datta et al. (2000).     

Bayesian multivariate normal analysis under the extended reflected normal loss function

This paper considers the Bayesian analysis of the multivariate normal distribution under a new and bounded loss function, based on a reflection of the multivariate normal density function. The Bayes estimators of the mean vector can be derived for an arbitrary prior distribution of [d]. When the covariance matrix has an inverted Wishart prior density, a Bayes estimator of[d] is obtained under a bounded loss function, based on the entropy loss. Finally the admissibility of all linear estimators c[d]+ d for the mean vector is considered     

Bayesian generalized fused lasso modeling via NEG distribution

The fused lasso penalizes a loss function by the L₁ norm for both the regression coefficients and their successive differences to encourage sparsity of both. In this paper, we propose a Bayesian generalized fused lasso modeling based on a normal-exponential-gamma (NEG) prior distribution. The NEG prior is assumed into the difference of successive regression coefficients. The proposed method enables us to construct a more versatile sparse model than the ordinary fused lasso using a flexible regularization term. Simulation studies and real data analyses show that the proposed method has superior performance to the ordinary fused lasso.     

A Simple Approach to Fitting Bayesian Survival Models

There has been much recent work on Bayesian approaches to survival analysis, incorporating features such as flexible baseline hazards, time-dependent covariate effects, and random effects. Some of the proposed methods are quite complicated to implement, and we argue that as good or better results can be obtained via simpler methods. In particular, the normal approximation to the log-gamma distribution yields easy and efficient computational methods in the face of simple multivariate normal priors for baseline log-hazards and time-dependent covariate effects. While the basic method applies to piecewise-constant hazards and covariate effects, it is easy to apply importance sampling to consider smoother functions.     

Bayesian validation assessment of multivariate computational models

Multivariate model validation is a complex decision-making problem involving comparison of multiple correlated quantities, based upon the available information and prior knowledge. This paper presents a Bayesian risk-based decision method for validation assessment of multivariate predictive models under uncertainty. A generalized likelihood ratio is derived as a quantitative validation metric based on Bayes’ theorem and Gaussian distribution assumption of errors between validation data and model prediction. The multivariate model is then assessed based on the comparison of the likelihood ratio with a Bayesian decision threshold, a function of the decision costs and prior of each hypothesis. The probability density function of the likelihood ratio is constructed using the statistics of multiple response quantities and Monte Carlo simulation. The proposed methodology is implemented in the validation of a transient heat conduction model, using a multivariate data set from experiments. The Bayesian methodology provides a quantitative approach to facilitate rational decisions in multivariate model assessment under uncertainty.     

Dynamic Bayesian analysis of generalized odds ratios assuming multivariate skew-normal distribution for the error terms in the system equation

In this paper, we develop a methodology for the dynamic Bayesian analysis of generalized odds ratios in contingency tables. It is a standard practice to assume a normal distribution for the random effects in the dynamic system equations. Nevertheless, the normality assumption may be unrealistic in some applications and hence the validity of inferences can be dubious. Therefore, we assume a multivariate skew-normal distribution for the error terms in the system equation at each step. Moreover, we introduce a moving average approach to elicit the hyperparameters. Both simulated data and real data are analyzed to illustrate the application of this methodology.     

Bayesian Identification of Multivariate Autoregressive Processes

Identification is one of the most important stages of a time series analysis. This paper develops a direct Bayesian technique to identify the order of multivariate autoregressive processes. By employing the conditional likelihood function and a matrix normal-Wishart prior density, or Jeffrey' vague prior, the proposed identification technique is based on deriving the exact posterior probability mass function of the model order in a convenient form. Then one may easily evaluate the posterior probabilities of the model order and choose the order that maximizes the posterior mass function to be the suitable order of the time series data being analyzed. Assuming the bivariate autoregressive processes, a numerical study, with different prior mass functions, is carried out to assess the efficiency of the proposed technique. The analysis of the numerical results supports the adequacy of the proposed technique in identifying the orders of multivariate autoregressive processes.     

Bayesian D-optimal design for logistic regression model with exponential distribution for random intercept

ABSTRACT

Nowadays, generalized linear models have many applications. Some of these models which have more applications in the real world are the models with random effects; that is, some of the unknown parameters are considered random variables. In this article, this situation is considered in logistic regression models with a random intercept having exponential distribution. The aim is to obtain the Bayesian D-optimal design; thus, the method is to maximize the Bayesian D-optimal criterion. For the model was considered here, this criterion is a function of the quasi-information matrix that depends on the unknown parameters of the model. In the Bayesian D-optimal criterion, the expectation is acquired in respect of the prior distributions that are considered for the unknown parameters. Thus, it will only be a function of experimental settings (support points) and their weights. The prior distribution of the fixed parameters is considered uniform and normal. The Bayesian D-optimal design is finally calculated numerically by R3.1.1 software.     

A hierarchical Bayesian regression model for the uncertain functional constraint using screened scale mixtures of Gaussian distributions

This paper considers a hierarchical Bayesian analysis of regression models using a class of Gaussian scale mixtures. This class provides a robust alternative to the common use of the Gaussian distribution as a prior distribution in particular for estimating the regression function subject to uncertainty about the constraint. For this purpose, we use a family of rectangular screened multivariate scale mixtures of Gaussian distribution as a prior for the regression function, which is flexible enough to reflect the degrees of uncertainty about the functional constraint. Specifically, we propose a hierarchical Bayesian regression model for the constrained regression function with uncertainty on the basis of three stages of a prior hierarchy with Gaussian scale mixtures, referred to as a hierarchical screened scale mixture of Gaussian regression models (HSMGRM). We describe distributional properties of HSMGRM and an efficient Markov chain Monte Carlo algorithm for posterior inference, and apply the proposed model to real applications with constrained regression models subject to uncertainty.     

The Gaussian Mixture Dynamic Conditional Correlation Model: Parameter Estimation,Value at Risk Calculation,and Portfolio Selection

A multivariate generalized autoregressive conditional heteroscedasticity model with dynamic conditional correlations is proposed, in which the individual conditional volatilities follow exponential generalized autoregressive conditional heteroscedasticity models and the standardized innovations follow a mixture of Gaussian distributions. Inference on the model parameters and prediction of future volatilities are addressed by both maximum likelihood and Bayesian estimation methods. Estimation of the Value at Risk of a given portfolio and selection of optimal portfolios under the proposed specification are addressed. The good performance of the proposed methodology is illustrated via Monte Carlo experiments and the analysis of the daily closing prices of the Dow Jones and NASDAQ indexes.     

Non-conjugate prior distribution assessment for multivariate normal sampling

Elicitation methods are proposed for quantifying expert opinion about a multivariate normal sampling model. The natural conjugate prior family imposes a relationship between the mean vector and the covariance matrix that can portray an expert's opinion poorly. Instead we assume that opinions about the mean and the covariance are independent and suggest innovative forms of question which enable the expert to quantify separately his or her opinion about each of these parameters. Prior opinion about the mean vector is modelled by a multivariate normal distribution and about the covariance matrix by both an inverse Wishart distribution and a generalized inverse-Wishart (GIW) distribution. To construct the latter, results are developed that give insight into the GIW parameters and their interrelationships. Certain of the elicitation methods exploit unconditional assessments as fully as possible, since these can reflect an expert's beliefs more accurately than conditional assessments. Methods are illustrated through an example.     

A default Bayesian procedure for the generalized Pareto distribution

The generalized Pareto distribution is used to model the exceedances over a threshold in a number of fields, including the analysis of environmental extreme events and financial data analysis. We use this model in a default Bayesian framework where no prior information is available on unknown model parameters. Using a large simulation study, we compare the performance of our posterior estimations of parameters with other methods proposed in the literature. We show that our procedure also allows to make inferences in other quantities of interest in extreme value analysis without asymptotic arguments. We apply the proposed methodology to a real data set.     

Bayesian multivariate Poisson mixtures with an unknown number of components

In this paper we present Bayesian analysis of finite mixtures of multivariate Poisson distributions with an unknown number of components. The multivariate Poisson distribution can be regarded as the discrete counterpart of the multivariate normal distribution, which is suitable for modelling multivariate count data. Mixtures of multivariate Poisson distributions allow for overdispersion and for negative correlations between variables. To perform Bayesian analysis of these models we adopt a reversible jump Markov chain Monte Carlo (MCMC) algorithm with birth and death moves for updating the number of components. We present results obtained from applying our modelling approach to simulated and real data. Furthermore, we apply our approach to a problem in multivariate disease mapping, namely joint modelling of diseases with correlated counts.     

Bayesian analysis of the generalized gamma distribution using non-informative priors

The Generalized gamma (GG) distribution plays an important role in statistical analysis. For this distribution, we derive non-informative priors using formal rules, such as Jeffreys prior, maximal data information prior and reference priors. We have shown that these most popular formal rules with natural ordering of parameters, lead to priors with improper posteriors. This problem is overcome by considering a prior averaging approach discussed in Berger et al. [Overall objective priors. Bayesian Analysis. 2015;10(1):189–221]. The obtained hybrid Jeffreys-reference prior is invariant under one-to-one transformations and yields a proper posterior distribution. We obtained good frequentist properties of the proposed prior using a detailed simulation study. Finally, an analysis of the maximum annual discharge of the river Rhine at Lobith is presented.     

Empirical bayes estimation of the mean in a multivariate normal distribution

We consider the problem of estimating the mean vector of a multivariate normal distribution under a variety of assumed structures among the parameters of the sampling and prior distributions. We adopt a pragmatic approach. We adopt distributional familites, assess hyperparmeters, and adopt patterned mean and coveariance structures when it is relatively simple to do so; alternatively, we use the sample data to estimate hyperparameters of prior distributions when assessment is a formidable task; such as the task of assessing parameters of multidimensional problems. James-Stein-like estimators are found to result. In some cases, we've been abl to show that the estimators proposed uniformly dominate the MLE's when measured with respect to quadratic loss functions.     

Regularized parameter estimation of high dimensional t distribution

We propose penalized-likelihood methods for parameter estimation of high dimensional t distribution. First, we show that a general class of commonly used shrinkage covariance matrix estimators for multivariate normal can be obtained as penalized-likelihood estimator with a penalty that is proportional to the entropy loss between the estimate and an appropriately chosen shrinkage target. Motivated by this fact, we then consider applying this penalty to multivariate t distribution. The penalized estimate can be computed efficiently using EM algorithm for given tuning parameters. It can also be viewed as an empirical Bayes estimator. Taking advantage of its Bayesian interpretation, we propose a variant of the method of moments to effectively elicit the tuning parameters. Simulations and real data analysis demonstrate the competitive performance of the new methods.     

Multivariate extension of modified Sarhan-Balakrishnan bivariate distribution

Recently Kundu and Gupta [2010, Modified Sarhan-Balakrishnan singular bivariate distribution, Journal of Statistical Planning and Inference, 140, 526-538] introduced the modified Sarhan-Balakrishnan bivariate distribution and established its several properties. In this paper we provide a multivariate extension of the modified Sarhan-Balakrishnan bivariate distribution. It is a distribution with a singular part. Different ageing and dependence properties of the proposed multivariate distribution have been established. The moment generating function, the product moments can be obtained in terms of infinite series. The multivariate hazard rate has been obtained. We provide the EM algorithm to compute the maximum likelihood estimators and an illustrative example is performed to see the effectiveness of the proposed method.     

Prior distribution elicitation for generalized linear and piecewise-linear models

An elicitation method is proposed for quantifying subjective opinion about the regression coefficients of a generalized linear model. Opinion between a continuous predictor variable and the dependent variable is modelled by a piecewise-linear function, giving a flexible model that can represent a wide variety of opinion. To quantify his or her opinions, the expert uses an interactive computer program, performing assessment tasks that involve drawing graphs and bar-charts to specify medians and other quantiles. Opinion about the regression coefficients is represented by a multivariate normal distribution whose parameters are determined from the assessments. It is practical to use the procedure with models containing a large number of parameters. This is illustrated through practical examples and the benefit from using prior knowledge is examined through cross-validation.     

The Kotz-type distribution with applications

The Kotz-type distribution was introduced by Kotz (1975) as a generalization of the multivariate normal distribution. Since 1990 there has been a surge of activity relating to this distribution. We have identified some 25 papers on the Kotz-type distribution over the period from 1990 to 2002 - compared to just 5 over the period from 1980 to 1989. The aim of this paper is to review the developments in the following areas: marginal distributions; moments; characteristic functions; characterizations; asymptotics; quadratic forms; estimation; hypothesis testing; generalizations; Bayesian inference; and, applications in other areas such as ecology, discriminant analysis, mathematical finance, repeated measurements, shape theory and signal processing. We feel that this review could be important as a source of reference and for unlocking further research on the distribution.