Simultaneous inference in structured additive conditional copula regression models: a unifying Bayesian approach

While most regression models focus on explaining distributional aspects of one single response variable alone, interest in modern statistical applications has recently shifted towards simultaneously studying multiple response variables as well as their dependence structure. A particularly useful tool for pursuing such an analysis are copula-based regression models since they enable the separation of the marginal response distributions and the dependence structure summarised in a specific copula model. However, so far copula-based regression models have mostly been relying on two-step approaches where the marginal distributions are determined first whereas the copula structure is studied in a second step after plugging in the estimated marginal distributions. Moreover, the parameters of the copula are mostly treated as a constant not related to covariates and most regression specifications for the marginals are restricted to purely linear predictors. We therefore propose simultaneous Bayesian inference for both the marginal distributions and the copula using computationally efficient Markov chain Monte Carlo simulation techniques. In addition, we replace the commonly used linear predictor by a generic structured additive predictor comprising for example nonlinear effects of continuous covariates, spatial effects or random effects and furthermore allow to make the copula parameters covariate-dependent. To facilitate Bayesian inference, we construct proposal densities for a Metropolis–Hastings algorithm relying on quadratic approximations to the full conditionals of regression coefficients avoiding manual tuning. The performance of the resulting Bayesian estimates is evaluated in simulations comparing our approach with penalised likelihood inference, studying the choice of a specific copula model based on the deviance information criterion, and comparing a simultaneous approach with a two-step procedure. Furthermore, the flexibility of Bayesian conditional copula regression models is illustrated in two applications on childhood undernutrition and macroecology.     

Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence

Most existing reduced-form macroeconomic multivariate time series models employ elliptical disturbances, so that the forecast densities produced are symmetric. In this article, we use a copula model with asymmetric margins to produce forecast densities with the scope for severe departures from symmetry. Empirical and skew t distributions are employed for the margins, and a high-dimensional Gaussian copula is used to jointly capture cross-sectional and (multivariate) serial dependence. The copula parameter matrix is given by the correlation matrix of a latent stationary and Markov vector autoregression (VAR). We show that the likelihood can be evaluated efficiently using the unique partial correlations, and estimate the copula using Bayesian methods. We examine the forecasting performance of the model for four U.S. macroeconomic variables between 1975:Q1 and 2011:Q2 using quarterly real-time data. We find that the point and density forecasts from the copula model are competitive with those from a Bayesian VAR. During the recent recession the forecast densities exhibit substantial asymmetry, avoiding some of the pitfalls of the symmetric forecast densities from the Bayesian VAR. We show that the asymmetries in the predictive distributions of GDP growth and inflation are similar to those found in the probabilistic forecasts from the Survey of Professional Forecasters. Last, we find that unlike the linear VAR model, our fitted Gaussian copula models exhibit nonlinear dependencies between some macroeconomic variables. This article has online supplementary material.     

Max-Linear Competing Factor Models

Models incorporating “latent” variables have been commonplace in financial, social, and behavioral sciences. Factor model, the most popular latent model, explains the continuous observed variables in a smaller set of latent variables (factors) in a matter of linear relationship. However, complex data often simultaneously display asymmetric dependence, asymptotic dependence, and positive (negative) dependence between random variables, which linearity and Gaussian distributions and many other extant distributions are not capable of modeling. This article proposes a nonlinear factor model that can model the above-mentioned variable dependence features but still possesses a simple form of factor structure. The random variables, marginally distributed as unit Fréchet distributions, are decomposed into max linear functions of underlying Fréchet idiosyncratic risks, transformed from Gaussian copula, and independent shared external Fréchet risks. By allowing the random variables to share underlying (latent) pervasive risks with random impact parameters, various dependence structures are created. This innovates a new promising technique to generate families of distributions with simple interpretations. We dive in the multivariate extreme value properties of the proposed model and investigate maximum composite likelihood methods for the impact parameters of the latent risks. The estimates are shown to be consistent. The estimation schemes are illustrated on several sets of simulated data, where comparisons of performance are addressed. We employ a bootstrap method to obtain standard errors in real data analysis. Real application to financial data reveals inherent dependencies that previous work has not disclosed and demonstrates the model’s interpretability to real data. Supplementary materials for this article are available online.     

Bootstrapping the conditional copula

This paper is concerned with inference about the dependence or association between two random variables conditionally upon the given value of a covariate. A way to describe such a conditional dependence is via a conditional copula function. Nonparametric estimators for a conditional copula then lead to nonparametric estimates of conditional association measures such as a conditional Kendall's tau. The limiting distributions of nonparametric conditional copula estimators are rather involved. In this paper we propose a bootstrap procedure for approximating these distributions and their characteristics, and establish its consistency. We apply the proposed bootstrap procedure for constructing confidence intervals for conditional association measures, such as a conditional Blomqvist beta and a conditional Kendall's tau. The performances of the proposed methods are investigated via a simulation study involving a variety of models, ranging from models in which the dependence (weak or strong) on the covariate is only through the copula and not through the marginals, to models in which this dependence appears in both the copula and the marginal distributions. As a conclusion we provide practical recommendations for constructing bootstrap-based confidence intervals for the discussed conditional association measures.     

A multivariate volatility vine copula model

This article proposes a dynamic framework for modeling and forecasting of realized covariance matrices using vine copulas to allow for more flexible dependencies between assets. Our model automatically guarantees positive definiteness of the forecast through the use of a Cholesky decomposition of the realized covariance matrix. We explicitly account for long-memory behavior by using fractionally integrated autoregressive moving average (ARFIMA) and heterogeneous autoregressive (HAR) models for the individual elements of the decomposition. Furthermore, our model incorporates non-Gaussian innovations and GARCH effects, accounting for volatility clustering and unconditional kurtosis. The dependence structure between assets is studied using vine copula constructions, which allow for nonlinearity and asymmetry without suffering from an inflexible tail behavior or symmetry restrictions as in conventional multivariate models. Further, the copulas have a direct impact on the point forecasts of the realized covariances matrices, due to being computed as a nonlinear transformation of the forecasts for the Cholesky matrix. Beside studying in-sample properties, we assess the usefulness of our method in a one-day-ahead forecasting framework, comparing recent types of models for the realized covariance matrix based on a model confidence set approach. Additionally, we find that in Value-at-Risk (VaR) forecasting, vine models require less capital requirements due to smoother and more accurate forecasts.     

Examination and visualisation of the simplifying assumption for vine copulas in three dimensions

Vine copulas are a highly flexible class of dependence models, which are based on the decomposition of the density into bivariate building blocks. For applications one usually makes the simplifying assumption that copulas of conditional distributions are independent of the variables on which they are conditioned. However this assumption has been criticised for being too restrictive. We examine both simplified and non‐simplified vine copulas in three dimensions and investigate conceptual differences. We show and compare contour surfaces of three‐dimensional vine copula models, which prove to be much more informative than the contour lines of the bivariate marginals. Our investigation shows that non‐simplified vine copulas can exhibit arbitrarily irregular shapes, whereas simplified vine copulas appear to be smooth extrapolations of their bivariate margins to three dimensions. In addition to a variety of constructed examples, we also investigate a three‐dimensional subset of the well‐known uranium data set and visually detect the fact that a non‐simplified vine copula is necessary to capture its complex dependence structure.     

On the Correlation Structure of Gaussian Copula Models for Geostatistical Count Data

We describe a class of random field models for geostatistical count data based on Gaussian copulas. Unlike hierarchical Poisson models often used to describe this type of data, Gaussian copula models allow a more direct modelling of the marginal distributions and association structure of the count data. We study in detail the correlation structure of these random fields when the family of marginal distributions is either negative binomial or zero‐inflated Poisson; these represent two types of overdispersion often encountered in geostatistical count data. We also contrast the correlation structure of one of these Gaussian copula models with that of a hierarchical Poisson model having the same family of marginal distributions, and show that the former is more flexible than the latter in terms of range of feasible correlation, sensitivity to the mean function and modelling of isotropy. An exploratory analysis of a dataset of Japanese beetle larvae counts illustrate some of the findings. All of these investigations show that Gaussian copula models are useful alternatives to hierarchical Poisson models, specially for geostatistical count data that display substantial correlation and small overdispersion.     

Eliciting Dirichlet and Gaussian copula prior distributions for multinomial models

In this paper, we propose novel methods of quantifying expert opinion about prior distributions for multinomial models. Two different multivariate priors are elicited using median and quartile assessments of the multinomial probabilities. First, we start by eliciting a univariate beta distribution for the probability of each category. Then we elicit the hyperparameters of the Dirichlet distribution, as a tractable conjugate prior, from those of the univariate betas through various forms of reconciliation using least-squares techniques. However, a multivariate copula function will give a more flexible correlation structure between multinomial parameters if it is used as their multivariate prior distribution. So, second, we use beta marginal distributions to construct a Gaussian copula as a multivariate normal distribution function that binds these marginals and expresses the dependence structure between them. The proposed method elicits a positive-definite correlation matrix of this Gaussian copula. The two proposed methods are designed to be used through interactive graphical software written in Java.     

Copula, marginal distributions and model selection: a Bayesian note

Copula functions and marginal distributions are combined to produce multivariate distributions. We show advantages of estimating all parameters of these models using the Bayesian approach, which can be done with standard Markov chain Monte Carlo algorithms. Deviance-based model selection criteria are also discussed when applied to copula models since they are invariant under monotone increasing transformations of the marginals. We focus on the deviance information criterion. The joint estimation takes into account all dependence structure of the parameters’ posterior distributions in our chosen model selection criteria. Two Monte Carlo studies are conducted to show that model identification improves when the model parameters are jointly estimated. We study the Bayesian estimation of all unknown quantities at once considering bivariate copula functions and three known marginal distributions.     

Tail-weighted measures of dependence

Multivariate copula models are commonly used in place of Gaussian dependence models when plots of the data suggest tail dependence and tail asymmetry. In these cases, it is useful to have simple statistics to summarize the strength of dependence in different joint tails. Measures of monotone association such as Kendall's tau and Spearman's rho are insufficient to distinguish commonly used parametric bivariate families with different tail properties. We propose lower and upper tail-weighted bivariate measures of dependence as additional scalar measures to distinguish bivariate copulas with roughly the same overall monotone dependence. These measures allow the efficient estimation of strength of dependence in the joint tails and can be used as a guide for selection of bivariate linking copulas in vine and factor models as well as for assessing the adequacy of fit of multivariate copula models. We apply the tail-weighted measures of dependence to a financial data set and show that the measures better discriminate models with different tail properties compared to commonly used risk measures – the portfolio value-at-risk and conditional tail expectation.     

The copula directional dependence by stochastic volatility models

This paper proposes a copula directional dependence by using a bivariate Gaussian copula beta regression with Stochastic Volatility (SV) models for marginal distributions. With the asymmetric copula generated by the composition of two Plackett copulas, we show that our SV copula directional dependence by the Gaussian copula beta regression model is superior to the Kim and Hwang (2016) copula directional dependence by an asymmetric GARCH model in terms of the percent relative efficiency of bias and mean squared error. To validate our proposed method with the real data, we use Brent Crude Daily Price (BRENT), West Texas Intermediate Daily Price (WTI), the Standard & Poor’s 500 (SP) and US 10-Year Treasury Constant Maturity Rate (TCM) so that our copula SV directional dependence is overall superior to the Kim and Hwang (2016) copula directional dependence by an asymmetric GARCH model in terms of precision by the percent relative efficiency of mean squared error. In terms of forecasting using the real financial data, we also show that the Bayesian SV model of the uniform transformed data by a copula conditional distribution yields an improvement on the volatility models such as GARCH and SV.     

Maximum likelihood estimation for bivariate SUR Tobit modeling in presence of two right-censored dependent variables

This article extends the analysis of the Seemingly Unrelated Regression (SUR) Tobit model for two right-censored dependent variables by modeling its nonlinear dependence structure through the rotated by 180 degrees version of the Clayton copula. An advantage of our approach is to provide unbiased point estimates of the marginal and copula parameters. Moreover, we discuss the construction of confidence intervals using bootstrap resampling procedures. The results of the performed simulation study demonstrate the good performance of the proposed methods. We illustrate our procedures using bivariate customer churn data from a Brazilian commercial bank.     

Nonparametric Tail Copula Estimation: An Application to Stock and Volatility Index Returns

In this study, we measure asymmetric negative tail dependence and discuss their statistical properties. In a simulation study, we show the reliability of nonparametric estimators of tail copula to measure not only the common positive lower and upper tail dependence, but also the negative “lower–upper” and “upper–lower” tail dependence. The use of this new framework is illustrated in an application to financial data. We detect the existence of asymmetric negative tail dependence between stock and volatility indices. Many common parametric copula models used in finance fail to capture this characteristic.     

Inference for Bivariate Survival Data by Copula Models Adjusted for the Boundary Effect

Copula models describe the dependence structure of two random variables separately from their marginal distributions and hence are particularly useful in studying the association for bivariate survival data. Semiparametric inference for bivariate survival data based on copula models has been studied for various types of data, including complete data, right-censored data, and current status data. This article discusses the boundary effect on these inference procedures, a problem that has been neglected in the previous literature. Specifically, asymptotic distribution of the association estimator on the boundary of parameter space is derived for one-dimensional copula models. The boundary properties are applied to test independence and to study the estimation efficiency. Simulation study is conducted for the bivariate right-censored data and current status data.     

Bivariate Tail Dependence and the Generation of Multivariate Extreme Value Distributions

We define, in a probabilistic way, a parametric family of multivariate extreme value distributions. We derive its copula, which is a mixture of several complete dependent copulas and total independent copulas, and the bivariate tail dependence and extremal coefficients. Based on the obtained results for these coefficients, we propose a method to build multivariate extreme value distributions with prescribed tail/extremal coefficients. We illustrate the results with examples.     

Bivariate Kumaraswamy distribution: properties and a new method to generate bivariate classes

In this paper, we introduce a bivariate Kumaraswamy (BVK) distribution whose marginals are Kumaraswamy distributions. The cumulative distribution function of this bivariate model has absolutely continuous and singular parts. Representations for the cumulative and density functions are presented and properties such as marginal and conditional distributions, product moments and conditional moments are obtained. We show that the BVK model can be obtained from the Marshall and Olkin survival copula and obtain a tail dependence measure. The estimation of the parameters by maximum likelihood is discussed and the Fisher information matrix is determined. We propose an EM algorithm to estimate the parameters. Some simulations are presented to verify the performance of the direct maximum-likelihood estimation and the proposed EM algorithm. We also present a method to generate bivariate distributions from our proposed BVK distribution. Furthermore, we introduce a BVK distribution which has only an absolutely continuous part and discuss some of its properties. Finally, a real data set is analysed for illustrative purposes.     

Statistical Modeling of Temporal Dependence in Financial Data via a Copula Function

In financial analysis it is useful to study the dependence between two or more time series as well as the temporal dependence in a univariate time series. This article is concerned with the statistical modeling of the dependence structure in a univariate financial time series using the concept of copula. We treat the series of financial returns as a first order Markov process. The Archimedean two-parameter BB7 copula is adopted to describe the underlying dependence structure between two consecutive returns, while the log-Dagum distribution is employed to model the margins marked by skewness and kurtosis. A simulation study is carried out to evaluate the performance of the maximum likelihood estimates. Furthermore, we apply the model to the daily returns of four stocks and, finally, we illustrate how its fitting to data can be improved when the dependence between consecutive returns is described through a copula function.     

A bivariate regression model with cure fraction

The use of bivariate distributions plays a fundamental role in survival and reliability studies. In this paper, we introduce a location-scale model for bivariate survival times based on the copula to model the dependence of bivariate survival data with cure fraction. We create the correlation structure between the failure times using the Clayton family of copulas, which is assumed to have any distribution. It turns out that the model becomes very flexible with respect to the choice of the marginal distributions. For the proposed model, we consider inferential procedures based on constrained parameters under maximum likelihood. We derive the appropriate matrices for assessing local influence under different perturbation schemes and present some ways to perform global influence analysis. The relevance of the approach is illustrated using a real data set and a diagnostic analysis is performed to select an appropriate model.