Gaussian copula distributions for mixed data,with application in discrimination

The construction of a joint model for mixed discrete and continuous random variables that accounts for their associations is an important statistical problem in many practical applications. In this paper, we use copulas to construct a class of joint distributions of mixed discrete and continuous random variables. In particular, we employ the Gaussian copula to generate joint distributions for mixed variables. Examples include the robit-normal and probit-normal-exponential distributions, the first for modelling the distribution of mixed binary-continuous data and the second for a mixture of continuous, binary and trichotomous variables. The new class of joint distributions is general enough to include many mixed-data models currently available. We study properties of the distributions and outline likelihood estimation; a small simulation study is used to investigate the finite-sample properties of estimates obtained by full and pairwise likelihood methods. Finally, we present an application to discriminant analysis of multiple correlated binary and continuous data from a study involving advanced breast cancer patients.     

CONDITIONAL EXPECTATION FORMULAE FOR COPULAS

Not only are copula functions joint distribution functions in their own right, they also provide a link between multivariate distributions and their lower‐dimensional marginal distributions. Copulas have a structure that allows us to characterize all possible multivariate distributions, and therefore they have the potential to be a very useful statistical tool. Although copulas can be traced back to 1959, there is still much scope for new results, as most of the early work was theoretical rather than practical. We focus on simple practical tools based on conditional expectation, because such tools are not widely available. When dealing with data sets in which the dependence throughout the sample is variable, we suggest that copula‐based regression curves may be more accurate predictors of specific outcomes than linear models. We derive simple conditional expectation formulae in terms of copulas and apply them to a combination of simulated and real data.     

Do stock returns have an Archimedean copula?

The flexible class of Archimedean copulas plays an important role in multivariate statistics. While there is a large number of goodness-of-fit tests for copulas and parametric families of copulas, the question if a given data set belongs to an arbitrary Archimedean copula or not has not yet received much attention in the literature. This paper suggests a new, straightforward method to test whether a copula is an Archimedean copula without the need to specify its parametric family. We conduct Monte Carlo simulations to assess the power of the test. The approach is applied to (bivariate) joint distributions of stock asset returns. We find that, in general, stock returns may have Archimedean copulas.     

Joint modelling of longitudinal biomarker and gap time between recurrent events: copula-based dependence

In this paper, we will extend the joint model of longitudinal biomarker and recurrent event via copula function for accounting the dependence between the two processes. The general idea of joining separate processes by allowing model-specific random effect may come from different families distribution. It is a main advantage of the proposed method that a copula construction does not constrain the choice of marginal distributions of random effects. A maximum likelihood estimation with importance sampling technique as a simple and easy understanding method is employed to model inference. To evaluate and verify the validation of the proposed joint model, a bootstrapping method as a model-based resampling is developed. Our proposed joint model is also applied to pemphigus disease data for assessing the effect of biomarker trajectory on risk of recurrence.     

Simultaneous inference in structured additive conditional copula regression models: a unifying Bayesian approach

While most regression models focus on explaining distributional aspects of one single response variable alone, interest in modern statistical applications has recently shifted towards simultaneously studying multiple response variables as well as their dependence structure. A particularly useful tool for pursuing such an analysis are copula-based regression models since they enable the separation of the marginal response distributions and the dependence structure summarised in a specific copula model. However, so far copula-based regression models have mostly been relying on two-step approaches where the marginal distributions are determined first whereas the copula structure is studied in a second step after plugging in the estimated marginal distributions. Moreover, the parameters of the copula are mostly treated as a constant not related to covariates and most regression specifications for the marginals are restricted to purely linear predictors. We therefore propose simultaneous Bayesian inference for both the marginal distributions and the copula using computationally efficient Markov chain Monte Carlo simulation techniques. In addition, we replace the commonly used linear predictor by a generic structured additive predictor comprising for example nonlinear effects of continuous covariates, spatial effects or random effects and furthermore allow to make the copula parameters covariate-dependent. To facilitate Bayesian inference, we construct proposal densities for a Metropolis–Hastings algorithm relying on quadratic approximations to the full conditionals of regression coefficients avoiding manual tuning. The performance of the resulting Bayesian estimates is evaluated in simulations comparing our approach with penalised likelihood inference, studying the choice of a specific copula model based on the deviance information criterion, and comparing a simultaneous approach with a two-step procedure. Furthermore, the flexibility of Bayesian conditional copula regression models is illustrated in two applications on childhood undernutrition and macroecology.     

Nonparametric estimation of copula functions for dependence modelling

Copulas characterize the dependence among components of random vectors. Unlike marginal and joint distributions, which are directly observable, the copula of a random vector is a hidden dependence structure that links the joint distribution with its margins. Choosing a parametric copula model is thus a nontrivial task but it can be facilitated by relying on a nonparametric estimator. Here the authors propose a kernel estimator of the copula that is mean square consistent everywhere on the support. They determine the bias and variance of this estimator. They also study the effects of kernel smoothing on copula estimation. They then propose a smoothing bandwidth selection rule based on the derived bias and variance. After confirming their theoretical findings through simulations, they use their kernel estimator to formulate a goodness-of-fit test for parametric copula models.     

Vine copula models with GLM and sparsity

Vine copula provides a flexible tool to capture asymmetry in modeling multivariate distributions. Nevertheless, its flexibility is achieved at the expense of exponentially increasing complexity of the model. To alleviate this issue, the simplifying assumption (SA) is commonly adapted in specific applications of vine copula models. In this paper, generalized linear models (GLMs) are proposed for the parameters in conditional bivariate copulas to relax the SA. In the spirit of the principle of parsimony, a regularization methodology is developed to control the number of parameters, leading to sparse vine copula models. The conventional vine copula with the SA, the proposed GLM-based vine copula, and the sparse vine copula are applied to several financial datasets, and the results show that our proposed models outperform the one with SA significantly in terms of the Bayesian information criterion.     

Non‐parametric Copula Estimation Under Bivariate Censoring

In this paper, we consider non‐parametric copula inference under bivariate censoring. Based on an estimator of the joint cumulative distribution function, we define a discrete and two smooth estimators of the copula. The construction that we propose is valid for a large range of estimators of the distribution function and therefore for a large range of bivariate censoring frameworks. Under some conditions on the tails of the distributions, the weak convergence of the corresponding copula processes is obtained in l^∞([0,1]²). We derive the uniform convergence rates of the copula density estimators deduced from our smooth copula estimators. Investigation of the practical behaviour of these estimators is performed through a simulation study and two real data applications, corresponding to different censoring settings. We use our non‐parametric estimators to define a goodness‐of‐fit procedure for parametric copula models. A new bootstrap scheme is proposed to compute the critical values.     

Bivariate degradation modelling with marginal heterogeneous stochastic processes

In this paper, we consider that the degradation of two performance characteristics of a product can be modelled by stochastic processes and jointly by copula functions, but different stochastic processes govern the behaviour of each performance characteristic (PC) degradation. Different heterogeneous and homogeneous models are presented considering copula functions and different combinations of the most used stochastic processes in degradation analysis as marginal distributions. This is an important aspect to consider because the behaviour of the degradation of each PC may be different in its nature. As the joint distributions of the proposed models result in complex distributions, the estimation of the parameters of interest is performed via MCMC. A simulation study is performed to compare heterogeneous and homogeneous models. In addition, the proposed models are implemented to crack propagation data of two terminals of an electronic device, and some insights are provided about the product reliability under heterogeneous models.     

Mutual information as a measure of multivariate association: analytical properties and statistical estimation

Mutual information (also known as Kullback–Leibler divergence) can be viewed as a measure of multivariate association in a random vector. The definition incorporates the joint density as well as the marginal densities. We will focus on a representation of mutual information in terms of copula densities that is thus independent of the marginal distributions. This representation yields a different approach to estimating mutual information than the original definition does, as only the copula density has to be estimated. We review analytical properties and examples for selected distributions and discuss methods of nonparametric estimation of copula densities and hence of the mutual information from a sample. Based on a simulation study, we compare the performance of these estimators with respect to bias, standard deviation, and the root mean squared error. The Gauss and the Frank copula are considered as examples.     

A bivariate geometric distribution allowing for positive or negative correlation

In this paper, we propose a new bivariate geometric model, derived by linking two univariate geometric distributions through a specific copula function, allowing for positive and negative correlations. Some properties of this joint distribution are presented and discussed, with particular reference to attainable correlations, conditional distributions, reliability concepts, and parameter estimation. A Monte Carlo simulation study empirically evaluates and compares the performance of the proposed estimators in terms of bias and standard error. Finally, in order to demonstrate its usefulness, the model is applied to a real data set.     

Absolute continuous bivariate generalized exponential distribution

Generalized exponential distribution has been used quite effectively to model positively skewed lifetime data as an alternative to the well known Weibull or gamma distributions. In this paper we introduce an absolute continuous bivariate generalized exponential distribution by using a simple transformation from a well known bivariate exchangeable distribution. The marginal distributions of the proposed bivariate generalized exponential distributions are generalized exponential distributions. The joint probability density function and the joint cumulative distribution function can be expressed in closed forms. It is observed that the proposed bivariate distribution can be obtained using Clayton copula with generalized exponential distribution as marginals. We derive different properties of this new distribution. It is a five-parameter distribution, and the maximum likelihood estimators of the unknown parameters cannot be obtained in closed forms. We propose some alternative estimators, which can be obtained quite easily, and they can be used as initial guesses to compute the maximum likelihood estimates. One data set has been analyzed for illustrative purposes. Finally we propose some generalization of the proposed model.     

Copula, marginal distributions and model selection: a Bayesian note

Copula functions and marginal distributions are combined to produce multivariate distributions. We show advantages of estimating all parameters of these models using the Bayesian approach, which can be done with standard Markov chain Monte Carlo algorithms. Deviance-based model selection criteria are also discussed when applied to copula models since they are invariant under monotone increasing transformations of the marginals. We focus on the deviance information criterion. The joint estimation takes into account all dependence structure of the parameters’ posterior distributions in our chosen model selection criteria. Two Monte Carlo studies are conducted to show that model identification improves when the model parameters are jointly estimated. We study the Bayesian estimation of all unknown quantities at once considering bivariate copula functions and three known marginal distributions.     

Copula-Based Models for the Power of Independence Tests

ABSTRACT

We consider independence tests and the methods to evaluate their efficiency. First, we observe that many of the most used independence tests are functions of the empirical copula, which is a sufficient statistic. Hence, the power of these tests, such as the tests based on Spearman's ρ, on Kendall's τ, and on Gini's γ, depend solely on the theoretical copula, and not on the marginal distributions. Then, we consider monotone dependence tests and we propose a parametric model to define the power function. Such a model is based on a path of copulas, from the copula of discordance to the copula of concordance, and can be characterized by the copula of the underlying joint distribution. Moreover, we introduce a consistent estimator of the path of copulas. Finally, we provide some examples of applications, and in particular, a bootstrap-plug-in estimator of the power curve, all useful for power comparison.     

On the Correlation Structure of Gaussian Copula Models for Geostatistical Count Data

We describe a class of random field models for geostatistical count data based on Gaussian copulas. Unlike hierarchical Poisson models often used to describe this type of data, Gaussian copula models allow a more direct modelling of the marginal distributions and association structure of the count data. We study in detail the correlation structure of these random fields when the family of marginal distributions is either negative binomial or zero‐inflated Poisson; these represent two types of overdispersion often encountered in geostatistical count data. We also contrast the correlation structure of one of these Gaussian copula models with that of a hierarchical Poisson model having the same family of marginal distributions, and show that the former is more flexible than the latter in terms of range of feasible correlation, sensitivity to the mean function and modelling of isotropy. An exploratory analysis of a dataset of Japanese beetle larvae counts illustrate some of the findings. All of these investigations show that Gaussian copula models are useful alternatives to hierarchical Poisson models, specially for geostatistical count data that display substantial correlation and small overdispersion.     

Joint response graphs and separation induced by triangular systems

Summary.  We consider joint probability distributions generated recursively in terms of univariate conditional distributions satisfying conditional independence restrictions. The independences are captured by missing edges in a directed graph. A matrix form of such a graph, called the generating edge matrix, is triangular so the distributions that are generated over such graphs are called triangular systems. We study consequences of triangular systems after grouping or reordering of the variables for analyses as chain graph models, i.e. for alternative recursive factorizations of the given density using joint conditional distributions. For this we introduce families of linear triangular equations which do not require assumptions of distributional form. The strength of the associations that are implied by such linear families for chain graph models is derived. The edge matrices of chain graphs that are implied by any triangular system are obtained by appropriately transforming the generating edge matrix. It is shown how induced independences and dependences can be studied by graphs, by edge matrix calculations and via the properties of densities. Some ways of using the results are illustrated.     

The copula directional dependence by stochastic volatility models

This paper proposes a copula directional dependence by using a bivariate Gaussian copula beta regression with Stochastic Volatility (SV) models for marginal distributions. With the asymmetric copula generated by the composition of two Plackett copulas, we show that our SV copula directional dependence by the Gaussian copula beta regression model is superior to the Kim and Hwang (2016) copula directional dependence by an asymmetric GARCH model in terms of the percent relative efficiency of bias and mean squared error. To validate our proposed method with the real data, we use Brent Crude Daily Price (BRENT), West Texas Intermediate Daily Price (WTI), the Standard & Poor’s 500 (SP) and US 10-Year Treasury Constant Maturity Rate (TCM) so that our copula SV directional dependence is overall superior to the Kim and Hwang (2016) copula directional dependence by an asymmetric GARCH model in terms of precision by the percent relative efficiency of mean squared error. In terms of forecasting using the real financial data, we also show that the Bayesian SV model of the uniform transformed data by a copula conditional distribution yields an improvement on the volatility models such as GARCH and SV.     

Frailty models and copulas: similarities and differences

Copulas and frailty models are important tools to model bivariate survival data. Equivalence between Archimedean copula models and shared frailty models, e.g. between the Clayton-Oakes copula model and the shared gamma frailty model, has often been claimed in the literature. In this note we show that, in both the models, there is indeed a well-known equivalence between the copula functions; the modeling of the marginal survival functions, however, is quite different. The latter fact leads to different joint survival functions.     

Mixtures of Gaussian copula factor analyzers for clustering high dimensional data

Mixtures of factor analyzers is a useful model-based clustering method which can avoid the curse of dimensionality in high-dimensional clustering. However, this approach is sensitive to both diverse non-normalities of marginal variables and outliers, which are commonly observed in multivariate experiments. We propose mixtures of Gaussian copula factor analyzers (MGCFA) for clustering high-dimensional clustering. This model has two advantages; (1) it allows different marginal distributions to facilitate fitting flexibility of the mixture model, (2) it can avoid the curse of dimensionality by embedding the factor-analytic structure in the component-correlation matrices of the mixture distribution.An EM algorithm is developed for the fitting of MGCFA. The proposed method is free of the curse of dimensionality and allows any parametric marginal distribution which fits best to the data. It is applied to both synthetic data and a microarray gene expression data for clustering and shows its better performance over several existing methods.