Modeling with a large class of unimodal multivariate distributions

In this paper we introduce a new class of multivariate unimodal distributions, motivated by Khintchine's representation for unimodal densities on the real line. We start by introducing a new class of unimodal distributions which can then be naturally extended to higher dimensions, using the multivariate Gaussian copula. Under both univariate and multivariate settings, we provide MCMC algorithms to perform inference about the model parameters and predictive densities. The methodology is illustrated with univariate and bivariate examples, and with variables taken from a real data set.     

Simultaneous inference in structured additive conditional copula regression models: a unifying Bayesian approach

While most regression models focus on explaining distributional aspects of one single response variable alone, interest in modern statistical applications has recently shifted towards simultaneously studying multiple response variables as well as their dependence structure. A particularly useful tool for pursuing such an analysis are copula-based regression models since they enable the separation of the marginal response distributions and the dependence structure summarised in a specific copula model. However, so far copula-based regression models have mostly been relying on two-step approaches where the marginal distributions are determined first whereas the copula structure is studied in a second step after plugging in the estimated marginal distributions. Moreover, the parameters of the copula are mostly treated as a constant not related to covariates and most regression specifications for the marginals are restricted to purely linear predictors. We therefore propose simultaneous Bayesian inference for both the marginal distributions and the copula using computationally efficient Markov chain Monte Carlo simulation techniques. In addition, we replace the commonly used linear predictor by a generic structured additive predictor comprising for example nonlinear effects of continuous covariates, spatial effects or random effects and furthermore allow to make the copula parameters covariate-dependent. To facilitate Bayesian inference, we construct proposal densities for a Metropolis–Hastings algorithm relying on quadratic approximations to the full conditionals of regression coefficients avoiding manual tuning. The performance of the resulting Bayesian estimates is evaluated in simulations comparing our approach with penalised likelihood inference, studying the choice of a specific copula model based on the deviance information criterion, and comparing a simultaneous approach with a two-step procedure. Furthermore, the flexibility of Bayesian conditional copula regression models is illustrated in two applications on childhood undernutrition and macroecology.     

Root n consistent and optimal density estimators for moving average processes

Abstract.  The marginal density of a first order moving average process can be written as a convolution of two innovation densities. Saavedra & Cao [Can. J. Statist. (2000), 28, 799] propose to estimate the marginal density by plugging in kernel density estimators for the innovation densities, based on estimated innovations. They obtain that for an appropriate choice of bandwidth the variance of their estimator decreases at the rate 1/ n . Their estimator can be interpreted as a specific U -statistic. We suggest a slightly simplified U -statistic as estimator of the marginal density, prove that it is asymptotically normal at the same rate, and describe the asymptotic variance explicitly. We show that the estimator is asymptotically efficient if no structural assumptions are made on the innovation density. For innovation densities known to have mean zero or to be symmetric, we describe improvements of our estimator which are again asymptotically efficient.     

Semiparametric Estimation in Copulas with the Same Marginals

We consider semiparametric multivariate data models based on copula representation of the common distribution function. A copula is characterized by a parameter of association and marginal distribution functions. This parameter and the marginal distributions are unknown. In this article, we study the estimator of the parameter of association in copulas with the marginal distribution functions assumed as nuisance parameters restricted by the assumption that the components are identically distributed. Results of this work could be used to construct special kinds of tests of homogeneity for random vectors having dependent components.     

A self-consistent estimator of marginal survival functions based on dependent competing risk data and an assumed copula

When the time to death, X, and the time to censoring, Y, are associated some additional information is need to identify the marginal survival functions. A natural function which provides this additional information is the copula of X and Y. Assuming that the copula is known, we use the notion of self consistency to construct an estimator of the marginal survival functions based on dependent competing risk data. Results of a small simulation study are shown to compare this estimator to other estimators of the marginal survival function based on an assumed copula.     

Discretizing a compound distribution with application to categorical modelling

Many probability distributions can be represented as compound distributions. Consider some parameter vector as random. The compound distribution is the expected distribution of the variable of interest given the random parameters. Our idea is to define a partition of the domain of definition of the random parameters, so that we can represent the expected density of the variable of interest as a finite mixture of conditional densities. We then model the mixture probabilities of the conditional densities using information on population categories, thus modifying the original overall model. We thus obtain specific models for sub-populations that stem from the overall model. The distribution of a sub-population of interest is thus completely specified in terms of mixing probabilities. All characteristics of interest can be derived from this distribution and the comparison between sub-populations easily proceeds from the comparison of the mixing probabilities. A real example based on EU-SILC data is given. Then the methodology is investigated through simulation.     

Nonparametric estimation of copula functions for dependence modelling

Copulas characterize the dependence among components of random vectors. Unlike marginal and joint distributions, which are directly observable, the copula of a random vector is a hidden dependence structure that links the joint distribution with its margins. Choosing a parametric copula model is thus a nontrivial task but it can be facilitated by relying on a nonparametric estimator. Here the authors propose a kernel estimator of the copula that is mean square consistent everywhere on the support. They determine the bias and variance of this estimator. They also study the effects of kernel smoothing on copula estimation. They then propose a smoothing bandwidth selection rule based on the derived bias and variance. After confirming their theoretical findings through simulations, they use their kernel estimator to formulate a goodness-of-fit test for parametric copula models.     

Copula, marginal distributions and model selection: a Bayesian note

Copula functions and marginal distributions are combined to produce multivariate distributions. We show advantages of estimating all parameters of these models using the Bayesian approach, which can be done with standard Markov chain Monte Carlo algorithms. Deviance-based model selection criteria are also discussed when applied to copula models since they are invariant under monotone increasing transformations of the marginals. We focus on the deviance information criterion. The joint estimation takes into account all dependence structure of the parameters’ posterior distributions in our chosen model selection criteria. Two Monte Carlo studies are conducted to show that model identification improves when the model parameters are jointly estimated. We study the Bayesian estimation of all unknown quantities at once considering bivariate copula functions and three known marginal distributions.     

On the effect of long-range dependence on extreme value copula estimation with fixed marginals

ABSTRACT

We establish the existence of multivariate stationary processes with arbitrary marginal copula distributions and long-range dependence. The effect of long-range dependence on extreme value copula estimation is illustrated in the case of known marginals, by deriving functional limit theorems for a standard non parametric estimator of the Pickands dependence function and related parametric projection estimators. The asymptotic properties turn out to be very different from the case of iid or short-range dependent observations. Simulated and real data examples illustrate the results.     

Smooth Tests of Copula Specifications

We present a family of smooth tests for the goodness of fit of semiparametric multivariate copula models. The proposed tests are distribution free and can be easily implemented. They are diagnostic and constructive in the sense that when a null distribution is rejected, the test provides useful pointers to alternative copula distributions. We then propose a method of copula density construction, which can be viewed as a multivariate extension of Efron and Tibshirani. We further generalize our methods to the semiparametric copula-based multivariate dynamic models. We report extensive Monte Carlo simulations and three empirical examples to illustrate the effectiveness and usefulness of our method.     

Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence

Most existing reduced-form macroeconomic multivariate time series models employ elliptical disturbances, so that the forecast densities produced are symmetric. In this article, we use a copula model with asymmetric margins to produce forecast densities with the scope for severe departures from symmetry. Empirical and skew t distributions are employed for the margins, and a high-dimensional Gaussian copula is used to jointly capture cross-sectional and (multivariate) serial dependence. The copula parameter matrix is given by the correlation matrix of a latent stationary and Markov vector autoregression (VAR). We show that the likelihood can be evaluated efficiently using the unique partial correlations, and estimate the copula using Bayesian methods. We examine the forecasting performance of the model for four U.S. macroeconomic variables between 1975:Q1 and 2011:Q2 using quarterly real-time data. We find that the point and density forecasts from the copula model are competitive with those from a Bayesian VAR. During the recent recession the forecast densities exhibit substantial asymmetry, avoiding some of the pitfalls of the symmetric forecast densities from the Bayesian VAR. We show that the asymmetries in the predictive distributions of GDP growth and inflation are similar to those found in the probabilistic forecasts from the Survey of Professional Forecasters. Last, we find that unlike the linear VAR model, our fitted Gaussian copula models exhibit nonlinear dependencies between some macroeconomic variables. This article has online supplementary material.     

Copula-Based Models for the Power of Independence Tests

ABSTRACT

We consider independence tests and the methods to evaluate their efficiency. First, we observe that many of the most used independence tests are functions of the empirical copula, which is a sufficient statistic. Hence, the power of these tests, such as the tests based on Spearman's ρ, on Kendall's τ, and on Gini's γ, depend solely on the theoretical copula, and not on the marginal distributions. Then, we consider monotone dependence tests and we propose a parametric model to define the power function. Such a model is based on a path of copulas, from the copula of discordance to the copula of concordance, and can be characterized by the copula of the underlying joint distribution. Moreover, we introduce a consistent estimator of the path of copulas. Finally, we provide some examples of applications, and in particular, a bootstrap-plug-in estimator of the power curve, all useful for power comparison.     

Bayesian bivariate survival analysis using the power variance function copula

Copula models have become increasingly popular for modelling the dependence structure in multivariate survival data. The two-parameter Archimedean family of Power Variance Function (PVF) copulas includes the Clayton, Positive Stable (Gumbel) and Inverse Gaussian copulas as special or limiting cases, thus offers a unified approach to fitting these important copulas. Two-stage frequentist procedures for estimating the marginal distributions and the PVF copula have been suggested by Andersen (Lifetime Data Anal 11:333–350, 2005), Massonnet et al. (J Stat Plann Inference 139(11):3865–3877, 2009) and Prenen et al. (J R Stat Soc Ser B 79(2):483–505, 2017) which first estimate the marginal distributions and conditional on these in a second step to estimate the PVF copula parameters. Here we explore an one-stage Bayesian approach that simultaneously estimates the marginal and the PVF copula parameters. For the marginal distributions, we consider both parametric as well as semiparametric models. We propose a new method to simulate uniform pairs with PVF dependence structure based on conditional sampling for copulas and on numerical approximation to solve a target equation. In a simulation study, small sample properties of the Bayesian estimators are explored. We illustrate the usefulness of the methodology using data on times to appendectomy for adult twins in the Australian NH&MRC Twin registry. Parameters of the marginal distributions and the PVF copula are simultaneously estimated in a parametric as well as a semiparametric approach where the marginal distributions are modelled using Weibull and piecewise exponential distributions, respectively.     

Semiparametric estimation in copula models

The author recalls the limiting behaviour of the empirical copula process and applies it to prove some asymptotic properties of a minimum distance estimator for a Euclidean parameter in a copula model. The estimator in question is semiparametric in that no knowledge of the marginal distributions is necessary. The author also proposes another semiparametric estimator which he calls “rank approximate Z‐estimator” and whose asymptotic normality he derives. He further presents Monte Carlo simulation results for the comparison of various estimators in four well‐known bivariate copula models.     

Bivariate Kumaraswamy distribution: properties and a new method to generate bivariate classes

In this paper, we introduce a bivariate Kumaraswamy (BVK) distribution whose marginals are Kumaraswamy distributions. The cumulative distribution function of this bivariate model has absolutely continuous and singular parts. Representations for the cumulative and density functions are presented and properties such as marginal and conditional distributions, product moments and conditional moments are obtained. We show that the BVK model can be obtained from the Marshall and Olkin survival copula and obtain a tail dependence measure. The estimation of the parameters by maximum likelihood is discussed and the Fisher information matrix is determined. We propose an EM algorithm to estimate the parameters. Some simulations are presented to verify the performance of the direct maximum-likelihood estimation and the proposed EM algorithm. We also present a method to generate bivariate distributions from our proposed BVK distribution. Furthermore, we introduce a BVK distribution which has only an absolutely continuous part and discuss some of its properties. Finally, a real data set is analysed for illustrative purposes.     

A class of weighted normal distributions and its variants useful for inequality constrained analysis

This article develops a class of the weighted normal distributions for which the probability density function has the form of a product of a normal density and a weight function. The class constitutes marginal distributions obtained from various kinds of doubly truncated bivariate normal distributions. This class of distributions strictly includes the normal, skew–normal and two-piece skew–normal and is useful for selection modelling and inequality constrained normal mean analysis. Some distributional properties and Bayesian perspectives of the class are given. Probabilistic representation of the distributions is also given. The representation is shown to be straightforward to specify distribution and to implement computation, with output readily adapted for required analysis. Necessary theories and illustrative examples are provided.     

Large sample properties of nonparametric copula estimators under bivariate censoring

A new nonparametric estimator is proposed for the copula function of a bivariate survival function for data subject to random right-censoring. We consider two censoring models: univariate and copula censoring. We show strong consistency and we obtain an i.i.d. representation for the copula estimator. In a simulation study we compare the new estimator to the one of Gribkova and Lopez [Nonparametric copula estimation under bivariate censoring; doi:10.1111/sjos.12144].     

Patched approximations and their convergence

Abstract

Patched approximations of copulas unify ordinal sums, shuffles of Min, checkerboard, and checkmin approximations. We give a characterization of patched approximations and an error bound of the approximations in Sobolev norm. Patched approximations with uniform marginal conditional distributions are shown to arise naturally. We prove that these uniform patched approximations converge uniformly and in the Sobolev norm. The latter convergence is settled by showing the convergence almost everywhere of the first partial derivatives. We also show that the independence copula can be approximated by conditional mutual complete copulas in the Sobolev norm.     

Copula directed acyclic graphs

A new methodology for selecting a Bayesian network for continuous data outside the widely used class of multivariate normal distributions is developed. The ‘copula DAGs’ combine directed acyclic graphs and their associated probability models with copula C/D-vines. Bivariate copula densities introduce flexibility in the joint distributions of pairs of nodes in the network. An information criterion is studied for graph selection tailored to the joint modeling of data based on graphs and copulas. Examples and simulation studies show the flexibility and properties of the method.     

Non-parametric estimation of copula based mutual information

Abstract

Mutual information is a measure for investigating the dependence between two random variables. The copula based estimation of mutual information reduces the complexity because it is depend only on the copula density. We propose two estimators and discuss the asymptotic properties. To compare the performance of the estimators a simulation study is carried out. The methods are illustrated using real data sets.