Dependence function for continuous bivariate densities

The notion of cross-product ratio for discrete two-way contingency table is extended to the case of continuous bivariate densities. This results in the “local dependence function” that measues the margin-free dependence between bivariate random variables. Properties and examples of the dependence function are discussed. The bivariate normal density plays a special role since it has constant dependence. Continuous bivariate densities can be constructed by specifying the dependence function along with two marginals in analogy to the construction of two-way contingency tables given marginals and patterns of interaction. The dependence function provides a partial ordering on bivariate dependence.     

Independence in Contingency Tables Using Simplicial Geometry

Frequently, contingency tables are generated in a multinomial sampling. Multinomial probabilities are then organized in a table assigning probabilities to each cell. A probability table can be viewed as an element in the simplex. The Aitchison geometry of the simplex identifies independent probability tables as a linear subspace. An important consequence is that, given a probability table, the nearest independent table is obtained by orthogonal projection onto the independent subspace. The nearest independent table is identified as that obtained by the product of geometric marginals, which do not coincide with the standard marginals, except in the independent case. The original probability table is decomposed into orthogonal tables, the independent and the interaction tables. The underlying model is log-linear, and a procedure to test independence of a contingency table, based on a multinomial simulation, is developed. Its performance is studied on an illustrative example.     

A Convergent Iterative Procedure for Constructing Bivariate Distributions

For many years there has been interest in families of bivariate distributions with the marginals as parameters. Questions of this kind arise if one is to build a stochastic model in a situation where one has some idea about the dependence structure and marginal distributions. In this article, among all bivariate distributions which satisfy the constraints imposed by the known marginals and/or dependence structure, one that has the maximum entropy is obtained by using iterative procedure, and its convergence is proved.     

Mixed Marginal Copula Modeling

ABSTRACT

This article extends the literature on copulas with discrete or continuous marginals to the case where some of the marginals are a mixture of discrete and continuous components. We do so by carefully defining the likelihood as the density of the observations with respect to a mixed measure. The treatment is quite general, although we focus on mixtures of Gaussian and Archimedean copulas. The inference is Bayesian with the estimation carried out by Markov chain Monte Carlo. We illustrate the methodology and algorithms by applying them to estimate a multivariate income dynamics model. Supplementary materials for this article are available online.     

On a class of bivariate mixed Sarmanov distributions

Multivariate distributions are more and more used to model the dependence encountered in many fields. However, classical multivariate distributions can be restrictive by their nature, while Sarmanov's multivariate distribution, by joining different marginals in a flexible and tractable dependence structure, often provides a valuable alternative. In this paper, we introduce some bivariate mixed Sarmanov distributions with the purpose to extend the class of bivariate Sarmanov distributions and to obtain new dependency structures. Special attention is paid to the bivariate mixed Sarmanov distribution with Poisson marginals and, in particular, to the resulting bivariate Sarmanov distributions with negative binomial and with Poisson‐inverse Gaussian marginals; these particular types of mixed distributions have possible applications in, for example modelling bivariate count data. The extension to higher dimensions is also discussed. Moreover, concerning the dependency structure, we also present some correlation formulas.     

Truncation invariant dependence structures

In this paper, a special class of m-dimensional distribution functions which can be uniquely determined in terms of their 2-dimensional marginals is studied. The members of the class can be characterized as having truncation invariant dependence structure. The representation given in this paper provides a physical meaning to the multivariate Cook-Johnson distribution, and introduces a systematic way of generating higher dimensional distributions by using rich 2-dimensional distributions provided that the 2-dimensional marginals are compatible. A class of 3-dimensional multivariate normal distribution has been generated and bounds in terms of lower dimensional marginals are provided.     

Bayesian inference for contingency tables with given marginals

Summary In this paper we introduce a class of prior distributions for contingency tables with given marginals. We are interested in the structrre of concordance/discordance of such tables. There is actually a minor limitation in that the marginals are required to assume only rational values. We do argue, though, that this is not a serious drawback for all applicatory purposes. The posterior and predictive distributions given anM-sample are computed. Examples of Bayesian estimates of some classical indices of concordance are also given. Moreover, we show how to use simulation in order to overcome some difficulties which arise in the computation of the posterior distribution.     

A Decomposition of Copulas and Its Use

ABSTRACT

In this article, we create a decomposition that represents and describes the depen-dence structure between two variables. Since copulas provide a deep understanding of the dependence structure by eliminating the effects of the marginals, they play a key role in this study. We define a discretized copula density matrix and decompose it into a set of permutation matrices by using the Birkhoff–von Neumann theorem. This decomposition provides a way to effectively apply the concepts of copulas to solve problems in multivariate statistical data analysis.     

A versatile bivariate distribution on a bounded domain: another look at the product moment correlation

The Farlie-Gumbel-Morgenstern (FGM) family has been investigated in detail for various continuous marginals such as Cauchy, normal, exponential, gamma, Weibull, lognormal and others. It has been a popular model for the bivariate distribution with mild dependence. However, bivariate FGMs with continuous marginals on a bounded support discussed in the literature are only those with uniform or power marginals. In this paper we study the bivariate FGM family with marginals given by the recently proposed two-sided power (TSP) distribution. Since this family of bounded continuous distributions is very flexible, the properties of the FGM family with TSP marginals could serve as an indication of the structure of the FGM distribution with arbitrary marginals defined on a compact set. A remarkable stability of the correlation between the marginals has been observed.     

Copula Density Estimation by Total Variation Penalized Likelihood

Copulas are full measures of dependence among random variables. They are increasingly popular among academics and practitioners in financial econometrics for modeling comovements between markets, risk factors, and other relevant variables. A copula's hidden dependence structure that couples a joint distribution with its marginals makes a parametric copula non-trivial. An approach to bivariate copula density estimation is introduced that is based on a penalized likelihood with a total variation penalty term. Adaptive choice of the amount of regularization is based on approximate Bayesian Information Criterion (BIC) type scores. Performance are evaluated through the Monte Carlo simulation.     

On the effect of long-range dependence on extreme value copula estimation with fixed marginals

ABSTRACT

We establish the existence of multivariate stationary processes with arbitrary marginal copula distributions and long-range dependence. The effect of long-range dependence on extreme value copula estimation is illustrated in the case of known marginals, by deriving functional limit theorems for a standard non parametric estimator of the Pickands dependence function and related parametric projection estimators. The asymptotic properties turn out to be very different from the case of iid or short-range dependent observations. Simulated and real data examples illustrate the results.     

Tests and limits for the common odds ratio of several 2 × 2 contingency tables: methods in analogy with the Mantel-Haenszel procedure

For a postulated common odds ratio for several 2 × 2 contingency tables one may, by conditioning on the marginals of the seperate tables, determine the exact expectation and variance of the entry in a particular cell of each table, hence for the total of such cells across all tables. This makes it feasible to determine limiting values, via single-degree-of-freedom, continuity-corrected chi-square tests on the common odds ratio–one determines lower and upper limits corresponding to just barely significant chi-square values. The Mantel-Haenszel approach can be viewed as a special application of this, but directed specifically to the case of unity for the odds ratio, for which the expectation and variance formulas are particularly simple. Computation of exact expectations and variances may be feasible only for 2 × 2 tables of limited size, but asymptotic formulas can be applied in other instances.Illustration is given for a particular set of four 2 × 2 tables in which both exact limits and limits by the proposed method could be applied, the two methods giving reasonably good agreement. Both procedures are directed at the distribution of the total over the designated cells, the proposed method treating that distribution as being asymptotically normal. Especially good agreement of proposed with exact limits could be anticipated in more asymptotic situations (overall, not for individual tables) but in practice this may not be demonstrable as the computation of exact limits is then unfeasible.     

Serial dependence and regression of Poisson INARMA models

Time series of counts occur in many fields of practice, with the Poisson distribution as a popular choice for the marginal process distribution. A great variety of serial dependence structures of stationary count processes can be modelled by the INARMA family. In this article, we propose a new approach to the INMA(q) family in general, including previously known results as special cases. In the particular case of Poisson marginals, we will derive new results concerning regression properties and the serial dependence structure of INAR(1) and INMA(q) models. Finally, we present explicit expressions for the distribution of jumps in such processes.     

On a Bivariate Distribution with Exponential Marginals

A new bivariate distribution with exponential marginals has been introduced by Singpurwalla & Youngren (1993). This distribution is absolutely continuous and has a single parameter. It was originally motivated as the failure model for a two-component system experiencing damage described by a shot–noise process. The purpose of this paper is two-fold. The first is to articulate on several aspects of this distribution, in particular, its genesis, the nature of its dependence, its correlation structure, and its generalized version as a two-parameter bivariate distribution with exponential marginals. The second purpose of this paper is more general. Prompted by the need to explain certain features of the bivariate distribution, it is found useful to introduce a new notion in reliability and survival analysis. This notion is called the "hazard potential", of an item susceptible to failure. The hazard potential is viewed as a kind of hidden parameter of failure models that delineates a cause and effect relationship in reliability.     

Continuity of f-projections and applications to the iterative proportional fitting procedure*

This paper proves continuity of f-projections and the continuous dependence of the limit matrix of the iterative proportional fitting procedure (IPF procedure) on the given matrix as well as the given marginals under certain regularity constraints. For finite spaces, the concept of f-projections of finite measures on a compact and convex set is introduced and continuity of f-projections is proven. This result is applied to the IPF procedure. Given a nonnegative matrix as well as row and column marginals the IPF procedure generates a sequence of matrices, called the IPF sequence, by alternately fitting rows and columns to match their respective marginals. The procedure is equivalent to cyclic f-projections. If the IPF sequence converges, the application of the continuity of f-projections yields the continuous dependence of the limit matrix on the given matrix. By generalized convex programming and under some constraints, it is shown that the limit matrix of the IPF sequence continuously depends not only on the given matrix but also on the marginals.     

Eliciting Dirichlet and Gaussian copula prior distributions for multinomial models

In this paper, we propose novel methods of quantifying expert opinion about prior distributions for multinomial models. Two different multivariate priors are elicited using median and quartile assessments of the multinomial probabilities. First, we start by eliciting a univariate beta distribution for the probability of each category. Then we elicit the hyperparameters of the Dirichlet distribution, as a tractable conjugate prior, from those of the univariate betas through various forms of reconciliation using least-squares techniques. However, a multivariate copula function will give a more flexible correlation structure between multinomial parameters if it is used as their multivariate prior distribution. So, second, we use beta marginal distributions to construct a Gaussian copula as a multivariate normal distribution function that binds these marginals and expresses the dependence structure between them. The proposed method elicits a positive-definite correlation matrix of this Gaussian copula. The two proposed methods are designed to be used through interactive graphical software written in Java.     

Preserving confidentiality of high-dimensional tabulated data: Statistical and computational issues

Dissemination of information derived from large contingency tables formed from confidential data is a major responsibility of statistical agencies. In this paper we present solutions to several computational and algorithmic problems that arise in the dissemination of cross-tabulations (marginal sub-tables) from a single underlying table. These include data structures that exploit sparsity to support efficient computation of marginals and algorithms such as iterative proportional fitting, as well as a generalized form of the shuttle algorithm that computes sharp bounds on (small, confidentiality threatening) cells in the full table from arbitrary sets of released marginals. We give examples illustrating the techniques.     

On the minimum expected quantity for the validity of the chi-squared test in 2 2 2 tables

A 2 2 2 contingency table can often be analysed in an exact fashion by using Fisher's exact test and in an approximate fashion by using the chi-squared test with Yates' continuity correction, and it is traditionally held that the approximation is valid when the minimum expected quantity E is E S 5. Unfortunately, little research has been carried out into this belief, other than that it is necessary to establish a bound E>E*, that the condition E S 5 may not be the most appropriate (Martín Andrés et al., 1992) and that E* is not a constant, but usually increasing with the growth of the sample size (Martín Andrés & Herranz Tejedor, 1997). In this paper, the authors conduct a theoretical experimental study from which they ascertain that E* value (which is very variable and frequently quite a lot greater than 5) is strongly related to the magnitude of the skewness of the underlying hypergeometric distribution, and that bounding the skewness is equivalent to bounding E (which is the best control procedure). The study enables estimating the expression for the above-mentioned E* (which in turn depends on the number of tails in the test, the alpha error used, the total sample size, and the minimum marginal imbalance) to be estimated. Also the authors show that E* increases generally with the sample size and with the marginal imbalance, although it does reach a maximum. Some general and very conservative validity conditions are E S 35.53 (one-tailed test) and E S 7.45 (two-tailed test) for alpha nominal errors in 1% h f h 10%. The traditional condition E S 5 is only valid when the samples are small and one of the marginals is very balanced; alternatively, the condition E S 5.5 is valid for small samples or a very balanced marginal. Finally, it is proved that the chi-squared test is always valid in tables where both marginals are balanced, and that the maximum skewness permitted is related to the maximum value of the bound E*, to its value for tables with at least one balanced marginal and to the minimum value that those marginals must have (in non-balanced tables) for the chi-squared test to be valid.     

Copula, marginal distributions and model selection: a Bayesian note

Copula functions and marginal distributions are combined to produce multivariate distributions. We show advantages of estimating all parameters of these models using the Bayesian approach, which can be done with standard Markov chain Monte Carlo algorithms. Deviance-based model selection criteria are also discussed when applied to copula models since they are invariant under monotone increasing transformations of the marginals. We focus on the deviance information criterion. The joint estimation takes into account all dependence structure of the parameters’ posterior distributions in our chosen model selection criteria. Two Monte Carlo studies are conducted to show that model identification improves when the model parameters are jointly estimated. We study the Bayesian estimation of all unknown quantities at once considering bivariate copula functions and three known marginal distributions.     

LTD and RTI dependence orderings

The authors show how the approach of Capéra à & Genest (The Canadian Journal of Statistics, 1990) can be used to order bivariate distributions with arbitrary marginals by their degree of dependence in the LTD (left‐tail decreasing) or RTI (right‐tail increasing) sense. Some properties of these new orderings are given, along with applications to Archimedean copulas, order statistics and compound random variables.