A bivariate mixture of negative binomial distributions and its applications

Abstract

We construct a new bivariate mixture of negative binomial distributions which represents over-dispersed data more efficiently. This is an extension of a univariate mixture of beta and negative binomial distributions. Characteristics of this joint distribution are studied including conditional distributions. Some properties of the correlation coefficient are explored. We demonstrate the applicability of our proposed model by fitting to three real data sets with correlated count data. A comparison is made with some previously used models to show the effectiveness of the new model.     

Characterizations of generalized mixtures of geometric and exponential distributions based on upper record values

Let X _{U (1)} < X _{U (2)} < … < X _{U ( n )} < … be the sequence of the upper record values from a population with common distribution function F. In this paper, we first give a theorem to characterize the generalized mixtures of geometric distribution by the relation between E[(X _{U ( n +1)}–X _{U ( n )})²|X _{U ( n )} = x] and the function of the failure rate of the distribution, for any positive integer n. Secondly, we also use the same relation to characterize the generalized mixtures of exponential distribution. The characterizing relations were motivated by the work of Balakrishnan and Balasubramanian (1995). Received: March 31, 1999; revised version: November 22, 1999     

On the distribution of the estimated mean from nonstandard mixtures of distributions

The distribution of the estimated mean of the nonstandard mixture of distributions that has a discrete probability mass at zero and a gamma distribution for positive values is derived. Furthermore, for the studied nonstandard mixture of distributions, the distribution of the standardized statistic (estimator - true mean)/standard deviation of estimator is derived. The results are used to study the accuracy of the confidence interval for the mean based on a large sample approximation. Quantiles for the standardized statistic are also calculated.     

On bootstrapping the number of components in finite mixtures of Poisson distributions

Finite mixture models arise in a natural way in that they are modeling unobserved population heterogeneity. It is assumed that the population consists of an unknown number k of subpopulations with parameters λ₁, ..., λ_k receiving weights p₁, ..., p_k. Because of the irregularity of the parameter space, the log-likelihood-ratio statistic (LRS) does not have a (χ²) limit distribution and therefore it is difficult to use the LRS to test for the number of components. These problems are circumvented by using the nonparametric bootstrap such that the mixture algorithm is applied B times to bootstrap samples obtained from the original sample with replacement. The number of components k is obtained as the mode of the bootstrap distribution of k. This approach is presented using the Times newspaper data and investigated in a simulation study for mixtures of Poisson data.     

Calibration model with skew scale mixtures of normal distributions

This work presents a new linear calibration model with replication by assuming that the error of the model follows a skew scale mixture of the normal distributions family, which is a class of asymmetric thick-tailed distributions that includes the skew normal distribution and symmetric distributions. In the literature, most calibration models assume that the errors are normally distributed. However, the normal distribution is not suitable when there are atypical observations and asymmetry. The estimation of the calibration model parameters are done numerically by the EM algorithm. A simulation study is carried out to verify the properties of the maximum likelihood estimators. This new approach is applied to a real dataset from a chemical analysis.     

Generalized binomial distributions

In many cases where the binomial dismbution fails to apply to real world data it is because of more variability in the data than can be explained by that dismbution. Several authors have proposed models that are useful in explaining extra-binomial variation. In this paper we point out a characterization of sequences of exchangeable Bernoulli random variables which can be used to develop models which show more variability than the binomial. We give sufficient conditions which will yield such models and show how existig models can be combined to generate further models. The usefulness of some of these models is illustrated by fitting them to sets of real data.     

Parametric estimation of mixtures of two uniform distributions

In this paper, we consider a mixture of two uniform distributions and derive L-moment estimators of its parameters. Three possible ways of mixing two uniforms, namely with neither overlap nor gap, with overlap, and with gap, are studied. The performance of these L-moment estimators in terms of bias and efficiency is compared to that obtained by means of the conventional method of moments (MM), modified maximum likelihood (MML) method and the usual maximum likelihood (ML) method. These intensive simulations reveal that MML estimators are the best in most of the cases, and the L-moment estimators are less subject to bias in estimation for some mixtures and more efficient in most of the cases than the conventional MM estimators. The L-moment estimators are, in some cases, more efficient than the ML and MML estimators.     

Fitting insurance and economic data with outliers: a flexible approach based on finite mixtures of contaminated gamma distributions

Insurance and economic data are frequently characterized by positivity, skewness, leptokurtosis, and multi-modality; although many parametric models have been used in the literature, often these peculiarities call for more flexible approaches. Here, we propose a finite mixture of contaminated gamma distributions that provides a better characterization of data. It is placed in between parametric and non-parametric density estimation and strikes a balance between these alternatives, as a large class of densities can be implemented. We adopt a maximum likelihood approach to estimate the model parameters, providing the likelihood and the expected-maximization algorithm implemented to estimate all unknown parameters. We apply our approach to an artificial dataset and to two well-known datasets as the workers compensation data and the healthcare expenditure data taken from the medical expenditure panel survey. The Value-at-Risk is evaluated and comparisons with other benchmark models are provided.     

Confidence regions for two proportions from independent negative binomial distributions

The negative binomial distribution offers an alternative view to the binomial distribution for modeling count data. This alternative view is particularly useful when the probability of success is very small, because, unlike the fixed sampling scheme of the binomial distribution, the inverse sampling approach allows one to collect enough data in order to adequately estimate the proportion of success. However, despite work that has been done on the joint estimation of two binomial proportions from independent samples, there is little, if any, similar work for negative binomial proportions. In this paper, we construct and investigate three confidence regions for two negative binomial proportions based on three statistics: the Wald (W), score (S) and likelihood ratio (LR) statistics. For large-to-moderate sample sizes, this paper finds that all three regions have good coverage properties, with comparable average areas for large sample sizes but with the S method producing the smaller regions for moderate sample sizes. In the small sample case, the LR method has good coverage properties, but often at the expense of comparatively larger areas. Finally, we apply these three regions to some real data for the joint estimation of liver damage rates in patients taking one of two drugs.     

On symmetry of finite mixtures of normal distributions

In this note we derive a necessary and sufficient condition for a distribution obtained by taking a finite mixture of multivariate normal distributions to be symmetric about zero. The result derived also holds for mixtures of symmetric stable distributions, including the Cauchy distribution.     

On compounded geometric distributions and their applications

Here, we introduce two-parameter compounded geometric distributions with monotone failure rates. These distributions are derived by compounding geometric distribution and zero-truncated Poisson distribution. Some statistical and reliability properties of the distributions are investigated. Parameters of the proposed distributions are estimated by the maximum likelihood method as well as through the minimum distance method of estimation. Performance of the estimates by both the methods of estimation is compared based on Monte Carlo simulations. An illustration with Air Crash casualties demonstrates that the distributions can be considered as a suitable model under several real situations.     

Characterization of a mixture of gamma distributions via conditional finite moments

A necessary and sufficient condition that a continuous, positive random variable follow a gamma distribution is given in terms of any one of its conditional finite moments and an expression involving its failure rate. The results are then used to develop a characterization for a mixture of two gamma distributions. The general results about characterization of a mixture of gamma distributions yield several special cases that have appeared separately in recent literature, including characterization of a single exponential distribution, characterization of a single gamma distribution (in terms of either first or second moments) and a sufficient condition for a mixture of two exponential distributions (in terms of first moments). The condition in this last result is shown to be necessary also. Numerous other cases are possible, using different choices for distribution parameters along with a selection of the mixing parameter, for either individual or mixtures of distributions. Various characterizations can be expressed using higher order moments, too.     

Estimating mixtures of normal distributions via empirical characteristic function

This paper uses the empirical characteristic function (ECF) procedure to estimate the parameters of mixtures of normal distributions. Since the characteristic function is uniformly bounded, the procedure gives estimates that are numerically stable. It is shown that, using Monte Carlo simulation, the finite sample properties of th ECF estimator are very good, even in the case where the popular maximum likelihood estimator fails to exist. An empirical application is illustrated using the monthl excess return of the Nyse value-weighted index.     

Multivariate geometric distributions

Families of multivariate geometric distributions with flexible correlations can be constructed by applying inverse sampling to a sequence of multinomial trials, and counting outcomes in possibly overlapping categories. Further multivariate families can be obtained by considering other stopping rules, with the possibility of different stopping roles for different counts, A simple characterisation is given for stopping rules which produce joint distributions with marginals having the same form as that of the number of trials. The inverse sampling approach provides a unified treatment of diverse results presented by earlier authors, including Goldberg (1934), Bates and Meyman (1952), Edwards and Gurland (1961), Hawkes (1972), Paulson and Uppulori (1972) and Griffiths and Milne (1987). It also provides a basis for investigating the range of possible correlations for a given set of marginal parameters. In the case of more than two joint geometric or negative binomial variables, a convenient matrix formulation is provided.     

The conditional variance for gamma mixtures of normal distributions

This paper is concerned with obtaining an expression for the conditional variance-covariance matrix when the random vector is gamma scaled of a multivariate normal distribution. We show that the conditional variance is not degenerate as in the multivariate normal distribution, but depends upon a positive function for which various asymptotic properties are derived. A discussion section is included commenting on the usefulness of these results     

Robust Bayesian analysis of loss reserving data using scale mixtures distributions

It is vital for insurance companies to have appropriate levels of loss reserving to pay outstanding claims and related settlement costs. With many uncertainties and time lags inherently involved in the claims settlement process, loss reserving therefore must be based on estimates. Existing models and methods cannot cope with irregular and extreme claims and hence do not offer an accurate prediction of loss reserving. This paper extends the conventional normal error distribution in loss reserving modeling to a range of heavy-tailed distributions which are expressed by certain scale mixtures forms. This extension enables robust analysis and, in addition, allows an efficient implementation of Bayesian analysis via Markov chain Monte Carlo simulations. Various models for the mean of the sampling distributions, including the log-Analysis of Variance (ANOVA), log-Analysis of Covariance (ANCOVA) and state space models, are considered and the straightforward implementation of scale mixtures distributions is demonstrated using OpenBUGS.     

Maximum likelihood estimation for mixtures of two gompertz distributions when censoring occurs

In estimating the proportion ‘cured’ after adjuvant treatment, a population of cancer patients can be assumed to be a mixture of two Gompertz subpopulations, those who will die of other causes with no evidence of disease relapse and those who will die of their primary cancer. Estimates of the parameters of the component dying of other causes can be obtained from census data, whereas maximum likelihood estimates for the proportion cured and for the parameters of the component of patients dying of cancer can be obtained from follow-up data.

This paper examines, through simulation of follow-up data, the feasibility of maximum likelihood estimation of a mixture of two Gompertz distributions when censoring occurs. Means, variances and mean square error of the maximum likelihood estimates and the estimated asymptotic variance-covariance matrix is obtained from the simulated samples. The relationship of these variances with sample size, proportion censored, mixing proportion and population parameters are considered.

Moderate sample size typical of cooperative trials yield clinically acceptable estimates. Both increasing sample size and decreasing proportion of censored data decreases variance and covariance of the unknown parameters. Useful results can be obtained with data which are as much as 50% censored. Moreover, if the sample size is sufficiently large, survival data which are as much as 70% censored can yield satisfactory results.