Improved two-parameter estimators for the negative binomial and Poisson regression models

Negative binomial regression (NBR) and Poisson regression (PR) applications have become very popular in the analysis of count data in recent years. However, if there is a high degree of relationship between the independent variables, the problem of multicollinearity arises in these models. We introduce new two-parameter estimators (TPEs) for the NBR and the PR models by unifying the two-parameter estimator (TPE) of Özkale and Kaç?ranlar [The restricted and unrestricted two-parameter estimators. Commun Stat Theory Methods. 2007;36:2707–2725]. These new estimators are general estimators which include maximum likelihood (ML) estimator, ridge estimator (RE), Liu estimator (LE) and contraction estimator (CE) as special cases. Furthermore, biasing parameters of these estimators are given and a Monte Carlo simulation is done to evaluate the performance of these estimators using mean square error (MSE) criterion. The benefits of the new TPEs are also illustrated in an empirical application. The results show that the new proposed TPEs for the NBR and the PR models are better than the ML estimator, the RE and the LE.     

Analysis of count data with covariate dependence in both mean and variance

Extended Poisson process modelling is generalised to allow for covariate-dependent dispersion as well as a covariate-dependent mean response. This is done by a re-parameterisation that uses approximate expressions for the mean and variance. Such modelling allows under- and over-dispersion, or a combination of both, in the same data set to be accommodated within the same modelling framework. All the necessary calculations can be done numerically, enabling maximum likelihood estimation of all model parameters to be carried out. The modelling is applied to re-analyse two published data sets, where there is evidence of covariate-dependent dispersion, with the modelling leading to more informative analyses of these data and more appropriate measures of the precision of any estimates.     

Multivariate models for correlated count data

In this study, we deal with the problem of overdispersion beyond extra zeros for a collection of counts that can be correlated. Poisson, negative binomial, zero-inflated Poisson and zero-inflated negative binomial distributions have been considered. First, we propose a multivariate count model in which all counts follow the same distribution and are correlated. Then we extend this model in a sense that correlated counts may follow different distributions. To accommodate correlation among counts, we have considered correlated random effects for each individual in the mean structure, thus inducing dependency among common observations to an individual. The method is applied to real data to investigate variation in food resources use in a species of marsupial in a locality of the Brazilian Cerrado biome.     

A weighted Poisson distribution and its application to cure rate models

The family of weighted Poisson distributions offers great flexibility in modeling discrete data due to its potential to capture over/under-dispersion by an appropriate selection of the weight function. In this paper, we introduce a flexible weighted Poisson distribution and further study its properties by using it in the context of cure rate modeling under a competing cause scenario. A special case of the new distribution is the COM-Poisson distribution which in turn encompasses the Bernoulli, Poisson, and geometric distributions; hence, many of the well-studied cure rate models may be seen as special cases of the proposed model. We focus on the estimation, through the maximum likelihood method, of the cured proportion and the properties of the failure time of the susceptibles/non cured individuals; a profile likelihood approach is also adopted for estimating the parameters of the weighted Poisson distribution. A Monte Carlo simulation study demonstrates the accuracy of the proposed inferential method. Finally, as an illustration, we fit the proposed model to a cutaneous melanoma data set.     

Robust Poisson likelihood estimation for frailty Cox models: A simulation study

Frailty models can be fit as mixed-effects Poisson models after transforming time-to-event data to the Poisson model framework. We assess, through simulations, the robustness of Poisson likelihood estimation for Cox proportional hazards models with log-normal frailties under misspecified frailty distribution. The log-gamma and Laplace distributions were used as true distributions for frailties on a natural log scale. Factors such as the magnitude of heterogeneity, censoring rate, number and sizes of groups were explored. In the simulations, the Poisson modeling approach that assumes log-normally distributed frailties provided accurate estimates of within- and between-group fixed effects even under a misspecified frailty distribution. Non-robust estimation of variance components was observed in the situations of substantial heterogeneity, large event rates, or high data dimensions.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

A note on LeCam’s bound for the distance between the Poisson binomial and the Poisson distribution

n possibly different success probabilities p ₁, p ₂, ..., p _n is frequently approximated by a Poisson distribution with parameter λ = p ₁ + p ₂ + ... + p _n . LeCam's bound p ² ₁ + p ² ₂ + ... + p _n ² for the total variation distance between both distributions is particularly useful provided the success probabilities are small. The paper presents an improved version of LeCam's bound if a generalized d-dimensional Poisson binomial distribution is to be approximated by a compound Poisson distribution. Received: May 10, 2000; revised version: January 15, 2001     

Empirical Bayes estimates for correlated hierarchical data with overdispersion

An extension of the generalized linear mixed model was constructed to simultaneously accommodate overdispersion and hierarchies present in longitudinal or clustered data. This so‐called combined model includes conjugate random effects at observation level for overdispersion and normal random effects at subject level to handle correlation, respectively. A variety of data types can be handled in this way, using different members of the exponential family. Both maximum likelihood and Bayesian estimation for covariate effects and variance components were proposed. The focus of this paper is the development of an estimation procedure for the two sets of random effects. These are necessary when making predictions for future responses or their associated probabilities. Such (empirical) Bayes estimates will also be helpful in model diagnosis, both when checking the fit of the model as well as when investigating outlying observations. The proposed procedure is applied to three datasets of different outcome types. Copyright © 2014 John Wiley & Sons, Ltd.     

Waiting time paradox and size biased sampling

Feller's (1971) 'Waiting time for the bus paradox1 is explained by the fact that the long Interarrival times have a better chance of covering an arbitrary point in time than do short interarrival times, This gives rise to size biased sampling and the length of the Interarrival time that contains the arbitrary point has a moment distribution, This paper deals with the characterization of the exponential distribution based on this 'Waiting time paradox'. Similar characterizations of the binomial, the negative binomial, the Poisson and the geometric distributions are obtained.     

Inflated modified power series distributions with applications

In certain applications involving discrete data, it is sometimes found that X = 0 is observed with a frequency significantly higher than predicted by the assumed model. Zero inflated Poisson, binomial and negative binomial models have been employed in some clinical trials and in some regression analysis problems.

In this paper, we study the zero inflated modified power series distributions (IMPSD) which include among others the generalized Poisson and the generalized negative binomial distributions and hence the Poisson, binomial and negative binomial distributions. The structural properties along with the distribution of the sum of independent IMPSD variables are studied. The maximum likelihood estimation of the parameters of the model is examined and the variance-covariance matrix of the estimators is obtained. Finally, examples are presented for the generalized Poisson distribution to illustrate the results.     

On a class of bivariate mixed Sarmanov distributions

Multivariate distributions are more and more used to model the dependence encountered in many fields. However, classical multivariate distributions can be restrictive by their nature, while Sarmanov's multivariate distribution, by joining different marginals in a flexible and tractable dependence structure, often provides a valuable alternative. In this paper, we introduce some bivariate mixed Sarmanov distributions with the purpose to extend the class of bivariate Sarmanov distributions and to obtain new dependency structures. Special attention is paid to the bivariate mixed Sarmanov distribution with Poisson marginals and, in particular, to the resulting bivariate Sarmanov distributions with negative binomial and with Poisson‐inverse Gaussian marginals; these particular types of mixed distributions have possible applications in, for example modelling bivariate count data. The extension to higher dimensions is also discussed. Moreover, concerning the dependency structure, we also present some correlation formulas.     

Exact calculation of minimum sample size for estimating a Poisson parameter

Abstract

We develop an exact approach for the determination of the minimum sample size for estimating a Poisson parameter such that the pre-specified levels of relative precision and confidence are guaranteed. The exact computation is made possible by reducing infinitely many evaluations of coverage probability to finitely many evaluations. The theory for supporting such a reduction is that the minimum of coverage probability with respect to the parameter in an interval is attained at a discrete set of finitely many elements. Computational mechanisms have been developed to further reduce the computational complexity. An explicit bound for the minimum sample size is established.     

A test for lack-of-fit of zero-inflated negative binomial models

When a count data set has excessive zero counts, nonzero counts are overdispersed, and the effect of a continuous covariate might be nonlinear, for analysis a semiparametric zero-inflated negative binomial (ZINB) regression model is proposed. The unspecified smooth functional form for the continuous covariate effect is approximated by a cubic spline. The semiparametric ZINB regression model is fitted by maximizing the likelihood function. The likelihood ratio procedure is used to evaluate the adequacy of a postulated parametric functional form for the continuous covariate effect. An extensive simulation study is conducted to assess the finite-sample performance of the proposed test. The practicality of the proposed methodology is demonstrated with data of a motorcycle survey of traffic regulations conducted in 2007 in Taiwan by the Ministry of Transportation and Communication.     

Analysis of survival data by an exponential-generalized Poisson distribution

In this paper, we consider the distribution of life length of a series system with random number of components, say Z. Considering the distribution of Z as generalized Poisson, an exponential-generalized Poisson (EGP) distribution is developed. The generalized Poisson distribution is a generalization of the Poisson distribution having one extra parameter. The structural properties of the resulting distribution are presented and the maximum likelihood estimation of the parameters is investigated. Extensive simulation studies are carried out to study the performance of the estimates. The score test is developed to test the importance of the extra parameter. For illustration, two real data sets are examined and it is shown that the EGP model, presented here, fits better than the exponential–Poisson distribution.     

Score tests for heterogeneity and overdispersion in zero‐inflated Poisson and binomial regression models

Hall (2000) has described zero‐inflated Poisson and binomial regression models that include random effects to account for excess zeros and additional sources of heterogeneity in the data. The authors of the present paper propose a general score test for the null hypothesis that variance components associated with these random effects are zero. For a zero‐inflated Poisson model with random intercept, the new test reduces to an alternative to the overdispersion test of Ridout, Demério & Hinde (2001). The authors also examine their general test in the special case of the zero‐inflated binomial model with random intercept and propose an overdispersion test in that context which is based on a beta‐binomial alternative.     

Isotonic estimation of the intensity of a nonhomogeneous Poisson process: The multiple realization setup

In the 1950s Brunk and Van Eeden each obtained maximum-likelihood estimators of a finite product of probability density functions under partial or complete ordering of their parameters. Their results play an important role in the general theory of inference under order restrictions and lead to an isotonic estimator of the intensity of a nonhomogeneous Poisson process. Here an elementary derivation of the maximum likelihood estimator (m.l.e.) for the intensity of a nonhomogeneous Poisson process is given when several (possibly censored) realizations are available. Boswell obtained the m.l.e. based on a single realization as well as a conditional m.l.e. under the same conditions. An example is given to show that in the multirealization setup a conditional m.l.e. may not exist; the proofs are, we believe, new and elementary. An illustrative application is given.     

Prediction of accrual closure date in multi-center clinical trials with discrete-time Poisson process models

In a phase III multi‐center cancer clinical trial or a large public health study, sample size is predetermined to achieve desired power, and study participants are enrolled from tens or hundreds of participating institutions. As the accrual is closing to the target size, the coordinating data center needs to project the accrual closure date on the basis of the observed accrual pattern and notify the participating sites several weeks in advance. In the past, projections were simply based on some crude assessment, and conservative measures were incorporated in order to achieve the target accrual size. This approach often resulted in excessive accrual size and subsequently unnecessary financial burden on the study sponsors. Here we proposed a discrete‐time Poisson process‐based method to estimate the accrual rate at time of projection and subsequently the trial closure date. To ensure that target size would be reached with high confidence, we also proposed a conservative method for the closure date projection. The proposed method was illustrated through the analysis of the accrual data of the National Surgical Adjuvant Breast and Bowel Project trial B‐38. The results showed that application of the proposed method could help to save considerable amount of expenditure in patient management without compromising the accrual goal in multi‐center clinical trials. Copyright © 2012 John Wiley & Sons, Ltd.     

Improved estimation for Poisson INAR(1) models

We consider the first-order Poisson autoregressive model proposed by McKenzie [Some simple models for discrete variate time series. Water Resour Bull. 1985;21:645–650] and Al-Osh and Alzaid [First-order integer valued autoregressive (INAR(1)) process. J Time Ser Anal. 1987;8:261–275], which may be suitable in situations where the time series data are non-negative and integer valued. We derive the second-order bias of the squared difference estimator [Weiß. Process capability analysis for serially dependent processes of Poisson counts. J Stat Comput Simul. 2012;82:383–404] for one of the parameters and show that this bias can be used to define a bias-reduced estimator. The behaviour of a modified conditional least-squares estimator is also studied. Furthermore, we access the asymptotic properties of the estimators here discussed. We present numerical evidence, based upon Monte Carlo simulation studies, showing that the here proposed bias-adjusted estimator outperforms the other estimators in small samples. We also present an application to a real data set.     

Discrete distributions and purchasing models

Ihis paper reviews the use of different discrete distributions in the modelling of consumer purchasing behaviour.. A feature of the work is the extensive empirical validation of the models. Some interesting characterizations are briefly discussed.. Ihe paper concludes with some unresolved problems and suggested areas for future research     

Zero-inflated Poisson and negative binomial integer-valued GARCH models

Zero inflation means that the proportion of 0's of a model is greater than the proportion of 0's of the corresponding Poisson model, which is a common phenomenon in count data. To model the zero-inflated characteristic of time series of counts, we propose zero-inflated Poisson and negative binomial INGARCH models, which are useful and flexible generalizations of the Poisson and negative binomial INGARCH models, respectively. The stationarity conditions and the autocorrelation function are given. Based on the EM algorithm, the estimating procedure is simple and easy to be implemented. A simulation study shows that the estimation method is accurate and reliable as long as the sample size is reasonably large. A real data example leads to superior performance of the proposed models compared with other competitive models in the literature.