Waiting time paradox and size biased sampling

Feller's (1971) 'Waiting time for the bus paradox1 is explained by the fact that the long Interarrival times have a better chance of covering an arbitrary point in time than do short interarrival times, This gives rise to size biased sampling and the length of the Interarrival time that contains the arbitrary point has a moment distribution, This paper deals with the characterization of the exponential distribution based on this 'Waiting time paradox'. Similar characterizations of the binomial, the negative binomial, the Poisson and the geometric distributions are obtained.     

An Extended Binomial Distribution with Applications

Based on Skellam (Poisson difference) distribution, an extended binomial distribution is introduced as a byproduct of extending Moran's characterization of Poisson distribution to the Skellam distribution. Basic properties of the distribution are investigated. Also, estimation of the distribution parameters is obtained. Applications with real data are also described.     

Confidence curves and improved exact confidence intervals for discrete distributions

The author describes a method for improving standard “exact” confidence intervals in discrete distributions with respect to size while retaining correct level. The binomial, negative binomial, hypergeometric, and Poisson distributions are considered explicitly. Contrary to other existing methods, the author's solution possesses a natural nesting condition: if α < α', the 1 ‐ α' confidence interval is included in the 1 ‐ α interval. Nonparametric confidence intervals for a quantile are also considered.     

A likelihood ratio test to discriminate exponential–Poisson and gamma distributions

The exponential–Poisson (EP) distribution with scale and shape parameters β>0 and λ∈?, respectively, is a lifetime distribution obtained by mixing exponential and zero-truncated Poisson models. The EP distribution has been a good alternative to the gamma distribution for modelling lifetime, reliability and time intervals of successive natural disasters. Both EP and gamma distributions have some similarities and properties in common, for example, their densities may be strictly decreasing or unimodal, and their hazard rate functions may be decreasing, increasing or constant depending on their shape parameters. On the other hand, the EP distribution has several interesting applications based on stochastic representations involving maximum and minimum of iid exponential variables (with random sample size) which make it of distinguishable scientific importance from the gamma distribution. Given the similarities and different scientific relevance between these models, one question of interest is how to discriminate them. With this in mind, we propose a likelihood ratio test based on Cox's statistic to discriminate the EP and gamma distributions. The asymptotic distribution of the normalized logarithm of the ratio of the maximized likelihoods under two null hypotheses – data come from EP or gamma distributions – is provided. With this, we obtain the probabilities of correct selection. Hence, we propose to choose the model that maximizes the probability of correct selection (PCS). We also determinate the minimum sample size required to discriminate the EP and gamma distributions when the PCS and a given tolerance level based on some distance are before stated. A simulation study to evaluate the accuracy of the asymptotic probabilities of correct selection is also presented. The paper is motivated by two applications to real data sets.     

Goodness-of-fit tests for binomial AR(1) processes

The binomial AR(1) model describes a nonlinear process with a first-order autoregressive (AR(1)) structure and a binomial marginal distribution. To develop goodness-of-fit tests for the binomial AR(1) model, we investigate the observed marginal distribution of the binomial AR(1) process, and we tackle its autocorrelation structure. Motivated by the family of power-divergence statistics for handling discrete multivariate data, we derive the asymptotic distribution of certain categorized power-divergence statistics for the case of a binomial AR(1) process. Then we consider Bartlett's formula, which is widely used in time series analysis to provide estimates of the asymptotic covariance between sample autocorrelations, but which is not applicable when the underlying process is nonlinear. Hence, we derive a novel Bartlett-type formula for the asymptotic distribution of the sample autocorrelations of a binomial AR(1) process, which is then applied to develop tests concerning the autocorrelation structure. Simulation studies are carried out to evaluate the size and power of the proposed tests under diverse alternative process models. Several real examples are used to illustrate our methods and findings.     

A Family Which Integrates the Generalized Charlier Series and Extended Noncentral Negative Binomial Distributions

The generalized Charlier series distribution includes the binomial distribution, and the noncentral negative binomial distribution extends the negative binomial distribution. The present article proposes a family of counting distributions, which contains both the generalized Charlier series and extended noncentral negative binomial distributions. Compound and mixture formulations of the proposed distribution are given. The probability mass function is expressible in terms of the confluent hypergeometric function as well as the Gauss hypergeometric function. Recursive formulae for probability mass function have been studied by Panjer, Sundt and Jewell, Schröter, Sundt, and Kitano et al. in the context of insurance risk. This article explores horizontal, vertical, triangular, and diagonal recursions. Recursive formulae as well as exact expressions for descending factorial moments are studied. The proposed distribution allows overdispersion or underdispersion relative to a Poisson distribution. An illustrative example of data fitting is given.     

Some General Comparative Points on Chao's and Zelterman's Estimators of the Population Size

Abstract. Two simple and frequently used capture–recapture estimates of the population size are compared: Chao's lower‐bound estimate and Zelterman's estimate allowing for contaminated distributions. In the Poisson case it is shown that if there are only counts of ones and twos, the estimator of Zelterman is always bounded above by Chao's estimator. If counts larger than two exist, the estimator of Zelterman is becoming larger than that of Chao's, if only the ratio of the frequencies of counts of twos and ones is small enough. A similar analysis is provided for the binomial case. For a two‐component mixture of Poisson distributions the asymptotic bias of both estimators is derived and it is shown that the Zelterman estimator can experience large overestimation bias. A modified Zelterman estimator is suggested and also the bias‐corrected version of Chao's estimator is considered. All four estimators are compared in a simulation study.     

POISSON VERSUS BINOMIAL: APPOINTMENT OF JUDGES TO THE U.S. SUPREME COURT

The problem of discriminating between the Poisson and binomial models is discussed in the context of a detailed statistical analysis of the number of appointments of the U.S. Supreme Court justices from 1789 to 2004. Various new and existing tests are examined. The analysis shows that both simple Poisson and simple binomial models are equally appropriate for describing the data. No firm statistical evidence in favour of an exponential Poisson regression model was found. Two attendant results were obtained by simulation: firstly, that the likelihood ratio test is the most powerful of those considered when testing for the Poisson versus binomial and, secondly, that the classical variance test with an upper-tail critical region is biased.     

A useful distribution for fitting discrete data: revival of the Conway–Maxwell–Poisson distribution

Summary.  A useful discrete distribution (the Conway–Maxwell–Poisson distribution) is revived and its statistical and probabilistic properties are introduced and explored. This distribution is a two-parameter extension of the Poisson distribution that generalizes some well-known discrete distributions (Poisson, Bernoulli and geometric). It also leads to the generalization of distributions derived from these discrete distributions (i.e. the binomial and negative binomial distributions). We describe three methods for estimating the parameters of the Conway–Maxwell–Poisson distribution. The first is a fast simple weighted least squares method, which leads to estimates that are sufficiently accurate for practical purposes. The second method, using maximum likelihood, can be used to refine the initial estimates. This method requires iterations and is more computationally intensive. The third estimation method is Bayesian. Using the conjugate prior, the posterior density of the parameters of the Conway–Maxwell–Poisson distribution is easily computed. It is a flexible distribution that can account for overdispersion or underdispersion that is commonly encountered in count data. We also explore two sets of real world data demonstrating the flexibility and elegance of the Conway–Maxwell–Poisson distribution in fitting count data which do not seem to follow the Poisson distribution.     

Analysis of over-dispersed count data with extra zeros using the Poisson log-skew-normal distribution

ABSTRACT

Mixed Poisson distributions are widely used in various applications of count data mainly when extra variation is present. This paper introduces an extension in terms of a mixed strategy to jointly deal with extra-Poisson variation and zero-inflated counts. In particular, we propose the Poisson log-skew-normal distribution which utilizes the log-skew-normal as a mixing prior and present its main properties. This is directly done through additional hierarchy level to the lognormal prior and includes the Poisson lognormal distribution as its special case. Two numerical methods are developed for the evaluation of associated likelihoods based on the Gauss–Hermite quadrature and the Lambert's W function. By conducting simulation studies, we show that the proposed distribution performs better than several commonly used distributions that allow for over-dispersion or zero inflation. The usefulness of the proposed distribution in empirical work is highlighted by the analysis of a real data set taken from health economics contexts.     

随机效应零膨胀索赔次数回归模型

索赔频率预测是非寿险费率厘定的重要组成部分。最常使用的索赔频率预测模型是泊松回归和负二项回归,以及与它们相对应的零膨胀回归模型。但是,当索赔次数观察值既具有零膨胀特征,又存在组内相依结构时,上述模型都不能很好地拟合实际数据。为此,本文在泊松分布、负二项分布、广义泊松分布、P型负二项分布等条件下分别建立了随机效应零膨胀损失次数回归模型。为了改进模型的预测效果,对于连续型的解释变量,还引入了二次平滑项,并建立了结构性零比例与解释变量之间的回归关系。基于一组实际索赔次数数据的实证分析结果表明,该模型可以显著改进现有模型的拟合效果。     

On a class of bivariate mixed Sarmanov distributions

Multivariate distributions are more and more used to model the dependence encountered in many fields. However, classical multivariate distributions can be restrictive by their nature, while Sarmanov's multivariate distribution, by joining different marginals in a flexible and tractable dependence structure, often provides a valuable alternative. In this paper, we introduce some bivariate mixed Sarmanov distributions with the purpose to extend the class of bivariate Sarmanov distributions and to obtain new dependency structures. Special attention is paid to the bivariate mixed Sarmanov distribution with Poisson marginals and, in particular, to the resulting bivariate Sarmanov distributions with negative binomial and with Poisson‐inverse Gaussian marginals; these particular types of mixed distributions have possible applications in, for example modelling bivariate count data. The extension to higher dimensions is also discussed. Moreover, concerning the dependency structure, we also present some correlation formulas.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

Equating Poisson and Normal Probability Functions to Derive Stirling's Formula

Often texts for introductory courses in probability or mathematical statistics make reference to Stirling's asymptotic formula (for a factorial) without presenting any proof or justification for the formula. A notable exception is Feller. In this article, we present a derivation of Stirling's formula based on the normal approximation of a Poisson probability that is considerably more accessible to the average student than Feller's approach. Besides illustrating a usage of the central limit theorem in conjunction with a continuity correction, the derivation lends itself to a mnemonic device for quickly obtaining Stirling's formula.     

Test of two hypotheses explaining the size of populations in a system of cities

Two classical hypotheses are examined about the population growth in a system of cities: Hypothesis 1 pertains to Gibrat's and Zipf's theory which states that the city growth–decay process is size independent; Hypothesis 2 pertains to the so-called Yule process which states that the growth of populations in cities happens when (i) the distribution of the city population initial size obeys a log-normal function, (ii) the growth of the settlements follows a stochastic process. The basis for the test is some official data on Bulgarian cities at various times. This system was chosen because (i) Bulgaria is a country for which one does not expect biased theoretical conditions; (ii) the city populations were determined rather precisely. The present results show that: (i) the population size growth of the Bulgarian cities is size dependent, whence Hypothesis 1 is not confirmed for Bulgaria; (ii) the population size growth of Bulgarian cities can be described by a double Pareto log-normal distribution, whence Hypothesis 2 is valid for the Bulgarian city system. It is expected that this fine study brings some information and light on other usually considered to be more pertinent countries of city systems.     

Better approximate confidence intervals for a binomial parameter

This paper discusses five methods for constructing approximate confidence intervals for the binomial parameter Θ, based on Y successes in n Bernoulli trials. In a recent paper, Chen (1990) discusses various approximate methods and suggests a new method based on a Bayes argument, which we call method I here. Methods II and III are based on the normal approximation without and with continuity correction. Method IV uses the Poisson approximation of the binomial distribution and then exploits the fact that the exact confidence limits for the parameter of the Poisson distribution can be found through the x² distribution. The confidence limits of method IV are then provided by the Wilson-Hilferty approximation of the x². Similarly, the exact confidence limits for the binomial parameter can be expressed through the F distribution. Method V approximates these limits through a suitable version of the Wilson-Hilferty approximation. We undertake a comparison of the five methods in respect to coverage probability and expected length. The results indicate that method V has an advantage over Chen's Bayes method as well as over the other three methods.     

On Stein's method, smoothing estimates in total variation distance and mixture distributions

In many settings it is useful to have bounds on the total variation distance between some random variable Z and its shifted version Z+1. For example, such quantities are often needed when applying Stein's method for probability approximation. This note considers one way in which such bounds can be derived, in cases where Z is either the equilibrium distribution of some birth-death process or the mixture of such a distribution. Applications of these bounds are given to translated Poisson and compound Poisson approximations for Poisson mixtures and the Pólya distribution.     

Asymptotic Analysis of Some Discrete Distributions by the Saddle Point Method

We present asymptotic formulas for the probability mass functions of three discrete distributions: the Neyman type A, the compound Poisson–Katz, and the convolution of negative binomial and Pólya–Aeppli. An approximation of the moments of the Neyman type A distribution is also given. All of these results are found by Hayman's encapsulation of the saddle point method.     

The inverse binomial distribution as a statistical model

A particular case of Jain and Consul's (1971) generalized neg-ative binomial distribution is studied. The name inverse binomial is suggested because of its close relation with the inverse Gaussian distribution. We develop statistical properties including conditional inference of a parameter. An application using real data is given.     

Comparison of Shared Frailty Models for Kidney Infection Data under Exponential Power Baseline Distribution

Shared frailty models are often used to model heterogeneity in survival analysis. There are certain assumptions about the baseline distribution and distribution of frailty. In this paper, four shared frailty models with frailty distribution gamma, inverse Gaussian, compound Poisson, and compound negative binomial with exponential power as baseline distribution are proposed. These models are fitted using Markov Chain Monte Carlo methods. These models are illustrated with a real life bivariate survival data set of McGilchrist and Aisbett (1991) related to kidney infection, and the best model is suggested for the data using different model comparison criteria.