The Probability Distribution for the Number of Successes in Independent Trials

The number of successes S in n independent trials is one of the classic distributions in statistics. When the probability of success p is constant, S has the binomial distribution with parameters n and p. Distributional properties of S in the homogeneous case are well known, but they are considerably harder to establish when p varies. A brief historical review is undertaken to highlight some of the more important results obtained over the past 50 years. In spite of the progress made, there are still some important open problems concerning stochastic comparisons for S that deserve to be solved!     

On binomial and circular binomial distributions of orderk forl-overlapping success runs of lengthk

The number ofl-overlapping success runs of lengthk inn trials, which was introduced and studied recently, is presently reconsidered in the Bernoulli case and two exact formulas are derived for its probability distribution function in terms of multinomial and binomial coefficients respectively. A recurrence relation concerning this distribution, as well as its mean, is also obtained. Furthermore, the number ofl-overlapping success runs of lengthk inn Bernoulli trials arranged on a circle is presently considered for the first time and its probability distribution function and mean are derived. Finally, the latter distribution is related to the first, two open problems regarding limiting distributions are stated, and numerical illustrations are given in two tables. All results are new and they unify and extend several results of various authors on binomial and circular binomial distributions of orderk.     

A Simple Distribution for the Sum of Correlated,Exchangeable Binary Data

This article describes a generalization of the binomial distribution. The closed form probability function for the probability of k successes out of n correlated, exchangeable Bernoulli trials depends on the number of trials and its two parameters: the common success probability and the common correlation. The distribution is derived under the assumption that the common correlation between all pairs of Bernoulli trials remains unchanged conditional on successes in all completed trials. The distribution was developed to model bond defaults but may be suited to biostatistical applications involving clusters of binary data encountered in repeated measurements or toxicity studies of families of organisms. Maximum likelihood estimates for the parameters of the distribution are found for a set of binary data from a developmental toxicity study on litters of mice.     

Improved Confidence Statements for the Binomial Parameter

In the computation of two-sided confidence intervals for the binomial parameter p (using the binomial mass function), it is known that such intervals achieve a confidence coefficient that in general is not equal to the confidence level 1 – α, say. In this article we present some general results on the confidence coefficient and tabulate them for selected pairs (α, n = number of trials). We treat only the nominal equal tail probability case because it is the most commonly taught and used.     

Binomial and Negative Binomial Analogues under Correlated Bernoulli Trials

Several statistical applications demand the adoption of models in which the response is binary but the outcomes of different trials exhibit some degree of correlation. Although the independent case is well known and treated even in elementary textbooks, results on correlated Bernoulli trials are hardly found in the literature. Analogues of the binomial and negative binomial distributions are presented in this article when the correlation is of the Markovian type. Probability-generating function, probability mass function, mean, and variance are derived. The analysis allows illustration of a variety of techniques useful in the study of discrete distributions appropriate for second-level probability courses. An example on customer brand switching discussed by Olkin, Glesser, and Derman is presented as illustration.     

Discrete q-distributions on Bernoulli trials with a geometrically varying success probability

Consider a sequence of independent Bernoulli trials and assume that the odds of success (or failure) or the probability of success (or failure) at the ith trial varies (increases or decreases) geometrically with rate (proportion) q, for increasing i=1,2,…. Introducing the notion of a geometric sequence of trials as a sequence of Bernoulli trials, with constant probability, that is terminated with the occurrence of the first success, a useful stochastic model is constructed. Specifically, consider a sequence of independent geometric sequences of trials and assume that the probability of success at the jth geometric sequence varies (increases or decreases) geometrically with rate (proportion) q, for increasing j=1,2,…. On both models, let X_n be the number of successes up the nth trial and T_k (or W_k) be the number of trials (or failures) until the occurrence of the kth success. The distributions of these random variables turned out to be q-analogues of the binomial and Pascal (or negative binomial) distributions. The distributions of X_n, for n→∞$n\to \infty$, and the distributions of W_k, for k→∞$k\to \infty$, can be approximated by a q  -Poisson distribution. Also, as k→0$k\to 0$, a zero truncated negative q  -binomial distribution _Uk=_Wk|_Wk>0$U_k=W_k|W_k>0$ can be approximated by a q-logarithmic distribution. These discrete q-distributions and their applications are reviewed, with critical comments and additions. Finally, consider a sequence of independent Bernoulli trials and assume that the probability of success (or failure) is a product of two sequences of probabilities with one of these sequences depending only the number of trials and the other depending only on the number of successes (or failures). The q-distributions of the number X_n of successes up to the nth trial and the number T_k of trials until the occurrence of the kth success are similarly reviewed.     

Sample Size Requirements for the Back-of-the-Envelope Binomial Confidence Interval

The simplest approximate confidence interval for the binomial parameter p, based on x successes in n trials, is

where c is a suitable percentile of the normal distribution. Because I ₀ is so useful in introductory teaching and for back-of-the-envelope calculation, it is desirable to have guidelines for deciding when it provides a good answer. (It is clearly unwise to use I ₀ when x is too near 0 or n.) This article proposes such guidelines, based on the criterion that I ₀ should differ from the exact Clopper-Pearson confidence interval by an amount that is small compared to the length of the interval.     

An application of the Bernoulli part to local limit theorems for moving averages on stationary sequences

We consider partial sums S_n of a general class of stationary sequences of integer-valued random variables, and we provide sufficient conditions for S_n to satisfy a local limit theorem. To prove this result, we introduce a concept called the Bernoulli part. The amount of Bernoulli part in S_n determines the extent to which the density of S_n is relatively flat. If in addition S_n satisfies a global central limit theorem, the local limit theorem follows.     

The search for submarine pingos in the Beaufort Sea: An unusual application of the binomial distribution

Almost all statistical estimation problems involving the binomial distribution occur with the number of independent Bernoulli trials, n, being a known parameter and the probability of success, p, being unknown. Applications in which n is unknown and p is known are extremely rare. One such application to a real problem in the physical sciences is the subject of this note.     

Bayes and Empirical Bayes Estimation of the Parameter n in a Binomial Distribution

The problem of estimating the total number of trials n in a binomial distribution is reconsidered in this article for both cases of known and unknown probability of success p from the Bayesian viewpoint. Bayes and empirical Bayes point estimates for n are proposed under the assumption of a left-truncated prior distribution for n and a beta prior distribution for p. Simulation studies are provided in this article in order to compare the proposed estimate with the most familiar n estimates.     

Expected Absolute Error of the Usual Estimator of the Binomial Parameter

For X with binomial (n, p) distribution the usual measure of the error of X/n as an estimator of p is its standard error S_n(p) = √{E(X/n – p)²} = √{p(1 – p)/n}. A somewhat more natural measure is the average absolute error D_n(p) = E‖X/n – p‖. This article considers use of D_n(p) instead of S_n(p) in a student's first introduction to statistical estimation. Exact and asymptotic values of D_n(p), and the appearance of its graph, are described in detail. The same is done for the Poisson distribution.     

Bayesian Analysis of Contingency Tables

ABSTRACT

The display of the data by means of contingency tables is used in different approaches to statistical inference, for example, to broach the test of homogeneity of independent multinomial distributions. We develop a Bayesian procedure to test simple null hypotheses versus bilateral alternatives in contingency tables. Given independent samples of two binomial distributions and taking a mixed prior distribution, we calculate the posterior probability that the proportion of successes in the first population is the same as in the second. This posterior probability is compared with the p-value of the classical method, obtaining a reconciliation between both results, classical and Bayesian. The obtained results are generalized for r × s tables.     

A Bayesian non‐inferiority test for two independent binomial proportions

In drug development, non‐inferiority tests are often employed to determine the difference between two independent binomial proportions. Many test statistics for non‐inferiority are based on the frequentist framework. However, research on non‐inferiority in the Bayesian framework is limited. In this paper, we suggest a new Bayesian index τ = P(π₁ > π₂ ? Δ₀ | X₁,X₂), where X₁ and X₂ denote binomial random variables for trials n₁ and n₂, and parameters π₁ and π₂, respectively, and the non‐inferiority margin is Δ₀ > 0. We show two calculation methods for τ, an approximate method that uses normal approximation and an exact method that uses an exact posterior PDF. We compare the approximate probability with the exact probability for τ. Finally, we present the results of actual clinical trials to show the utility of index τ. Copyright © 2013 John Wiley & Sons, Ltd.     

On the asymptotic expectation and variance of the number of boundary crossings

Let X₁,X₂,… be independent and identically distributed nonnegative random variables with mean μ, and let S_n = X₁ + … + X_n. For each λ > 0 and each n ≥ 1, let A_n be the interval [λn^Y, ∞), where γ > 1 is a constant. The number of times that S_n is in A_n is denoted by N. As λ tends to zero, the asymtotic behavior of N is studied. Specifically under suitable conditions, the expectation of N is shown to be (μλ^?1)^β + o(λ^?β/2 where β = 1/(γ-1) and the variance of N is shown to be (μλ^?1)^β(βμ¹)²σ² + o(λ^?β) where σ² is the variance of X_n.     

Recursive characterization of a large family of discrete probability distributions showing extra-Poisson variation

This article analyses the broad family of discrete probability distributions generated by relating Prob (y) to Prob (y?1), …, Prob (y?n), for some n≥1, through a recursive equation. This family contains the binomial, negative binomial and Poisson distributions as well as the Katz family of distributions. In addition, the suggested family contains some convolutions of Poisson distributions and other generalized distributions, which provide models for Poisson overdispersion or underdispersion.     

Exact distribution of the convolution of negative binomial random variables

In this note, we derive the exact distribution of S by using the method of generating function and BELL polynomials, where S = X₁ + X₂ + ??? + X_n, and each X_i follows the negative binomial distribution with arbitrary parameters. As a particular case, we also obtain the exact distribution of the convolution of geometric random variables.     

Empirical Bayes testing for guarantee lifetime: Non identical components case

This article considers an empirical Bayes testing problem for the guarantee lifetime in the two-parameter exponential distributions with non identical components. We study a method of constructing empirical Bayes tests under a class of unknown prior distributions for the sequence of the component testing problems. The asymptotic optimality of the sequence of empirical Bayes tests is studied. Under certain regularity conditions on the prior distributions, it is shown that the sequence of the constructed empirical Bayes tests is asymptotically optimal, and the associated sequence of regrets converges to zero at a rate O(n^{? 1 + 1/[2(r + α) + 1]}) for some integer r ? 0 and 0 ? α ? 1 depending on the unknown prior distributions, where n is the number of past data available when the (n + 1)st component testing problem is considered.     

Some characterizations of discrete distributions based on weak records

Let X ₁, X ₂,... be iid random variables (rv's) with the support on nonnegative integers and let (W _n , n≥0) denote the corresponding sequence of weak record values. We obtain new characterization of geometric and some other discrete distributions based on different forms of partial independence of rv's W _n and W _n+r —W _n for some fixed n≥0 and r≥1. We also prove that rv's W ₀ and W _n+1 —W _n have identical distribution if and only if (iff) the underlying distribution is geometric.     

Forecasting future values of changing sequences

Sequences of independent random variables are observed and on the basis of these observations future values of the process are forecast. The Bayesian predictive density of k future observations for normal, exponential, and binomial sequences which change exactly once are analyzed for several cases. It is seen that the Bayesian predictive densities are mixtures of standard probability distributions. For example, with normal sequences the Bayesian predictive density is a mixture of either normal or t-distributions, depending on whether or not the common variance is known. The mixing probabilities are the same as those occurring in the corresponding posterior distribution of the mean(s) of the sequence. The predictive mass function of the number of future successes that will occur in a changing Bernoulli sequence is computed and point and interval predictors are illustrated.     

On approximating point spread distributions

We discuss some properties of the point spread distribution, defined as the distribution of the difference of two independent binomial random variables with the same parameter n including exact and approximate probabilities and related optimization issues. We use various approximation techniques for different distributions, special functions, and analytic, combinatorial and symbolic methods, such as multi-summation techniques. We prove that in case of unequal success rates, if these rates change with their difference kept fixed and small, and n is appropriately bounded, then the point spread distribution only slightly changes for small point differences. We also prove that for equal success rates p, the probability of a tie is minimized if p=1/2. Numerical examples are included for the case with n=12.