Finite mixtures of natural exponential families

Let μ be a positive measure concentrated on R⁺ generating a natural exponential family (NEF) F with quadratic variance function V_F(m), m being the mean parameter of F. It is shown that v(dx) = (γ+x)μ(γ ≥ 0) (γ ≥ 0) generates a NEF G whose variance function is of the form l(m)Δ+cΔ(m), where l(m) is an affine function of m, Δ(m) is a polynomial in m (the mean of G) of degree 2, and c is a constant. The family G turns out to be a finite mixture of F and its length-biased family. We also examine the cases when F has cubic variance function and show that for suitable choices of γ the family G has variance function of the form P(m) + Q(m)m where P, Q are polynomials in m of degree m2 while Δ is an affine function of m. Finally we extend the idea to two dimensions by considering a bivariate Poisson and bivariate gamma mixture distribution.     

Kolmogorov-type tests of goodness-of-fit against stochastic ordering

This article addresses the problem of testing the null hypothesis H₀ that a random sample of size n is from a distribution with the completely specified continuous cumulative distribution function F_n(x). Kolmogorov-type tests for H₀ are based on the statistics C⁺ _n = Sup[F_n(x)?F₀(x)] and C^? _n=Sup[F₀(x)?F_n(x)], where F_n(x) is an empirical distribution function. Let F(x) be the true cumulative distribution function, and consider the ordered alternative H₁: F(x)≥F₀(x) for all x and with strict inequality for some x. Although it is natural to reject H₀ and accept H₁ if C ⁺ _n is large, this article shows that a test that is superior in some ways rejects F₀ and accepts H₁ if C^mdash _n is small. Properties of the two tests are compared based on theoretical results and simulated results.     

An exact test for nbue class of survival functions

Let F(x) be a life distribution. An exact test is given for testing H₀ F is exponential, versusH₁Fε NBUE (NWUE); along with a table of critical values for n=5(l)80, and n=80(5)65. An asymptotic test is made available for large values of n, where the standardized normal table can be used for testing.     

Computation of the central and noncentral f distributions

Recursion relations suitable for rapid computation are derived for the cumulative distribution of F′ = (X/m)/(Y/n) where X is χ²(λ, m) and Y is independently χ²(n). When n is even no complicated function evaluations are needed. For n odd, a special doubly noncentral t distribution is needed to start the computation. Series representations for this t distribution are given with rigorous bounds on truncation errors. Proper recursion techniques for numerical evaluation of the special functions are given.     

Inequalities for generalized order statistics from some restricted family of distributions

The Steffensen inequality is applied to derive quantile bounds for the expectations of generalized order statistics from a distribution belonging to a particular subclass of distributions. The subclass consists of F having the property that F^?1(0+)=x₀>0 and that x →[1? F(x)]x^z is nonincreasing for all x > X₀ and some z > 0.     

Local asymptotic normality of intermediate and central order statistics

Consider n independent random variables Z_i,…, Z_n on R with common distribution function F, whose upper tail belongs to a parametric family F(t) = F_θ(t),t ≥ x₀, where θ ∈ ? ? R ^d. A necessary and sufficient condition for the family F_θ, θ ∈ ?, is established such that the k-th largest order statistic Z_n?k+1:n alone constitutes the central sequence yielding local asymptotic normality ( LAN ) of the loglikelihood ratio of the vector (Z_n?i+1:n)¹ _i=kof the k largest order statistics. This is achieved for k = k(n)→_n→∞∞ with k/n→_n→∞ 0.

In the case of vectors of central order statistics ( Z_r:n, Z_r+1:n,…, Z_s:n ), with r/n and s/n both converging to q ∈ ( 0,1 ), it turns out that under fairly general conditions any order statistic Z_m:n with r ≤ m ≤s builds the central sequence in a pertaining LAN expansion.These results lead to asymptotically optimal tests and estimators of the underlying parameter, which depend on single order statistics only     

On a Berry-Esséen theorem for a Studentized jackknife L-estimate

Consider a linear function of order statistics (“L-estimate”) which can be expressed as a statistical function T(F_n) based on the sample cumulative distribution function F_n. Let T*(F_n) be the corresponding jackknifed version of T(F_n), and let V²_n be the jackknife estimate of the asymptotic variance of n ^1/2T(F_n) or n ^1/2T*(F_n). In this paper, we provide a Berry-Esséen rate of the normal approximation for a Studentized jackknife L-estimate n^1/2[T*(F_n) - T(F)]/V_n, where T(F) is the basic functional associated with the L-estimate.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

On a Class of Distributions Defined by the Relationship Between Their Density and Distribution Functions

Knowledge concerning the family of univariate continuous distributions with density function f and distribution function F defined through the relation f(x) = F ^α(x)(1 ? F(x))^β, α, β ? , is reviewed and modestly extended. Symmetry, modality, tail behavior, order statistics, shape properties based on the mode, L-moments, and—for the first time—transformations between members of the family are the general properties considered. Fully tractable special cases include all the complementary beta distributions (including uniform, power law and cosine distributions), the logistic, exponential and Pareto distributions, the Student t distribution on 2 degrees of freedom and, newly, the distribution corresponding to α = β = 5/2. The logistic distribution is central to some of the developments of the article.     

Asymptotic calculations of functions of expected values and covariances of order statistics

Suppose m and V are respectively the vector of expected values and the covariance matrix of the order statistics of a sample of size n from a continuous distribution F. A method is presented to calculate asymptotic values of functions of m and V ^–1, for distributions F which are sufficiently regular. Values are given for the normal, logistic, and extreme-value distributions; also, for completeness, for the uniform and exponential distributions, although for these other methods must be used.     

On Censored Bivariate Random Variables: Copula,Characterization, and Estimation

Let (X, Y) be a bivariate random vector with joint distribution function F_{X, Y}(x, y) = C(F(x), G(y)), where C is a copula and F and G are marginal distributions of X and Y, respectively. Suppose that (X_i, Y_i), i = 1, 2, …, n is a random sample from (X, Y) but we are able to observe only the data consisting of those pairs (X_i, Y_i) for which X_i ? Y_i. We denote such pairs as (X*_i, Y_i*), i = 1, 2, …, ν, where ν is a random variable. The main problem of interest is to express the distribution function F_{X, Y}(x, y) and marginal distributions F and G with the distribution function of observed random variables X* and Y*. It is shown that if X and Y are exchangeable with marginal distribution function F, then F can be uniquely determined by the distributions of X* and Y*. It is also shown that if X and Y are independent and absolutely continuous, then F and G can be expressed through the distribution functions of X* and Y* and the stress–strength reliability P{X ? Y}. This allows also to estimate P{X ? Y} with the truncated observations (X*_i, Y_i*). The copula of bivariate random vector (X*, Y*) is also derived.     

Small-sample results for maximum-likelihood estimation in branching processes

In this article, small sample properties of the maximum-likelihood estimator (m.l.e.) for the offspring distribution (pk) and its mean m are considered in the context of the simple branching process. A representation theorem is given for the m.l.e. of (Pk) from which the m.l.e. of m is obtained. The case where p0 + p1 + p2 = 1 is studied in detail: numerical results are given for the exact bias of these estimators as a function of the age of the process; a curve fitting analysis expresses the bias of m? as a function of the mean and the variance of the offspring distribution and finally an “approximate m.l.e.” for (pk) is given.     

Dispersive ordering—Some applications and examples

A basic concept for comparing spread among probability distributions is that of dispersive ordering. Let X and Y be two random variables with distribution functions F and G, respectively. Let F ⁻¹ and G ⁻¹ be their right continuous inverses (quantile functions). We say that Y is less dispersed than X (Y≤ _disp X) if G ⁻¹(β)−G ⁻¹(α)≤F ⁻¹(β)−F ⁻¹(α), for all 0<α≤β<1. This means that the difference between any two quantiles of G is smaller than the difference between the corresponding quantiles of F. A consequence of Y≤ _disp X is that |Y ₁−Y ₂| is stochastically smaller than |X ₁−X ₂| and this in turn implies var(Y)≤var(X) as well as E[|Y ₁−Y ₂|]≤E[|X ₁−X ₂|], where X ₁, X ₂ (Y ₁, Y ₂) are two independent copies of X(Y). In this review paper, we give several examples and applications of dispersive ordering in statistics. Examples include those related to order statistics, spacings, convolution of non-identically distributed random variables and epoch times of non-homogeneous Poisson processes. This work was supported in part by KOSEF through Statistical Research Center for Complex Systems at Seoul National University. Subhash Kochar is thankful to Dr. B. Khaledi for many helpful discussions.     

Uniform convergence of an empirical cdf based on a relatively small number of order statistics

An empirical distribution function F_m, defined on a subset of order statistics of a random sample of size n taken from the distribution of a random variable with continuous distribution function F, is shown to converge uniformly with probability one to F. Small sample distributions of the one and two sided deviations and the asymptotic normality of the standardized F_m are established. The relative efficiency of F_m as compared to the classical empirical distribution function is calculated and tabled. for n = 10, 20, 50, 100, 200.     

The n.s. conditions for the ration of two quadratic forms to have an f-distribution and its applications

Suppose that ξ and η be two random vectors and that (ξ^τ, η^τ have an elliptically contoured distribution or a multivariate normal distribution. In this article, we obtain some necessary and sufficient (N.S.) conditions such that the ratio of two quadratic forms, say ξ^τ Aξ and η^τ Bη(for some symmetric nonnegative matrices A and B), has an F-distribution. As applications, we extend the classical F-test to some dependent two group samples. Two cases are considered: elliptically contoured and normal distributions.     

Simple bounds on availability in a model with unknown life and repair distributions

We take a fresh look at the classic model of a device supported by a single statistically identical spare and provision for repairs, with system failure resulting whenever the currently operating unit fails before the repair of the previously failed unit is completed to allow it to become a spare. The limiting availability A(F,G) of this system depends on the life distribution F and repair time distribution G through α=∫GdF and the expected downtime. In this paper we derive several computable and sharp bounds on A(F,G) when F,G have suitable life distribution characteristics in the sense of reliability theory but are otherwise unknown except for at most two moments. Among other results, we find a sharp bound which involves the MTBF, MTTR and the second moment of the life-distribution of the device through its coefficient of variation. This leads to a maximin result for DFR repairs and DMRL lives.     

An asymptotic sequential test based on confidence sequences

In the context of a translation parameter family of distributions F₀(x) = F(x-θ) an asymptotic sequential test of H₀: θ ≤ -△ versus H₁: θ ≥ △ developed. The test is based on confidence sequences. In the special case where F is a specified normal distribution the proposed test is uniformly at least as efficient (in the sense of Rechanter (1960)) as the Wald sequention probibilty ratio test.     

On An Intriguing Distributional Identity

For a continuous random variable X with support equal to (a, b), with c.d.f. F, and g: Ω₁ → Ω₂ a continuous, strictly increasing function, such that Ω₁∩Ω₂?(a, b), but otherwise arbitrary, we establish that the random variables F(X) ? F(g(X)) and F(g^{? 1}(X)) ? F(X) have the same distribution. Further developments, accompanied by illustrations and observations, address as well the equidistribution identity U ? ψ(U) = ^dψ^{? 1}(U) ? U for U ～ U(0, 1), where ψ is a continuous, strictly increasing and onto function, but otherwise arbitrary. Finally, we expand on applications with connections to variance reduction techniques, the discrepancy between distributions, and a risk identity in predictive density estimation.     

Bounds for Expectations of Differences of Generalized Order Statistics Based on General and Life Distributions

Let X _? ^(r), r ≥ 1, denote generalized order statistics based on an arbitrary distribution function F with finite pth absolute moment for some 1 ≤ p ≤ ∞. We present sharp upper bounds on E(X _? ^(s) ? X _? ^(r)), 1 ≤ r < s, for F being either general or life distribution. The bounds are expressed in various scale units generated by pth central absolute or raw moments of F, respectively. The distributions achieving the bounds are specified.     

Asymptotic distributions of order statistics and record values arising from the class of beta-generated distributions

In this paper, we show that both the class of beta-generated distributions G_F and its base distribution F belong to the same domain of maximal (or minimal or upper record value or lower record value) attraction. Moreover, it is shown that the weak convergence of any non-extreme order statistic (central or intermediate order statistic), based on a base distribution F, to a non-degenerate limit type implies the weak convergence of G_F to a non-degenerate limit type. The relations between the two limit types are deduced.