Probability inequalities for continuous unimodal random variables with finite support

A paramecer-free Bernstein-type upper bound is derived for the probability that the sum S of n i.i.d, unimodal random variables with finite support, X₁ ,X₂,…,X_n, exceeds its mean E(S) by the positive value nt. The bound for P{S - nμ ≥ nt} depends on the range of the summands, the sample size n, the positive number t, and the type of unimodality assumed for X_i. A two-sided Gauss-type probability inequality for sums of strongly unimodal random variables is also given. The new bounds are contrasted to Hoeffding's inequality for bounded random variables and to the Bienayme-Chebyshev inequality. Finally, the new inequalities are applied to a classic probability inequality example first published by Savage (1961).     

Bounds on Bivariate Distribution Functions with Given Margins and Known Values at Several Points

Let H(x, y) be a continuous bivariate distribution function with known marginal distribution functions F(x) and G(y). Suppose the values of H are given at several points, H(x _i , y _i ) = θ _i , i = 1, 2,…, n. We first discuss conditions for the existence of a distribution satisfying these conditions, and present a procedure for checking if such a distribution exists. We then consider finding lower and upper bounds for such distributions. These bounds may be used to establish bounds on the values of Spearman's ρ and Kendall's τ. For n = 2, we present necessary and sufficient conditions for existence of such a distribution function and derive best-possible upper and lower bounds for H(x, y). As shown by a counter-example, these bounds need not be proper distribution functions, and we find conditions for these bounds to be (proper) distribution functions. We also present some results for the general case, where the values of H(x, y) are known at more than two points. In view of the simplification in notation, our results are presented in terms of copulas, but they may easily be expressed in terms of distribution functions.     

Some competitors of the mood test for the two-sample scale problem

Let X_l,…,X_n (Y_l,…,Y_m) be a random sample from an absolutely continuous distribution with distribution function F(G).A class of distribution-free tests based on U-statistics is proposed for testing the equality of F and G against the alternative that X's are more dispersed then Y's. Let 2 ? C ? n and 2 ? d ? m be two fixed integers. Let ?_c,d(X_il,…,X_ic ; Y_jl,…,X_jd)=1(-1)when max as well as min of {X_il,…,X_ic ; Y_jl,…,Y_jd } are some X_i's (Y_j's)and zero oterwise. Let S_c,d be the U-statistic corresponding to ?_c,d.In case of equal sample sizes, S22 is equivalent to Mood's Statistic.Large values of S_c,d are significant and these tests are quite efficient     

Bounds on the expected maximum

Let (X₁,X₂, …,X_n) be jointly distributed random variables. Define X_n:n = max(X₁,X₂, …,X_n).Bounds on E(X_n:n), obtained by putting constraints on the distributions and/or dependence structure of the X_i's, are surveyed.     

On characterizations based on record values and order statistics

Consider an infinite sequence of independent random variables having common continuous c.d.f. F. For 1 ⩽ i ⩽ n, let X_i:n denote the ith order statistic of the first n random variables, and let {X(n), n ⩾ 1} be the sequence of upper record values. We examine the similarities and differences between the dependence structures of the X_i:n's and the X(n)'s, with an emphasis on the latter. We present an interesting situation involving a characterization of F using the moment sequence of records. We obtain characterizations based on the properties of certain regression functions associated with order statistics, record values, and the original observations. We discuss the resemblance between some known and some new characterizations based on order statistics, record values and those based on the properties of truncated F.     

Confidence bounds for the joint survival function in the dependent competing risks setup

In the competing risks set up with two dependent competing risks, the joint distribution of (X₁,X₂), the latent lifetimes of the system under the two risks, is not identifiable on the basis of the distribution of the actual observation (T, δ) where T = min(X₁, X₂) and δ = I(T=X₁), Using Peterson's (1976) bounds, we have obtained conservative pointwise as well as simultaneous confidence bounds for the unidentifiable joint survival function. In an example we evaluate the confidence bounds and Indicate where the estimated joint survival function in the independent case, lies within them.     

Information Properties for Concomitants of Order Statistics in Farlie–Gumbel–Morgenstern (FGM) Family

Let (X _i , Y _i ), i = 1, 2,…, n be independent and identically distributed random variables from some continuous bivariate distribution. If X _(r) denotes the rth-order statistic, then the Y's associated with X _(r) denoted by Y _[r] is called the concomitant of the rth-order statistic. In this article, we derive an analytical expression of Shannon entropy for concomitants of order statistics in FGM family. Applying this expression for some well-known distributions of this family, we obtain the exact form of Shannon entropy, some of the information properties, and entropy bounds for concomitants of order statistics. Some comparisons are also made between the entropy of order statistics X _(r) and the entropy of its concomitants Y _[r]. In this family, we show that the mutual information between X _(r) and Y _[r], and Kullback–Leibler distance among the concomitants of order statistics are all distribution-free. Also, we compare the Pearson correlation coefficient between X _(r) and Y _[r] with the mutual information of (X _(r), Y _[r]) for the copula model of FGM family.     

A Note on the Calculation of Pr{X 1 < X 2 < ··· < Xk }

Suppose that X_i are independent random variables, and that X_i has cdf F_i (x), 1 ≤ i ≤ k. Many statistical problems involve the probability Pr{X ₁ < X ₂ < ··· < X_k }. In this note a numerical method is proposed for computing this probability.     

Bounds for Expectations of Differences of Generalized Order Statistics Based on General and Life Distributions

Let X _? ^(r), r ≥ 1, denote generalized order statistics based on an arbitrary distribution function F with finite pth absolute moment for some 1 ≤ p ≤ ∞. We present sharp upper bounds on E(X _? ^(s) ? X _? ^(r)), 1 ≤ r < s, for F being either general or life distribution. The bounds are expressed in various scale units generated by pth central absolute or raw moments of F, respectively. The distributions achieving the bounds are specified.     

Berry-Esseen bounds for kernel estimates of stationaryprocesses

In this paper we obtain nonuniform Berry-Esseen bounds of the kernel estimate of stationary process {X_i} by the method of martingale approximation. In particular, by choice of bandwidth b_n, the Berry-Esseen bounds can be n^−2/15. The dependence condition of {X_i} is expressed in terms of physical dependence measures introduced by Wu (2005).     

VARIANCE ESTIMATION IN MULTI-STAGE SAMPLING

In multi-stage sampling with the first stage units (fsu) chosen without replacement (WOR) with varying probability schemes (VPS) unbiased estimators (UE) of variances of homogeneous linear (HL) functions of unbiased estimators (UE) T_i's of fsu totals Y_i's based on selection of subsequent stage units (SSU) from chosen fsu's are derived as homogeneous quadratic (HQ) functions of alternative less efficient UE's, say of T_i';'s of Y_i's. Specific strategies are illustrated.     

Simulation of a stationary autoregression: A characterization of the normal distribution

Simulating a stationary AR(p), X_t = ∑^p_i=1α_iX_t−i + Z_t, when the innovations {Z_t} are assumed to be i.i.d. is straightforward. Starting the process in the stationary state, however, requires generation of (X₁,X₂,…,X_p) from the stationary p-dimensional distribution. When Z_t is normal this may be achieved by generating X_i as a linear function of X₁,X₂,…,X_i−1 and an independent normal variate for i = 2,3,…, p. It is shown that the ability to initialize a stationary AR(p) in this way characterizes the normal distribution.     

Test of equality of normal means in the absence of independent estimator of variance

Let X_l,…,X_n be normally and independently distributed with means θ_l,…,θ_nand a cornmorl variance. Thus there are n observations and n+i unknwon parameters. A test of the null hypothesis that, the θ_i's are all zero and the alternative that the vector (θ_l,…,θ_n) lies in a convex cone with its vertex a.t the origin is connsidered in this paper. It is shown that under a mild condition the likelihood ratio test is possible. The ordinary one sided t - test belongs to the class of tests considered in this paper. The hypothesis of equality of means against the simple order alternative can be tested in certain cases .     

Some New Results on Likelihood Ratio Orderings for Spacings of Heterogeneous Exponential Random Variables

Let X ₁, X ₂,…, X _n be independent exponential random variables with X _i having failure rate λ _i for i = 1,…, n. Denote by D _i:n  = X _i:n  ? X _i?1:n the ith spacing of the order statistics X _1:n  ≤ X _2:n  ≤ ··· ≤ X _n:n , i = 1,…, n, where X _0:n ≡ 0. It is shown that if λ _n+1 ≤ [≥] λ _k for k = 1,…, n then D _n:n  ≤ _lr D _n+1:n+1 and D _1:n  ≤ _lr D _2:n+1 [D _2:n+1 ≤ _lr D _2:n ], and that if λ _i  + λ _j  ≥ λ _k for all distinct i,j, and k then D _n?1:n  ≤ _lr D _n:n and D _n:n+1 ≤ _lr D _n:n , where ≤ _lr denotes the likelihood ratio order. We also prove that D _1:n  ≤ _lr D _2:n for n ≥ 2 and D _2:3 ≤ _lr D _3:3 for all λ _i 's.     

A predictive approach for the selection of a fixed number of good treatments

This paper offers a predictive approach for the selection of a fixed number (= t) of treatments from k treatments with the goal of controlling for predictive losses. For the ith treatment, independent observations X _ij (j = 1,2,…,n) can be observed where X _ij ’s are normally distributed N(θ _i ; σ ²). The ranked values of θ _i ’s and X _i ’s are θ ₍₁₎ ≤ … ≤ θ _(k) and X _[1] ≤ … ≤ X _[k] and the selected subset S = {[k], [k? 1], … , [k ? t+1]} will be considered. This paper distinguishes between two types of loss functions. A type I loss function associated with a selected subset S is the loss in utility from the selector’s view point and is a function of θ _i with i ? S. A type II loss function associated with S measures the unfairness in the selection from candidates’ viewpoint and is a function of θ _i with i ? S. This paper shows that under mild assumptions on the loss functions S is optimal and provides the necessary formulae for choosing n so that the two types of loss can be controlled individually or simultaneously with a high probability. Predictive bounds for the losses are provided, Numerical examples support the usefulness of the predictive approach over the design of experiment approach.     

ON ASYMPTOTIC OPTIMALITY OF SOME TESTS FOR EXPONENTIAL DISTRIBUTIONS

The probability density function (pdf) of a two parameter exponential distribution is given by f(x; p, s?) =s?^-1 exp {-(x - ρ)/s?} for x≥ρ and 0 elsewhere, where 0 < ρ < ∞ and 0 < s?∞. Suppose we have k independent random samples where the ith sample is drawn from the ith population having the pdf f(x; ρ_i, s?_i), 0 < ρ_i < ∞, 0 < s?_i < s?_i < and f(x; ρ, s?) is as given above. Let X_i1 < X_i2 <… < X_iri denote the first r_i order statistics in a random sample of size n_i, drawn from the ith population with pdf f(x; ρ_i, s?_i), i = 1, 2,…, k. In this paper we show that the well known tests of hypotheses about the parameters ρ_i, s?_i, i = 1, 2,…, k based on the above observations are asymptotically optimal in the sense of Bahadur efficiency. Our results are similar to those for normal distributions.     

Estimation of the Scale Parameter of the Selected Gamma Population Under the Entropy Loss Function

Let X ₁, X ₂,…, X _k be k (≥2) independent random variables from gamma populations Π₁, Π₂,…, Π _k with common known shape parameter α and unknown scale parameter θ _i , i = 1,2,…,k, respectively. Let X _(i) denotes the ith order statistics of X ₁,X ₂,…,X _k . Suppose the population corresponding to largest X _(k) (or the smallest X ₍₁₎) observation is selected. We consider the problem of estimating the scale parameter θ _M (or θ _J ) of the selected population under the entropy loss function. For k ≥ 2, we obtain the Unique Minimum Risk Unbiased (UMRU) estimator of θ _M (and θ _J ). For k = 2, we derive the class of all linear admissible estimators of the form cX ₍₂₎ (and cX ₍₁₎) and show that the UMRU estimator of θ _M is inadmissible. The results are extended to some subclass of exponential family.     

Constants on a Uniform Berry-Esseen Bound on Some Borel Sets in ℝ k via Stein's Method

For each n, k ∈ ?, let Y _i  = (Y _i1, Y _i2,…, Y _ik ), 1 ≤ i ≤ n be independent random vectors in ? ^k with finite third moments and Y _ij are independent for all j = 1, 2,…, k. In this article, we use the Stein's technique to find constants in uniform bounds for multidimensional Berry-Esseen inequality on a closed sphere, a half plane and a rectangular set.