Simultaneous estimation of several CDF’s: homogeneity constraint

Let {x_ij(1 ? j ? n_i)|i = 1, 2, …, k} be k independent samples of size n_j from respective distributions of functions F_j(x)(1 ? j ? k). A classical statistical problem is to test whether these k samples came from a common distribution function, F(x) whose form may or may not be known. In this paper, we consider the complementary problem of estimating the distribution functions suspected to be homogeneous in order to improve the basic estimator known as “empirical distribution function” (edf), in an asymptotic setup. Accordingly, we consider four additional estimators, namely, the restricted estimator (RE), the preliminary test estimator (PTE), the shrinkage estimator (SE), and the positive rule shrinkage estimator (PRSE) and study their characteristic properties based on the mean squared error (MSE) and relative risk efficiency (RRE) with tables and graphs. We observed that for k ? 4, the positive rule SE performs uniformly better than both shrinkage and the unrestricted estimator, while PTEs works reasonably well for k < 4.     

ON TRANSITION PROBABILITIES OF SKIP-FREE MARKOV CHAINS

Consider an ergodic Markov chain X(t) in continuous time with an infinitesimal matrix Q = (q_ij) defined on a finite state space {0, 1,…, N}. In this note, we prove that if X(t) is skip-free positive (negative, respectively), i.e., q_ij, = 0 for j > i+ 1 (i > j+ 1), then the transition probability p_ij(t) = Pr[X(t)=j | X(0) =i] can be represented as a linear combination of p_0N(t) (p^(m)_(N0)(t)), 0 ≤ m ≤N, where f^(m)(t) denotes the mth derivative of a function f(t) with f⁽⁰⁾(t) =f(t). If X(t) is a birth-death process, then p_ij(t) is represented as a linear combination of p_0N^(m)(t), 0 ≤m≤N - |i-j|.     

DISTRIBUTIONS IN R WITH ROTATIONAL SYMMETRIES1

Let X ∈ R be a random vector with a distribution which is invariant under rotations within the subspaces V_j (dim V_j. = q_j) whose direct sum is R. The large sample distributions of the eigenvalues and vectors of M_n= n^-1Σⁿ_l x_ix_i are studied. In particular it is shown that several eigenvalue results of Anderson & Stephens (1972) for uniformly distributed unit vectors hold more generally.     

Testing independence with additional information

Let X = (X^j : j = 1,…, n) be n row vectors of dimension p independently and identically distributed multinomial. For each j, X^j is partitioned as X^j = (X^j₁, X^j₂, X^j₃), where p_i is the dimension of X^j_i with p₁ = 1,p₁+p₂+p₃ = p. In addition, consider vectors Y^j_i, i = 1,2j = 1,…,n_i that are independent and distributed as X¹_i. We treat here the problem of testing independence between X¹₁ and X¹₃ knowing that X¹₁ and X¹₂ are uncorrected. A locally best invariant test is proposed for this problem.     

Precise large deviations for the difference of two sums of WUOD and non identically distributed random variables with dominatedly varying tails

In this article, we study large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j, where {X_1j, j ? 1} is a sequence of widely upper orthant dependent (WUOD) random variables with non identical distributions {F_1j(x), j ? 1}, {X_2j, j ? 1} is a sequence of independent identically distributed random variables, n₁(t) and n₂(t) are two positive integer-valued functions, and {N_i(t), t ? 0}²_{i = 1} with EN_i(t) = λ_i(t) are two counting processes independent of {X_ij, j ? 1}²_{i = 1}. Under several assumptions, some results of precise large deviations for non random difference and random difference are derived, and some corresponding results are extended.     

A One Sided Test Based on Sample Quasi Ranges

Abstract

Let the data from the ith treatment/population follow a distribution with cumulative distribution function (cdf) F _i (x) = F[(x ? μ _i )/θ _i ], i = 1,…, k (k ≥ 2). Here μ _i (?∞ < μ _i  < ∞) is the location parameter, θ _i (θ _i  > 0) is the scale parameter and F(?) is any absolutely continuous cdf, i.e., F _i (?) is a member of location-scale family, i = 1,…, k. In this paper, we propose a class of tests to test the null hypothesis H ₀ ? θ₁ = · = θ _k against the simple ordered alternative H _A  ? θ₁ ≤ · ≤ θ _k with at least one strict inequality. In literature, use of sample quasi range as a measure of dispersion has been advocated for small sample size or sample contaminated by outliers [see David, H. A. (1981). Order Statistics. 2nd ed. New York: John Wiley, Sec. 7.4]. Let X _i1,…, X _in be a random sample of size n from the population π _i and R _ir  = X _i:n?r  ? X _i:r+1, r = 0, 1,…, [n/2] ? 1 be the sample quasi range corresponding to this random sample, where X _i:j represents the jth order statistic in the ith sample, j = 1,…, n; i = 1,…, k and [x] is the greatest integer less than or equal to x. The proposed class of tests, for the general location scale setup, is based on the statistic W _r  = max_1≤i<j≤k (R _jr /R _ir ). The test is reject H ₀ for large values of W _r . The construction of a three-decision procedure and simultaneous one-sided lower confidence bounds for the ratios, θ _j /θ _i , 1 ≤ i < j ≤ k, have also been discussed with the help of the critical constants of the test statistic W _r . Applications of the proposed class of tests to two parameter exponential and uniform probability models have been discussed separately with necessary tables. Comparisons of some members of our class with the tests of Gill and Dhawan [Gill A. N., Dhawan A. K. (1999). A One-sided test for testing homogeneity of scale parameters against ordered alternative. Commun. Stat. – Theory and Methods 28(10):2417–2439] and Kochar and Gupta [Kochar, S. C., Gupta, R. P. (1985). A class of distribution-free tests for testing homogeneity of variances against ordered alternatives. In: Dykstra, R. et al., ed. Proceedings of the Conference on Advances in Order Restricted Statistical Inference at Iowa city. Springer Verlag, pp. 169–183], in terms of simulated power, are also presented.     

Fitting a multiple regression function

Consider the p-dimensional unit cube [0,1]^p, p≥1. Partition [0, 1]^p into n regions, R_1,n,…,R_n,n such that the volume Δ(R_j,n) is of order n^?1,j=1,…,n. Select and fix a point in each of these regions so that we have x⁽ⁿ⁾₁,…,x⁽ⁿ⁾_n. Suppose that associated with the j-th predictor vector x⁽ⁿ⁾_j there is an observable variable Y⁽ⁿ⁾_j, j=1,…,n, satisfying the multiple regression model $\text{Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{=g(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{)+e}{}^{\mathrm{(n)}}{}_{\mathrm{j}}$, where g is an unknown function defined on [0, 1]^pand {e⁽ⁿ⁾_j} are independent identically distributed random variables with Ee⁽ⁿ⁾₁=0 and Var e⁽ⁿ⁾₁=σ²<∞. This paper proposes as an estimator of g(x), where k(u) is a known p-dimensional bounded density and {a_n} is a sequence of reals converging to 0 asn→∞. Weak and strong consistency of g_n(x) and rates of convergence are obtained. Asymptoticnormality of the estimator is established. Also proposed is $\text{σ}{}^2{}_{\mathrm{n}}\text{=n}{}^{\mathrm{?1}}\text{Σ}{}^{\mathrm{n}}{}_{\mathrm{j=1}}\text{(Y}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{?g}{}_{\mathrm{n}}\text{(}\text{x}{}^{\mathrm{(n)}}{}_{\mathrm{j}}\text{))}{}^2$ as a consistent estimate of σ².     

A Note on the Calculation of Pr{X 1 < X 2 < ··· < Xk }

Suppose that X_i are independent random variables, and that X_i has cdf F_i (x), 1 ≤ i ≤ k. Many statistical problems involve the probability Pr{X ₁ < X ₂ < ··· < X_k }. In this note a numerical method is proposed for computing this probability.     

Local asymptotic normality of intermediate and central order statistics

Consider n independent random variables Z_i,…, Z_n on R with common distribution function F, whose upper tail belongs to a parametric family F(t) = F_θ(t),t ≥ x₀, where θ ∈ ? ? R ^d. A necessary and sufficient condition for the family F_θ, θ ∈ ?, is established such that the k-th largest order statistic Z_n?k+1:n alone constitutes the central sequence yielding local asymptotic normality ( LAN ) of the loglikelihood ratio of the vector (Z_n?i+1:n)¹ _i=kof the k largest order statistics. This is achieved for k = k(n)→_n→∞∞ with k/n→_n→∞ 0.

In the case of vectors of central order statistics ( Z_r:n, Z_r+1:n,…, Z_s:n ), with r/n and s/n both converging to q ∈ ( 0,1 ), it turns out that under fairly general conditions any order statistic Z_m:n with r ≤ m ≤s builds the central sequence in a pertaining LAN expansion.These results lead to asymptotically optimal tests and estimators of the underlying parameter, which depend on single order statistics only     

Berry–Esseen type bounds in heteroscedastic errors-in-variables model

ABSTRACT

Consider the heteroscedastic partially linear errors-in-variables (EV) model y_i = x_iβ + g(t_i) + ε_i, ξ_i = x_i + μ_i (1 ? i ? n), where ε_i = σ_ie_i are random errors with mean zero, σ²_i = f(u_i), (x_i, t_i, u_i) are non random design points, x_i are observed with measurement errors μ_i. When f( · ) is known, we derive the Berry–Esseen type bounds for estimators of β and g( · ) under {e_i,?1 ? i ? n} is a sequence of stationary α-mixing random variables, when f( · ) is unknown, the Berry–Esseen type bounds for estimators of β, g( · ), and f( · ) are discussed under independent errors.     

Kernel Estimators for Distribution Functions on Dependent Random Fields

Consider observations (representing lifelengths) taken on a random field indexed by lattice points. Estimating the distribution function F(x) = P(X _i  ≤ x) is an important problem in survival analysis. We propose to estimate F(x) by kernel estimators, which take into account the smoothness of the distribution function. Under some general mixing conditions, our estimators are shown to be asymptotically unbiased and consistent. In addition, the proposed estimator is shown to be strongly consistent and sharp rates of convergence are obtained.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

Admissible tests for the mean with additional information

Let X be a po-normal random vector with unknown µ and unknown covariance matrix ∑ and let X be partitioned as X = (X^′ ₍₁₎, …, X^′ _(r))′ where X_(j)is a subvector of X with dimension p_jsuch that ∑^r _j=1Pj = P0. Some admissible tests are derived for testing H₀: μ = 0 versus H₁: μ ¦0 based on a sample drawn from the whole vector X of dimension p and r additional samples drawn from X₍₁₎, X₍₂₎, …, X(r) respectively, All (r+1) samples are assumed to be independent. The distribution of some of the tests' statistics involved are also derived.     

Identifiability of distributions under competing risks and complementary risks model

Let X₁,X₂,…,X_p be p random variables with cdf's F₁(x),F₂(x),…,F_p(x)respectively. Let U = min(X₁,X₂,…,X_p) and V = max(X₁,X₂,…,X_p).In this paper we study the problem of uniquely determining and estimating the marginal distributions F₁,F₂,…,F_p given the distribution of U or of V.

First the problem of competing and complementary risks are introduced with examples and the corresponding identification problems are considered when the X₁'s are independently distributed and U(V) is identified, as well as the case when U(V) is not identified. The case when the X₁'s are dependent is considered next. Finally the problem of estimation is considered.     

The Recursive Kernel Distribution Function Estimator Based on Negatively and Positively Associated Sequences

Let {X _j , j ≥ 1} be a strictly stationary negatively or positively associated sequence of real valued random variables with unknown distribution function F(x). On the basis of the random variables {X _j , j ≥ 1}, we propose a smooth recursive kernel-type estimate of F(x), and study asymptotic bias, quadratic-mean consistency and asymptotic normality of the recursive kernel-type estimator under suitable conditions.     

Uniform asymptotic linearity in a regression parameter of a process based on a rank statistic

For X₁, …, X_N a random sample from a distribution F, let the process S^δ_N(t) be defined as where K²_N = σ^N_i=1(c_i ? c?)² and R x_i, + Δd, is the rank of X_i + Δd_i, among X₁ + Δd₁, …, X_N + Δd_N. The purpose of this note is to prove that, under certain regularity conditions on F and on the constants c_i and d_i, S^Δ_N (t) is asymptotically approximately a linear function of Δ, uniformly in t and in Δ, |Δ| ≤ C. The special case of two samples is considered.     

A one-sided test for testino homogeneity of scale parameters against simple ordered alternative

In an earlier paper the authors (1997) extended the results of Hayter (1990) to the two parameter exponential probability model. This paper addressee the extention to the scale parameter case under location-scale probability model. Consider k (k≧3) treatments or competing firms such that an observation from with treatment or firm follows a distribution with cumulative distribution function (cdf) F_i(x)=F[(x-μ_i)/Q_i], where F(·) is any absolutely continuous cdf, i=1,…,k. We propose a test to test the null hypothesis H₀:θ₁=…=θ_k against the simple ordered alternative H₁:θ₁≦…≦θ_k, with at least one strict inequality, using the data X_i,j, i=1,…k; j=1,…,n₁. Two methods to compute the critical points of the proposed test have been demonstrated by talking k two parameter exponential distributions. The test procedure also allows us to construct simultaneous one sided confidence intervals (SOCIs) for the ordered pairwise ratios θ_j/θ_i, 1≦i<j≦k. Statistical simulation revealed that: 9i) actual sizes of the critical points are almost conservative and (ii) power of the proposed test relative to some existing tests is higher.     

Bounds on Bivariate Distribution Functions with Given Margins and Known Values at Several Points

Let H(x, y) be a continuous bivariate distribution function with known marginal distribution functions F(x) and G(y). Suppose the values of H are given at several points, H(x _i , y _i ) = θ _i , i = 1, 2,…, n. We first discuss conditions for the existence of a distribution satisfying these conditions, and present a procedure for checking if such a distribution exists. We then consider finding lower and upper bounds for such distributions. These bounds may be used to establish bounds on the values of Spearman's ρ and Kendall's τ. For n = 2, we present necessary and sufficient conditions for existence of such a distribution function and derive best-possible upper and lower bounds for H(x, y). As shown by a counter-example, these bounds need not be proper distribution functions, and we find conditions for these bounds to be (proper) distribution functions. We also present some results for the general case, where the values of H(x, y) are known at more than two points. In view of the simplification in notation, our results are presented in terms of copulas, but they may easily be expressed in terms of distribution functions.     

Nonparametric Estimation of a Regression Function: Limiting Distribution2

Consider the regression model Y_i= g(x_i) + e_i, i = 1,…, n, where g is an unknown function defined on [0, 1], 0 = x₀ < x₁ < … < x_n≤ 1 are chosen so that max_1≤i≤n(x_i-x_{i- 1}) = 0(n^-1), and where {e_i} are i.i.d. with Ee₁= 0 and Var e₁ - s?². In a previous paper, Cheng & Lin (1979) study three estimators of g, namely, g_1n of Cheng & Lin (1979), g_2n of Clark (1977), and g_3n of Priestley & Chao (1972). Consistency results are established and rates of strong uniform convergence are obtained. In the current investigation the limiting distribution of &_in, i = 1, 2, 3, and that of the isotonic estimator g**_n are considered.     

D-Optimal Axial Designs for Quadratic and Cubic Additive Mixture Models

The paper discusses D-optimal axial designs for the additive quadratic and cubic mixture models σ_1≤i≤q(β_ix_i + β_iix²_i) and σ_1≤i≤q(β_ix_i + β_iix²_i + β_iiix³_i), where x_i≥ 0, x₁ + . . . + x_q = 1. For the quadratic model, a saturated symmetric axial design is used, in which support points are of the form (x₁, . . . , x_q) = [1 ? (q?1)δ_i, δ_i, . . . , δ_i], where i = 1, 2 and 0 ≤δ₂ <_{δ1 ≤} 1/(q ?1). It is proved that when 3 ≤q≤ 6, the above design is D-optimal if δ₂ = 0 and δ₁ = 1/(q?1), and when q≥ 7 it is D-optimal if δ₂ = 0 and δ₁ = [5q?1 ? (9q²?10q + 1)^1/2]/(4q²). Similar results exist for the cubic model, with support points of the form (x₁, . . . , x_q) = [1 ? (q?1)δ_i, δ_i, . . . , δ_i], where i = 1, 2, 3 and 0 = δ₃ <_δ2 < δ_{1 ≤}1/(q?1). The saturated D-optimal axial design and D-optimal design for the quadratic model are compared in terms of their efficiency and uniformity.