Nonparametric statistical procedures for the changepoint problem

Let X₁,…,X_r?1,X_r,X_r+1,…,X_n be independent, continuous random variables such that X_i, i = 1,…,r, has distribution function F(x), and X_i, i = r+1,…,n, has distribution function F(x?Δ), with -∞ <Δ< ∞. When the integer r is unknown, this is refered to as a change point problem with at most one change. The unknown parameter Δ represents the magnitude of the change and r is called the changepoint. In this paper we present a general review discussion of several nonparametric approaches for making inferences about r and Δ.     

Almost Sure Convergence of Weighted Sums for Negatively Associated Random Variables

In this article, let {X₁, …, X_n} be a sequence of negatively associated random variables and {a_ni, 1 ? i ? n, n ? 1} be a triangular array of constants. Several almost sure convergence theorems for the weighted sums ∑ⁿ_{i = 1}a_niX_i are established.     

A stochastic Newton-Raphson method

A stochastic approximation procedure of the Robbins-Monro type is considered. The original idea behind the Newton-Raphson method is used as follows. Given n approximations X₁,…, X_n with observations Y₁,…, Y_n, a least squares line is fitted to the points (X_m, Y_m),…, (X_n, Y_n) where m<n may depend on n. The (n+1)st approximation is taken to be the intersection of the least squares line with y=0. A variation of the resulting process is studied. It is shown that this process yields a strongly consistent sequence of estimates which is asymptotically normal with minimal asymptotic variance.     

A CHARACTERIZATION OF GEOMETRIC DISTRIBUTIONS THROUGH CONDITIONAL INDEPENDENCE

Let X₁,…, X_n be mutually independent non-negative integer-valued random variables with probability mass functions f_i(x) > 0 for z= 0,1,…. Let E denote the event that {X₁≥X₂≥…≥X_n}. This note shows that, conditional on the event E, X_i-X_i+ 1 and X_i+ 1 are independent for all t = 1,…, k if and only if X_i (i= 1,…, k) are geometric random variables, where 1 ≤k≤n-1. The k geometric distributions can have different parameters θ_i, i= 1,…, k.     

Strict stationarity of ar(p) processes generated by nonlinear random functions with additive perturbations

Let {X_n} be a generalized autoregressive process of order ρ defined by X_n=Φ_n(X_n-ρ,…,X_n-1)-η_m, where {φ_n} is a sequence of i.i.d. random maps taking values on H, and {η_n} is a sequence of i.i.d. random variables. Let H be a collection of Borel measurable functions on R_P to R. By considering the associated Markov process, we obtain sufficient conditions for stationarity, (geometric) ergodicity of {X_n}.     

Stochastic orderings related to ranking in an nth order record process

Let X₁, X₂, …, X_m be successive observations on m objects, numbered 1,2, …, m. If X₁ belongs to the n largest observations among X₁,X₂,…,X_i, object i is called a record, i = 1,2,…,m; n?1.In investigating the influence of the ranking of the objects on the expected number of records, a hierarchy of stochastic order relations between random variables arises.It is these order relations and their relationship with known stochastic orderings that are studied in this paper.     

Minimizing the expected sample range

Let X_i be i.i.d. random variables with finite expectations, and θ_i arbitrary constants, i=1,…,n. Y_i=X_i+θ_i. The expected range of the Y's is R_n(θ₁,…,θ_n)=E(maxY_i-minY_i. It is shown that the expected range is minimized if and only if θ₁=?=θ_n. In the case where the X_i are independently and symmetrically distributed around the same constant, but not identically distributed, it is shown that θ₁=?=θ_n are not necessarily the only (θ₁,...,θ_n) minimizing R_n. Some lemmas which are applicable to more general problems of minimizing R_n are also given.     

A new class of bivariate lifetime distributions

This paper introduces a new class of bivariate lifetime distributions. Let {X_i}_{i ? 1} and {Y_i}_{i ? 1} be two independent sequences of independent and identically distributed positive valued random variables. Define T₁ = min?(X₁, …, X_M) and T₂ = min?(Y₁, …, Y_N), where (M, N) has a discrete bivariate phase-type distribution, independent of {X_i}_{i ? 1} and {Y_i}_{i ? 1}. The joint survival function of (T₁, T₂) is studied.     

A formula for P(bi≤Ri≤ai, 1≤i≤m) under a general class of alternatives

Let X_i≤?≤X_m and Y_i≤?≤Y_n be two sets of independent order statistics from continous distributions with distribution functions F and G respectively. Let R_i denote the rank of X_i in the combined order sample. Steck (1980) has found an expression for P(b_i≤R_i≤a_i, all i) when F = h(G), h being the incomplete beta function with parameters (α,β?α+1). An alternative expression for the same probability is obtained which is computationally a substantial improvement on Steck's result.     

Some competitors of the mood test for the two-sample scale problem

Let X_l,…,X_n (Y_l,…,Y_m) be a random sample from an absolutely continuous distribution with distribution function F(G).A class of distribution-free tests based on U-statistics is proposed for testing the equality of F and G against the alternative that X's are more dispersed then Y's. Let 2 ? C ? n and 2 ? d ? m be two fixed integers. Let ?_c,d(X_il,…,X_ic ; Y_jl,…,X_jd)=1(-1)when max as well as min of {X_il,…,X_ic ; Y_jl,…,Y_jd } are some X_i's (Y_j's)and zero oterwise. Let S_c,d be the U-statistic corresponding to ?_c,d.In case of equal sample sizes, S22 is equivalent to Mood's Statistic.Large values of S_c,d are significant and these tests are quite efficient     

Concerning the vector v(m,t)

Let q = mt + 1 be a prime power, and let v(m, t) be the (m + 1)-vector (b₁, b₂, …, b_{m + 1}) of elements of GF(q) such that for each k, 1 ⩽ k ⩽ m + 1, the set {b_i−b_j:i∈{1,2,…m+1} − {m + 2 − k}, j  i + k(mod m + 2) and 1⩽j⩽m+1} forms a system of representatives for the cyclotomic classes of index m in GF(q). In this paper, we investigate the existence of such vectors. An upper bound on t for the existence of a v(m, t) is given for each fixed m unless both m and t are even, in which case there is no such a vector. Some special cases are also considered.     

A note on the admissibility of hammersley's estimator of an integer mean

Let X₁, X₂, …, X_n be identically, independently distributed N(i,1) random variables, where i = 0, ±1, ±2, … Hammersley (1950) showed that d = [X?_n], the nearest integer to the sample mean, is the maximum likelihood estimator of i. Khan (1973) showed that d is minimax and admissible with respect to zero-one loss. This note now proves a conjecture of Stein to the effect that in the class of integer-valued estimators d is minimax and admissible under squared-error loss.     

Two remarks on order statistics

Let X₍₁₎,…,X_(n) be the order statistics of n iid distributed random variables. We prove that (X_(i)) have a certain Markov property for general distributions and secondly that the order statistics have monotone conditional regression dependence. Both properties are well known in the case of continuous distributions.     

Orderings for series and parallel systems comprising heterogeneous exponentiated Weibull-geometric components

Let X₁, …, X_n be independent random variables with X_i ～ EWG(α, β, λ_i, p_i), i = 1, …, n, and Y₁, …, Y_n be another set of independent random variables with Y_i ～ EWG(α, β, γ_i, q_i), i = 1, …, n. The results established here are developed in two directions. First, under conditions p₁ = ??? = p_n = q₁ = ??? = q_n = p, and based on the majorization and p-larger orders between the vectors of scale parameters, we establish the usual stochastic and reversed hazard rate orders between the series and parallel systems. Next, for the case λ₁ = ??? = λ_n = γ₁ = ??? = γ_n = λ, we obtain some results concerning the reversed hazard rate and hazard rate orders between series and parallel systems based on the weak submajorization between the vectors of (p₁, …, p_n) and (q₁, …, q_n). The results established here can be used to find various bounds for some important aging characteristics of these systems, and moreover extend some well-known results in the literature.     

A note on the asymptotic efficiency of the sobel–wald test

Let X₁,X₂, … be iid random variables with the pdf f(x,θ)=exp(θx?b(θ)) relative to a σ-finite measure μ, and consider the problem of deciding among three simple hypotheses H_i:θ=θ_i (1?i?3) subject to P(acceptH_i|θ_i)=1?α (1?i?3). A procedure similar to Sobel–Wald procedure is discussed and its asymptotic efficiency as compared with the best nonsequential test is obtained by finding the limit lim_a→0(E_iN(a)/n(a)), where N (a) is the stopping time of the proposed procedure and n(a) is the sample size of the best non-sequential test. It is shown that the same asymptotic limit holds for the original Sobel–Wald procedure. Specializing to N(θ,1) distribution it is found that lim_a→0$\text{(E}{}_{\mathrm{i}}\text{N(α)/n(α))=}\text{1}\text{4}$ (i=1,2) and lim_a→0 (E₃N(α)n(α))=δ²₁/4δ, where δ_i=(θ_i+1?θ_i) with 0<δ₁?δ₂. Also, the asymptotic efficiency evaluated when the X's have an exponential distribution.     

On moments of the supremum of normed weighted averages

Let {X, X_n; n ≥ 1} be a sequence of real-valued iid random variables, 0 < r < 2 and p > 0. Let D = { A = (a_nk; 1 ≤ k ≤ n, n ≥ 1); a_nk, ? R and sup_{n, k} |a_n,k| < ∞}. Set S_n( A ) = ∑ⁿ_k=1a_{n, k}X_k for A ? D and n ≥ 1. This paper is devoted to determining conditions whereby E{sup_{n ≥ 1}, |S_n( A )|/n^1/r}^p < ∞ or E{sup_{n ≥ 2} |S_n( A )|/2n log n)^1/2}^p < ∞ for every A ? D. This generalizes some earlier results, including those of Burkholder (1962), Choi and Sung (1987), Davis (1971), Gut (1979), Klass (1974), Siegmund (1969) and Teicher (1971).     

Nonparametric estimation of survival functions for incomplete observations when the life time distribution is proportionally related ot the censoring time distribution

Let X₁, X₂…,X_n be a random sample from [ILM0001] and let Y₁, …,Y_n be a random sample from [ILM0002]. Then instead of observing a complete sample X₁,…X_n, we can only observe the pairs Z_i. = min(X_i.,Y_i) and [ILM0003] In this paper, we consider estimation of survival function [ILM0004] when [ILM0005], where β is an unknown positive real number.

     

The uniform convergence of the nadaraya-watson regression function estimate

If (X₁,Y₁), …, (X_n,Y_n) is a sequence of independent identically distributed R_d × R-valued random vectors then Nadaraya (1964) and Watson (1964) proposed to estimate the regression function m(x) = ? {Y₁|X₁ = x{ by where K is a known density and {h_n} is a sequence of positive numbers satisfying certain properties. In this paper a variety of conditions are given for the strong convergence to 0 of ess_Xsup|m_n (X)-m(X)| (here X is independent of the data and distributed as X₁). The theorems are valid for all distributions of X₁ and for all sequences {h_n} satisfying h_n → 0 and nh/log n→0.     

Bounds on the expected maximum

Let (X₁,X₂, …,X_n) be jointly distributed random variables. Define X_n:n = max(X₁,X₂, …,X_n).Bounds on E(X_n:n), obtained by putting constraints on the distributions and/or dependence structure of the X_i's, are surveyed.     

More bounds for moments of some rank statistics

Let X₁,…,X₇ be i.i.d. random variables with a common continuous distribution F, Two parameters, μ(F) = P(X₁ < X₅ and X₁+X₄ < X₂+X₃) and λ(F) = P(X₁+X₄ < X₂+X₃ and X₁+X₇ < X₅+X₆), which appear in the moments of some rank statistics have been studied by several authors. It is shown that the existing lower bound, 3/10 ≤ μ(F) can be improved to 3/10 < μ(F) and that no further improvement is possible. It is also shown that the existing upper bounds μ(F) ≤ (2^1/2+6)/24 ≈ 0.30893 and λ(F) ≤ 7/24 ≈ 0.29167 can be improved to [14+(2/3)^1/2]/48 ≈ 0.30868 and {7 ? [1 ? (2/3)^1/2]²/4}/24 ≈ 0.29132.