Nonparametric statistical procedures for the changepoint problem

Let X₁,…,X_r?1,X_r,X_r+1,…,X_n be independent, continuous random variables such that X_i, i = 1,…,r, has distribution function F(x), and X_i, i = r+1,…,n, has distribution function F(x?Δ), with -∞ <Δ< ∞. When the integer r is unknown, this is refered to as a change point problem with at most one change. The unknown parameter Δ represents the magnitude of the change and r is called the changepoint. In this paper we present a general review discussion of several nonparametric approaches for making inferences about r and Δ.     

On the Failure Probability of Used Coherent Systems

In analyzing the lifetime properties of a coherent system, the concept of “signature” is a useful tool. Let T be the lifetime of a coherent system having n iid components. The signature of the system is a probability vector s=(s₁, s₂, …, s_n), such that s_i=P(T=X_i:n), where, X_i:n, i=1, 2, …, n denote the ordered lifetimes of the components. In this note, we assume that the system is working at time t>0. We consider the conditional signature of the system as a vector in which the ith element is defined as p_i(t)=P(T=X_i:n|T>t) and investigate its properties as a function of time.     

Characterizations of geometric distribution and discrete IFR (DFR) distributions using order statistics

Let X be a discrete random variable the set of possible values (finite or infinite) of which can be arranged as an increasing sequence of real numbers a₁<a₂<a₃<…. In particular, a_i could be equal to i for all i. Let X_1n≦X_2n≦?≦X_nn denote the order statistics in a random sample of size n drawn from the distribution of X, where n is a fixed integer ≧2. Then, we show that for some arbitrary fixed k(2≦k≦n), independence of the event {X_kn=X_1n} and X_1n is equivalent to X being either degenerate or geometric. We also show that the montonicity in i of P{X_kn = X_1n | X_1n = a_i} is equivalent to X having the IFR (DFR) property. Let a_i = i and $\text{G(i) = P(X≧i), i = 1, 2, …}$. We prove that the independence of {X_2n ? X_1n ∈B} and X_1n for all i is equivalent to X being geometric, where B = {m} (B = {m,m+1,…}), provided G(i) = q^i?1, 1≦i≦m+2 (1≦i≦m+1), where 0<q<1.     

Minimizing the expected sample range

Let X_i be i.i.d. random variables with finite expectations, and θ_i arbitrary constants, i=1,…,n. Y_i=X_i+θ_i. The expected range of the Y's is R_n(θ₁,…,θ_n)=E(maxY_i-minY_i. It is shown that the expected range is minimized if and only if θ₁=?=θ_n. In the case where the X_i are independently and symmetrically distributed around the same constant, but not identically distributed, it is shown that θ₁=?=θ_n are not necessarily the only (θ₁,...,θ_n) minimizing R_n. Some lemmas which are applicable to more general problems of minimizing R_n are also given.     

A modified cluster sampling method for estimating the bacterial density in Xanthan gum

Suppose particles are randomly distributed in a certain medium, powder or liquid, which is conceptually divided into N cells. Let p_i denote the probability that a particle falls in the ith cell and Y_i denote the number of particles in the ith cell. Assume that the joint probability function of the Y_i follows a multinomial distribution with cell probabilities p_i respectively. Take n (≤N) cells at random without replacement and put each of the cells separately through a mixing mechanism of dilution and swirl. These n cells constitute the first stage samples and the number of particles in these cells are not observable. Now conceptually divide each of n cells into M subcells of equal size and let X_ij denote the number of particles in the jth subcell of the ith cell selected in the first stage; i=1,2,…,N and j=1,2,…,M. Consequently assume that the conditional joint probability function of the X_ij given Y_i=y_i follows a multinomial distribution with equal cell probabilities. Now take m (≤M) subcells at random from each of the cells selected in the first stage sample. Assume that the numbers of particles in M×N subcells are observable. The properties of the estimator of the particle density per sample unit are investigated under the modified two-stage cluster sampling method. A laboratory experiment for Xanthan Gum Products is analyzed in order to examine the appropriateness of the model assumed in this paper.     

On the construction of orthogonal F-squares of order n from an orthogonal array (n, k, s, 2) and an OL(s, t) set

Complete sets of orthogonal F-squares of order n = s^p, where g is a prime or prime power and p is a positive integer have been constructed by Hedayat, Raghavarao, and Seiden (1975). Federer (1977) has constructed complete sets of orthogonal F-squares of order n = 4t, where t is a positive integer. We give a general procedure for constructing orthogonal F-squares of order n from an orthogonal array (n, k, s, 2) and an OL(s, t) set, where n is not necessarily a prime or prime power. In particular, we show how to construct sets of orthogonal F-squares of order n = 2s^p, where s is a prime or prime power and p is a positive integer. These sets are shown to be near complete and approach complete sets as s and/or p become large. We have also shown how to construct orthogonal arrays by these methods. In addition, the best upper bound on the number t of orthogonal F(n, λ₁), F(n, λ₂), …, F(n, λ₁) squares is given.     

Prediction based on linear combinations of order statistics and bivariate concomitants in the case of multivariate elliptical distributions

In this paper, by considering a (3n+1) -dimensional random vector (X₀, X^T, Y^T, Z^T)^T having a multivariate elliptical distribution, we derive the exact joint distribution of (X₀, a^TX_(n), b^TY_[n], c^TZ_[n])^T, where a, b, c∈?ⁿ, X_(n)=(X₍₁₎, …, X_(n))^T, X₍₁₎<···<X_(n), is the vector of order statistics arising from X, and Y_[n]=(Y_[1], …, Y_[n])^T and Z_[n]=(Z_[1], …, Z_[n])^T denote the vectors of concomitants corresponding to X_(n) ((Y_[r], Z_[r])^T, for r=1, …, n, is the vector of bivariate concomitants corresponding to X_(r)). We then present an alternate approach for the derivation of the exact joint distribution of (X₀, X_(r), Y_[r], Z_[r])^T, for r=1, …, n. We show that these joint distributions can be expressed as mixtures of four-variate unified skew-elliptical distributions and these mixture forms facilitate the prediction of X_(r), say, based on the concomitants Y_[r] and Z_[r]. Finally, we illustrate the usefulness of our results by a real data.     

Simulation of a stationary autoregression: A characterization of the normal distribution

Simulating a stationary AR(p), X_t = ∑^p_i=1α_iX_t−i + Z_t, when the innovations {Z_t} are assumed to be i.i.d. is straightforward. Starting the process in the stationary state, however, requires generation of (X₁,X₂,…,X_p) from the stationary p-dimensional distribution. When Z_t is normal this may be achieved by generating X_i as a linear function of X₁,X₂,…,X_i−1 and an independent normal variate for i = 2,3,…, p. It is shown that the ability to initialize a stationary AR(p) in this way characterizes the normal distribution.     

Testing independence with additional information

Let X = (X^j : j = 1,…, n) be n row vectors of dimension p independently and identically distributed multinomial. For each j, X^j is partitioned as X^j = (X^j₁, X^j₂, X^j₃), where p_i is the dimension of X^j_i with p₁ = 1,p₁+p₂+p₃ = p. In addition, consider vectors Y^j_i, i = 1,2j = 1,…,n_i that are independent and distributed as X¹_i. We treat here the problem of testing independence between X¹₁ and X¹₃ knowing that X¹₁ and X¹₂ are uncorrected. A locally best invariant test is proposed for this problem.     

Changepoint Problems Under Random Censorship

Let X ₁, …, X _[nθ], X _{[nθ] + 1}, …, X _n be a sequence of independent random variables (the “lifetimes”) such that X _j ? F ₁ for 1 ≤ j ≤ [nθ] and X _j ? F ₂ for [nθ] + 1 ≤ j ≤ n, with F ₁ ≠ F ₂ unknown. In this paper we investigate an estimator θ _n for the changepoint θ if the X's are subject to censoring. The rate of almost sure convergence of θ _n to θ is established and a test for the hypothesis θ = 0, i.e. “no change”, is proposed.     

A stochastic Newton-Raphson method

A stochastic approximation procedure of the Robbins-Monro type is considered. The original idea behind the Newton-Raphson method is used as follows. Given n approximations X₁,…, X_n with observations Y₁,…, Y_n, a least squares line is fitted to the points (X_m, Y_m),…, (X_n, Y_n) where m<n may depend on n. The (n+1)st approximation is taken to be the intersection of the least squares line with y=0. A variation of the resulting process is studied. It is shown that this process yields a strongly consistent sequence of estimates which is asymptotically normal with minimal asymptotic variance.     

On the bounded regret of empirical bayes estimators

Let (θ₁,x₁),…,(θ_n,x_n) be independent and identically distributed random vectors with E(xθ) = θ and Var(x|θ) = a + bθ + cθ². Let t_i be the linear Bayes estimator of θ_i and θ~_i be the linear empirical Bayes estimator of θ_i as proposed in Robbins (1983). When Ex and Var x are unknown to the statistician. The regret of using θ~_i instead of t_i because of ignorance of the mean and the variance is r_i = E(θ_i ? θ_i)² ?E(t_i ?θ_i)². Under appropriate conditions cumulative regret R_n = r₁+…r_n is shown to have a finite limit even when n tends to infinity. The limit can be explicitly computed in terms of a,b,c and the first four moments of x.     

Asymptotic expaxsioxs for the joint distribution of cirrelated hotellings t2 statlstics under normality

Let T² _i=z′_iS^?1z_i, i==,…k be correlated Hotelling's T² statistics under normality. where z=(z′_i,…,z′_k)′ and nS are independently distributed as N_kp((O,ρ?∑) and Wishart distribution W_p(∑, n), respectively. The purpose of this paper is to study the distribution function F(x₁,…,x_k) of (T² _i,…,T² _k) when n is large. First we derive an asymptotic expansion of the characteristic function of (T² _i,…,T² _k) up to the order n^?2. Next we give asymptotic expansions for (T² _i,…,T² _k) in two cases (i)ρ=I_k and (ii) k=2 by inverting the expanded characteristic function up to the orders n^?2 and n^?1, respectively. Our results can be applied to the distribution function of max (T² _i,…,T² _k) as a special case.     

Inference procedures in some bivariate exponential models under hybrid random censoring

We consider a life testing experiment in whichn units are put on test, successive lifetimes (X ₁,X ₂) of both componentsC ₁ andC ₂ are recorded and the observation is terminated either at ther-th order statistic ofY _i =Min(X _1i ,X _2i ),i=1,…,n i.e.Y _(r) or a random timeT _i whichever is reached first. This mixture of random censoring and type-II censoring schemes, we call as hybrid random censoring which is of wide use. We use this censoring scheme and obtain maximum likelihood estimation of the parameters and develop large sample tests in bivariate exponential (BVE) models proposed by Marshall-Olkin (1967), Block-Basu (1974), Freund (1961) and Preschan-Sullo (1974).     

Stochastic orderings related to ranking in an nth order record process

Let X₁, X₂, …, X_m be successive observations on m objects, numbered 1,2, …, m. If X₁ belongs to the n largest observations among X₁,X₂,…,X_i, object i is called a record, i = 1,2,…,m; n?1.In investigating the influence of the ranking of the objects on the expected number of records, a hierarchy of stochastic order relations between random variables arises.It is these order relations and their relationship with known stochastic orderings that are studied in this paper.     

Optimal designs for approximating the path of a stochastic process

We consider a centered stochastic process {X(t):t ∈ T} with known and continuous covariance function. On the basis of observations X(t₁), …, X(t_n) we approximate the whole path by orthogonal projection and measure the performance of the chosen design d = (t₁, …, t_n)′ by the corresponding mean squared L²-distance. For covariance functions on T² = [0, 1]², which satisfy a generalized Sacks-Ylvisaker regularity condition of order zero, we construct asymptotically optimal sequences of designs. Moreover, we characterize the achievement of a lower error bound, given by Micchelli and Wahba (1981), and study the question of whether this bound can be attained.     

A RENEWAL THEOREM IN MULTIDIMENSIONAL TIME

Let Y_l, Y₂,… be i.i.d., positive, integer-valued random variables with means, μ. Let the sequences {Y_ij, j= 1,2,…}, i= 1,…, r be independent copies of {Y₁, Y₂,…}. For n={n₁,…, n_r.}, n₁≥1, let S_n=S?ⁿ¹_k1=1= 1 …S?^nr_kr=1 Y_ik1… Y_rkr. We show that S?^N_k=1S?^∞_k1=1…S?^∞_nr=1 P[[S_n= k] ? [μ^-r N log^r-1 (N)/(r-1)!] as N →∞.     

Precise large deviations for the difference of two sums of WUOD and non identically distributed random variables with dominatedly varying tails

In this article, we study large deviations for non random difference ∑^n₁(t)_{j = 1}X_1j ? ∑^n₂(t)_{j = 1}X_2j and random difference ∑^N₁(t)_{j = 1}X_1j ? ∑^N₂(t)_{j = 1}X_2j, where {X_1j, j ? 1} is a sequence of widely upper orthant dependent (WUOD) random variables with non identical distributions {F_1j(x), j ? 1}, {X_2j, j ? 1} is a sequence of independent identically distributed random variables, n₁(t) and n₂(t) are two positive integer-valued functions, and {N_i(t), t ? 0}²_{i = 1} with EN_i(t) = λ_i(t) are two counting processes independent of {X_ij, j ? 1}²_{i = 1}. Under several assumptions, some results of precise large deviations for non random difference and random difference are derived, and some corresponding results are extended.     

Concomitants of order statistics from multivariate elliptical distributions

In this paper, by considering a 2n-dimensional elliptically contoured random vector (X^T,Y^T)^T=(X₁,…,X_n,Y₁,…,Y_n)^T, we derive the exact joint distribution of linear combinations of concomitants of order statistics arising from X. Specifically, we establish a mixture representation for the distribution of the rth concomitant order statistic, and also for the joint distribution of the rth order statistic and its concomitant. We show that these distributions are indeed mixtures of multivariate unified skew-elliptical distributions. The two most important special cases of multivariate normal and multivariate t distributions are then discussed in detail. Finally, an application of the established results in an inferential problem is outlined.