On multivariate variable-kernel density estimates for time series

Let X₁ be a strictly stationary multiple time series with values in R^d and with a common density f. Let X₁,.,.,X_n, be n consecutive observations of X₁. Let k = k_n, be a sequence of positive integers, and let H_ni be the distance from X_i to its kth nearest neighbour among X_j, j i. The multivariate variable-kernel estimate f_n, of f is defined by where K is a given density. The complete convergence of f_n, to f on compact sets is established for time series satisfying a dependence condition (referred to as the strong mixing condition in the locally transitive sense) weaker than the strong mixing condition. Appropriate choices of k are explicitly given. The results apply to autoregressive processes and bilinear time-series models.     

Testing independence with additional information

Let X = (X^j : j = 1,…, n) be n row vectors of dimension p independently and identically distributed multinomial. For each j, X^j is partitioned as X^j = (X^j₁, X^j₂, X^j₃), where p_i is the dimension of X^j_i with p₁ = 1,p₁+p₂+p₃ = p. In addition, consider vectors Y^j_i, i = 1,2j = 1,…,n_i that are independent and distributed as X¹_i. We treat here the problem of testing independence between X¹₁ and X¹₃ knowing that X¹₁ and X¹₂ are uncorrected. A locally best invariant test is proposed for this problem.     

BAYESIAN SMOOTHING WITH OCCASIONAL JUMPS

Consider a sequence of independent random variables X ₁, X ₂,…,X _n observed at n equally spaced time points where X _i has a probability distribution which is known apart from the values of a parameter θ _i ∈ R which may change from observation to observation. We consider the problem of estimating θ = (θ₁, θ₂,…,θ _n ) given the observed values of X ₁, X ₂,…,X _n . The paper proposes a prior distribution for the parameters θ for which sets of parameter values exhibiting no change, or no change apart from a few sudden large changes, or lots of small changes, all have positive prior probability. Markov chain sampling may be used to calculate Bayes estimates of the parameters. We report the results of a Monte Carlo study based on Poisson distributed data which compares the Bayes estimator with estimators obtained using cubic splines and with estimators derived from the Schwarz criterion. We conclude that the Bayes method is preferable in a minimax sense since it never produces the disastrously large errors of the other methods and pays only a modest price for this degree of safety. All three methods are used to smooth mortality rates for oesophageal cancer in Irish males aged 65–69 over the period 1955 through 1994.     

ON ASYMPTOTIC OPTIMALITY OF SOME TESTS FOR EXPONENTIAL DISTRIBUTIONS

The probability density function (pdf) of a two parameter exponential distribution is given by f(x; p, s?) =s?^-1 exp {-(x - ρ)/s?} for x≥ρ and 0 elsewhere, where 0 < ρ < ∞ and 0 < s?∞. Suppose we have k independent random samples where the ith sample is drawn from the ith population having the pdf f(x; ρ_i, s?_i), 0 < ρ_i < ∞, 0 < s?_i < s?_i < and f(x; ρ, s?) is as given above. Let X_i1 < X_i2 <… < X_iri denote the first r_i order statistics in a random sample of size n_i, drawn from the ith population with pdf f(x; ρ_i, s?_i), i = 1, 2,…, k. In this paper we show that the well known tests of hypotheses about the parameters ρ_i, s?_i, i = 1, 2,…, k based on the above observations are asymptotically optimal in the sense of Bahadur efficiency. Our results are similar to those for normal distributions.     

A CHARACTERIZATION OF GEOMETRIC DISTRIBUTIONS THROUGH CONDITIONAL INDEPENDENCE

Let X₁,…, X_n be mutually independent non-negative integer-valued random variables with probability mass functions f_i(x) > 0 for z= 0,1,…. Let E denote the event that {X₁≥X₂≥…≥X_n}. This note shows that, conditional on the event E, X_i-X_i+ 1 and X_i+ 1 are independent for all t = 1,…, k if and only if X_i (i= 1,…, k) are geometric random variables, where 1 ≤k≤n-1. The k geometric distributions can have different parameters θ_i, i= 1,…, k.     

Weak and strong uniform consistency rates of kernel density estimates for randomly censored data

Let X₁,., X_n, be i.i.d. random variables with distribution function F, and let Y₁,.,.,Y_n be i.i.d. with distribution function G. For i = 1, 2,.,., n set δ_i, = 1 if X_i ≤ Y_i, and 0 otherwise, and X_i, = min{X_i, K_i}. A kernel-type density estimate of f, the density function of F w.r.t. Lebesgue measure on the Borel o-field, based on the censored data (δ_i, X_i), i = 1,.,.,n, is considered. Weak and strong uniform consistency properties over the whole real line are studied. Rates of convergence results are established under higher-order differentiability assumption on f. A procedure for relaxing such assumptions is also proposed.     

CRITICAL VALUES FOR INFERENCE ABOUT NORMAL DISPERSION1

Let F_N(.) be the density function of X²_N. Values of C₁/N, i= 1, 2, satisfying the twin conditions Pr (C₁≤X²_N≤C₂)=1-α and the conditional expectation of X²_N given C₁≤X²_N≤C₂ is N are tabulated for α=.2, .1, .05, .01, .005, .001, N=1(1)20(2)50(5)150(10)350. The second condition may be replaced by the condition f_N+2(C₁)=f_N+2V(C₂). The author has with him a bigger table giving C₁ and C₂ for α=.2, .1, .05, .01, .005, .001, N=1(1)350 to three decimals (to three significant digits, if some decimals are not significant). Several applications are mentioned. A practical application that is perhaps not obvious is to test whether two or more counts are distributed as independent Poisson variables. The new simple formulae used in the construction of the table are given and should prove useful in obtaining accurate values for omitted entries and in increasing the accuracy of entries.     

Testing retrospective hypotheses

This paper develops a conditional approach to testing hypotheses set up after viewing the data. For example, suppose X_i are estimates of location parameters θ_i, i = 1,…n. We show how to compute p-values for testing whether θ₁ is one of the three largest θ_i after observing that X₁ is one of the three largest X_i, or for testing whether θ₁ > θ₂ > … > θ_n after observing X₁ >X₂> … >X_n.     

On the maxima of heterogeneous gamma variables

In this article, we establish some new results on stochastic comparisons of the maxima of two heterogenous gamma variables with different shape and scale parameters. Let X₁ and X₂ [X*₁ and X*₂] be two independent gamma variables with X_i?[X*_i] having shape parameter r_i?[r*_i] and scale parameter λ_i?[λ*_i], i = 1, 2. It is shown that the likelihood ratio order holds between the maxima, X_{2: 2} and X*_{2: 2} when λ₁ = λ*₁ ? λ₂ = λ*₂ and r₁ ? r*₁ ? r₂ = r*₂. We also prove that, if r_i, r*_i ∈ (0, 1], (r₁, r₂) majorizes (r*₁, r₂*), and (λ₁, λ₂) is p-larger than (λ*₁, λ₂*), then X_{2: 2} is larger than X*_{2: 2} in the sense of the hazard rate order [dispersive order]. Some numerical examples are provided to illustrate the main results. The new results established here strengthen and generalize some of the results known in the literature.     

A Note on the Calculation of Pr{X 1 < X 2 < ··· < Xk }

Suppose that X_i are independent random variables, and that X_i has cdf F_i (x), 1 ≤ i ≤ k. Many statistical problems involve the probability Pr{X ₁ < X ₂ < ··· < X_k }. In this note a numerical method is proposed for computing this probability.     

On Censored Bivariate Random Variables: Copula,Characterization, and Estimation

Let (X, Y) be a bivariate random vector with joint distribution function F_{X, Y}(x, y) = C(F(x), G(y)), where C is a copula and F and G are marginal distributions of X and Y, respectively. Suppose that (X_i, Y_i), i = 1, 2, …, n is a random sample from (X, Y) but we are able to observe only the data consisting of those pairs (X_i, Y_i) for which X_i ? Y_i. We denote such pairs as (X*_i, Y_i*), i = 1, 2, …, ν, where ν is a random variable. The main problem of interest is to express the distribution function F_{X, Y}(x, y) and marginal distributions F and G with the distribution function of observed random variables X* and Y*. It is shown that if X and Y are exchangeable with marginal distribution function F, then F can be uniquely determined by the distributions of X* and Y*. It is also shown that if X and Y are independent and absolutely continuous, then F and G can be expressed through the distribution functions of X* and Y* and the stress–strength reliability P{X ? Y}. This allows also to estimate P{X ? Y} with the truncated observations (X*_i, Y_i*). The copula of bivariate random vector (X*, Y*) is also derived.     

A general reduction method for n–variate normal orthant probability

Let X₁,X₂,…,X_n be n normal variates with zero means, unit variances and correlation matrix {p_ij). The orthant probability is the probability that all of the X₁'s are simultaneously positive. This paper presents a general reduction method by extending the method of Childs (1967), and shows that the probability can be represented by a linear combination of some multivariate integrals of order([n/2]?1). As illustrations, we apply the proposed method to the quadrivariate and six–variate cases. Some numerical results are also given.     

Uniform asymptotic linearity of a process based on a signed rank statistic

Consider the process with, cf. (1.2) on page 265 in B1, X₁, …, X_N a sample from a distribution F and, for i = 1, …, N, R${}_{\text{|x}{}_{\text{1}}\text{, - q}{}_{\text{1}}\text{ø|}}$ , the rank of |X₁ - q₁ø| among |X₁ - q₁ø|, …, |X_N - q_Nø|. It is shown that, under certain regularity conditions on F and on the constants p_i and q_i, T^ø_N(t) is asymptotically approximately a linear function of ø uniformly in t and in ø for |ø| ≤ C. The special case where the p_i and the q_i, are independent of i is considered.     

A new class of bivariate lifetime distributions

This paper introduces a new class of bivariate lifetime distributions. Let {X_i}_{i ? 1} and {Y_i}_{i ? 1} be two independent sequences of independent and identically distributed positive valued random variables. Define T₁ = min?(X₁, …, X_M) and T₂ = min?(Y₁, …, Y_N), where (M, N) has a discrete bivariate phase-type distribution, independent of {X_i}_{i ? 1} and {Y_i}_{i ? 1}. The joint survival function of (T₁, T₂) is studied.     

Distribution of the correlation coefficient for the class of bivariate elliptical models

We consider n pairs of random variables (X₁₁,X₂₁),(X₁₂,X₂₂),… (X_1n,X_2n) having a bivariate elliptically contoured density of the form where θ₁ θ₂ are location parameters and Δ = ((λ_ik)) is a 2 × 2 symmetric positive definite matrix of scale parameters. The exact distribution of the Pearson product-moment correlation coefficient between X₁ and X₂ is obtained. The usual case when a sample of size n is drawn from a bivariate normal population is a special case of the abovementioned model.     

Stochastic Comparisons and Dependence of Spacings from Two Samples of Exponential Random Variables

Let X ₁,X ₂,…,X _n be independent exponential random variables such that X _i has hazard rate λ for i = 1,…,p and X _j has hazard rate λ* for j = p + 1,…,n, where 1 ≤ p < n. Denote by D _i:n (λ, λ*) = X _i:n  ? X _i?1:n the ith spacing of the order statistics X _1:n  ≤ X _2:n  ≤ ··· ≤ X _n:n , i = 1,…,n, where X _0:n ≡ 0. It is shown that the spacings (D _1,n ,D _2,n ,…,D _n:n ) are MTP₂, strengthening one result of Khaledi and Kochar (2000), and that (D _1:n (λ₂, λ*),…,D _n:n (λ₂, λ*)) ≤ _lr (D _1:n (λ₁, λ*),…,D _n:n (λ₁, λ*)) for λ₁ ≤ λ* ≤ λ₂, where ≤ _lr denotes the multivariate likelihood ratio order. A counterexample is also given to show that this comparison result is in general not true for λ* < λ₁ < λ₂.     

Information Properties for Concomitants of Order Statistics in Farlie–Gumbel–Morgenstern (FGM) Family

Let (X _i , Y _i ), i = 1, 2,…, n be independent and identically distributed random variables from some continuous bivariate distribution. If X _(r) denotes the rth-order statistic, then the Y's associated with X _(r) denoted by Y _[r] is called the concomitant of the rth-order statistic. In this article, we derive an analytical expression of Shannon entropy for concomitants of order statistics in FGM family. Applying this expression for some well-known distributions of this family, we obtain the exact form of Shannon entropy, some of the information properties, and entropy bounds for concomitants of order statistics. Some comparisons are also made between the entropy of order statistics X _(r) and the entropy of its concomitants Y _[r]. In this family, we show that the mutual information between X _(r) and Y _[r], and Kullback–Leibler distance among the concomitants of order statistics are all distribution-free. Also, we compare the Pearson correlation coefficient between X _(r) and Y _[r] with the mutual information of (X _(r), Y _[r]) for the copula model of FGM family.     

Uniform asymptotic linearity in a regression parameter of a process based on a rank statistic

For X₁, …, X_N a random sample from a distribution F, let the process S^δ_N(t) be defined as where K²_N = σ^N_i=1(c_i ? c?)² and R x_i, + Δd, is the rank of X_i + Δd_i, among X₁ + Δd₁, …, X_N + Δd_N. The purpose of this note is to prove that, under certain regularity conditions on F and on the constants c_i and d_i, S^Δ_N (t) is asymptotically approximately a linear function of Δ, uniformly in t and in Δ, |Δ| ≤ C. The special case of two samples is considered.     

Poisson approximations in selected metrics by coupling and semigroup methods with applications

Let S_n = X₁ + … + X_n, where X₁,…, X_n are independent Bernoulli random variables. In this paper, we evaluate probability metrics of the Wasserstein type between the distribution of S_n and a Poisson distribution. Our results show that, if E(S_n) = O(1) and if the individual probabilities of success of the X_i's tend uniformly to zero, then the general rate of convergence of the above mentioned metrics to zero is O(∑ⁿ_i = ₁P²_i). We also show that this rate is sharp and discuss applications of these results.