Information Properties for Concomitants of Order Statistics in Farlie–Gumbel–Morgenstern (FGM) Family

Let (X _i , Y _i ), i = 1, 2,…, n be independent and identically distributed random variables from some continuous bivariate distribution. If X _(r) denotes the rth-order statistic, then the Y's associated with X _(r) denoted by Y _[r] is called the concomitant of the rth-order statistic. In this article, we derive an analytical expression of Shannon entropy for concomitants of order statistics in FGM family. Applying this expression for some well-known distributions of this family, we obtain the exact form of Shannon entropy, some of the information properties, and entropy bounds for concomitants of order statistics. Some comparisons are also made between the entropy of order statistics X _(r) and the entropy of its concomitants Y _[r]. In this family, we show that the mutual information between X _(r) and Y _[r], and Kullback–Leibler distance among the concomitants of order statistics are all distribution-free. Also, we compare the Pearson correlation coefficient between X _(r) and Y _[r] with the mutual information of (X _(r), Y _[r]) for the copula model of FGM family.     

Nonparametric Estimation of a Regression Function: Limiting Distribution2

Consider the regression model Y_i= g(x_i) + e_i, i = 1,…, n, where g is an unknown function defined on [0, 1], 0 = x₀ < x₁ < … < x_n≤ 1 are chosen so that max_1≤i≤n(x_i-x_{i- 1}) = 0(n^-1), and where {e_i} are i.i.d. with Ee₁= 0 and Var e₁ - s?². In a previous paper, Cheng & Lin (1979) study three estimators of g, namely, g_1n of Cheng & Lin (1979), g_2n of Clark (1977), and g_3n of Priestley & Chao (1972). Consistency results are established and rates of strong uniform convergence are obtained. In the current investigation the limiting distribution of &_in, i = 1, 2, 3, and that of the isotonic estimator g**_n are considered.     

Weak and strong uniform consistency rates of kernel density estimates for randomly censored data

Let X₁,., X_n, be i.i.d. random variables with distribution function F, and let Y₁,.,.,Y_n be i.i.d. with distribution function G. For i = 1, 2,.,., n set δ_i, = 1 if X_i ≤ Y_i, and 0 otherwise, and X_i, = min{X_i, K_i}. A kernel-type density estimate of f, the density function of F w.r.t. Lebesgue measure on the Borel o-field, based on the censored data (δ_i, X_i), i = 1,.,.,n, is considered. Weak and strong uniform consistency properties over the whole real line are studied. Rates of convergence results are established under higher-order differentiability assumption on f. A procedure for relaxing such assumptions is also proposed.     

On an application of concomitants of order statistics

ABSTRACT

Let (X_i, Y_i), i = 1, …, n be a pair where the first coordinate X_i represents the lifetime of a component, and the second coordinate Y_i denotes the utility of the component during its lifetime. Then the random variable Y_{[r: n]} which is known to be the concomitant of the rth order statistic defines the utility of the component which has the rth smallest lifetime. In this paper, we present a dynamic analysis for an n component system under the above-mentioned concomitant setup.     

Parameter Estimation for Bivariate Shock Models with Singular Distribution for Censored Data with Concomitant Order Statistics

When two‐component parallel systems are tested, the data consist of Type‐II censored data X_(i), i= 1, n, from one component, and their concomitants Y _[i] randomly censored at X_(r), the stopping time of the experiment. Marshall & Olkin's (1967) bivariate exponential distribution is used to illustrate statistical inference procedures developed for this data type. Although this data type is motivated practically, the likelihood is complicated, and maximum likelihood estimation is difficult, especially in the case where the parameter space is a non‐open set. An iterative algorithm is proposed for finding maximum likelihood estimates. This article derives several properties of the maximum likelihood estimator (MLE) including existence, uniqueness, strong consistency and asymptotic distribution. It also develops an alternative estimation method with closed‐form expressions based on marginal distributions, and derives its asymptotic properties. Compared with variances of the MLEs in the finite and large sample situations, the alternative estimator performs very well, especially when the correlation between X and Y is small.     

Comparing Fisher information in record values and their concomitants with random observations

In a sequence of bivariate random variables {(X _i , Y _i ), i≥1} from a continuous distribution with a real parameter θ, general comparison results between the amount of Fisher information about θ contained in the sequence of the first n records and their concomitants, and the desired information in an i.i.d. sample of size n from the parent distribution are established. Some relationships between reliability properties and the proposed criteria are obtained in situations in which the univariate counterpart of the underlying bivariate family belongs to location, scale or shape families. It is also shown that in some classes of bivariate families, the concerned information property is equivalent to that of its univariate counterpart. The proposed procedure is illustrated by considering several examples.     

Maximum likelihood estimation of the parameters of the bivariate binomial distribution

We consider the problem of maximum likelihood estimation of the parameters of the bxvariate binomial distribution, In the statistical literature, this problem is solved when the observed sample is available in the form of a 2x2 contingency table, that is, with all four cell fre quencies given,, The present paper provides a solution for this problem when only the marginal totals of the 2x2 table are observed, which is the natural set-up in a bivariate sampling situation.. Thus, based on a sample [(X_i,Y_i:), i = 1, …, k] from a bivariate binomial population, we derive maximum likelihood (ML) estimators for the two marginal parameters p₁,p₂: and the covariance parameter p₁₁: It. turns out that the ML estimators for P₁: and P₂: are expressed explicitly in terms of the sample values, whereas the ML estimator for p₁₁: can only be obtained numerically by iterative methods Two nu merical illustrations are also presented     

Prediction based on linear combinations of order statistics and bivariate concomitants in the case of multivariate elliptical distributions

In this paper, by considering a (3n+1) -dimensional random vector (X₀, X^T, Y^T, Z^T)^T having a multivariate elliptical distribution, we derive the exact joint distribution of (X₀, a^TX_(n), b^TY_[n], c^TZ_[n])^T, where a, b, c∈?ⁿ, X_(n)=(X₍₁₎, …, X_(n))^T, X₍₁₎<···<X_(n), is the vector of order statistics arising from X, and Y_[n]=(Y_[1], …, Y_[n])^T and Z_[n]=(Z_[1], …, Z_[n])^T denote the vectors of concomitants corresponding to X_(n) ((Y_[r], Z_[r])^T, for r=1, …, n, is the vector of bivariate concomitants corresponding to X_(r)). We then present an alternate approach for the derivation of the exact joint distribution of (X₀, X_(r), Y_[r], Z_[r])^T, for r=1, …, n. We show that these joint distributions can be expressed as mixtures of four-variate unified skew-elliptical distributions and these mixture forms facilitate the prediction of X_(r), say, based on the concomitants Y_[r] and Z_[r]. Finally, we illustrate the usefulness of our results by a real data.     

On Censored Bivariate Random Variables: Copula,Characterization, and Estimation

Let (X, Y) be a bivariate random vector with joint distribution function F_{X, Y}(x, y) = C(F(x), G(y)), where C is a copula and F and G are marginal distributions of X and Y, respectively. Suppose that (X_i, Y_i), i = 1, 2, …, n is a random sample from (X, Y) but we are able to observe only the data consisting of those pairs (X_i, Y_i) for which X_i ? Y_i. We denote such pairs as (X*_i, Y_i*), i = 1, 2, …, ν, where ν is a random variable. The main problem of interest is to express the distribution function F_{X, Y}(x, y) and marginal distributions F and G with the distribution function of observed random variables X* and Y*. It is shown that if X and Y are exchangeable with marginal distribution function F, then F can be uniquely determined by the distributions of X* and Y*. It is also shown that if X and Y are independent and absolutely continuous, then F and G can be expressed through the distribution functions of X* and Y* and the stress–strength reliability P{X ? Y}. This allows also to estimate P{X ? Y} with the truncated observations (X*_i, Y_i*). The copula of bivariate random vector (X*, Y*) is also derived.     

Changepoint Problems Under Random Censorship

Let X ₁, …, X _[nθ], X _{[nθ] + 1}, …, X _n be a sequence of independent random variables (the “lifetimes”) such that X _j ? F ₁ for 1 ≤ j ≤ [nθ] and X _j ? F ₂ for [nθ] + 1 ≤ j ≤ n, with F ₁ ≠ F ₂ unknown. In this paper we investigate an estimator θ _n for the changepoint θ if the X's are subject to censoring. The rate of almost sure convergence of θ _n to θ is established and a test for the hypothesis θ = 0, i.e. “no change”, is proposed.     

Bivariate extreme value distributions

Let (X_i, Y_i), i = 1, 2,…, n, be n independent observations from a bivariate population and let X_(n) = max X_i and Y_(n) = max Y_i. This article gives a necessary and sufficient condition for the weak convergence of the distribution function of (X_(n), Y_(n)) to a nondegenerate distribution.     

Distribution of concomitants of order statistics and their order statistics

For a random sample of size n$n$ from an absolutely continuous random vector (X,Y)$(X,Y)$, let _Yi:n$Y_{i:n}$ be i$i$th Y$Y$-order statistic and _Y[j:n]$Y_{[j:n]}$ be the Y$Y$-concomitant of _Xj:n$X_{j:n}$. We determine the joint pdf of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$ for all i,j=1$i,j=1$ to n$n$, and establish some symmetry properties of the joint distribution for symmetric populations. We discuss the uses of the joint distribution in the computation of moments and probabilities of various ranks for _Y[j:n]$Y_{[j:n]}$. We also show how our results can be used to determine the expected cost of mismatch in broken bivariate samples and approximate the first two moments of the ratios of linear functions of _Yi:n$Y_{i:n}$ and _Y[j:n]$Y_{[j:n]}$. For the bivariate normal case, we compute the expectations of the product of _Yi:n$Y_{i:n}$ and _Y[i:n]$Y_{[i:n]}$ for n=2$n=2$ to 8 for selected values of the correlation coefficient and illustrate their uses.     

Characterizations based on regression assumptions of order statistics

Let X₍₁₎≤X₍₂₎≤···≤X_(n) be the order statistics from independent and identically distributed random variables {X_i, 1≤i≤n} with a common absolutely continuous distribution function. In this work, first a new characterization of distributions based on order statistics is presented. Next, we review some conditional expectation properties of order statistics, which can be used to establish some equivalent forms for conditional expectations for sum of random variables based on order statistics. Using these equivalent forms, some known results can be extended immediately.     

Unbiased Estimation of P(X > Y) for Exponential Populations Using Order Statistics with Application in Ranked Set Sampling

This paper addresses the problem of unbiased estimation of P[X > Y] = θ for two independent exponentially distributed random variables X and Y. We present (unique) unbiased estimator of θ based on a single pair of order statistics obtained from two independent random samples from the two populations. We also indicate how this estimator can be utilized to obtain unbiased estimators of θ when only a few selected order statistics are available from the two random samples as well as when the samples are selected by an alternative procedure known as ranked set sampling. It is proved that for ranked set samples of size two, the proposed estimator is uniformly better than the conventional non-parametric unbiased estimator and further, a modified ranked set sampling procedure provides an unbiased estimator even better than the proposed estimator.     

Inference procedures in some bivariate exponential models under hybrid random censoring

We consider a life testing experiment in whichn units are put on test, successive lifetimes (X ₁,X ₂) of both componentsC ₁ andC ₂ are recorded and the observation is terminated either at ther-th order statistic ofY _i =Min(X _1i ,X _2i ),i=1,…,n i.e.Y _(r) or a random timeT _i whichever is reached first. This mixture of random censoring and type-II censoring schemes, we call as hybrid random censoring which is of wide use. We use this censoring scheme and obtain maximum likelihood estimation of the parameters and develop large sample tests in bivariate exponential (BVE) models proposed by Marshall-Olkin (1967), Block-Basu (1974), Freund (1961) and Preschan-Sullo (1974).     

Improved estimators for the selected location parameters

_i , i = 1, 2, ..., k be k independent exponential populations with different unknown location parameters θ _i , i = 1, 2, ..., k and common known scale parameter σ. Let Y _i denote the smallest observation based on a random sample of size n from the i-th population. Suppose a subset of the given k population is selected using the subset selection procedure according to which the population π _i is selected iff Y _i ≥Y ₍₁₎−d, where Y ₍₁₎ is the largest of the Y _i 's and d is some suitable constant. The estimation of the location parameters associated with the selected populations is considered for the squared error loss. It is observed that the natural estimator dominates the unbiased estimator. It is also shown that the natural estimator itself is inadmissible and a class of improved estimators that dominate the natural estimator is obtained. The improved estimators are consistent and their risks are shown to be O(kn ⁻²). As a special case, we obtain the coresponding results for the estimation of θ₍₁₎, the parameter associated with Y ₍₁₎. Received: January 6, 1998; revised version: July 11, 2000     

A new class of bivariate lifetime distributions

This paper introduces a new class of bivariate lifetime distributions. Let {X_i}_{i ? 1} and {Y_i}_{i ? 1} be two independent sequences of independent and identically distributed positive valued random variables. Define T₁ = min?(X₁, …, X_M) and T₂ = min?(Y₁, …, Y_N), where (M, N) has a discrete bivariate phase-type distribution, independent of {X_i}_{i ? 1} and {Y_i}_{i ? 1}. The joint survival function of (T₁, T₂) is studied.     

Small-Sample Quantile Estimators in a Large Nonparametric Model

The large nonparametric model in this note is a statistical model with the family ? of all continuous and strictly increasing distribution functions. In the abundant literature of the subject, there are many proposals for nonparametric estimators that are applicable in the model. Typically the kth order statistic X _k:n is taken as a simplest estimator, with k = [nq], or k = [(n + 1)q], or k = [nq] + 1, etc. Often a linear combination of two consecutive order statistics is considered. In more sophisticated constructions, different L-statistics (e.g., Harrel–Davis, Kaigh–Lachenbruch, Bernstein, kernel estimators) are proposed. Asymptotically the estimators do not differ substantially, but if the sample size n is fixed, which is the case of our concern, differences may be serious. A unified treatment of quantile estimators in the large, nonparametric statistical model is developed.     

A note on the admissibility of hammersley's estimator of an integer mean

Let X₁, X₂, …, X_n be identically, independently distributed N(i,1) random variables, where i = 0, ±1, ±2, … Hammersley (1950) showed that d = [X?_n], the nearest integer to the sample mean, is the maximum likelihood estimator of i. Khan (1973) showed that d is minimax and admissible with respect to zero-one loss. This note now proves a conjecture of Stein to the effect that in the class of integer-valued estimators d is minimax and admissible under squared-error loss.