Information Properties for Concomitants of Order Statistics in Farlie–Gumbel–Morgenstern (FGM) Family

Let (X _i , Y _i ), i = 1, 2,…, n be independent and identically distributed random variables from some continuous bivariate distribution. If X _(r) denotes the rth-order statistic, then the Y's associated with X _(r) denoted by Y _[r] is called the concomitant of the rth-order statistic. In this article, we derive an analytical expression of Shannon entropy for concomitants of order statistics in FGM family. Applying this expression for some well-known distributions of this family, we obtain the exact form of Shannon entropy, some of the information properties, and entropy bounds for concomitants of order statistics. Some comparisons are also made between the entropy of order statistics X _(r) and the entropy of its concomitants Y _[r]. In this family, we show that the mutual information between X _(r) and Y _[r], and Kullback–Leibler distance among the concomitants of order statistics are all distribution-free. Also, we compare the Pearson correlation coefficient between X _(r) and Y _[r] with the mutual information of (X _(r), Y _[r]) for the copula model of FGM family.     

Correlation estimation in Downton's bivariate exponential distribution using incomplete samples

Suppose (X, Y) has a Downton's bivariate exponential distribution with correlation ρ. For a random sample of size n from (X, Y), let X _r:n be the rth X-order statistic and Y _[r:n] be its concomitant. We investigate estimators of ρ when all the parameters are unknown and the available data is an incomplete bivariate sample made up of (i) all the Y-values and the ranks of associated X-values, i.e. (i, Y _[i:n]), 1≤i≤n, and (ii) a Type II right-censored bivariate sample consisting of (X _i:n , Y _[i:n]), 1≤i≤r<n. In both setups, we use simulation to examine the bias and mean square errors of several estimators of ρ and obtain their estimated relative efficiencies. The preferred estimator under (i) is a function of the sample correlation of (Y _i:n , Y _[i:n]) values, and under (ii), a method of moments estimator involving the regression function is preferred.     

Prediction based on linear combinations of order statistics and bivariate concomitants in the case of multivariate elliptical distributions

In this paper, by considering a (3n+1) -dimensional random vector (X₀, X^T, Y^T, Z^T)^T having a multivariate elliptical distribution, we derive the exact joint distribution of (X₀, a^TX_(n), b^TY_[n], c^TZ_[n])^T, where a, b, c∈?ⁿ, X_(n)=(X₍₁₎, …, X_(n))^T, X₍₁₎<···<X_(n), is the vector of order statistics arising from X, and Y_[n]=(Y_[1], …, Y_[n])^T and Z_[n]=(Z_[1], …, Z_[n])^T denote the vectors of concomitants corresponding to X_(n) ((Y_[r], Z_[r])^T, for r=1, …, n, is the vector of bivariate concomitants corresponding to X_(r)). We then present an alternate approach for the derivation of the exact joint distribution of (X₀, X_(r), Y_[r], Z_[r])^T, for r=1, …, n. We show that these joint distributions can be expressed as mixtures of four-variate unified skew-elliptical distributions and these mixture forms facilitate the prediction of X_(r), say, based on the concomitants Y_[r] and Z_[r]. Finally, we illustrate the usefulness of our results by a real data.     

Nonparametric two‐step regression estimation when regressors and error are dependent

This paper considers estimation of the function g in the model Y_t = g(X_t ) + ?_t when E(?_t|Xt) ≠ 0 with nonzero probability. We assume the existence of an instrumental variable Z_t that is independent of ?_t, and of an innovation ηt = X_t — E(X_t|Z_t). We use a nonparametric regression of X_t on Z_t to obtain residuals η_t, which in turn are used to obtain a consistent estimator of g. The estimator was first analyzed by Newey, Powell & Vella (1999) under the assumption that the observations are independent and identically distributed. Here we derive a sample mean‐squared‐error convergence result for independent identically distributed observations as well as a uniform‐convergence result under time‐series dependence.     

Bivariate Aging Properties under Archimedean Dependence Structures

Let X  = (X, Y) be a pair of lifetimes whose dependence structure is described by an Archimedean survival copula, and let X _t  = [(X ? t, Y ? t) | X > t, Y > t] denotes the corresponding pair of residual lifetimes after time t ≥ 0. Multivariate aging notions, defined by means of stochastic comparisons between X and X _t , with t ≥ 0, were studied in Pellerey (2008 Pellerey , F. ( 2008 ). On univariate and bivariate aging for dependent lifetimes with Archimedean survival copulas . Kybernetika 44 : 795 – 806 .[Web of Science ®] , [Google Scholar]), who considered pairs of lifetimes having the same marginal distribution. Here, we present the generalizations of his results, considering both stochastic comparisons between X _t and X _t+s for all t, s ≥ 0 and the case of dependent lifetimes having different distributions. Comparisons between two different pairs of residual lifetimes, at any time t ≥ 0, are discussed as well.     

A Note on the Predictors of Differenced Sequences

In this note we consider the problems of optimal linear prediction (o.l.p.) and the minimum mean squared error prediction (m.m.s.e.p.) of a sequence X_t, which fits to a stationary and invertible ARMA model through the filter (1 - B^s)^d X_t= Y_t. It is shown that these two predictors are not identical in general from the theoretical point of view. Permitting the degree of differencing d to take any real value, a set of conditions for these commonly applied prediction formulas to be identical is given.     

Testing for lack of dependence in the functional linear model

The authors consider the linear model Y_n = ψX_n + ?_n relating a functional response with explanatory variables. They propose a simple test of the nullity of ψ based on the principal component decomposition. The limiting distribution of their test statistic is chi‐squared, but this distribution is also an excellent approximation in finite samples. The authors illustrate their method using data from terrestrial magnetic observatories.     

The T-type estimate of a class of partially non linear models

Abstract

This paper considers a partially non linear model E(Y|X, z, t) = f(X, β) + z^Tg(t) and gives its T-type estimate, which is a weighted quasi-likelihood estimate using sieve method and can be obtained by EM algorithm. The influence functions and asymptotic properties of T-type estimate (consistency and asymptotic normality) are discussed, and convergence rate of both parametric and non parametric components are obtained. Simulation results show the shape of influence functions and prove that the T-type estimate performs quite well. The proposed estimate is also applied to a data set and compared with the least square estimate and least absolute deviation estimate.     

On an application of concomitants of order statistics

ABSTRACT

Let (X_i, Y_i), i = 1, …, n be a pair where the first coordinate X_i represents the lifetime of a component, and the second coordinate Y_i denotes the utility of the component during its lifetime. Then the random variable Y_{[r: n]} which is known to be the concomitant of the rth order statistic defines the utility of the component which has the rth smallest lifetime. In this paper, we present a dynamic analysis for an n component system under the above-mentioned concomitant setup.     

Changepoint Problems Under Random Censorship

Let X ₁, …, X _[nθ], X _{[nθ] + 1}, …, X _n be a sequence of independent random variables (the “lifetimes”) such that X _j ? F ₁ for 1 ≤ j ≤ [nθ] and X _j ? F ₂ for [nθ] + 1 ≤ j ≤ n, with F ₁ ≠ F ₂ unknown. In this paper we investigate an estimator θ _n for the changepoint θ if the X's are subject to censoring. The rate of almost sure convergence of θ _n to θ is established and a test for the hypothesis θ = 0, i.e. “no change”, is proposed.     

Nonlinear regression in a trivariate elliptical distribution via a linear combination of order statistics

In this paper, by assuming that (X, Y ₁, Y ₂)^T has a trivariate elliptical distribution, we derive the exact joint distribution of X and a linear combination of order statistics from (Y ₁, Y ₂)^T and show that it is a mixture of unified bivariate skew-elliptical distributions. We then derive the corresponding marginal and conditional distributions for the special case of t kernel. We also present these results for an exchangeable case with t kernel and illustrate the established results with an air-pollution data.     

Bias of the lse estimator of the first order autoregressive model under tukey contamination

Results of an exhaustive study of the bias of the least square estimator (LSE) of an first order autoregression coefficient α in a contaminated Gaussian model are presented. The model describes the following situation. The process is defined as X_t = α X_t-1 + Y_t . Until a specified time T, Y_t are iid normal N(0, 1). At the moment T we start our observations and since then the distribution of Y_t, t≥T, is a Tukey mixture T(εσ) = (1 – ε)N(0,1) + εN(0, σ²). Bias of LSE as a function of α and ε, and σ² is considered. A rather unexpected fact is revealed: given α and ε, the bias does not change montonically with σ (“the magnitude of the contaminant”), and similarly, given α and σ, the bias is not growing with ε (“the amount of contaminants”).     

Confidence Intervals for Nonparametric Regression Functions with Missing Data

Suppose that we have a nonparametric regression model Y = m(X) + ε with X ∈ R^p, where X is a random design variable and is observed completely, and Y is the response variable and some Y-values are missing at random. Based on the “complete” data sets for Y after nonaprametric regression imputation and inverse probability weighted imputation, two estimators of the regression function m(x₀) for fixed x₀ ∈ R^p are proposed. Asymptotic normality of two estimators is established, which is used to construct normal approximation-based confidence intervals for m(x₀). We also construct an empirical likelihood (EL) statistic for m(x₀) with limiting distribution of χ²₁, which is used to construct an EL confidence interval for m(x₀).     

A characterization of the dilation order and its applications

LetX andY be two random variables with finite expectationsE X andE Y, respectively. ThenX is said to be smaller thanY in the dilation order ifE[ϕ(X-E X)]≤E[ϕ(Y-E Y)] for any convex functionϕ for which the expectations exist. In this paper we obtain a new characterization of the dilation order. This characterization enables us to give new interpretations to the dilation order, and using them we identify conditions which imply the dilation order. A sample of applications of the new characterization is given. Partially supported by MURST 40% Program on Non-Linear Systems and Applications. Partially supported by “Gruppo Nazionale per l'Analisi Funzionale e sue Applicazioni”—CNR.     

Conditional estimation of average on the basis of weighting data

LetF(x,y) be a distribution function of a two dimensional random variable (X,Y). We assume that a distribution functionF _x(x) of the random variableX is known. The variableX will be called an auxiliary variable. Our purpose is estimation of the expected valuem=E(Y) on the basis of two-dimensional simple sample denoted by:U=[(X ₁, Y₁)…(X_n, Y_n)]=[X Y]. LetX=[X ₁…X _n]andY=[Y ₁…Y _n].This sample is drawn from a distribution determined by the functionF(x,y). LetX _(k)be the k-th (k=1, …,n) order statistic determined on the basis of the sampleX. The sampleU is truncated by means of this order statistic into two sub-samples: % MathType!End!2!1! and % MathType!End!2!1!.Let % MathType!End!2!1! and % MathType!End!2!1! be the sample means from the sub-samplesU _k,1 andU _k,2, respectively. The linear combination % MathType!End!2!1! of these means is the conditional estimator of the expected valuem. The coefficients of this linear combination depend on the distribution function of auxiliary variable in the pointx _(k).We can show that this statistic is conditionally as well as unconditionally unbiased estimator of the averagem. The variance of this estimator is derived. The variance of the statistic % MathType!End!2!1! is compared with the variance of the order sample mean. The generalization of the conditional estimation of the mean is considered, too.     

Concomitants of order statistics from multivariate elliptical distributions

In this paper, by considering a 2n-dimensional elliptically contoured random vector (X^T,Y^T)^T=(X₁,…,X_n,Y₁,…,Y_n)^T, we derive the exact joint distribution of linear combinations of concomitants of order statistics arising from X. Specifically, we establish a mixture representation for the distribution of the rth concomitant order statistic, and also for the joint distribution of the rth order statistic and its concomitant. We show that these distributions are indeed mixtures of multivariate unified skew-elliptical distributions. The two most important special cases of multivariate normal and multivariate t distributions are then discussed in detail. Finally, an application of the established results in an inferential problem is outlined.     

A linear regression with unobserved dependent variables

Let (?,X) be a random vector such that E(X|?) = ? and Var(x|?) a + b? + c?² for some known constants a, b and c. Assume X₁,…,X_n are independent observations which have the same distribution as X. Let t(X) be the linear regression of ? on X. The linear empirical Bayes estimator is used to approximate the linear regression function. It is shown that under appropriate conditions, the linear empirical Bayes estimator approximates the linear regression well in the sense of mean squared error.     

Nonparametric Estimation of Volatility Function with Variable Bandwidth Parameter

In this article, we introduce a new method for the volatility function estimation of continuous-time diffusion process dX _t  = μ(X _t )dt + σ(X _t )dW _t , which is based on combining the idea of local linear smoother and variable bandwidth. We give the expressions for the conditional MSE and MISE of the estimator and obtain the optimal variable bandwidth. An explicit formula for the optimal variable bandwidth is presented by minimizing the MISE, which extends the related results in Fan and Gijbels (1992 Fan , J. Q. , Gijbels , I. ( 1992 ). Variable bandwidth and local linear regression smoother . Ann. Statist. 20 ( 4 ): 2008 – 2036 .[Crossref], [Web of Science ®] , [Google Scholar]), etc. Finally, some simulations show that the performance of the proposed estimator with optimal variable bandwidth is often much better than that of the local linear estimator with invariable bandwidth.     

On Nonparametric Estimation of a Reliability Function

This article considers the properties of a nonparametric estimator developed for a reliability function which is used in many reliability problems. Properties such as asymptotic unbiasedness and consistency are proven for the estimator and using U-statistics, weak convergence of the estimator to a normal distribution is shown. Finally, numerical examples based on an extensive simulation study are presented to illustrate the theory and compare the estimator developed in this article with another based directly on the ratio of two empirical distributions studied in Zardasht and Asadi (2010 Zardasht , V. , Asadi , M. ( 2010 ). Evaluation of P(X _t  > Y _t ) when both X _t and Y _t are residual lifetimes of two systems . Statistica Neerlandica 64 : 460 – 481 .[Crossref], [Web of Science ®] , [Google Scholar]).     

Asymptotic Inferences for an AR(1) Model with a Change Point and Possibly Infinite Variance

The basic model in this paper is an AR(1) model with a structural break in the AR parameter β at an unknown time k₀. That is, y_t = β₁y_{t ? 1}I{t ? k₀} + β₂y_{t ? 1}I{t > k₀} + ?_t, t = 1, 2, ???, T, where I{ · } denotes the indicator function. Suppose |β₁| < 1, |β₂| < 1, and {?_t, t ? 1} is a sequence of i.i.d. random variables which are in the domain of attraction of the normal law with zero mean and possibly infinite variance, then the limiting distributions for the least squares estimators of β₁ and β₂ are studied in the present paper, which extend some results in Chong (2001 Chong, T.L. (2001). Structural change in AR(1) models. Econometric Theory 17:87–155.[Crossref], [Web of Science ®] , [Google Scholar]).