An inverse-probability-weighted approach to estimation of the bivariate survival function under left-truncation and right-censoring

In this note, we consider estimating the bivariate survival function when both survival times are subject to random left truncation and one of the survival times is subject to random right censoring. Motivated by Satten and Datta [2001. The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average. Amer. Statist. 55, 207–210], we propose an inverse-probability-weighted (IPW) estimator. It involves simultaneous estimation of the bivariate survival function of the truncation variables and that of the censoring variable and the truncation variable of the uncensored components. We prove that (i) when there is no censoring, the IPW estimator reduces to NPMLE of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131] and (ii) when there is random left truncation and right censoring on only one of the components and the other component is always observed, the IPW estimator reduces to the estimator of Gijbels and Gürler [1998. Covariance function of a bivariate distribution function estimator for left truncated and right censored data. Statist. Sin. 1219–1232]. Based on Theorem 3.1 of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627], we prove that the IPW estimator is consistent under certain conditions. Finally, we examine the finite sample performance of the IPW estimator in some simulation studies. For the special case that censoring time is independent of truncation time, a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627]. For the special case (i), a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by Huang et al. (2001. Nonnparametric estimation of marginal distributions under bivariate truncation with application to testing for age-of-onset application. Statist. Sin. 11, 1047–1068).     

Fitting parametric frailty and mixture models under biased sampling

Biased sampling from an underlying distribution with p.d.f. f(t), t>0, implies that observations follow the weighted distribution with p.d.f. f ^w (t)=w(t)f(t)/E[w(T)] for a known weight function w. In particular, the function w(t)=t ^α has important applications, including length-biased sampling (α=1) and area-biased sampling (α=2). We first consider here the maximum likelihood estimation of the parameters of a distribution f(t) under biased sampling from a censored population in a proportional hazards frailty model where a baseline distribution (e.g. Weibull) is mixed with a continuous frailty distribution (e.g. Gamma). A right-censored observation contributes a term proportional to w(t)S(t) to the likelihood; this is not the same as S ^w (t), so the problem of fitting the model does not simply reduce to fitting the weighted distribution. We present results on the distribution of frailty in the weighted distribution and develop an EM algorithm for estimating the parameters of the model in the important Weibull–Gamma case. We also give results for the case where f(t) is a finite mixture distribution. Results are presented for uncensored data and for Type I right censoring. Simulation results are presented, and the methods are illustrated on a set of lifetime data.     

Correcting the bias due to dependent censoring of the survival estimator by conditioning

We consider the conditional estimation of the survival function of the time T₂ to a second event as a function of the time T₁ to a first event when there is a censoring mechanism acting on their sum T₁+T₂. The problem has been motivated by a treatment interruption study aimed at improving the quality of life of HIV-infected patients. We base the analysis on the survival function of T₂ given that T₁∈I, where I represents a period of scientific interest (1 trimester, 1 year, 2 years, etc.) and propose a non-parametric estimator for the survival function of T₂ given that T₁∈I, which takes into account both the selection bias and the heterogeneity due to the dependent censoring. The proposed estimator for the survival function uses the risk group of T₂ conditioned on the categories of T₁ and corrects for the dependent censoring using weights defined by the observed values of T₁. The estimator, properly normalized, converges weakly to a zero-mean Gaussian process. We estimate the variance of the limiting process via a bootstrap methodology. Properties of the proposed estimator are illustrated by an extensive simulation study. The motivating data set is analysed by means of this new methodology.     

Estimating stage occupation probabilities in non-Markov models

We study non-Markov multistage models under dependent censoring regarding estimation of stage occupation probabilities. The individual transition and censoring mechanisms are linked together through covariate processes that affect both the transition intensities and the censoring hazard for the corresponding subjects. In order to adjust for the dependent censoring, an additive hazard regression model is applied to the censoring times, and all observed counting and “at risk” processes are subsequently given an inverse probability of censoring weighted form. We examine the bias of the Datta–Satten and Aalen–Johansen estimators of stage occupation probability, and also consider the variability of these estimators by studying their estimated standard errors and mean squared errors. Results from different simulation studies of frailty models indicate that the Datta–Satten estimator is approximately unbiased, whereas the Aalen–Johansen estimator either under- or overestimates the stage occupation probability due to the dependent nature of the censoring process. However, in our simulations, the mean squared error of the latter estimator tends to be slightly smaller than that of the former estimator. Studies on development of nephropathy among diabetics and on blood platelet recovery among bone marrow transplant patients are used as demonstrations on how the two estimation methods work in practice. Our analyses show that the Datta–Satten estimator performs well in estimating stage occupation probability, but that the censoring mechanism has to be quite selective before a deviation from the Aalen-Johansen estimator is of practical importance. N. Gunnes—Supported by a grant from the Norwegian Cancer Society.     

A polar coordinate transformation for estimating bivariate survival functions with randomly censored and truncated data

This paper proposes a new estimator for bivariate distribution functions under random truncation and random censoring. The new method is based on a polar coordinate transformation, which enables us to transform a bivariate survival function to a univariate survival function. A consistent estimator for the transformed univariate function is proposed. Then the univariate estimator is transformed back to a bivariate estimator. The estimator converges weakly to a zero-mean Gaussian process with an easily estimated covariance function. Consistent truncation probability estimate is also provided. Numerical studies show that the distribution estimator and truncation probability estimator perform remarkably well.     

Nonparametric two‐step regression estimation when regressors and error are dependent

This paper considers estimation of the function g in the model Y_t = g(X_t ) + ?_t when E(?_t|Xt) ≠ 0 with nonzero probability. We assume the existence of an instrumental variable Z_t that is independent of ?_t, and of an innovation ηt = X_t — E(X_t|Z_t). We use a nonparametric regression of X_t on Z_t to obtain residuals η_t, which in turn are used to obtain a consistent estimator of g. The estimator was first analyzed by Newey, Powell & Vella (1999) under the assumption that the observations are independent and identically distributed. Here we derive a sample mean‐squared‐error convergence result for independent identically distributed observations as well as a uniform‐convergence result under time‐series dependence.     

The Product-Limit Estimate as an Inverse-Probability-Weighted Average

Abstract

For randomly censored data, (Satten, G. A., Datta S. (2001 Satten, G. A. and Datta, S. 2001. The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average. Amer. Statist. Ass., 55: 207–210. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average. Amer. Statist. Ass. 55:207–210) showed that the Kaplan–Meier estimator (product-limit estimator (PLE)) can be expressed as an inverse-probability-weighted average. In this article, we consider the other two PLEs: the truncation PLE and the censoring-truncation PLE. For the data subject to left-truncation or both left-truncation and right-censoring, it is shown that these two PLEs can be expressed as inverse-probability-weighted averages.     

Interval estimation of the joint survival function for successive duration times under left truncation and right censoring

In incident cohort studies, survival data often include subjects who have had an initiate event at recruitment and may potentially experience two successive events (first and second) during the follow-up period. Since the second duration process becomes observable only if the first event has occurred, left truncation and dependent censoring arise if the two duration times are correlated. To confront the two potential sampling biases, we propose two inverse-probability-weighted (IPW) estimators for the estimation of the joint survival function of two successive duration times. One of them is similar to the estimator proposed by Chang and Tzeng [Nonparametric estimation of sojourn time distributions for truncated serial event data – a weight adjusted approach, Lifetime Data Anal. 12 (2006), pp. 53–67]. The other is the extension of the nonparametric estimator proposed by Wang and Wells [Nonparametric estimation of successive duration times under dependent censoring, Biometrika 85 (1998), pp. 561–572]. The weak convergence of both estimators are established. Furthermore, the delete-one jackknife and simple bootstrap methods are used to estimate standard deviations and construct interval estimators. A simulation study is conducted to compare the two IPW approaches.     

Optimal Designs for Approximating a Stochastic Process with Respect to a Minimax Criterion

We study the problem of approximating a stochastic process Y = {Y(t: t ∈ T} with known and continuous covariance function R on the basis of finitely many observations Y(t ₁,), …, Y(t _n ). Dependent on the knowledge about the mean function, we use different approximations ? and measure their performance by the corresponding maximum mean squared error sub _t∈T E(Y(t) ? ?(t))². For a compact T ? ? ^p we prove sufficient conditions for the existence of optimal designs. For the class of covariance functions on T ² = [0, 1]² which satisfy generalized Sacks/Ylvisaker regularity conditions of order zero or are of product type, we construct sequences of designs for which the proposed approximations perform asymptotically optimal.     

Sequential estimation in two-truncation parameter family of distributions under type II censoring

Summary This paper deals with the sequential estimation ofq(ϑ₁, ϑ₂) when the underlying density function is of the formf(x)=q(ϑ₁, ϑ₂)h(x), where ϑ₁ and ϑ₂ are unknown truncation parameters. We study the sequential properties of the stopping rule and the sequential estimator ofq(ϑ₁, ϑ₂). In this study we assume that the sample is type II censored.     

Bayesian and Robust Bayesian analysis under a general class of balanced loss functions

For estimating an unknown parameter θ, we introduce and motivate the use of balanced loss functions of the form L_{r, w, d0}(q, d)=wr(d₀, d)+ (1-w) r(q, d){L_{\rho, \omega, \delta_0}(\theta, \delta)=\omega \rho(\delta_0, \delta)+ (1-\omega) \rho(\theta, \delta)}, as well as the weighted version q(q) L_{r, w, d0}(q, d){q(\theta) L_{\rho, \omega, \delta_0}(\theta, \delta)}, where ρ(θ, δ) is an arbitrary loss function, δ ₀ is a chosen a priori “target” estimator of q, w ? [0,1){\theta, \omega \in[0,1)}, and q(·) is a positive weight function. we develop Bayesian estimators under L_{r, w, d0}{L_{\rho, \omega, \delta_0}} with ω > 0 by relating such estimators to Bayesian solutions under L_{r, w, d0}{L_{\rho, \omega, \delta_0}} with ω = 0. Illustrations are given for various choices of ρ, such as absolute value, entropy, linex, and squared error type losses. Finally, under various robust Bayesian analysis criteria including posterior regret gamma-minimaxity, conditional gamma-minimaxity, and most stable, we establish explicit connections between optimal actions derived under balanced and unbalanced losses.     

Simultaneous marginal survival estimators when doubly censored data is present

A doubly censoring scheme occurs when the lifetimes T being measured, from a well-known time origin, are exactly observed within a window [L, R] of observational time and are otherwise censored either from above (right-censored observations) or below (left-censored observations). Sample data consists on the pairs (U, δ) where U = min{R, max{T, L}} and δ indicates whether T is exactly observed (δ = 0), right-censored (δ = 1) or left-censored (δ = −1). We are interested in the estimation of the marginal behaviour of the three random variables T, L and R based on the observed pairs (U, δ). We propose new nonparametric simultaneous marginal estimators [^(S)]_T, [^(S)]_L{\hat S_{T}, \hat S_{L}} and [^(S)]_R{\hat S_{R}} for the survival functions of T, L and R, respectively, by means of an inverse-probability-of-censoring approach. The proposed estimators [^(S)]_T, [^(S)]_L{\hat S_{T}, \hat S_{L}} and [^(S)]_R{\hat S_{R}} are not computationally intensive, generalize the empirical survival estimator and reduce to the Kaplan-Meier estimator in the absence of left-censored data. Furthermore, [^(S)]_T{\hat S_{T}} is equivalent to a self-consistent estimator, is uniformly strongly consistent and asymptotically normal. The method is illustrated with data from a cohort of drug users recruited in a detoxification program in Badalona (Spain). For these data we estimate the survival function for the elapsed time from starting IV-drugs to AIDS diagnosis, as well as the potential follow-up time. A simulation study is discussed to assess the performance of the three survival estimators for moderate sample sizes and different censoring levels.     

Nonparametric Bivariate Estimation with Left-Truncated and Right-Censored Data

ABSTRACT

In this article we consider estimating the bivariate survival function observations where one of the components is subject to left truncation and right censoring and the other is subject to right censoring only. Two types of nonparametric estimators are proposed. One is in the form of inverse-probability-weighted average (Satten and Datta, 2001 Satten , G. A. , Datta , S. ( 2001 ). The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average . Amer. Statist. 55 : 207 – 210 . [CROSSREF] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and the other is a generalization of Dabrowska's 1988 Dabrowska , D. M. ( 1988 ). Kaplan–Meier estimate on the plane . Ann. Statist. 18 : 308 – 325 . [Google Scholar] estimator. The two are then compared based on their empirical performances.     

Large sample properties of nonparametric copula estimators under bivariate censoring

A new nonparametric estimator is proposed for the copula function of a bivariate survival function for data subject to random right-censoring. We consider two censoring models: univariate and copula censoring. We show strong consistency and we obtain an i.i.d. representation for the copula estimator. In a simulation study we compare the new estimator to the one of Gribkova and Lopez [Nonparametric copula estimation under bivariate censoring; doi:10.1111/sjos.12144].     

Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

Conditional Quantile Estimation for Truncated and Associated Data

Abstract

In survival or reliability studies, it is common to have data which are not only incomplete but weakly dependent too. Random truncation and censoring are two common forms of such data when they are neither independent nor strongly mixing but rather associated. The focus of this paper is on estimating conditional distribution and conditional quantile functions for randomly left truncated data satisfying association condition. We aim at deriving strong uniform consistency rates and asymptotic normality for the estimators and thereby, extend to association case some results stated under iid and α-mixing hypotheses. The performance of the quantile function estimator is evaluated on simulated data sets.     

Nonparametric estimation with left-truncated and right-censored data when the sample size before truncation is known

In this article, we consider nonparametric estimation of the survival function when the data are subject to left-truncation and right-censoring and the sample size before truncation is known. We propose two estimators. The first estimator is derived based on a self-consistent estimating equation. The second estimator is obtained by using the constrained expectation-maximization algorithm. Simulation results indicate that both estimators are more efficient than the product-limit estimator. When there is no censoring, the performance of the proposed estimators is compared with that of the estimator proposed by Li and Qin [Semiparametric likelihood-based inference for biased and truncated data when total sample size is known, J. R. Stat. Soc. B 60 (1998), pp. 243–254] via simulation study.     

Estimation of the joint survival function for successive duration times under double-truncation and right-censoring

ABSTRACT

In incident cohort studies, survival data often include subjects who have had an initiate event at recruitment and may potentially experience two successive events (first and second) during the follow-up period. When disease registries or surveillance systems collect data based on incidence occurring within a specific calendar time interval, the initial event is usually subject to double truncation. Furthermore, since the second duration process is observable only if the first event has occurred, double truncation and dependent censoring arise. In this article, under the two sampling biases with an unspecified distribution of truncation variables, we propose a nonparametric estimator of the joint survival function of two successive duration times using the inverse-probability-weighted (IPW) approach. The consistency of the proposed estimator is established. Based on the estimated marginal survival functions, we also propose a two-stage estimation procedure for estimating the parameters of copula model. The bootstrap method is used to construct confidence interval. Numerical studies demonstrate that the proposed estimation approaches perform well with moderate sample sizes.     

Estimated Generalized Least Squares for a Heteroscedastic Regression Model

This paper considers the general linear regression model yc = X₁β+u_t under the heteroscedastic structure E(u_t) = 0, E(u²) =σ²- (X_tβ)², E(u_t u_s) = 0, tæs, t, s= 1, T. It is shown that any estimated GLS estimator for β is asymptotically equivalent to the GLS estimator under some regularity conditions. A three-step GLS estimator, which calls upon the assumption E(u_t²) =s?²(X,β)² for the estimation of the disturbance covariance matrix, is considered.