Comparison of renewal function estimators for censored data

The computation of the renewal function when the distribution function is completely known has received much attention in the literature. However, in many cases the form of the distribution function is unknown and has to be estimated nonparametrically. A nonparametric estimator for the renewal function for complete data was suggested by Frees (1986). In many cases, however, censoring of the lifetime might occur. We shall present parametric and nonparametric estimators of the renewal function based on censored data. In a simulation study we compare the nonparametric estimators with parametric estimators for the Weibull and lognormal distribution. The study suggests that the nonparametric estimator is a viable alternative to the parametric estimators when the lifetime distribution is unknown. Also, the nonparametric estimator is computationally simpler than the parametric estimator.     

A maximum likelihood estimator for left-truncated lifetimes based on probabilistic prior information about time of occurrence

In forestry, many processes of interest are binary and they can be modeled using lifetime analysis. However, available data are often incomplete, being interval- and right-censored as well as left-truncated, which may lead to biased parameter estimates. While censoring can be easily considered in lifetime analysis, left truncation is more complicated when individual age at selection is unknown. In this study, we designed and tested a maximum likelihood estimator that deals with left truncation by taking advantage of prior knowledge about the time when the individuals enter the experiment. Whenever a model is available for predicting the time of selection, the distribution of the delayed entries can be obtained using Bayes' theorem. It is then possible to marginalize the likelihood function over the distribution of the delayed entries in the experiment to assess the joint distribution of time of selection and time to event. This estimator was tested with continuous and discrete Gompertz-distributed lifetimes. It was then compared with two other estimators: a standard one in which left truncation was not considered and a second estimator that implemented an analytical correction. Our new estimator yielded unbiased parameter estimates with empirical coverage of confidence intervals close to their nominal value. The standard estimator leaded to an overestimation of the long-term probability of survival.     

Comparing Nonparametric Estimators for Length-Biased Data

Length-biased data appear when sampling lifetimes by cross-section. Right-censoring may affect the sampled information due to time limitation in following-up, lost to follow-up cases, etc. In this article, we compare by simulations two alternative nonparametric estimators of the lifetime distribution function when the data are length-biased and right-censored. These estimates, recently introduced in the literature, are based on nonparametric maximum-likelihood and moment-based principles. It is shown that the relative benefits associated to each estimator depend on several factors, such as the shape of the underlying distribution, sample size, or censoring level.     

A Generalization of Turnbull’s Estimator for Interval-Censored and Doubly Truncated Data

Nonparametric estimates of the conditional distribution of a response variable given a covariate are important for data exploration purposes. In this article, we propose a nonparametric estimator of the conditional distribution function in the case where the response variable is subject to interval censoring and double truncation. Using the approach of Dehghan and Duchesne (2011), the proposed method consists in adding weights that depend on the covariate value in the self-consistency equation of Turnbull (1976), which results in a nonparametric estimator. We demonstrate by simulation that the estimator, bootstrap variance estimation and bandwidth selection all perform well in finite samples.     

Asymptotic Normality for Regression Function Estimate Under Truncation and α-Mixing Conditions

In this article we establish pointwise asymptotic normality of nonparametric kernel estimator of regression function for a left truncation model. It is assumed that the lifetime observations with multivariate covariates form a stationary α-mixing sequence. Also, the asymptotic normality of the estimation of the covariable's density is considered. As a by-product, we obtain a uniform weak convergence rate for the product-limit estimator of the lifetime and truncated distributions under dependence, which is interesting independently. Finite sample behavior of the estimator of the regression function is investigated as well.     

Computationally simple estimation and improved efficiency for special cases of double truncation

Doubly truncated survival data arise when event times are observed only if they occur within subject specific intervals of times. Existing iterative estimation procedures for doubly truncated data are computationally intensive (Turnbull 38:290–295, 1976; Efron and Petrosian 94:824–825, 1999; Shen 62:835–853, 2010a). These procedures assume that the event time is independent of the truncation times, in the sample space that conforms to their requisite ordering. This type of independence is referred to as quasi-independence. In this paper we identify and consider two special cases of quasi-independence: complete quasi-independence and complete truncation dependence. For the case of complete quasi-independence, we derive the nonparametric maximum likelihood estimator in closed-form. For the case of complete truncation dependence, we derive a closed-form nonparametric estimator that requires some external information, and a semi-parametric maximum likelihood estimator that achieves improved efficiency relative to the standard nonparametric maximum likelihood estimator, in the absence of external information. We demonstrate the consistency and potentially improved efficiency of the estimators in simulation studies, and illustrate their use in application to studies of AIDS incubation and Parkinson’s disease age of onset.     

Extreme quantile estimation based on financial time series

Estimation of market risk is an important problem in finance. Two well-known risk measures, viz., value at risk and median shortfall, turn out to be extreme quantiles of the marginal distribution of asset return. Time series on asset returns are known to exhibit certain stylized facts, such as heavy tails, skewness, volatility clustering, etc. Therefore, estimation of extreme quantiles in the presence of such features in the data seems to be of natural interest. It is difficult to capture most of these stylized facts using one specific time series model. This motivates nonparametric and extreme value theory-based estimation of extreme quantiles that do not require exact specification of the asset return model. We review these quantile estimators and compare their known properties. Their finite sample performance are compared using Monte Carlo simulation. We propose a new estimator that exhibits encouraging finite sample performance while estimating extreme quantile in the right tail region.     

Pseudo MLE for semiparametric transformation model with doubly truncated data

In this article, we consider the efficient estimation of the semiparametric transformation model with doubly truncated data. We propose a two-step approach for obtaining the pseudo maximum likelihood estimators (PMLE) of regression parameters. In the first step, the truncation time distribution is estimated by the nonparametric maximum likelihood estimator (Shen, 2010a) when the distribution function $K$ of the truncation time is unspecified or by the conditional maximum likelihood estimator (Bilker and Wang, 1996) when $K$ is parameterized. In the second step, using the pseudo complete-data likelihood function with the estimated distribution of truncation time, we propose expectation–maximization algorithms for obtaining the PMLE. We establish the consistency of the PMLE. The simulation study indicates that the PMLE performs well in finite samples. The proposed method is illustrated using an AIDS data set.     

Nonparametric estimation of quality adjusted lifetime distribution in a simple illness-death model

In this work, we consider the nonparametric estimation of quality adjusted lifetime (QAL) distribution in a simple illness-death model. We first derive the expression of QAL distribution in terms of the distribution of sojourn time in each health state. Next we substitute the estimate of sojourn time distributions in the expression of QAL distribution to obtain its estimate. Consistency and asymptotic normality of the proposed nonparametric estimator are established. Estimation in the presence of some missing data on the transition time to illness is also discussed. We conduct a simulation study to investigate the performance of the proposed estimator. For illustration, we analyse a data set of the Stanford Heart Transplant program. Extension to multistate progressive model is discussed along with an analysis of International Breast Cancer Study Group (IBCSG) Trial V data.     

BACKWARD ESTIMATION OF STOCHASTIC PROCESSES WITH FAILURE EVENTS AS TIME ORIGINS

Stochastic processes often exhibit sudden systematic changes in pattern a short time before certain failure events. Examples include increase in medical costs before death and decrease in CD4 counts before AIDS diagnosis. To study such terminal behavior of stochastic processes, a natural and direct way is to align the processes using failure events as time origins. This paper studies backward stochastic processes counting time backward from failure events, and proposes one-sample nonparametric estimation of the mean of backward processes when follow-up is subject to left truncation and right censoring. We will discuss benefits of including prevalent cohort data to enlarge the identifiable region and large sample properties of the proposed estimator with related extensions. A SEER-Medicare linked data set is used to illustrate the proposed methodologies.     

Interval censoring: Model characterizations for the validity of the simplified likelihood

In survival data analysis, the interval censoring problem has generally been treated via likelihood methods. Because this likelihood is complex, it is often assumed that the censoring mechanisms do not affect the mortality process. The authors specify conditions that ensure the validity of such a simplified likelihood. They prove the equivalence between different characterizations of noninformative censoring and define a constant‐sum condition analogous to the one derived in the context of right censoring. They also prove that when the noninformative or constant‐sum condition holds, the simplified likelihood can be used to obtain the nonparametric maximum likelihood estimator of the death time distribution function.     

Smoothed empirical likelihood confidence intervals for the relative distribution with left‐truncated and right‐censored data

The study of differences among groups is an interesting statistical topic in many applied fields. It is very common in this context to have data that are subject to mechanisms of loss of information, such as censoring and truncation. In the setting of a two‐sample problem with data subject to left truncation and right censoring, we develop an empirical likelihood method to do inference for the relative distribution. We obtain a nonparametric generalization of Wilks' theorem and construct nonparametric pointwise confidence intervals for the relative distribution. Finally, we analyse the coverage probability and length of these confidence intervals through a simulation study and illustrate their use with a real data set on gastric cancer. The Canadian Journal of Statistics 38: 453–473; 2010 © 2010 Statistical Society of Canada     

Nonparametric quasi-likelihood for right censored data

Quasi-likelihood was extended to right censored data to handle heteroscedasticity in the frame of the accelerated failure time (AFT) model. However, the assumption of known variance function in the quasi-likelihood for right censored data is usually unrealistic. In this paper, we propose a nonparametric quasi-likelihood by replacing the specified variance function with a nonparametric variance function estimator. This nonparametric variance function estimator is obtained by smoothing a function of squared residuals via local polynomial regression. The rate of convergence of the nonparametric variance function estimator and the asymptotic limiting distributions of the regression coefficient estimators are derived. It is demonstrated in simulations that for finite samples the proposed nonparametric quasi-likelihood method performs well. The new method is illustrated with one real dataset.     

Semiparametric Analysis of Truncated Data

Randomly truncated data are frequently encountered in many studies where truncation arises as a result of the sampling design. In the literature, nonparametric and semiparametric methods have been proposed to estimate parameters in one-sample models. This paper considers a semiparametric model and develops an efficient method for the estimation of unknown parameters. The model assumes that K populations have a common probability distribution but the populations are observed subject to different truncation mechanisms. Semiparametric likelihood estimation is studied and the corresponding inferences are derived for both parametric and nonparametric components in the model. The method can also be applied to two-sample problems to test the difference of lifetime distributions. Simulation results and a real data analysis are presented to illustrate the methods.     

A Nonparametric Estimator of Survival Functions for Arbitrarily Truncated and Censored Data

It is well-known that the nonparametric maximum likelihood estimator (NPMLE) may severely under-estimate the survival function with left truncated data. Based on the Nelson estimator (for right censored data) and self-consistency we suggest a nonparametric estimator of the survival function, the iterative Nelson estimator (INE), for arbitrarily truncated and censored data, where only few nonparametric estimators are available. By simulation we show that the INE does well in overcoming the under-estimation of the survival function from the NPMLE for left-truncated and interval-censored data. An interesting application of the INE is as a diagnostic tool for other estimators, such as the monotone MLE or parametric MLEs. The methodology is illustrated by application to two real world problems: the Channing House and the Massachusetts Health Care Panel Study data sets.     

An inverse-probability-weighted approach to estimation of the bivariate survival function under left-truncation and right-censoring

In this note, we consider estimating the bivariate survival function when both survival times are subject to random left truncation and one of the survival times is subject to random right censoring. Motivated by Satten and Datta [2001. The Kaplan–Meier estimator as an inverse-probability-of-censoring weighted average. Amer. Statist. 55, 207–210], we propose an inverse-probability-weighted (IPW) estimator. It involves simultaneous estimation of the bivariate survival function of the truncation variables and that of the censoring variable and the truncation variable of the uncensored components. We prove that (i) when there is no censoring, the IPW estimator reduces to NPMLE of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131] and (ii) when there is random left truncation and right censoring on only one of the components and the other component is always observed, the IPW estimator reduces to the estimator of Gijbels and Gürler [1998. Covariance function of a bivariate distribution function estimator for left truncated and right censored data. Statist. Sin. 1219–1232]. Based on Theorem 3.1 of van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627], we prove that the IPW estimator is consistent under certain conditions. Finally, we examine the finite sample performance of the IPW estimator in some simulation studies. For the special case that censoring time is independent of truncation time, a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by van der Laan [1996a. Nonparametric estimation of the bivariate survival function with truncated data. J. Multivariate Anal. 58, 107–131, 1996b. Efficient estimation of the bivariate censoring model and repairing NPMLE. Ann. Statist. 24, 596–627]. For the special case (i), a simulation study is conducted to compare the performances of the IPW estimator against that of the estimator proposed by Huang et al. (2001. Nonnparametric estimation of marginal distributions under bivariate truncation with application to testing for age-of-onset application. Statist. Sin. 11, 1047–1068).     

A Bayesian nonparametric estimator based on left censored data

Summary This paper introduces a Bayesian nonparametric estimator for an unknown distribution function based on left censored observations. Hjort (1990)/Lo (1993) introduced Bayesian nonparametric estimators derived from beta/beta-neutral processes which allow for right censoring. These processes are taken as priors from the class ofneutral to the right processes (Doksum, 1974). The Kaplan-Meier nonparametric product limit estimator can be obtained from these Bayesian nonparametric estimators in the limiting case of a vague prior. The present paper introduces what can be seen as the correspondingleft beta/beta-neutral process prior which allow for left censoring. The Bayesian nonparametyric estimator is obtained as in the corresponding product limit estimator based on left censored data.     

Nonparametric Bayes estimation of a distribution function with truncated data

A truncation bias affects the observation of a pair of variables (X,Y), so that data are available only if Y ⩽ X. In such a situation, the nonparametric maximum likelihood estimator (NPMLE) of the distribution function of Y may have unpleasant features (Woodroofe, Ann. Statist. 13 (1985) 163–177). As a possible alternative, a nonparametric Bayes estimator is obtained using a Dirichlet prior (Ferguson, Ann. Statist. 1 (1973) 209–230). Its frequentist asymptotic behavior is investigated and found to be the same as the asymptotic behavior of the NPMLE. The results are illustrated by an example, with astronomical data, where the NPMLE is clearly unacceptable.     

Nonparametric Bayesian estimation of survival function under random left truncation

Several observational studies give rise to randomly left truncated data. In a nonparametric model for such data X denotes a variable of interest, T denotes the truncation variable and the distributions of both X and T are left unspecified. For this model, the product-limit estimator, which is also the maximum likelihood estimator of the survival curve, has been widely discussed. In this article, a nonparametric Bayes estimator of the survival function based on randomly left truncated data and Dirichlet process prior is presented. Some new results on the mixtures of Dirichlet processes in the context of truncated data are obtained. These results are then used to derive the Bayes estimator of the survival function under squared error loss. The weak convergence of the Bayes estimator is studied. An example using transfusion related AIDS data quoted in Kalbfleisch and Lawless (1989) is considered.     

Estimation of the joint survival function for three successive duration times under double truncation and right censoring

In incident cohort studies, it is common to include subjects who have experienced a certain event within a calendar time window. For all the included individuals, the time of the previous events is retrospectively confirmed and the occurrence of subsequent events is observed during the follow-up periods. During the follow-up periods, subjects may undergo three successive events. Since the second/third duration process becomes observable only if the first/second event has occurred, the data is subject to double truncation and right censoring. We consider two cases: the case when the first event time is subject to double truncation and the case when the second event time is subject to double truncation. Using the inverse-probability-weighted approach, we propose nonparametric and semiparametric estimators for the estimation of the joint survival function of three successive duration times. We establish the asymptotic properties of the proposed estimators and conduct a simulation study to investigate the finite sample properties of the proposed estimators.