Most powerful tests for use in matched pair experiments when data may be censored

Four distribution-free tests are developed for use in matched pair experiments when data may be censored: a bootstrap based on estimates of the median difference, and three rerandomization tests. The latter include a globally almost most powerful (GAMP) test which uses the original data and two modified Gilbert-Gehan tests which use the ranks. Computation time is reduced by using a binary count to generate subsamples and by restricting subsampling to the uncensored pairs. In Monte Carlo simulations against normal alternatives, mixed normal alternatives, and exponential alternatives, the GAMP test is most powerful with light censoring, the rank test is most powerful with heavy censoring. The bootstrap degenerates to the sign test and is least powerful.     

Periodogram Analysis of Censored Time Series from a Designed Experiment

Growth hormone plasma concentrations vary rhythmically between high and low values. Radioimmunoassay measurements of low values are often indistinguishable from low controls, and are reported as a censored value, the 'minimum detectable dose'. This paper reports such a dataset from a designed experiment with about 60% of the values censored but large distinct signals for the remainder of the data. The ordinates of the average periodogram for each treatment group are independently gamma distributed, with distribution depending on the underlying spectrum and the replication for that group. This situation can lead to an analysis for common spectral shape using a gamma generalized linear model with log link, and the hypothesis of common spectral shape is rejected here. Since such a level of censoring reduces the variance of each profile, the periodogram, which is a partition of the variance, is also reduced in overall magnitude. A simulation study shows that this reduction is not necessarily uniform over the frequency domain, but may be more pronounced at lower or higher ordinates depending on the underlying model. Therefore it is possible that the rejection of common spectral shape is an artefact of the censoring.     

Added variable plots for linear regression with censored data

In linear regression the structure of the hat matrix plays an important part in regression diagnostics. In this note we investigate the properties of the hat matrix for regression with censored responses in the presence of one or more explanatory variables observed without censoring. The censored points in the scatterplot are renovated to positions had they been observed without censoring in a renovation process based on Buckley-James censored regression estimators. This allows natural links to be established with the structure of ordinary least squares estimators. In particular, we show that the renovated hat matrix may be partitioned in a manner which assists in deciding whether further explanatory variables should be added to the linear model. The added variable plot for regression with censored data is developed as a diagnostic tool for this decision process.     

Estimation and goodness-of-fit for the Cox model with various types of censored data

The currently existing estimation methods and goodness-of-fit tests for the Cox model mainly deal with right censored data, but they do not have direct extension to other complicated types of censored data, such as doubly censored data, interval censored data, partly interval-censored data, bivariate right censored data, etc. In this article, we apply the empirical likelihood approach to the Cox model with complete sample, derive the semiparametric maximum likelihood estimators (SPMLE) for the Cox regression parameter and the baseline distribution function, and establish the asymptotic consistency of the SPMLE. Via the functional plug-in method, these results are extended in a unified approach to doubly censored data, partly interval-censored data, and bivariate data under univariate or bivariate right censoring. For these types of censored data mentioned, the estimation procedures developed here naturally lead to Kolmogorov-Smirnov goodness-of-fit tests for the Cox model. Some simulation results are presented.     

Weighing the Evidence for Hypotheses with Small Samples of Right-censored Exponential Data

The p-value evidence for an alternative to a null hypothesis regarding the mean lifetime can be unreliable if based on asymptotic approximations when there is only a small sample of right-censored exponential data. However, a guarded weight of evidence for the alternative can always be obtained without approximation, no matter how small the sample, and has some other advantages over p-values. Weights of evidence are defined as estimators of 0 when the null hypothesis is true and 1 when the alternative is true, and they are judged on the basis of the ensuing risks, where risk is mean squared error of estimation. The evidence is guarded in that a preassigned bound is placed on the risk under the hypothesis. Practical suggestions are given for choosing the bound and for interpreting the magnitude of the weight of evidence. Acceptability profiles are obtained by inversion of a family of guarded weights of evidence for two-sided alternatives to point hypotheses, just as confidence intervals are obtained from tests; these profiles are arguably more informative than confidence intervals, and are easily determined for any level and any sample size, however small. They can help understand the effects of different amounts of censoring. They are found for several small size data sets, including a sample of size 12 for post-operative cancer patients. Both singly Type I and Type II censored examples are included. An examination of the risk functions of these guarded weights of evidence suggests that if the censoring time is of the same magnitude as the mean lifetime, or larger, then the risks in using a guarded weight of evidence based on a likelihood ratio are not much larger than they would be if the parameter were known.     

Estimation from Censored Data with Incomplete Information

Phillips and Sweeting [J. R. Statist. Soc. B 58 (1996) 775–783.] considered estimation of the parameter of the exponential distribution with censored failure time data when there is incomplete knowledge of the censoring times. It was shown that, under particular models for the censoring mechanism and censoring errors, it will usually be safe to ignore such errors provided they are not expected to be too large. A flexible model is introduced which includes the extreme cases of no censoring errors and no information on the censoring values. The effect of alternative assumptions about knowledge of the censoring values on the estimation of failure rate is investigated.     

Nonparametric bayes estimation of the survival function from a record of failures and follow-ups

In some observational studies, we have random censoring model. However, the data available may be partially observable censored data consisting of the observed failure times and only those nonfailure times which are subject to follow-up. Suzuki (1985) discussed the problem of nonparametric estimation of the survival function from such partially observable censored data. In this article, we derive a nonparametric Bayes estimator of the survival function for such data of failures and follow-ups under a Dirichlet process prior and squared error loss. The limiting properties such as the mean square consistency, weak convergence and strong consistency of the Bayes estimator are studied. Finally, the procedures developed are illustrated by means of an example.     

PROGRESSIVE INTERVAL CENSORING: SOME MATHEMATICAL RESULTS WITH APPLICATIONS TO INFERENCE

In this paper, we will introduce a union of two methods of collecting Type-I censored data, namely interval censoring and progressive censoring. We will call the resulting sample a progressively Type-I interval censored sample.We will discuss likelihood point and interval estimation, and simulation of such a censored sample from a random sample of units put on test whose lifetime distribution is continuous. An illustrative example will also be presented.

     

Monte carlo results for conditional survival tests under randomly censored data

Within a Monte Carlo study finite sample results are obtained for different generalized rank tests based on randomly censored life time data. It is pointed out that conditional tests should be applied in practice whenever drastic differences between the censoring distributions for the underlying groups do not appear. The tests are slight modifications of known permutation tests for censored data.     

Joint modeling of censored longitudinal and event time data

Censoring of a longitudinal outcome often occurs when data are collected in a biomedical study and where the interest is in the survival and or longitudinal experiences of a study population. In the setting considered herein, we encountered upper and lower censored data as the result of restrictions imposed on measurements from a kinetic model producing “biologically implausible” kidney clearances. The goal of this paper is to outline the use of a joint model to determine the association between a censored longitudinal outcome and a time to event endpoint. This paper extends Guo and Carlin's [6] paper to accommodate censored longitudinal data, in a commercially available software platform, by linking a mixed effects Tobit model to a suitable parametric survival distribution. Our simulation results showed that our joint Tobit model outperforms a joint model made up of the more naïve or “fill-in” method for the longitudinal component. In this case, the upper and/or lower limits of censoring are replaced by the limit of detection. We illustrated the use of this approach with example data from the hemodialysis (HEMO) study [3] and examined the association between doubly censored kidney clearance values and survival.     

The log-odd log-logistic Weibull regression model: modelling,estimation, influence diagnostics and residual analysis

In applications of survival analysis, the failure rate function may frequently present a unimodal shape. In such cases, the log-normal and log-logistic distributions are used. In this paper, we shall be concerned only with parametric forms, so a location-scale regression model based on the odd log-logistic Weibull distribution is proposed for modelling data with a decreasing, increasing, unimodal and bathtub failure rate function as an alternative to the log-Weibull regression model. For censored data, we consider a classic method to estimate the parameters of the proposed model. We derive the appropriate matrices for assessing local influences on the parameter estimates under different perturbation schemes and present some ways to assess global influences. Further, for different parameter settings, sample sizes and censoring percentages, various simulations are performed. In addition, the empirical distribution of some modified residuals is determined and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be extended to a modified deviance residual in the new regression model applied to censored data. We analyse a real data set using the log-odd log-logistic Weibull regression model.     

Kalman filtering with censored measurements

This paper concerns Kalman filtering when the measurements of the process are censored. The censored measurements are addressed by the Tobit model of Type I and are one-dimensional with two censoring limits, while the (hidden) state vectors are multidimensional. For this model, Bayesian estimates for the state vectors are provided through a recursive algorithm of Kalman filtering type. Experiments are presented to illustrate the effectiveness and applicability of the algorithm. The experiments show that the proposed method outperforms other filtering methodologies in minimizing the computational cost as well as the overall Root Mean Square Error (RMSE) for synthetic and real data sets.     

A log-linear regression model for the odd Weibull distribution with censored data

We introduce the log-odd Weibull regression model based on the odd Weibull distribution (Cooray, 2006). We derive some mathematical properties of the log-transformed distribution. The new regression model represents a parametric family of models that includes as sub-models some widely known regression models that can be applied to censored survival data. We employ a frequentist analysis and a parametric bootstrap for the parameters of the proposed model. We derive the appropriate matrices for assessing local influence on the parameter estimates under different perturbation schemes and present some ways to assess global influence. Further, for different parameter settings, sample sizes and censoring percentages, some simulations are performed. In addition, the empirical distribution of some modified residuals are given and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be extended to a modified deviance residual in the proposed regression model applied to censored data. We define martingale and deviance residuals to check the model assumptions. The extended regression model is very useful for the analysis of real data.     

Bayesian Analysis of Different Hybrid and Progressive Life Tests

Type-I and Type-II censoring schemes are the widely used censoring schemes available for life testing experiments. A mixture of Type-I and Type-II censoring schemes is known as a hybrid censoring scheme. Different hybrid censoring schemes have been introduced in recent years. In the last few years, a progressive censoring scheme has also received considerable attention. In this article, we mainly consider the Bayesian inference of the unknown parameters of two-parameter exponential distribution under different hybrid and progressive censoring schemes. It is observed that in general the Bayes estimate and the associated credible interval of any function of the unknown parameters, cannot be obtained in explicit form. We propose to use the Monte Carlo sampling procedure to compute the Bayes estimate and also to construct the associated credible interval. Monte Carlo Simulation experiments have been performed to see the effectiveness of the proposed method in case of Type-I hybrid censored samples. The performances are quite satisfactory. One data analysis has been performed for illustrative purposes.     

Imputation methods for doubly censored HIV data

In medical research, it is common to have doubly censored survival data: origin time and event time are both subject to censoring. In this paper, we review simple and probability-based methods that are used to impute interval censored origin time and compare the performance of these methods through extensive simulations in the one-sample problem, two-sample problem and Cox regression model problem. The use of a bootstrap procedure for inference is demonstrated.     

On selection procedures for positive exponential family distributions based on type-I censored data

We investigate the problem of selecting the best population from positive exponential family distributions based on type-I censored data. A Bayes rule is derived and a monotone property of the Bayes selection rule is obtained. Following that property, we propose an early selection rule. Through this early selection rule, one can terminate the experiment on a few populations early and possibly make the final decision before the censoring time. An example is provided in the final part to illustrate the use of the early selection rule.     

Imputation methods for doubly censored HIV data

In medical research, it is common to have doubly censored survival data: origin time and event time are both subject to censoring. In this paper, we review simple and probability-based methods that are used to impute interval censored origin time and compare the performance of these methods through extensive simulations in the one-sample problem, two-sample problem and Cox regression model problem. The use of a bootstrap procedure for inference is demonstrated.     

Renovating inverval-censored responses

In this note we provide a general framework for describing interval-censored samples including estimation of the magnitude and rank positions of data that have been interval-censored so as to counteract the effect of censoring. This process of sample adjustment, or renovation, allows samples to be compared graphically, using diagrams (such as boxplots) which are based on ranks. The renovation process is based on Buckley-James regression estimators for linear regression with censored data.     

Asymptotic Properties of M-estimators Based on Estimating Equations and Censored Data

Properties of Huber's M-estimators based on estimating equations have been studied extensively and are well understood for complete (i.i.d.) data. Although the concepts of M-estimators and influence curves have been extended for some time by Reid (1981) to incomplete data that are subject to right censoring, results on the general behavior of M-estimators based on incomplete data remain scattered and restrictive. This paper establishes a general large sample theory for M-estimators based on censored data. We show how to extend any asymptotic result available for M-estimators based on complete data to the case of censored data. The extensions are usually straightforward and include the multiparameter situation. Both the lifetime and censoring distributions may be discontinuous. We illustrate several extensions which provide simple and tractable sufficient conditions for an M-estimator to be strongly consistent and asymptotically normal. The influence curves and asymptotic variance of the M-estimators are also derived. The applicability of the new sufficient conditions is demonstrated through several examples, including location and scale M-estimators.     

New approaches for censored longitudinal data in joint modelling of longitudinal and survival data,with application to HIV vaccine studies

In HIV vaccine studies, longitudinal immune response biomarker data are often left-censored due to lower limits of quantification of the employed immunological assays. The censoring information is important for predicting HIV infection, the failure event of interest. We propose two approaches to addressing left censoring in longitudinal data: one that makes no distributional assumptions for the censored data—treating left censored values as a “point mass” subgroup—and the other makes a distributional assumption for a subset of the censored data but not for the remaining subset. We develop these two approaches to handling censoring for joint modelling of longitudinal and survival data via a Cox proportional hazards model fit by h-likelihood. We evaluate the new methods via simulation and analyze an HIV vaccine trial data set, finding that longitudinal characteristics of the immune response biomarkers are highly associated with the risk of HIV infection.