On self-consistent estimators and kernel density estimators with doubly censored data

We study the detailed structure (in a large sample) of the self-consistent estimators of the survival functions with doubly censored data. We also introduce the kernel-type density estimators based on the self-consistent estimators, and using our results on the structure of the self-consistent estimators, we establish the strong uniform consistency and the asymptotic normality of the kernel density estimators for doubly censored data. From these, the strong uniform consistency and the asymptotic normality of the failure rate estimators for doubly censored data are derived.     

Correcting for non-compliance in randomized trials using rank preserving structural failure time models

We propose correcting for non-compliance in randomized trials by estimating the parameters of a class of semi-parametric failure time models, the rank preserving structural failure time models, using a class of rank estimators. These models are the structural or strong version of the “accelerated failure time model with time-dependent covariates” of Cox and Oakes (1984). In this paper we develop a large sample theory for these estimators, derive the optimal estimator within this class, and briefly consider the construction of “partially adaptive” estimators whose efficiency may approach that of the optimal estimator. We show that in the absence of censoring the optimal estimator attains the semiparametric efficiency bound for the model.     

Conditional failure occurrence rates for semi-Markov chains*

ABSTRACT

In the present paper, we aim at providing plug-in-type empirical estimators that enable us to quantify the contribution of each operational or/and non-functioning state to the failures of a system described by a semi-Markov model. In the discrete-time and finite state space semi-Markov framework, we study different conditional versions of an important reliability measure for random repairable systems, the failure occurrence rate, which is based on counting processes. The identification of potential failure contributors through the conditional counterparts of the failure occurrence rate is of paramount importance since it could lead to corrective actions that minimize the occurrence of the more important failure modes and therefore improve the reliability of the system. The aforementioned estimators are characterized by appealing asymptotic properties such as strong consistency and asymptotic normality. We further obtain detailed analytical expressions for the covariance matrices of the random vectors describing the conditional failure occurrence rates. As particular cases we present the failure occurrence rates for hidden (semi-) Markov models. We illustrate our results by means of a simulated study. Different applications are presented based on wind, earthquake and vibration data.     

Estimation in multitype epidemics

A multitype epidemic model is analysed assuming proportionate mixing between types. Estimation procedures for the susceptibilities and infectivities are derived for three sets of data: complete data, meaning that the whole epidemic process is observed continuously; the removal processes are observed continuously; only the final state is observed. Under the assumption of a major outbreak in a population of size n it is shown that, for all three data sets, the susceptibility estimators are always efficient, i.e. consistent with a √ n rate of convergence. The infectivity estimators are 'in most cases' respectively efficient, efficient and unidentifiable. However, if some susceptibilities are equal then the corresponding infectivity estimators are respectively barely consistent (√log( n ) rate of convergence), not consistent and unidentifiable. The estimators are applied to simulated data.     

Analyzing Length-biased Data with Semiparametric Transformation and Accelerated Failure Time Models

Right-censored time-to-event data are often observed from a cohort of prevalent cases that are subject to length-biased sampling. Informative right censoring of data from the prevalent cohort within the population often makes it difficult to model risk factors on the unbiased failure times for the general population, because the observed failure times are length biased. In this paper, we consider two classes of flexible semiparametric models: the transformation models and the accelerated failure time models, to assess covariate effects on the population failure times by modeling the length-biased times. We develop unbiased estimating equation approaches to obtain the consistent estimators of the regression coefficients. Large sample properties for the estimators are derived. The methods are confirmed through simulations and illustrated by application to data from a study of a prevalent cohort of dementia patients.     

Robust explicit estimation of the two-parameter Birnbaum–Saunders distribution

The two-parameter Birnbaum–Saunders distribution is widely applicable to model failure times of fatiguing materials. Its maximum-likelihood estimators (MLEs) are very sensitive to outliers and also have no closed-form expressions. This motivates us to develop some alternative estimators. In this paper, we develop two robust estimators, which are also explicit functions of sample observations and are thus easy to compute. We derive their breakdown points and carry out extensive Monte Carlo simulation experiments to compare the performance of all the estimators under consideration. It has been observed from the simulation results that the proposed estimators outperform in a manner that is approximately comparable with the MLEs, whereas they are far superior in the presence of data contamination that often occurs in practical situations. A simple bias-reduction technique is presented to reduce the bias of the recommended estimators. Finally, the practical application of the developed procedures is illustrated with a real-data example.     

CURRENT STATUS AND RIGHT-CENSORED DATA STRUCTURES WHEN OBSERVING A MARKER AT THE CENSORING TIME

We study nonparametric estimation with two types of data structures. In the first data structure n i.i.d. copies of (C, N(C)) are observed, where N is a finite state counting process jumping at time-variables of interest and C a random monitoring time. In the second data structure n i.i.d. copies of (C ∧ T, I (T ≤ C), N(C ∧ T)) are observed, where N is a counting process with a final jump at time T (e.g., death). This data structure includes observing right-censored data on T and a marker variable at the censoring time.In these data structures, easy to compute estimators, namely (weighted)-pool-adjacent-violator estimators for the marginal distributions of the unobservable time variables, and the Kaplan-Meier estimator for the time T till the final observable event, are available. These estimators ignore seemingly important information in the data. In this paper we prove that, at many continuous data generating distributions the ad hoc estimators yield asymptotically efficient estimators of [Formula: see text]-estimable parameters.     

On the $$L_p$$ norms of kernel regression estimators for incomplete data with applications to classification

We consider kernel methods to construct nonparametric estimators of a regression function based on incomplete data. To tackle the presence of incomplete covariates, we employ Horvitz–Thompson-type inverse weighting techniques, where the weights are the selection probabilities. The unknown selection probabilities are themselves estimated using (1) kernel regression, when the functional form of these probabilities are completely unknown, and (2) the least-squares method, when the selection probabilities belong to a known class of candidate functions. To assess the overall performance of the proposed estimators, we establish exponential upper bounds on the \(L_p\) norms, \(1\le p<\infty \), of our estimators; these bounds immediately yield various strong convergence results. We also apply our results to deal with the important problem of statistical classification with partially observed covariates.     

Conditional Likelihood Estimators for Hidden Markov Models and Stochastic Volatility Models

ABSTRACT.  This paper develops a new contrast process for parametric inference of general hidden Markov models, when the hidden chain has a non-compact state space. This contrast is based on the conditional likelihood approach, often used for ARCH-type models. We prove the strong consistency of the conditional likelihood estimators under appropriate conditions. The method is applied to the Kalman filter (for which this contrast and the exact likelihood lead to asymptotically equivalent estimators) and to the discretely observed stochastic volatility models.     

Proportional cause-specific reversed hazards model

The proportional reversed hazards model explains the multiplicative effect of covariates on the baseline reversed hazard rate function of lifetimes. In the present study, we introduce a proportional cause-specific reversed hazards model. The proposed regression model facilitates the analysis of failure time data with multiple causes of failure under left censoring. We estimate the regression parameters using a partial likelihood approach. We provide Breslow's type estimators for the cumulative cause-specific reversed hazard rate functions. Asymptotic properties of the estimators are discussed. Simulation studies are conducted to assess their performance. We illustrate the applicability of the proposed model using a real data set.     

Estimation and prediction of Marshall–Olkin extended exponential distribution under progressively type-II censored data

In this paper, we consider Marshall–Olkin extended exponential (MOEE) distribution which is capable of modelling various shapes of failure rates and aging criteria. The purpose of this paper is three fold. First, we derive the maximum likelihood estimators of the unknown parameters and the observed the Fisher information matrix from progressively type-II censored data. Next, the Bayes estimates are evaluated by applying Lindley’s approximation method and Markov Chain Monte Carlo method under the squared error loss function. We have performed a simulation study in order to compare the proposed Bayes estimators with the maximum likelihood estimators. We also compute 95% asymptotic confidence interval and symmetric credible interval along with the coverage probability. Third, we consider one-sample and two-sample prediction problems based on the observed sample and provide appropriate predictive intervals under classical as well as Bayesian framework. Finally, we analyse a real data set to illustrate the results derived.     

Estimation of cumulative incidence functions in competing risks studies under an order restriction

In the competing risks problem an important role is played by the cumulative incidence function (CIF), whose value at time t is the probability of failure by time t for a particular type of failure in the presence of other risks. Its estimation and asymptotic distribution theory have been studied by many. In some cases there are reasons to believe that the CIFs due to two types of failure are order restricted. Several procedures have appeared in the literature for testing for such orders. In this paper we initiate the study of estimation of two CIFs subject to a type of stochastic ordering, both when there are just two causes of failure and when there are more than two causes of failure, treating those other than the two of interest as a censoring mechanism. We do not assume independence of the two types of failure of interest; however, these are assumed to be independent of the other causes in the censored case. Weak convergence results for the estimators have been derived. It is shown that when the order restriction is strict, the asymptotic distributions are the same as those for the empirical estimators without the order restriction. Thus we get the restricted estimators “free of charge”, at least in the asymptotic sense. When the two CIFs are equal, the asymptotic MSE is reduced by using the order restriction. For finite sample sizes simulations seem to indicate that the restricted estimators have uniformly smaller MSEs than the unrestricted ones in all cases.     

Maximum Likelihood Estimations and EM Algorithms with Length-biased Data

Length-biased sampling has been well recognized in economics, industrial reliability, etiology applications, epidemiological, genetic and cancer screening studies. Length-biased right-censored data have a unique data structure different from traditional survival data. The nonparametric and semiparametric estimations and inference methods for traditional survival data are not directly applicable for length-biased right-censored data. We propose new expectation-maximization algorithms for estimations based on full likelihoods involving infinite dimensional parameters under three settings for length-biased data: estimating nonparametric distribution function, estimating nonparametric hazard function under an increasing failure rate constraint, and jointly estimating baseline hazards function and the covariate coefficients under the Cox proportional hazards model. Extensive empirical simulation studies show that the maximum likelihood estimators perform well with moderate sample sizes and lead to more efficient estimators compared to the estimating equation approaches. The proposed estimates are also more robust to various right-censoring mechanisms. We prove the strong consistency properties of the estimators, and establish the asymptotic normality of the semi-parametric maximum likelihood estimators under the Cox model using modern empirical processes theory. We apply the proposed methods to a prevalent cohort medical study. Supplemental materials are available online.     

On the Optimality of Prediction-based Selection Criteria and the Convergence Rates of Estimators

Several estimators of squared prediction error have been suggested for use in model and bandwidth selection problems. Among these are cross-validation, generalized cross-validation and a number of related techniques based on the residual sum of squares. For many situations with squared error loss, e.g. nonparametric smoothing, these estimators have been shown to be asymptotically optimal in the sense that in large samples the estimator minimizing the selection criterion also minimizes squared error loss. However, cross-validation is known not to be asymptotically optimal for some `easy' location problems. We consider selection criteria based on estimators of squared prediction risk for choosing between location estimators. We show that criteria based on adjusted residual sum of squares are not asymptotically optimal for choosing between asymptotically normal location estimators that converge at rate n ^1/2but are when the rate of convergence is slower. We also show that leave-one-out cross-validation is not asymptotically optimal for choosing between √ n -differentiable statistics but leave- d -out cross-validation is optimal when d ∞ at the appropriate rate.     

A new two-parameter lifetime distribution with decreasing,increasing or upside-down bathtub-shaped failure rate

In this paper, we introduce a generalization of the Bilal distribution, where a new two-parameter distribution is presented. We show that its failure rate function can be upside-down bathtub shaped. The failure rate can also be decreasing or increasing. A comprehensive mathematical treatment of the new distribution is provided. The estimation by maximum likelihood is discussed, and a closed-form expression for Fisher’s information matrix is obtained. Asymptotic interval estimators for both of the two unknown parameters are also given. A simulation study is conducted and applications to real data sets are presented.     

Density estimation under the koziol-green model of censoring by penalized likelihood methods

We propose two density estimators of the survival distribution in the setting of the Koziol-Green random-censoring model. The estimators are obtained by maximum-penalized-likelihood methods, and we provide an algorithm for their numerical evaluation. We establish the strong consistency of the estimators in the Hellinger metric, the L_p-norms, p= 1,2, ∞, and a Sobolev norm, under mild conditions on the underlying survival density and the censoring distribution.     

Additive transformation models for clustered failure time data

We propose a class of additive transformation risk models for clustered failure time data. Our models are motivated by the usual additive risk model for independent failure times incorporating a frailty with mean one and constant variability which is a natural generalization of the additive risk model from univariate failure time to multivariate failure time. An estimating equation approach based on the marginal hazards function is proposed. Under the assumption that cluster sizes are completely random, we show the resulting estimators of the regression coefficients are consistent and asymptotically normal. We also provide goodness-of-fit test statistics for choosing the transformation. Simulation studies and real data analysis are conducted to examine the finite-sample performance of our estimators.     

ROBUST ESTIMATION UNDER TYPE II CENSORING

The properties of robust M-estimators with type II censored failure time data are considered. The optimal members within two classes of ψ-functions are characterized. The first optimality result is the censored data analogue of the optimality result described in Hampel et al. (1986); the estimators corresponding to the optimal members within this class are referred to as the optimal robust estimators. The second result pertains to a restricted class of ψ-functions which is the analogue of the class of ψ-functions considered in James (1986) for randomly censored data; the estimators corresponding to the optimal members within this restricted class are referred to as the optimal James-type estimators. We examine the usefulness of the two classes of ψ-functions and find that the breakdown point and efficiency of the optimal James-type estimators compare favourably with those of the corresponding optimal robust estimators. From the computational point of view, the optimal James-type ψ-functions are readily obtainable from the optimal ψ-functions in the uncensored case. The ψ-functions for the optimal robust estimators require a separate algorithm which is provided. A data set illustrates the optimal robust estimators for the parameters of the extreme value distribution.     

Information dependency: Strong consistency of Darbellay–Vajda partition estimators

The Darbellay–Vajda partition scheme is a well known method to estimate the information dependency. This estimator belongs to a class of data-dependent partition estimators. We would like to prove that with some simple conditions, the Darbellay–Vajda partition estimator is a strong consistency for the information dependency estimation of a bivariate random vector. This result is an extension of 20 and 21 work which gives some simple conditions to confirm that the Gessaman's partition estimator and the tree-quantization partition estimator, other estimators in the class of data-dependent partition estimators, are strongly consistent.     

Estimation of the Weibull tail-coefficient with linear combination of upper order statistics

We present a new family of estimators of the Weibull tail-coefficient. The Weibull tail-coefficient is defined as the regular variation coefficient of the inverse failure rate function. Our estimators are based on a linear combination of log-spacings of the upper order statistics. Their asymptotic normality is established and illustrated for two particular cases of estimators in this family. Their finite sample performances are presented on a simulation study.