Estimators Based on Data‐Driven Generalized Weighted Cramér‐von Mises Distances under Censoring – with Applications to Mixture Models

Abstract. Estimators based on data‐driven generalized weighted Cramér‐von Mises distances are defined for data that are subject to a possible right censorship. The function used to measure the distance between the data, summarized by the Kaplan–Meier estimator, and the target model is allowed to depend on the sample size and, for example, on the number of censored items. It is shown that the estimators are consistent and asymptotically multivariate normal for every p dimensional parametric family fulfiling some mild regularity conditions. The results are applied to finite mixtures. Simulation results for finite mixtures indicate that the estimators are useful for moderate sample sizes. Furthermore, the simulation results reveal the usefulness of sample size dependent and censoring sensitive distance functions for moderate sample sizes. Moreover, the estimators for the mixing proportion seem to be fairly robust against a ‘symmetric’ contamination model even when censoring is present.     

Reliability estimation for the exponential distribution

This paper is concerned with classical statistical estimation of the reliability function for the exponential density with unknown mean failure time θ, and with a known and fixed mission time τ. The minimum variance unbiased (MVU) estimator and the maximum likelihood (ML) estimator are reviewed and their mean square errors compared for different sample sizes. These comparisons serve also to extend previous work, and reinforce further the nonexistence of a uniformly best estimator. A class of shrunken estimators is then defined, and it produces a shrunken quasi-estimator and a shrunken estimator. The mean square errors for both these estimators are compared to the mean square errors of the MVU and ML estimators, and the new estimators are found to perform very well. Unfortunately, these estimators are difficult to compute for practical applications. A second class of estimators, which is easy to compute is also developed. Its mean square error properties are compared to the other estimators, and it outperforms all the contending estimators over the high and low reliability parameter space. Since, for all the estimators, analytical mean square error comparisons are not tractable, extensive numerical analyses are done in obtaining both the exact small sample and large sample results.     

Survival analysis for the missing censoring indicator model using kernel density estimation techniques

This article concerns asymptotic theory for a new estimator of a survival function in the missing censoring indicator model of random censorship. Specifically, the large sample results for an inverse probability-of-non-missingness weighted estimator of the cumulative hazard function, so far not available, are derived, including an almost sure representation with rate for a remainder term, and uniform strong consistency with rate of convergence. The estimator is based on a kernel estimate for the conditional probability of non-missingness of the censoring indicator. Expressions for its bias and variance, in turn leading to an expression for the mean squared error as a function of the bandwidth, are also obtained. The corresponding estimator of the survival function, whose weak convergence is derived, is asymptotically efficient. A numerical study, comparing the performances of the proposed and two other currently existing efficient estimators, is presented.     

Wavelet estimation of density for censored data with censoring indicator missing at random

In this paper, we define the nonlinear wavelet estimator of density for the right censoring model with the censoring indicator missing at random (MAR), and develop its asymptotic expression for mean integrated squared error (MISE). Unlike for kernel estimator, the MISE expression of the estimator is not affected by the presence of discontinuities in the curve. Meanwhile, asymptotic normality of the estimator is established. The proposed estimator can reduce to the estimator defined by Li [Non-linear wavelet-based density estimators under random censorship. J Statist Plann Inference. 2003;117(1):35–58] when the censoring indicator MAR does not occur and a bandwidth in non-parametric estimation is close to zero. Also, we define another two nonlinear wavelet estimators of the density. A simulation is done to show the performance of the three proposed estimators.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Improved pretest nonparametric estimation in a multivariate regression model

Shrinkage pretest nonparametric estimation of the location parameter vector in a multivariate regression model is considered when nonsample information (NSI) about the regression parameters is available. By using the quadratic risk criterion, the dominance of the pretest estimators over the usual estimators has been investigated. We demonstrate analytically and computationally that the proposed improved pretest estimator establishes a wider dominance range for the parameter under consideration than that of the usual pretest estimator in which it is superior over the unrestricted estimator.     

Point and Interval Estimation for a Generalized Logistic Distribution Under Progressive Type II Censoring

The likelihood equations based on a progressively Type II censored sample from a Type I generalized logistic distribution do not provide explicit solutions for the location and scale parameters. We present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We examine numerically the bias and variance of these estimators and show that these estimators are as efficient as the maximum likelihood estimators (MLEs). The probability coverages of the pivotal quantities (for location and scale parameters) based on asymptotic normality are shown to be unsatisfactory, especially when the effective sample size is small. Therefore we suggest using unconditional simulated percentage points of these pivotal quantities for the construction of confidence intervals. A wide range of sample sizes and progressive censoring schemes have been considered in this study. Finally, we present a numerical example to illustrate the methods of inference developed here.     

Product-limit Estimators and Cox Regression with Missing Censoring Information

The Kaplan–Meier estimator of a survival function requires that the censoring indicator is always observed. A method of survival function estimation is developed when the censoring indicators are missing completely at random (MCAR). The resulting estimator is a smooth functional of the Nelson–Aalen estimators of certain cumulative transition intensities. The asymptotic properties of this estimator are derived. A simulation study shows that the proposed estimator has greater efficiency than competing MCAR-based estimators. The approach is extended to the Cox model setting for the estimation of a conditional survival function given a covariate.     

Correcting for non-compliance in randomized trials using rank preserving structural failure time models

We propose correcting for non-compliance in randomized trials by estimating the parameters of a class of semi-parametric failure time models, the rank preserving structural failure time models, using a class of rank estimators. These models are the structural or strong version of the “accelerated failure time model with time-dependent covariates” of Cox and Oakes (1984). In this paper we develop a large sample theory for these estimators, derive the optimal estimator within this class, and briefly consider the construction of “partially adaptive” estimators whose efficiency may approach that of the optimal estimator. We show that in the absence of censoring the optimal estimator attains the semiparametric efficiency bound for the model.     

A New Estimation Method Based on Order Statistics in the Families of Symmetric Location-scale Distributions

In this study, new unbiased and nonlinear estimators based on order statistics are proposed for the family of symmetric location-scale distributions and these estimators can be computed from both uncensored and symmetric doubly Type II censored samples. In addition, other relevant unbiased estimators are proposed to estimate standard deviations of these new estimators. A simulation study has been performed to evaluate the performance of the new estimators compared to BLU estimators for small sample sizes. As a result of the simulation study, the new estimators proposed for the location-scale family in general performed nearly as good as BLU estimators. Furthermore, the computational advantage of the proposed estimators over BLU and ML estimators are worthy of notice. In addition, these new estimators have been applied to real data, and the estimation results obtained have been compatible with those of BLUE methods.     

Location and scale parameter estimation from randomly censored data

The problem of location and scale parameter estimation from randomly censored data is analyzed through use of a regression model for the Kaplan-Meier quantlle process. Continuous time regression techniques are employed to construct estimators that are both asymptotically normal and efficient. Estimators with a particularly simple form are obtained for the Koziol-Green model for random censorship. In the event of no censoring the regression model, and resulting estimators, reduce to those proposed by Parzen (1979 a, b).     

Efficiency of a Class of Unbiased Estimators for the Invariant Distribution Function of a Diffusion Process

We consider the problem of the estimation of the invariant distribution function of an ergodic diffusion process when the drift coefficient is unknown. The empirical distribution function is a natural estimator which is unbiased, uniformly consistent and efficient in different metrics. Here we study the properties of optimality for another kind of estimator recently proposed. We consider a class of unbiased estimators and we show that they are also efficient in the sense that their asymptotic risk, defined as the integrated mean square error, attains the same asymptotic minimax lower bound of the empirical distribution function.     

Linear regression analysis of survival data with missing censoring indicators

Linear regression analysis has been studied extensively in a random censorship setting, but typically all of the censoring indicators are assumed to be observed. In this paper, we develop synthetic data methods for estimating regression parameters in a linear model when some censoring indicators are missing. We define estimators based on regression calibration, imputation, and inverse probability weighting techniques, and we prove all three estimators are asymptotically normal. The finite-sample performance of each estimator is evaluated via simulation. We illustrate our methods by assessing the effects of sex and age on the time to non-ambulatory progression for patients in a brain cancer clinical trial.     

Flexible Modeling in the Koziol-Green Model by a Copula Function

In survival analysis, the classical Koziol-Green random censorship model is commonly used to describe informative censoring. Hereby, it is assumed that the distribution of the censoring time is a power of the distribution of the survival time. In this article, we extend this model by assuming a general function between these distributions. We determine this function from a relationship between the observable random variables which is described by a copula family that depends on an unknown parameter θ. For this setting, we develop a semi-parametric estimator for the distribution of the survival time in which we propose a pseudo-likelihood estimator for the copula parameter θ. As results, we show first the consistency and asymptotic normality of the estimator for θ. Afterwards, we prove the weak convergence of the process associated to the semi-parametric distribution estimator. Furthermore, we investigate the finite sample performance of these estimators through a simulation study and finally apply it to a practical data set on survival with malignant melanoma.     

Linear estimation for the extended exponential power distribution

Tiao and Lund [The use of OLUMV estimators in inference robustness studies of the location parameter of a class of symmetric distributions. J Amer Statist Assoc. 1970;65(329):370–386] tabulated the coefficients of the best linear unbiased estimators (BLUEs) of location and scale for a particular family of symmetric distributions. This family was a reparameterization of the extended exponential power distribution (EEPD) with the shape parameter restricted to be greater than or equal to one. In this work, we consider the BLU estimation of the location and scale parameters of the EEPD when the shape parameter is one-third and one-half. We obtain closed-form expressions for the single and product moments of the order statistics when the shape parameter is in general in the form of a reciprocal of an integer. These expressions are then used to determine the BLUEs and the corresponding variances for complete samples of size 20 and less. We consider some other linear estimators of the location and scale parameters and then compare them with the BLUEs. Finally, we present a numerical example to illustrate the developed results.     

Super efficient frequency estimation

In this paper we propose a modified Newton-Raphson method to obtain super efficient estimators of the frequencies of a sinusoidal signal in presence of stationary noise. It is observed that if we start from an initial estimator with convergence rate O_p(n⁻¹) and use Newton-Raphson algorithm with proper step factor modification, then it produces super efficient frequency estimator in the sense that its asymptotic variance is lower than the asymptotic variance of the corresponding least squares estimator. The proposed frequency estimator is consistent and it has the same rate of convergence, namely O_p(n^−3/2), as the least squares estimator. Monte Carlo simulations are performed to observe the performance of the proposed estimator for different sample sizes and for different models. The results are quite satisfactory. One real data set has been analyzed for illustrative purpose.     

A new modified Jackknifed estimator for the Poisson regression model

The Poisson regression is very popular in applied researches when analyzing the count data. However, multicollinearity problem arises for the Poisson regression model when the independent variables are highly intercorrelated. Shrinkage estimator is a commonly applied solution to the general problem caused by multicollinearity. Recently, the ridge regression (RR) estimators and some methods for estimating the ridge parameter k in the Poisson regression have been proposed. It has been found that some estimators are better than the commonly used maximum-likelihood (ML) estimator and some other RR estimators. In this study, the modified Jackknifed Poisson ridge regression (MJPR) estimator is proposed to remedy the multicollinearity. A simulation study and a real data example are provided to evaluate the performance of estimators. Both mean-squared error and the percentage relative error are considered as the performance criteria. The simulation study and the real data example results show that the proposed MJPR method outperforms the Poisson ridge regression, Jackknifed Poisson ridge regression and the ML in all of the different situations evaluated in this paper.     

Estimating the common hazard rate of two exponential distributions with ordered location parameters

This paper is concerned with estimating the common hazard rate of two exponential distributions with unknown and ordered location parameters under a general class of bowl-shaped scale invariant loss functions. The inadmissibility of the best affine equivariant estimator is established by deriving an improved estimator. Another estimator is obtained which improves upon the best affine equivariant estimator. A class of improving estimators is derived using the integral expression of risk difference approach of Kubokawa [A unified approach to improving equivariant estimators. Ann Statist. 1994;22(1):290–299]. These results are applied to specific loss functions. It is further shown that these estimators can be derived for four important sampling schemes: (i) complete and i.i.d. sample, (ii) record values, (iii) type-II censoring, and (iv) progressive Type-II censoring. A simulation study is carried out for numerically comparing the risk performance of these proposed estimators.     

Aalen's linear model for doubly censored data

Double censoring often occurs in registry studies when left censoring is present in addition to right censoring. In this work, we examine estimation of Aalen's nonparametric regression coefficients based on doubly censored data. We propose two estimation techniques. The first type of estimators, including ordinary least squared (OLS) estimator and weighted least squared (WLS) estimators, are obtained using martingale arguments. The second type of estimator, the maximum likelihood estimator (MLE), is obtained via expectation-maximization (EM) algorithms that treat the survival times of left censored observations as missing. Asymptotic properties, including the uniform consistency and weak convergence, are established for the MLE. Simulation results demonstrate that the MLE is more efficient than the OLS and WLS estimators.     

Efficient estimation of the PDF and the CDF of the inverse Rayleigh distribution

In this paper, we consider the estimation of the probability density function and the cumulative distribution function of the inverse Rayleigh distribution. In this regard, the following estimators are considered: uniformly minimum variance unbiased estimator, maximum likelihood (ML) estimator, percentile estimator, least squares estimator and weighted least squares estimator. To do so, analytical expressions are derived for the mean integrated squared error. As the result of simulation studies and real data applications indicate, when the sample size is not very small the ML estimator performs better than the others.