Likelihood Estimation for Censored Random Vectors

This article shows how to construct a likelihood for a general class of censoring problems. This likelihood is proven to be valid, i.e. its maximizer is consistent and the respective root-n estimator is asymptotically efficient and normally distributed under regularity conditions. The method generalizes ordinary maximum likelihood estimation as well as several standard estimators for censoring problems (e.g. tobit type I-tobit type V).     

Sliced Average Variance Estimation for Censored Data

We consider a nonlinear censored regression problem with a vector of predictors. With censoring, high-dimensional regression analysis becomes much more complicated. Since censoring can cause severe bias in estimation, modification to adjust such bias is needed to be made. Based on the weight adjustment, we develop the modification of sliced average variance estimation for estimating the lifetime central subspace without requiring a prespecified parametric model. Our proposed method preserves as much regression information as possible. Simulation results are reported and comparisons are made with the sliced inverse regression of Li et al. (1999 Li , K. C. , Wang , J. L. , Chen , C. H. ( 1999 ). Dimension reduction for censored regression data . Ann. Statist. 27 : 1 – 23 . [Google Scholar]).     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Partially Adaptive Estimation of the Censored Regression Model

Data censoring causes ordinary least squares estimates of linear models to be biased and inconsistent. Tobit, semiparametric, and partially adaptive estimators have been considered as possible solutions. This paper proposes several new partially adaptive estimators that cover a wide range of distributional characteristics. A simulation study is used to investigate the estimators’ relative efficiency in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and may outperform Tobit and semiparametric estimators considered for non-normal distributions. An empirical example of out-of-pocket expenditures for a health insurance plan provides an example, which supports these results.     

On Maximum Likelihood Estimation for the Two Parameter Burr XII Distribution

This article considers three related aspects of maximum likelihood estimation of parameters in the two-parameter Burr XII distribution. Specifically, we first provide further clarification to some limiting results in Wingo (1993 Wingo , D. R. ( 1993 ). Maximum likelihood estimation of Burr XII distribution parameters under Type II censoring . Microelectron. Reliab. 33 : 1251 – 1257 .[Crossref], [Web of Science ®] , [Google Scholar]). We then focus on details in a proof of the uniqueness of the maximum likelihood estimators. Finally, we consider using the likelihood approach for data which does not satisfy Wingo's criterion, and show that this results in fitting either a Pareto distribution or an intuitively sensible degenerate distribution to the data. The discussion here is completely general, and not restricted to data obtained under Type II censoring.     

On Censored Bivariate Random Variables: Copula,Characterization, and Estimation

Let (X, Y) be a bivariate random vector with joint distribution function F_{X, Y}(x, y) = C(F(x), G(y)), where C is a copula and F and G are marginal distributions of X and Y, respectively. Suppose that (X_i, Y_i), i = 1, 2, …, n is a random sample from (X, Y) but we are able to observe only the data consisting of those pairs (X_i, Y_i) for which X_i ? Y_i. We denote such pairs as (X*_i, Y_i*), i = 1, 2, …, ν, where ν is a random variable. The main problem of interest is to express the distribution function F_{X, Y}(x, y) and marginal distributions F and G with the distribution function of observed random variables X* and Y*. It is shown that if X and Y are exchangeable with marginal distribution function F, then F can be uniquely determined by the distributions of X* and Y*. It is also shown that if X and Y are independent and absolutely continuous, then F and G can be expressed through the distribution functions of X* and Y* and the stress–strength reliability P{X ? Y}. This allows also to estimate P{X ? Y} with the truncated observations (X*_i, Y_i*). The copula of bivariate random vector (X*, Y*) is also derived.     

数据归并与连续自变量虚拟化

 本文基于数据双侧归并的一般化设定探讨了回归方程中包含归并数据时的参数估计问题。对于某些变量存在数据归并的线性模型,由于样本似然函数非常复杂,普通的一阶优化条件没有解析解,Newton-Raphson迭代也难以收敛。我们基于EM算法来计算参数的ML估计,推导了对应的参数迭代方程,给出了参数的一个闭式解。特别是,当数据双侧归并比例达到100%时,被归并的连续变量退化为虚拟变量的形式,对此,我们建议使用AIC或SC来识别回归方程中的虚拟变量是否为结构变化抑或是变量归并。     

Estimation of weibull parameters for grouped data with competing risks

We consider the problem of estimating Weibull parameters for grouped data when competing risks are present. We propose two simple methods of estimation and derive their asymptotic properties. A Monte Carlo study was carried out to evaluate the performance of these two methods.     

Parameter Estimation of Type-II Hybrid Censored Weighted Exponential Distribution

A hybrid censoring scheme is a mixture of Type-I and Type-II censoring schemes. We study the estimation of parameters of weighted exponential distribution based on Type-II hybrid censored data. By applying the EM algorithm, maximum likelihood estimators are evaluated. Using Fisher information matrix, asymptotic confidence intervals are provided. By applying Markov chain Monte Carlo techniques, Bayes estimators, and corresponding highest posterior density confidence intervals of parameters are obtained. Monte Carlo simulations are performed to compare the performances of the different methods, and one dataset is analyzed for illustrative purposes.     

Estimation from Censored Data with Incomplete Information

Phillips and Sweeting [J. R. Statist. Soc. B 58 (1996) 775–783.] considered estimation of the parameter of the exponential distribution with censored failure time data when there is incomplete knowledge of the censoring times. It was shown that, under particular models for the censoring mechanism and censoring errors, it will usually be safe to ignore such errors provided they are not expected to be too large. A flexible model is introduced which includes the extreme cases of no censoring errors and no information on the censoring values. The effect of alternative assumptions about knowledge of the censoring values on the estimation of failure rate is investigated.     

Non Null Asymptotic Distributions of Some Criteria in Censored Exponential Regression

In this article, we consider the class of censored exponential regression models which is very useful for modeling lifetime data. Under a sequence of Pitman alternatives, the asymptotic expansions up to order n^{? 1/2} of the non null distribution functions of the likelihood ratio, Wald, Rao score, and gradient statistics are derive in this class of models. The non null asymptotic distribution functions of these statistics are obtained for testing a composite null hypothesis in the presence of nuisance parameters. The power of all four tests, which are equivalent to first order, are compared based on these non null asymptotic expansions. Furthermore, in order to compare the finite-sample performance of these tests in this class of models, we consider Monte Carlo simulations. We also present an empirical application for illustrative purposes.     

Using BBPSO Algorithm to Estimate the Weibull Parameters with Censored Data

This article proposes the maximum likelihood estimates based on bare bones particle swarm optimization (BBPSO) algorithm for estimating the parameters of Weibull distribution with censored data, which is widely used in lifetime data analysis. This approach can produce more accuracy of the parameter estimation for the Weibull distribution. Additionally, the confidence intervals for the estimators are obtained. The simulation results show that the BB PSO algorithm outperforms the Newton–Raphson method in most cases in terms of bias, root mean square of errors, and coverage rate. Two examples are used to demonstrate the performance of the proposed approach. The results show that the maximum likelihood estimates via BBPSO algorithm perform well for estimating the Weibull parameters with censored data.     

Exponential Parameter Estimation for Data Sets Containing Left and Right Censored Observations

Lifetime data sets may contain both left and right censored observations. Regression, maximum likelihood, and the best iinear unbiased parameter estimates are given for the exponential distribution, along with a comparison of the estimators.     

Heteroscedasticity and Distributional Assumptions in the Censored Regression Model

Data censoring causes ordinary least-square estimators of linear models to be biased and inconsistent. The Tobit estimator yields consistent estimators in the presence of data censoring if the errors are normally distributed. However, nonnormality or heteroscedasticity results in the Tobit estimators being inconsistent. Various estimators have been proposed for circumventing the normality assumption. Some of these estimators include censored least absolute deviations (CLAD), symmetrically censored least-square (SCLS), and partially adaptive estimators. CLAD and SCLS will be consistent in the presence of heteroscedasticity; however, SCLS performs poorly in the presence of asymmetric errors. This article extends the partially adaptive estimation approach to accommodate possible heteroscedasticity as well as nonnormality. A simulation study is used to investigate the estimators’ relative performance in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and appear to outperform the Tobit and semiparametric estimators for nonnormal error distributions and be less sensitive to the presence of heteroscedasticity. An empirical example is considered, which supports these results.     

Parameter Estimation Robust to Low-Frequency Contamination

We provide methods to robustly estimate the parameters of stationary ergodic short-memory time series models in the potential presence of additive low-frequency contamination. The types of contamination covered include level shifts (changes in mean) and monotone or smooth time trends, both of which have been shown to bias parameter estimates toward regions of persistence in a variety of contexts. The estimators presented here minimize trimmed frequency domain quasi-maximum likelihood (FDQML) objective functions without requiring specification of the low-frequency contaminating component. When proper sample size-dependent trimmings are used, the FDQML estimators are consistent and asymptotically normal, asymptotically eliminating the presence of any spurious persistence. These asymptotic results also hold in the absence of additive low-frequency contamination, enabling the practitioner to robustly estimate model parameters without prior knowledge of whether contamination is present. Popular time series models that fit into the framework of this article include autoregressive moving average (ARMA), stochastic volatility, generalized autoregressive conditional heteroscedasticity (GARCH), and autoregressive conditional heteroscedasticity (ARCH) models. We explore the finite sample properties of the trimmed FDQML estimators of the parameters of some of these models, providing practical guidance on trimming choice. Empirical estimation results suggest that a large portion of the apparent persistence in certain volatility time series may indeed be spurious. Supplementary materials for this article are available online.     

Maximum Likelihood Estimation in Compound Geometric Failure Model with Changing Parameters From Type-I Two-Stage Progressively Censored and Group Censored Samples

Boardman and Kendell (1970 Boardman , T. J. , Kendell , P. J. ( 1970 ). Estimation in compound failure models . Technometrics 12 : 891 – 908 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) considered the problem of estimation with respect to Type-I censoring when an item is subjected to only one of the two causes of failure assuming exponential model. Patel and Gajjar (1992 Patel , M. N. , Gajjar , A. V. ( 1992 ). Maximum likelihood estimation in compound exponential failure model with changing failure rates from Type-I progressively censored and group censored samples . Commun. Statist. Theor. Meth. 21 ( 10 ): 2899 – 2908 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) considered extension of the Boardman and Kendell's results in case of two-stage progressive censoring. Here we have considered geometric competing risk failure model with two independent causes of failures. Maximum likelihood estimation of the parameters is carried out using Type-I two-stage progressively censored and group censored samples. Asymptotic standard errors of the estimators are obtained for both the cases. Two illustrative examples are cited for ungroup and group competing risk models.     

Local Influence Under Parameter Constraints

Calculations of local influence curvatures and leverage have been well developed when the parameters are unrestricted. In this article, we discuss the assessment of local influence and leverage under linear equality parameter constraints with extensions to inequality constraints. Using a penalized quadratic function we express the normal curvature of local influence for arbitrary perturbation schemes and the generalized leverage matrix in interpretable forms, which depend on restricted and unrestricted components. The results are quite general and can be applied in various statistical models. In particular, we derive the normal curvature under three useful perturbation schemes for generalized linear models. Four illustrative examples are analyzed by the methodology developed in the article.     

Regression Parameter Estimation from Panel Counts

This paper considers a study where each subject may experience multiple occurrences of an event and the rate of the event occurrences is of primary interest. Specifically, we are concerned with the situations where, for each subject, there are only records of the accumulated counts for the event occurrences at a finite number of time points over the study period. Sets of observation times may vary from subject to subject and differ between groups. We model the mean of the event occurrence number over time semiparametrically, and estimate the regression parameter. The proposed estimation procedures are illustrated with data from a bladder cancer study ( Byar, 1980 ). Both asymptotics and simulation studies on the estimators are presented.     

Nonparametric Estimation for Random Censored Data Based on Ranking Set Sampling

In the case where the population distribution is unknown, the Kaplan–Meier estimator of the reliability function based on a ranked set sample with random right-censored data is first proposed. It is shown to be a unique self-consistent estimator. Then, the censored RSS estimator of the population mean is constructed. A simulation study is conducted to compare the performance of the proposed estimators with the corresponding estimators based on a simple random sample. It is shown that the ranked set sampling has higher efficiency. Finally, the proposed method is applied to a renal carcinoma study.