Estimation of tobit-type models with individual specific effects

The aim of this paper is two-fold. First, we review recent estimators for censored regression and sample selection panel data models with unobservable individual specific effects, and show how the idea behind these estimators can be used to construct estimators for a variety of other Tobit-type models. The estimators presented in this paper are semiparametric, in the sense that they do not require the parametrization of the distribution of the unobservables. The second aim of the paper is to introduce a new class of estimators for the censored regression model. The advantage of the new estimators is that they can be applied under a stationarity assumption on the transitory error terms, which is weaker than the exchangeability assumption that is usually made in this literature. A similar generalization does not seem feasible for the estimators of the other models that are considered.     

Heteroscedasticity and Distributional Assumptions in the Censored Regression Model

Data censoring causes ordinary least-square estimators of linear models to be biased and inconsistent. The Tobit estimator yields consistent estimators in the presence of data censoring if the errors are normally distributed. However, nonnormality or heteroscedasticity results in the Tobit estimators being inconsistent. Various estimators have been proposed for circumventing the normality assumption. Some of these estimators include censored least absolute deviations (CLAD), symmetrically censored least-square (SCLS), and partially adaptive estimators. CLAD and SCLS will be consistent in the presence of heteroscedasticity; however, SCLS performs poorly in the presence of asymmetric errors. This article extends the partially adaptive estimation approach to accommodate possible heteroscedasticity as well as nonnormality. A simulation study is used to investigate the estimators’ relative performance in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and appear to outperform the Tobit and semiparametric estimators for nonnormal error distributions and be less sensitive to the presence of heteroscedasticity. An empirical example is considered, which supports these results.     

Added variable plots for linear regression with censored data

In linear regression the structure of the hat matrix plays an important part in regression diagnostics. In this note we investigate the properties of the hat matrix for regression with censored responses in the presence of one or more explanatory variables observed without censoring. The censored points in the scatterplot are renovated to positions had they been observed without censoring in a renovation process based on Buckley-James censored regression estimators. This allows natural links to be established with the structure of ordinary least squares estimators. In particular, we show that the renovated hat matrix may be partitioned in a manner which assists in deciding whether further explanatory variables should be added to the linear model. The added variable plot for regression with censored data is developed as a diagnostic tool for this decision process.     

LASSO and shrinkage estimation in Weibull censored regression models

In this paper we address the problem of estimating a vector of regression parameters in the Weibull censored regression model. Our main objective is to provide natural adaptive estimators that significantly improve upon the classical procedures in the situation where some of the predictors may or may not be associated with the response. In the context of two competing Weibull censored regression models (full model and candidate submodel), we consider an adaptive shrinkage estimation strategy that shrinks the full model maximum likelihood estimate in the direction of the submodel maximum likelihood estimate. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Further, we consider a LASSO type estimation strategy and compare the relative performance with the shrinkage estimators. Monte Carlo simulations reveal that when the true model is close to the candidate submodel, the shrinkage strategy performs better than the LASSO strategy when, and only when, there are many inactive predictors in the model. Shrinkage and LASSO strategies are applied to a real data set from Veteran's administration (VA) lung cancer study to illustrate the usefulness of the procedures in practice.     

Nonparametric quasi-likelihood for right censored data

Quasi-likelihood was extended to right censored data to handle heteroscedasticity in the frame of the accelerated failure time (AFT) model. However, the assumption of known variance function in the quasi-likelihood for right censored data is usually unrealistic. In this paper, we propose a nonparametric quasi-likelihood by replacing the specified variance function with a nonparametric variance function estimator. This nonparametric variance function estimator is obtained by smoothing a function of squared residuals via local polynomial regression. The rate of convergence of the nonparametric variance function estimator and the asymptotic limiting distributions of the regression coefficient estimators are derived. It is demonstrated in simulations that for finite samples the proposed nonparametric quasi-likelihood method performs well. The new method is illustrated with one real dataset.     

Testing Censoring Point Independence

Identification in censored regression analysis and hazard models of duration outcomes relies on the condition that censoring points are conditionally independent of latent outcomes, an assumption which may be questionable in many settings. This article proposes a test for this assumption based on a Cramer–von-Mises-like test statistic comparing two different nonparametric estimators for the latent outcome cdf: the Kaplan–Meier estimator, and the empirical cdf conditional on the censoring point exceeding (for right-censored data) the cdf evaluation point. The test is consistent and has power against a wide variety of alternatives. Applying the test to unemployment duration data from the NLSY, the SIPP, and the PSID suggests the assumption is frequently suspect.     

Finite mixture modeling of censored regression models

A finite mixture of Tobit models is suggested for estimation of regression models with a censored response variable. A mixture of models is not primarily adapted due to a true component structure in the population; the flexibility of the mixture is suggested as a way of avoiding non-robust parametrically specified models. The new estimator has several interesting features. One is its potential to yield valid estimates in cases with a high degree of censoring. The estimator is in a Monte Carlo simulation compared with earlier suggestions of estimators based on semi-parametric censored regression models. Simulation results are partly in favor of the proposed estimator and indicate potentials for further improvements.     

Partially Adaptive Estimation of the Censored Regression Model

Data censoring causes ordinary least squares estimates of linear models to be biased and inconsistent. Tobit, semiparametric, and partially adaptive estimators have been considered as possible solutions. This paper proposes several new partially adaptive estimators that cover a wide range of distributional characteristics. A simulation study is used to investigate the estimators’ relative efficiency in these settings. The partially adaptive censored regression estimators have little efficiency loss for censored normal errors and may outperform Tobit and semiparametric estimators considered for non-normal distributions. An empirical example of out-of-pocket expenditures for a health insurance plan provides an example, which supports these results.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Bivariate location–scale models for regression analysis, with applications to lifetime data

Summary.  The literature on multivariate linear regression includes multivariate normal models, models that are used in survival analysis and a variety of models that are used in other areas such as econometrics. The paper considers the class of location–scale models, which includes a large proportion of the preceding models. It is shown that, for complete data, the maximum likelihood estimators for regression coefficients in a linear location–scale framework are consistent even when the joint distribution is misspecified. In addition, gains in efficiency arising from the use of a bivariate model, as opposed to separate univariate models, are studied. A major area of application for multivariate regression models is to clustered, 'parallel' lifetime data, so we also study the case of censored responses. Estimators of regression coefficients are no longer consistent under model misspecification, but we give simulation results that show that the bias is small in many practical situations. Gains in efficiency from bivariate models are also examined in the censored data setting. The methodology in the paper is illustrated by using lifetime data from the Diabetic Retinopathy Study.     

Bias From Censored Regressors

We study the bias that arises from using censored regressors in estimation of linear models. We present results on bias in ordinary least aquares (OLS) regression estimators with exogenous censoring and in instrumental variable (IV) estimators when the censored regressor is endogenous. Bound censoring such as top-coding results in expansion bias, or effects that are too large. Independent censoring results in bias that varies with the estimation method—attenuation bias in OLS estimators and expansion bias in IV estimators. Severe biases can result when there are several regressors and when a 0–1 variable is used in place of a continuous regressor.     

Point estimation using tail modelling for right skew populations

ABSTRACT

We evaluate the merits of estimators for right-skewed data which are motivated by a distributional assumption for the tail of the population. Our aim is to make a coherent account of estimators of this type already existing in the literature as well as suggesting some modifications, and to compare their performance empirically to other conceivable alternatives. Our results indicate that making use of parametric models to derive the explicit form of estimators can be a fruitful approach for a wide range of right-skewed populations when auxiliary data is not available, especially for small samples.     

Inference on semiparametric transformation model with general interval-censored failure time data

Failure time data occur in many areas and in various censoring forms and many models have been proposed for their regression analysis such as the proportional hazards model and the proportional odds model. Another choice that has been discussed in the literature is a general class of semiparmetric transformation models, which include the two models above and many others as special cases. In this paper, we consider this class of models when one faces a general type of censored data, case K informatively interval-censored data, for which there does not seem to exist an established inference procedure. For the problem, we present a two-step estimation procedure that is quite flexible and can be easily implemented, and the consistency and asymptotic normality of the proposed estimators of regression parameters are established. In addition, an extensive simulation study is conducted and suggests that the proposed procedure works well for practical situations. An application is also provided.     

New estimators based on order statistics in some families of scale distributions

In this study some new unbiased estimators based on order statistics are proposed for the scale parameter in some family of scale distributions. These new estimators are suitable for the cases of complete (uncensored) and symmetric doubly Type-II censored samples. Further, they can be adapted to Type II right or Type II left censored samples. In addition, unbiased standard deviation estimators of the proposed estimators are also given. Moreover, unlike BLU estimators based on order statistics, expectation and variance-covariance of relevant order statistics are not required in computing these new estimators.

Simulation studies are conducted to compare performances of the new estimators with their counterpart BLU estimators for small sample sizes. The simulation results show that most of the proposed estimators in general perform almost as good as the counterpart BLU estimators; even some of them are better than BLU in some cases. Furthermore, a real data set is used to illustrate the new estimators and the results obtained parallel with those of BLUE methods.     

Cumulative Incidence Association Models for Bivariate Competing Risks Data

Association models, like frailty and copula models, are frequently used to analyze clustered survival data and evaluate within-cluster associations. The assumption of noninformative censoring is commonly applied to these models, though it may not be true in many situations. In this paper, we consider bivariate competing risk data and focus on association models specified for the bivariate cumulative incidence function (CIF), a nonparametrically identifiable quantity. Copula models are proposed which relate the bivariate CIF to its corresponding univariate CIFs, similarly to independently right censored data, and accommodate frailty models for the bivariate CIF. Two estimating equations are developed to estimate the association parameter, permitting the univariate CIFs to be estimated either parametrically or nonparametrically. Goodness-of-fit tests are presented for formally evaluating the parametric models. Both estimators perform well with moderate sample sizes in simulation studies. The practical use of the methodology is illustrated in an analysis of dementia associations.     

Small sample comparison of six bivariate survival curve estimators 1

We study the performance of six proposed bivariate survival curve estimators on simulated right censored data. The performance of the estimators is compared for data generated by three bivariate models with exponential marginal distributions. The estimators are compared in their ability to estimate correlations and survival functions probabilities. Simulated data results are presented so that the proposed estimators in this relatively new area of analysis can be explicitly compared to the known distribution of the data and the parameters of the underlying model. The results show clear differences in the performance of the estimators.     

Modelling Survival Events with Longitudinal Covariates Measured with Error

In survival analysis, time-dependent covariates are usually present as longitudinal data collected periodically and measured with error. The longitudinal data can be assumed to follow a linear mixed effect model and Cox regression models may be used for modelling of survival events. The hazard rate of survival times depends on the underlying time-dependent covariate measured with error, which may be described by random effects. Most existing methods proposed for such models assume a parametric distribution assumption on the random effects and specify a normally distributed error term for the linear mixed effect model. These assumptions may not be always valid in practice. In this article, we propose a new likelihood method for Cox regression models with error-contaminated time-dependent covariates. The proposed method does not require any parametric distribution assumption on random effects and random errors. Asymptotic properties for parameter estimators are provided. Simulation results show that under certain situations the proposed methods are more efficient than the existing methods.     

Semiparametric estimation of employment duration models

There are a variety of economic areas, such as studies of employment duration and of the durability of capital goods, in which data on important variables typically are censored. The standard techinques for estimating a model from censored data require the distributions of unobservable random components of the model to be specified a priori up to a finite set of parameters, and misspecification of these distributions usually leads to inconsistent parameter estimates. However, economic theory rarely gives guidance about distributions and the standard estimation techniques do not provide convenient methods for identifying distributions from censored data. Recently, several distribution-free or semiparametric methods for estimating censored regression models have been developed. This paper presents the results of using two such methods to estimate a model of employment duration. The paper reports the operating characteristics of the semiparametric estimators and compares the semiparametric estimates with those obtained from a standard parametric model.     

Parameter estimation approaches to tackling measurement error and multicollinearity in ordinal probit models

Abstract

The regression model with ordinal outcome has been widely used in a lot of fields because of its significant effect. Moreover, predictors measured with error and multicollinearity are long-standing problems and often occur in regression analysis. However there are not many studies on dealing with measurement error models with generally ordinal response, even fewer when they suffer from multicollinearity. The purpose of this article is to estimate parameters of ordinal probit models with measurement error and multicollinearity. First, we propose to use regression calibration and refined regression calibration to estimate parameters in ordinal probit models with measurement error. Second, we develop new methods to obtain estimators of parameters in the presence of multicollinearity and measurement error in ordinal probit model. Furthermore we also extend all the methods to quadratic ordinal probit models and talk about the situation in ordinal logistic models. These estimators are consistent and asymptotically normally distributed under general conditions. They are easy to compute, perform well and are robust against the normality assumption for the predictor variables in our simulation studies. The proposed methods are applied to some real datasets.     

Semiparametric inference for the recurrent events process by means of a single-index model

In this paper, we introduce new parametric and semiparametric regression techniques for a recurrent event process subject to random right censoring. We develop models for the cumulative mean function and provide asymptotically normal estimators. Our semiparametric model which relies on a single-index assumption can be seen as a dimension reduction technique that, contrary to a fully nonparametric approach, is not stroke by the curse of dimensionality when the number of covariates is high. We discuss data-driven techniques to choose the parameters involved in the estimation procedures and provide a simulation study to support our theoretical results.