An Iterative Weighted Least Squares Algorithm and Simulation Study for Censored Data M-Estimates

A popular linear regression estimator for censored data is the one proposed by Buckley and James (1979). However, this estimator is not robust to outliers, which is not surprising since it is a modified version of the uncensored data least squares estimator. Lai and Ying (1994) have proposed an M-estimator for censored data that is a generalization of the Buckley- James estimator. In this paper we discuss a weighted least squares algorithm for computing these M-estimates and compare the performance of two Huber M-estimators with the Buckley-James estimator in a simulation study. We find that the Huber M-estimators perform more robustly for a broad range of censoring and error distributions.     

Tukey’s M-estimator of the Poisson parameter with a special focus on small means

We treat robust M-estimators for independent and identically distributed Poisson data. We introduce modified Tukey M-estimators with bias correction and compare them to M-estimators based on the Huber function as well as to weighted likelihood and other estimators by simulation in case of clean data and data with outliers. In particular, we investigate the problem of combining robustness and high efficiencies at small Poisson means caused by the strong asymmetry of such Poisson distributions and propose a further estimator based on adaptive trimming. The advantages of the constructed estimators are illustrated by an application to smoothing count data with a time varying mean and level shifts.     

Nonparametric Estimation of Variance Function for Functional Data Under Mixing Conditions

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite dimensional case, our asymptotic result shows the smoothness of the unknown mean function has an effect on the rate of convergence. Our simulation studies demonstrate that estimator based on residuals performs much better than that based on conditional second moment of the responses.     

Conditional Quantile Estimation for Truncated and Associated Data

Abstract

In survival or reliability studies, it is common to have data which are not only incomplete but weakly dependent too. Random truncation and censoring are two common forms of such data when they are neither independent nor strongly mixing but rather associated. The focus of this paper is on estimating conditional distribution and conditional quantile functions for randomly left truncated data satisfying association condition. We aim at deriving strong uniform consistency rates and asymptotic normality for the estimators and thereby, extend to association case some results stated under iid and α-mixing hypotheses. The performance of the quantile function estimator is evaluated on simulated data sets.     

Hazard-based nonparametric survivor function estimation

Summary.  A representation is developed that expresses the bivariate survivor function as a function of the hazard function for truncated failure time variables. This leads to a class of nonparametric survivor function estimators that avoid negative mass. The transformation from hazard function to survivor function is weakly continuous and compact differentiable, so that such properties as strong consistency, weak convergence to a Gaussian process and bootstrap applicability for a hazard function estimator are inherited by the corresponding survivor function estimator. The set of point mass assignments for a survivor function estimator is readily obtained by using a simple matrix calculation on the set of hazard rate estimators. Special cases arise from a simple empirical hazard rate estimator, and from an empirical hazard rate estimator following the redistribution of singly censored observations within strips. The latter is shown to equal van der Laan's repaired nonparametric maximum likelihood estimator, for which a Greenwood-like variance estimator is given. Simulation studies are presented to compare the moderate sample performance of various nonparametric survivor function estimators.     

Probability Generating Function Based Jeffrey's Divergence for Statistical Inference

Statistical inference procedures based on transforms such as characteristic function and probability generating function have been examined by many researchers because they are much simpler than probability density functions. Here, a probability generating function based Jeffrey's divergence measure is proposed for parameter estimation and goodness-of-fit test. Being a member of the M-estimators, the proposed estimator is consistent. Also, the proposed goodness-of-fit test has good statistical power. The proposed divergence measure shows improved performance over existing probability generating function based measures. Real data examples are given to illustrate the proposed parameter estimation method and goodness-of-fit test.     

M-estimation for functional linear regression

This paper studies M-estimation in functional linear regression in which the dependent variable is scalar while the covariate is a function. An estimator for the slope function is obtained based on the functional principal component basis. The global convergence rate of the M-estimator of unknown slope function is established. The convergence rate of the mean-squared prediction error for the proposed estimators is also established. Monte Carlo simulation studies are conducted to examine the finite-sample performance of the proposed procedure. Finally, the proposed method is applied to analyze the Berkeley growth data.     

Robust estimates of ordered means in normal models

In this paper we consider the problem of estimating the locations of several normal populations when an order relation between them is known to be true. We compare the maximum likelihood estimator, the M-estimators based on Huber’s ψ function, a robust weighted likelihood estimator, the Gastworth estimator and the trimmed mean estimator. A Monte-Carlo study illustrates the performance of the methods considered.     

Nonparametric estimation of the conditional distribution function in a semiparametric censorship model

In this paper we propose a new nonparametric estimator of the conditional distribution function under a semiparametric censorship model. We establish an asymptotic representation of the estimator as a sum of iid random variables, balanced by some kernel weights. This representation is used for obtaining large sample results such as the rate of uniform convergence of the estimator, or its limit distributional law. We prove that the new estimator outperforms the conditional Kaplan–Meier estimator for censored data, in the sense that it exhibits lower asymptotic variance. Illustration through real data analysis is provided.     

A Convolution Estimator for the Density of Nonlinear Regression Observations

Abstract. The problem of estimating an unknown density function has been widely studied. In this article, we present a convolution estimator for the density of the responses in a nonlinear heterogenous regression model. The rate of convergence for the mean square error of the convolution estimator is of order n ^?1 under certain regularity conditions. This is faster than the rate for the kernel density method. We derive explicit expressions for the asymptotic variance and the bias of the new estimator, and further a data‐driven bandwidth selector is proposed. We conduct simulation experiments to check the finite sample properties, and the convolution estimator performs substantially better than the kernel density estimator for well‐behaved noise densities.     

Estimating the density of a possibly missing response variable in nonlinear regression

This paper considers linear and nonlinear regression with a response variable that is allowed to be “missing at random”. The only structural assumptions on the distribution of the variables are that the errors have mean zero and are independent of the covariates. The independence assumption is important. It enables us to construct an estimator for the response density that uses all the observed data, in contrast to the usual local smoothing techniques, and which therefore permits a faster rate of convergence. The idea is to write the response density as a convolution integral which can be estimated by an empirical version, with a weighted residual-based kernel estimator plugged in for the error density. For an appropriate class of regression functions, and a suitably chosen bandwidth, this estimator is consistent and converges with the optimal parametric rate n^1/2. Moreover, the estimator is proved to be efficient (in the sense of Hájek and Le Cam) if an efficient estimator is used for the regression parameter.     

Kernel density estimation under negative superadditive dependence and its application for real data

In this paper, the kernel density estimator for negatively superadditive dependent random variables is studied. The exponential inequalities and the exponential rate for the kernel estimator of density function with a uniform version, over compact sets are investigated. Also, the optimal bandwidth rate of the estimator is obtained using mean integrated squared error. The results are generalized and used to improve the ones obtained for the case of associated sequences. As an application, FGM sequences that fulfil our assumptions are investigated. Also, the convergence rate of the kernel density estimator is illustrated via a simulation study. Moreover, a real data analysis is presented.     

Adaptive nonparametric estimation in the presence of dependence

We consider nonparametric estimation problems in the presence of dependent data, notably nonparametric regression with random design and nonparametric density estimation. The proposed estimation procedure is based on a dimension reduction. The minimax optimal rate of convergence of the estimator is derived assuming a sufficiently weak dependence characterised by fast decreasing mixing coefficients. We illustrate these results by considering classical smoothness assumptions. However, the proposed estimator requires an optimal choice of a dimension parameter depending on certain characteristics of the function of interest, which are not known in practice. The main issue addressed in our work is an adaptive choice of this dimension parameter combining model selection and Lepski's method. It is inspired by the recent work of Goldenshluger and Lepski [(2011), ‘Bandwidth Selection in Kernel Density Estimation: Oracle Inequalities and Adaptive Minimax Optimality’, The Annals of Statistics, 39, 1608–1632]. We show that this data-driven estimator can attain the lower risk bound up to a constant provided a fast decay of the mixing coefficients.     

Fitting Cox Models with Doubly Censored Data Using Spline‐Based Sieve Marginal Likelihood

In some applications, the failure time of interest is the time from an originating event to a failure event while both event times are interval censored. We propose fitting Cox proportional hazards models to this type of data using a spline‐based sieve maximum marginal likelihood, where the time to the originating event is integrated out in the empirical likelihood function of the failure time of interest. This greatly reduces the complexity of the objective function compared with the fully semiparametric likelihood. The dependence of the time of interest on time to the originating event is induced by including the latter as a covariate in the proportional hazards model for the failure time of interest. The use of splines results in a higher rate of convergence of the estimator of the baseline hazard function compared with the usual non‐parametric estimator. The computation of the estimator is facilitated by a multiple imputation approach. Asymptotic theory is established and a simulation study is conducted to assess its finite sample performance. It is also applied to analyzing a real data set on AIDS incubation time.     

A Berry–Esséen Bound for M-estimators

We prove a Berry–Esséen bound for general M-estimators under optimal regularity conditions on the score function and the underlying distribution. As an application we obtain Berry–Esséen bounds for the sample median, the L_p -median, p > 1 and Huber's estimator of location     

The Whittle Estimator for Strongly Dependent Stationary Gaussian Fields

In this article we generalize results on the asymptotic behaviour of the Whittle estimator for certain stationary Gaussian long range dependent fields. These results have been established in the one-dimensional case under very general conditions. They require controlling the estimation bias and also giving convergence theorems for certain quadratic forms of the observations. In the multidimensional setting, our main interest will be controlling the bias. This can be done for d ≤ 3 using taper functions, and, depending on the shape of the singularity, also introducing certain regularizing functions. In this last case, however, the estimator will no longer be efficient. We also present certain partial results concerning the convergence to a limiting Gaussian distribution of the associated quadratic forms.     

Robust statistical inference: weighted likelihoods or usual m-estimation?

We review the weighted likelihood estimating equations methodology introduced by Markatou, Basu and Lindsay (1995). and Basu, Markatou and Lindsay (1995) and compare it, in the case of symmetric and asymmetric contamination, with Huber's M-estimators of location. The simulation study shows that the weighted likelihood estimating equations estimator is at least as competitive as Huber's M-estimators in the case of symmetric contamination. In the case of asymmetric contamination it may be superior than Huber's M-estimators     

Computing the log concave NPMLE for interval censored data

In analyzing interval censored data, a non-parametric estimator is often desired due to difficulties in assessing model fits. Because of this, the non-parametric maximum likelihood estimator (NPMLE) is often the default estimator. However, the estimates for values of interest of the survival function, such as the quantiles, have very large standard errors due to the jagged form of the estimator. By forcing the estimator to be constrained to the class of log concave functions, the estimator is ensured to have a smooth survival estimate which has much better operating characteristics than the unconstrained NPMLE, without needing to specify a parametric family or smoothing parameter. In this paper, we first prove that the likelihood can be maximized under a finite set of parameters under mild conditions, although the log likelihood function is not strictly concave. We then present an efficient algorithm for computing a local maximum of the likelihood function. Using our fast new algorithm, we present evidence from simulated current status data suggesting that the rate of convergence of the log-concave estimator is faster (between \(n^{2/5}\) and \(n^{1/2}\)) than the unconstrained NPMLE (between \(n^{1/3}\) and \(n^{1/2}\)).     

Efficient Estimation of the Partly Linear Additive Hazards Model with Current Status Data

This paper focuses on efficient estimation, optimal rates of convergence and effective algorithms in the partly linear additive hazards regression model with current status data. We use polynomial splines to estimate both cumulative baseline hazard function with monotonicity constraint and nonparametric regression functions with no such constraint. We propose a simultaneous sieve maximum likelihood estimation for regression parameters and nuisance parameters and show that the resultant estimator of regression parameter vector is asymptotically normal and achieves the semiparametric information bound. In addition, we show that rates of convergence for the estimators of nonparametric functions are optimal. We implement the proposed estimation through a backfitting algorithm on generalized linear models. We conduct simulation studies to examine the finite‐sample performance of the proposed estimation method and present an analysis of renal function recovery data for illustration.