Comparison of renewal function estimators for censored data

The computation of the renewal function when the distribution function is completely known has received much attention in the literature. However, in many cases the form of the distribution function is unknown and has to be estimated nonparametrically. A nonparametric estimator for the renewal function for complete data was suggested by Frees (1986). In many cases, however, censoring of the lifetime might occur. We shall present parametric and nonparametric estimators of the renewal function based on censored data. In a simulation study we compare the nonparametric estimators with parametric estimators for the Weibull and lognormal distribution. The study suggests that the nonparametric estimator is a viable alternative to the parametric estimators when the lifetime distribution is unknown. Also, the nonparametric estimator is computationally simpler than the parametric estimator.     

Minimax estimation of a probability of success under LINEX loss

Minimax estimation of a binomial probability under LINEX loss function is considered. It is shown that no equalizer estimator is available in the statistical decision problem under consideration. It is pointed out that the problem can be solved by determining the Bayes estimator with respect to a least favorable distribution having finite support. In this situation, the optimal estimator and the least favorable distribution can be determined only by using numerical methods. Some properties of the minimax estimators and the corresponding least favorable prior distributions are provided depending on the parameters of the loss function. The properties presented are exploited in computing the minimax estimators and the least favorable distributions. The results obtained can be applied to determine minimax estimators of a cumulative distribution function and minimax estimators of a survival function.     

Estimation of the error distribution in a varying coefficient regression model

This paper deals with the estimation of the error distribution function in a varying coefficient regression model. We propose two estimators and study their asymptotic properties by obtaining uniform stochastic expansions. The first estimator is a residual-based empirical distribution function. We study this estimator when the varying coefficients are estimated by under-smoothed local quadratic smoothers. Our second estimator which exploits the fact that the error distribution has mean zero is a weighted residual-based empirical distribution whose weights are chosen to achieve the mean zero property using empirical likelihood methods. The second estimator improves on the first estimator. Bootstrap confidence bands based on the two estimators are also discussed.     

Shape Constrained Non‐parametric Estimators of the Baseline Distribution in Cox Proportional Hazards Model

Abstract. We investigate non‐parametric estimation of a monotone baseline hazard and a decreasing baseline density within the Cox model. Two estimators of a non‐decreasing baseline hazard function are proposed. We derive the non‐parametric maximum likelihood estimator and consider a Grenander type estimator, defined as the left‐hand slope of the greatest convex minorant of the Breslow estimator. We demonstrate that the two estimators are strongly consistent and asymptotically equivalent and derive their common limit distribution at a fixed point. Both estimators of a non‐increasing baseline hazard and their asymptotic properties are obtained in a similar manner. Furthermore, we introduce a Grenander type estimator for a non‐increasing baseline density, defined as the left‐hand slope of the least concave majorant of an estimator of the baseline cumulative distribution function, derived from the Breslow estimator. We show that this estimator is strongly consistent and derive its asymptotic distribution at a fixed point.     

Parameter estimation based upon nonparametric function estimators

By considering the solution to a linear approximation of a nonlinear regression problem, a procedure for developing a para¬meter estimator, based upon a nonpammetric estimator of a para¬metric function, is given. The resulting estimators, which are determinable in closed form, are asymptotically normally distri¬buted and are optimal among the class of estimators based upon the function estimator. Further, in many cases, the estimator will have the same asymptotic distribution theory as the correspond¬ing maximum likelihood estimator. Estimators based upon the Kaplan-Meier quantile function are developed for randomly censored samples.     

Bernstein conditional density estimation with application to conditional distribution and regression functions

In this paper we propose a smooth nonparametric estimation for the conditional probability density function based on a Bernstein polynomial representation. Our estimator can be written as a finite mixture of beta densities with data-driven weights. Using the Bernstein estimator of the conditional density function, we derive new estimators for the distribution function and conditional mean. We establish the asymptotic properties of the proposed estimators, by proving their asymptotic normality and by providing their asymptotic bias and variance. Simulation results suggest that the proposed estimators can outperform the Nadaraya–Watson estimator and, in some specific setups, the local linear kernel estimators. Finally, we use our estimators for modeling the income in Italy, conditional on year from 1951 to 1998, and have another look at the well known Old Faithful Geyser data.     

A Note on Estimation of a Distribution Function in a Nonparametric Set-up Using Stein’s Shrinkage Estimation Technique

Based on Stein’s famous shrinkage estimation of a multivariate normal distribution, we propose a new type of estimators of the distribution function of a random variable in a nonparametric setup. The proposed estimators are then compared with the empirical distribution function, which is the best equivariant estimator under a well-known loss function. Our extensive simulation study shows that our proposed estimators can perform better for moderate to large sample sizes.     

Application of Bernstein Polynomials for smooth estimation of a distribution and density function

The empirical distribution function is known to have optimum properties as an estimator of the underlying distribution function. However, it may not be appropriate for estimating continuous distributions because of its jump discontinuities. In this paper, we consider the application of Bernstein polynomials for approximating a bounded and continuous function and show that it can be naturally adapted for smooth estimation of a distribution function concentrated on the interval [0,1] by a continuous approximation of the empirical distribution function. The smoothness of the approximating polynomial is further used in deriving a smooth estimator of the corresponding density. The asymptotic properties of the resulting estimators are investigated. Specifically, we obtain strong consistency and asymptotic normality under appropriate choice of the degree of the polynomial. The case of distributions with other compact and non-compact support can be dealt through transformations. Thus, this paper gives a general method for non-parametric density estimation as an alternative to the current estimators. A small numerical investigation shows that the estimator proposed here may be preferable to the popular kernel-density estimator.     

Bias-calibrated estimation from sample surveys containing outliers

We discuss the problem of estimating finite population parameters on the basis of a sample containing representative outliers. We clarify the motivation for Chambers's bias-calibrated estimator of the population total and show that bias calibration is a key idea in constructing estimators of finite population parameters. We then link the problem of estimating the population total to distribution function or quantile estimation and explore a methodology based on the use of Chambers's estimator. We also propose methodology based on the use of robust estimates and a bias-calibrated form of the Chambers and Dunstan estimator of the population distribution function. This proposal leads to a bias-calibrated estimator of the population total which is an alternative to that of Chambers. We present a small simulation study to illustrate the utility of these estimators.     

Nonparametric Bayes estimation of gap-time distribution with recurrent event data

Nonparametric Bayes (NPB) estimation of the gap-time survivor function governing the time to occurrence of a recurrent event in the presence of censoring is considered. In our Bayesian approach, the gap-time distribution, denoted by F, has a Dirichlet process prior with parameter α. We derive NPB and nonparametric empirical Bayes (NPEB) estimators of the survivor function F?=1?F and construct point-wise credible intervals. The resulting Bayes estimator of F? extends that based on single-event right-censored data, and the PL-type estimator is a limiting case of this Bayes estimator. Through simulation studies, we demonstrate that the PL-type estimator has smaller biases but higher root-mean-squared errors (RMSEs) than those of the NPB and the NPEB estimators. Even in the case of a mis-specified prior measure parameter α, the NPB and the NPEB estimators have smaller RMSEs than the PL-type estimator, indicating robustness of the NPB and NPEB estimators. In addition, the NPB and NPEB estimators are smoother (in some sense) than the PL-type estimator.     

Nonparametric curve estimation with missing data: A general empirical process approach

A general nonparametric imputation procedure, based on kernel regression, is proposed to estimate points as well as set- and function-indexed parameters when the data are missing at random (MAR). The proposed method works by imputing a specific function of a missing value (and not the missing value itself), where the form of this specific function is dictated by the parameter of interest. Both single and multiple imputations are considered. The associated empirical processes provide the right tool to study the uniform convergence properties of the resulting estimators. Our estimators include, as special cases, the imputation estimator of the mean, the estimator of the distribution function proposed by Cheng and Chu [1996. Kernel estimation of distribution functions and quantiles with missing data. Statist. Sinica 6, 63–78], imputation estimators of a marginal density, and imputation estimators of regression functions.     

Optimum design-based ratio estimators of the distribution function

The ratio method is commonly used to the estimation of means and totals. This method was extended to the problem of estimating the distribution function. An alternative ratio estimator of the distribution function is defined. A result that compares the variances of the aforementioned ratio estimators is used to define optimum design-based ratio estimators of the distribution function. Different empirical results indicate that the optimum ratio estimators can be more efficient than alternative ratio estimators. In addition, we show by simulations that alternative ratio estimators can have large biases, whereas biases of the optimum ratio estimators are negligible in this situation.     

Second-order properties of intraclass correlation estimators for a symmetric normal distribution

Consider the problem of estimating the intraclass correlation coefficient of a symmetric normal distribution under the squared error loss function. The general admissibility of the standard estimators of the intraclass correlation coefficient is hard to check due to their complicated sampling distributions. We follow the asymptotic decision-theoretic approach of Ghosh and Sinha (1981) and prove that the three standard intraclass correlation estimators (the maximum-likelihood estimator, the method-of-moments estimator and the first-order unbiased estimator) are second-order admissible for all p ≥ 2, p being the dimension of the distribution.     

Ranked set sample inference under a symmetry restriction

This paper considers statistical inference for a ranked set sample under a symmetry restriction on the underlying distribution. We present new estimators for the distribution function and the center of symmetry. It is shown that these estimators outperform their competitors in the literature. Based on the proposed distribution function estimator, a Kolmogorov–Smirnov type test is developed and the construction of a confidence interval is discussed.     

Local Estimation of the Second-Order Parameter in Extreme Value Statistics and Local Unbiased Estimation of the Tail Index

We develop and study in the framework of Pareto-type distributions a class of nonparametric kernel estimators for the conditional second order tail parameter. The estimators are obtained by local estimation of the conditional second order parameter using a moving window approach. Asymptotic normality of the proposed class of kernel estimators is proven under some suitable conditions on the kernel function and the conditional tail quantile function. The nonparametric estimators for the second order parameter are subsequently used to obtain a class of bias-corrected kernel estimators for the conditional tail index. In particular it is shown how for a given kernel function one obtains a bias-corrected kernel function, and that replacing the second order parameter in the latter with a consistent estimator does not change the limiting distribution of the bias-corrected estimator for the conditional tail index. The finite sample behavior of some specific estimators is illustrated with a simulation experiment. The developed methodology is also illustrated on fire insurance claim data.     

Efficient estimation of the PDF and the CDF of the inverse Rayleigh distribution

In this paper, we consider the estimation of the probability density function and the cumulative distribution function of the inverse Rayleigh distribution. In this regard, the following estimators are considered: uniformly minimum variance unbiased estimator, maximum likelihood (ML) estimator, percentile estimator, least squares estimator and weighted least squares estimator. To do so, analytical expressions are derived for the mean integrated squared error. As the result of simulation studies and real data applications indicate, when the sample size is not very small the ML estimator performs better than the others.     

Quantile regression in functional linear semiparametric model

This paper proposes nonparametric estimation methods for functional linear semiparametric quantile regression, where the conditional quantile of the scalar responses is modelled by both scalar and functional covariates and an additional unknown nonparametric function term. The slope function is estimated using the functional principal component basis and the nonparametric function is approximated by a piecewise polynomial function. The asymptotic distribution of the estimators of slope parameters is derived and the global convergence rate of the quantile estimator of unknown slope function is established under suitable norm. The asymptotic distribution of the estimator of the unknown nonparametric function is also established. Simulation studies are conducted to investigate the finite-sample performance of the proposed estimators. The proposed methodology is demonstrated by analysing a real data from ADHD-200 sample.     

Extended linear empirical bayes estimation

In this paper, the linear empirical Bayes estimation method, which is based on approximation of the Bayes estimator by a linear function, is generalized to an extended linear empirical Bayes estimation technique which represents the Bayes estimator by a series of algebraic polynomials. The extended linear empirical Bayes estimators are elaborated in the case of a location or a scale parameter. The theory is illustrated by examples of its application to the normal distribution with a location parameter and the gamma distribution with a scale parameter. The linear and the extended linear empirical Bayes estimators are constructed in these two cases and, then, studied numerically via Monte Carlo simulations. The simulations show that the extended linear empirical Bayes estimators have better convergence rates than the traditional linear empirical Bayes estimators.     

ON THE USE OF THE EMPIRICAL DISTRIBUTION AND CHARACTERISTIC FUNCTION TO ESTIMATE PARAMETERS OF REGULAR VARIATION

In this paper we present two new classes of estimators of parameters of regular variation, one based on the empirical distribution function and the other on the empirical characteristic function. They achieve the same rates of mean square error convergence as the estimators proposed by Hall (1982). The estimator based on the empirical characteristic function, unlike the other estimators, utilises the whole sample and not just a few extreme order statistics.     

A Pointwise Estimator for the k-Fold Convolution of a Distribution Function

ABSTRACT

This article is concerned with some parametric and nonparametric estimators for the k-fold convolution of a distribution function. An alternative estimator is proposed and its unbiasedness, asymptotic unbiasedness, and consistency properties are investigated. The asymptotic normality of this estimator is established. Some applications of the estimator are given in renewal processes. Finally, the computational procedures are described and the relative performance of these estimators for small sample sizes is investigated by a simulation study.