Jackknife empirical likelihood-based inferences for Lorenz curve with kernel smoothing

The Lorenz curve describes the wealth proportion for an income-ordered population. In this paper, we introduce a kernel smoothing estimator for the Lorenz curve and propose a smoothed jackknife empirical likelihood method for constructing confidence intervals of Lorenz ordinates. Extensive simulation studies are conducted to evaluate finite sample performances of the proposed methods. A real dataset of Georgia professor’s income is used to illustrate the proposed methods.     

An alternative method for global and partial comparison of two diagnostic systems based on ROC curves

In this paper, an alternative method for the comparison of two diagnostic systems based on receiver operating characteristic (ROC) curves is presented. ROC curve analysis is often used as a statistical tool for the evaluation of diagnostic systems. However, in general, the comparison of ROC curves is not straightforward, in particular, when they cross each other. A similar difficulty is also observed in the multi-objective optimization field where sets of solutions defining fronts must be compared with a multi-dimensional space. Thus, the proposed methodology is based on a procedure used to compare the performance of distinct multi-objective optimization algorithms. In general, methods based on the area under the ROC curves are not sensitive to the existence of crossing points between the curves. The new approach can deal with this situation and also allows the comparison of partial portions of ROC curves according to particular values of sensitivity and specificity of practical interest. Simulations results are presented. For illustration purposes, considering real data from newborns with very low birthweight, the new method was applied in order to discriminate the better index for evaluating the risk of death.     

Nonparametric estimation of the ROC curve for length-biased and right-censored data

Abstract

ROC curve is a fundamental evaluation tool in medical researches and survival analysis. The estimation of ROC curve has been studied extensively with complete data and right-censored survival data. However, these methods are not suitable to analyze the length-biased and right-censored data. Since this kind of data includes the auxiliary information that truncation time and residual time share the same distribution, the two new estimators for the ROC curve are proposed by taking into account this auxiliary information to improve estimation efficiency. Numerical simulation studies with different assumed cases and real data analysis are conducted.     

Consistency of non parametric estimators of the area under the ROC curve

ABSTRACT

The area under the receiver operating characteristic (ROC) curve is a popular summary index that measures the accuracy of a continuous-scale diagnostic test to measure its accuracy. Under certain conditions on estimators of distribution functions, we prove a theorem on strong consistency of the non parametric “plugin” estimators of the area under the ROC curve. Based on this theorem, we construct some new “plugin” consistent estimators. The performance of the non parametric estimators considered is illustrated numerically and the estimators are compared in terms of bias, variance, and mean square error.     

Distribution estimation with auxiliary information for missing data

There is much literature on statistical inference for distribution under missing data, but surprisingly very little previous attention has been paid to missing data in the context of estimating distribution with auxiliary information. In this article, the auxiliary information with missing data is proposed. We use Zhou, Wan and Wang's method (2008) to mitigate the effects of missing data through a reformulation of the estimating equations, imputed through a semi-parametric procedure. Whence we can estimate distribution and the τth quantile of the distribution by taking auxiliary information into account. Asymptotic properties of the distribution estimator and corresponding sample quantile are derived and analyzed. The distribution estimators based on our method are found to significantly outperform the corresponding estimators without auxiliary information. Some simulation studies are conducted to illustrate the finite sample performance of the proposed estimators.     

Local influence on bandwidth estimation for kernel smoothing

This paper examines the problem of assessing local influence on the optimal bandwidth estimation in kernel smoothing based on cross validation. The bandwidth for kernel smoothing plays an important role in the model fitting and is often estimated using the cross-validation criterion. Following the argument of the second-order approach to local influence suggested by Wu and Luo (1993), we develop a new diagnostic statistic to examine the local influence of the observations on the estimation of the optimal bandwidth, where the perturbation may belong to one of three schemes. These are the response perturbation, the perturbation in the explanatory variable, and the case-weight

perturbation. The proposed diagnostic is nonparametric and is capable of identifying influential observations with strong influence on the bandwidth estimation. An example is presented to illustrate the application of the proposed diagnostic, and the usefulness of the nonparametric approach is illustrated in comparison with some other approaches to the assessment of local influence     

A wide review on exponentiality tests and two competitive proposals with application on reliability

In this paper, two new statistics based on comparison of the theoretical and empirical distribution functions are proposed to test exponentiality. Critical values are determined by means of Monte Carlo simulations for various sample sizes and different significance levels. Through an extensive simulation study, 50 selected exponentiality tests are studied for a wide collection of alternative distributions. From the empirical power study, it is concluded that, firstly, one of our proposals is preferable for IFR (increasing failure rate) and UFR (unimodal failure rate) alternatives, whereas the other one is preferable for DFR (decreasing failure rate) and BFR (bathtub failure rate) alternatives and, secondly, the new tests can be considered serious and powerful competitors to other existing proposals, since they have the same (or higher) level of performance than the best tests in the statistical literature.     

Optimal nonparametric estimator of the area under ROC curve based on clustered data

Abstract

In diagnostic trials, clustered data are obtained when several subunits of the same patient are observed. Intracluster correlations need to be taken into account when analyzing such clustered data. A nonparametric method has been proposed by Obuchowski (1997 Obuchowski, N. A. 1997. Nonparametric analysis of clustered ROC curve data. Biometrics 53 (2):567–78.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to estimate the Receiver Operating Characteristic curve area (AUC) for such clustered data. However, Obuchowski’s estimator is not efficient as it gives equal weight to all pairwise rankings within and between cluster. In this paper, we propose a more efficient nonparametric AUC estimator with two sets of optimal weights. Simulation results show that the loss of efficiency of Obuchowski’s estimator for a single AUC or the AUC difference can be substantial when there is a moderate intracluster test correlation and the cluster size is large. The efficiency gain of our weighted AUC estimator for a single AUC or the AUC difference is further illustrated using the data from a study of screening tests for neonatal hearing.     

Semi-parametric estimation of ROC curves based on binomial regression modelling

This paper presents a method of estimating a receiver operating characteristic (ROC) curve when the underlying diagnostic variable X is continuous and fully observed. The new method is based on modelling the probability of response given X , rather than the distribution of X given response. The method offers advantages in modelling flexibility and computational simplicity. The resulting ROC curve estimates are semi-parametric and can, in principle, take an infinite variety of shapes. Moreover, model selection can be based on standard methods within the binomial regression framework. Statistical accuracy of the curve estimate is provided by a simply implemented bootstrap approach.     

Bayesian shrinkage estimation based on Rayleigh type-II censored data

In this paper, we construct a Bayes shrinkage estimator for the Rayleigh scale parameter based on censored data under the squared log error loss function. Risk-unbiased estimator is derived and its risk is computed. A Bayes shrinkage estimator is obtained when a prior point guess value is available for the scale parameter. Risk-bias of the Bayes shrinkage estimator is considered. A comparison between the proposed Bayes shrinkage estimator and the risk-unbiased estimator is provided using calculation of the relative efficiency. A numerical example is presented for illustrative and comparative purposes.     

An empirical saddlepoint approximation based method for smoothing survival functions under right censoring

The Kaplan–Meier (KM) estimator is ubiquitously used for estimating survival functions, but it provides only a discrete approximation at the observation times and does not deliver a proper distribution if the largest observation is censored. Using KM as a starting point, we devise an empirical saddlepoint approximation‐based method for producing a smooth survival function that is unencumbered by choice of tuning parameters. The procedure inverts the moment generating function (MGF) defined through a Riemann–Stieltjes integral with respect to an underlying mixed probability measure consisting of the discrete KM mass function weights and an absolutely continuous exponential right‐tail completion. Uniform consistency, and weak and strong convergence results are established for the resulting MGF and its derivatives, thus validating their usage as inputs into the saddlepoint routines. Relevant asymptotic results are also derived for the density and distribution function estimates. The performance of the resulting survival approximations is examined in simulation studies, which demonstrate a favourable comparison with the log spline method (Kooperberg & Stone, 1992) in small sample settings. For smoothing survival functions we argue that the methodology has no immediate competitors in its class, and we illustrate its application on several real data sets. The Canadian Journal of Statistics 47: 238–261; 2019 © 2019 Statistical Society of Canada     

Maximum likelihood vs. maximum goodness of fit estimation of the three-parameter Weibull distribution

The use of statistics based on the empirical distribution function is analysed for estimation of the scale, shape, and location parameters of the three-parameter Weibull distribution. The resulting maximum goodness of fit (MGF) estimators are compared with their maximum likelihood counterparts. In addition to the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling statistics, some related empirical distribution function statistics using different weight functions are considered. The results show that the MGF estimators of the scale and shape parameters are usually more efficient than the maximum likelihood estimators when the shape parameter is smaller than 2, particularly if the sample size is large.     

A simple formula based on quantiles for the moments of beta generalized distributions

In this article, we derive explicit expansions for the moments of beta generalized distributions from power series expansions for the quantile functions of the baseline distributions. We apply our formula to the beta normal, beta Student t, beta gamma and beta beta generalized distributions. We propose a simple way to express the quantile function of any beta generalized distribution as a power series expansion with known coefficients.     

Confidence intervals for nonparametric quantile regression: an emphasis on smoothing splines approach

In this paper we consider the problem of constructing confidence intervals for nonparametric quantile regression with an emphasis on smoothing splines. The mean‐based approaches for smoothing splines of Wahba (1983) and Nychka (1988) may not be efficient for constructing confidence intervals for the underlying function when the observed data are non‐Gaussian distributed, for instance if they are skewed or heavy‐tailed. This paper proposes a method of constructing confidence intervals for the unknown τth quantile function (0<τ<1) based on smoothing splines. In this paper we investigate the extent to which the proposed estimator provides the desired coverage probability. In addition, an improvement based on a local smoothing parameter that provides more uniform pointwise coverage is developed. The results from numerical studies including a simulation study and real data analysis demonstrate the promising empirical properties of the proposed approach.     

Minimum disparity estimation based on combined disparities: Asymptotic results

The maximum likelihood estimator (MLE) is asymptotically efficient for most parametric models under standard regularity conditions, but it has very poor robustness properties. On the other hand some of the minimum disparity estimators like the minimum Hellinger distance estimator (MHDE) have strong robustness features but their small sample efficiency at the model turns out to be very poor compared to the MLE. Methods based on the minimization of some combined disparities can substantially improve their small sample performances without affecting their robustness properties (Park et al., 1995). All studies involving the combined disparity have so far been empirical, and there are no results on the asymptotic properties of these estimators. In view of the usefulness of these procedures this is a major gap in theory, which we try to fill through the present work. Some illustrations of the performance of the estimators and the corresponding tests are also provided.     

Testing the validity of the logistic model based on the empirical distribution function

The logistic distribution is one of the fundamental distribution and is widely used for describing model growth curves in survival analysis and biological studies. Applications of this distribution are presented in statistical literature. In this article, goodness of fit tests for the logistic distribution based on the empirical distribution function (EDF) are considered. In order to compute the test statistics, because the MLEs cannot be obtained explicitly, we use the approximate maximum likelihood estimates (AMLEs) suggested by Balakrishnan and Cohen (1990 Balakrishnan, N., Cohen, A. C. (1990). Order Statistics and Inference: Estimation Methods. Boston: Academic Press. [Google Scholar]), which are simple explicit estimators. Power comparisons of the considered tests are carried out via simulations. Finally, two illustrative examples are presented and analyzed.     

Bootstrap misspecification tests for ARCH based on the empirical process of squared residuals

We propose and study by means of simulations and graphical tools a class of goodness-of-fit tests for ARCH models. The tests are based on the empirical distribution function of squared residuals and smooth (parametric) bootstrap. We examine empirical size and power by means of a simulation study. While the tests have overall correct size, their power strongly depends on the type of alternative and is particularly high when the assumption of Gaussian innovations is violated. As an example, the tests are applied to returns on Foreign Exchange rates.     

A Class of Goodness-of-fit Tests Based on Transformation

There is an increasing number of goodness-of-fit tests whose test statistics measure deviations between the empirical characteristic function and an estimated characteristic function of the distribution in the null hypothesis. With the aim of overcoming certain computational difficulties with the calculation of some of these test statistics, a transformation of the data is considered. To apply such a transformation, the data are assumed to be continuous with arbitrary dimension, but we also provide a modification for discrete random vectors. Practical considerations leading to analytic formulas for the test statistics are studied, as well as theoretical properties such as the asymptotic null distribution, validity of the corresponding bootstrap approximation, and consistency of the test against fixed alternatives. Five applications are provided in order to illustrate the theory. These applications also include numerical comparison with other existing techniques for testing goodness-of-fit.     

Wavelet threshold based on Stein's unbiased risk estimators of restricted location parameter in multivariate normal

In this paper, the problem of estimating the mean vector under non-negative constraints on location vector of the multivariate normal distribution is investigated. The value of the wavelet threshold based on Stein''s unbiased risk estimators is calculated for the shrinkage estimator in restricted parameter space. We suppose that covariance matrix is unknown and we find the dominant class of shrinkage estimators under Balance loss function. The performance evaluation of the proposed class of estimators is checked through a simulation study by using risk and average mean square error values.