A non-inferiority test for diagnostic accuracy in the absence of the golden standard test based on the paired partial areas under receiver operating characteristic curves

Non-inferiority tests are often measured for the diagnostic accuracy in medical research. The area under the receiver operating characteristic (ROC) curve is a familiar diagnostic measure for the overall diagnostic accuracy. Nevertheless, since it may not differentiate the diverse shapes of the ROC curves with different diagnostic significance, the partial area under the ROC (PAUROC) curve, another summary measure emerges for such diagnostic processes that require the false-positive rate to be in the clinically interested range. Traditionally, to estimate the PAUROC, the golden standard (GS) test on the true disease status is required. Nevertheless, the GS test may sometimes be infeasible. Besides, in a lot of research fields such as the epidemiology field, the true disease status of the patients may not be known or available. Under the normality assumption on diagnostic test results, based on the expectation-maximization algorithm in combination with the bootstrap method, we propose the heuristic method to construct a non-inferiority test for the difference in the paired PAUROCs without the GS test. Through the simulation study, although the proposed method might provide a liberal test, as a whole, the empirical size of the proposed method sufficiently controls the size at the significance level, and the empirical power of the proposed method in the absence of the GS is as good as that of the non-inferiority in the presence of the GS. The proposed method is illustrated with the published data.     

Modelling stochastic order in the analysis of receiver operating characteristic data: Bayesian non-parametric approaches

Summary.  The evaluation of the performance of a continuous diagnostic measure is a commonly encountered task in medical research. We develop Bayesian non-parametric models that use Dirichlet process mixtures and mixtures of Polya trees for the analysis of continuous serologic data. The modelling approach differs from traditional approaches to the analysis of receiver operating characteristic curve data in that it incorporates a stochastic ordering constraint for the distributions of serologic values for the infected and non-infected populations. Biologically such a constraint is virtually always feasible because serologic values from infected individuals tend to be higher than those for non-infected individuals. The models proposed provide data-driven inferences for the infected and non-infected population distributions, and for the receiver operating characteristic curve and corresponding area under the curve. We illustrate and compare the predictive performance of the Dirichlet process mixture and mixture of Polya trees approaches by using serologic data for Johne's disease in dairy cattle.     

Nonparametric estimation of the limiting availability

The point availability of a repairable system is the probability that the system is operating at a specified time. As time increases, the point availability converges to a positive constant called the limiting availability. Baxter and Li (1994a) developed a technique for constructing nonparametric confidence intervals for the point availability. However, nonparametric estimators of the limiting availability have not previously been studied in the literature. In this paper, we consider two separate cases: (1) the data are complete and (2) the data are subject to right censorship. For each case, a nonparametric confidence interval for the limiting availability is derived. Applications and simulation studies are presented.deceased after the paper was accepted     

Comparing Performance of Multiclass Classification Systems with ROC Manifolds: When Volume and Correct Classification Fails

Higher dimensional surfaces are used to examine the diagnostic performance of multiclass classification systems. These surfaces are extensions of the ROC curve and are known as ROC surfaces or manifolds. Manifolds may be constructed from either the correct classifications or from the misclassifications of the diagnostic system. Comparisons of the usefulness of each of these ROC manifolds with respect to the performance of the diagnostic system are made with emphasis on inferences from volume under the surface and optimal operating points (thresholds) of the system. Recommendations for when to use each type of ROC manifold and performance measure are discussed.     

Nonparametric estimation of the ROC curve for length-biased and right-censored data

Abstract

ROC curve is a fundamental evaluation tool in medical researches and survival analysis. The estimation of ROC curve has been studied extensively with complete data and right-censored survival data. However, these methods are not suitable to analyze the length-biased and right-censored data. Since this kind of data includes the auxiliary information that truncation time and residual time share the same distribution, the two new estimators for the ROC curve are proposed by taking into account this auxiliary information to improve estimation efficiency. Numerical simulation studies with different assumed cases and real data analysis are conducted.     

关于多个总体判别分析ROC曲面及其一些性质

为了把两个总体判别分析中的ROC曲线推广到了多个总体的情形,根据两个总体判断分析中的ROC曲线变换,得到了多个总体判别分析中的ROC曲面,并研究了其某些性质。     

Joint hypothesis testing of the area under the receiver operating characteristic curve and the Youden index

In the receiver operating characteristic (ROC) analysis, the area under the ROC curve (AUC ) serves as an overall measure of diagnostic accuracy. Another popular ROC index is the Youden index (J ), which corresponds to the maximum sum of sensitivity and specificity minus one. Since the AUC and J describe different aspects of diagnostic performance, we propose to test if a biomarker beats the pre-specified targeting values of AUC₀ and J₀ simultaneously with H₀ : AUC ≤ AUC₀ or J ≤ J₀ against H_a : AUC > AUC₀ and J > J₀ . This is a multivariate order restrictive hypothesis with a non-convex space in H_a , and traditional likelihood ratio-based tests cannot apply. The intersection–union test (IUT) and the joint test are proposed for such test. While the IUT test independently tests for the AUC and the Youden index, the joint test is constructed based on the joint confidence region. Findings from the simulation suggest both tests yield similar power estimates. We also illustrated the tests using a real data example and the results of both tests are consistent. In conclusion, testing jointly on AUC and J gives more reliable results than using a single index, and the IUT is easy to apply and have similar power as the joint test.     

Nonparametrio bayes and empirical bayes estimation of the residual survival function at age t

Nonparametric Bayes and empirical Bayes estimations of the

survival function of a unit of age t (> 0) using Dirichlet

process prior are presented. The proposed empirical Bayes

estimators are found to be “asymptotically optimal” in the sense of Robbins (1955). The performances of the proposed

empirical Bayes estimators are compared with those of certain

rival estimators in terms of relative savings loss, The exact

expressions for Bayes risks are also provided in certain cases.     

Criteria for reporting noncompartmental estimates of half‐life and area under the curve extrapolated to infinity

Various criteria have been proposed for determining the reliability of noncompartmental pharmacokinetic estimates of the terminal disposition phase half‐life (t_1/2) and the extrapolated area under the curve (AUC_extrap). This simulation study assessed the performance of two frequently used reportability rules: the terminal disposition phase regression adjusted‐r² classification rule and the regression data point time span classification rule. Using simulated data, these rules were assessed in relation to the magnitude of the variability in the terminal disposition phase slope, the length of the terminal disposition phase captured in the concentration‐time profile (data span), the number of data points present in the terminal disposition phase, and the type and level of variability in concentration measurement. The accuracy of estimating t_1/2 was satisfactory for data spans of 1.5 and longer, given low measurement variability; and for spans of 2.5 and longer, given high measurement variability. Satisfactory accuracy in estimating AUC_extrap was only achieved with low measurement variability and spans of 2.5 and longer. Neither of the classification rules improved the identification of accurate t_1/2 and AUC_extrap estimates. Based on the findings of this study, a strategy is proposed for determining the reportability of estimates of t_1/2 and area under the curve extrapolated to infinity.     

Likelihood and bayesian approaches to inference for the stationary point of a quadratic response surface

In response surface analysis, a second order polynomial model is often used for inference on the stationary point of the response function. The standard confidence regions for the stationary point are due to Box & Hunter (1954). The authors propose an alternative parametrization, in which the stationary point is the parameter of interest; likelihood techniques and Bayesian analysis are then easier to perform. The authors also suggest an approximate method to get highest posterior density regions for the maximum point (not simply for the stationary point). Furthermore, they study the coverage probabilities of these Bayesian regions through simulations.     

A glimpse of the impact of pál erd#ous on probability and statistics

The title of this article notwithstanding, it is the author's aspiration here to provide a bit more than merely a glimpse of some of Erdõs's contributions per se to probability‐statistics. He hopes to have succeeded in providing a guided tour of, and whenever it has appeared feasible, an introduction to, a few selected areas that have been strongly influenced by the work of Erdõs. The author also hopes to have succeeded in facilitating a glimpse of the impact of these contributions by presenting them in their historical context.