Empirical likelihood confidence regions for comparison distributions and roc curves

Abstract: The authors derive empirical likelihood confidence regions for the comparison distribution of two populations whose distributions are to be tested for equality using random samples. Another application they consider is to ROC curves, which are used to compare measurements of a diagnostic test from two populations. The authors investigate the smoothed empirical likelihood method for estimation in this context, and empirical likelihood based confidence intervals are obtained by means of the Wilks theorem. A bootstrap approach allows for the construction of confidence bands. The method is illustrated with data analysis and a simulation study.     

Empirical Likelihood Local Polynomial Regression Analysis of Clustered Data

Abstract. In this article, a naive empirical likelihood ratio is constructed for a non‐parametric regression model with clustered data, by combining the empirical likelihood method and local polynomial fitting. The maximum empirical likelihood estimates for the regression functions and their derivatives are obtained. The asymptotic distributions for the proposed ratio and estimators are established. A bias‐corrected empirical likelihood approach to inference for the parameters of interest is developed, and the residual‐adjusted empirical log‐likelihood ratio is shown to be asymptotically chi‐squared. These results can be used to construct a class of approximate pointwise confidence intervals and simultaneous bands for the regression functions and their derivatives. Owing to our bias correction for the empirical likelihood ratio, the accuracy of the obtained confidence region is not only improved, but also a data‐driven algorithm can be used for selecting an optimal bandwidth to estimate the regression functions and their derivatives. A simulation study is conducted to compare the empirical likelihood method with the normal approximation‐based method in terms of coverage accuracies and average widths of the confidence intervals/bands. An application of this method is illustrated using a real data set.     

Robust confidence regions for the semi-parametric regression model with responses missing at random

In this paper, a regression semi-parametric model is considered where responses are assumed to be missing at random. From the empirical likelihood function defined based on the rank-based estimating equation, robust confidence intervals/regions of the true regression coefficient are derived. Monte Carlo simulation experiments show that the proposed approach provides more accurate confidence intervals/regions compared to its normal approximation counterpart under different model error structure. The approach is also compared with the least squares approach, and its superiority is shown whenever the error distribution in the simulation study is heavy tailed or contaminated. Finally, a real data example is given to illustrate our proposed method.     

Empirical likelihood ratio confidence intervals in terms of cumulative hazard function for left-truncated and right-censored data

Abstract

Based on the approach of Pan and Zhou, we demonstrate that empirical likelihood ratios in terms of cumulative hazard function for left-truncated and right-censored (LTRC) data can be used to form confidence intervals for the parameters that are linear functionals of the cumulative hazard function. Simulation studies indicate that the empirical likelihood ratio based confidence intervals work well in finite samples.     

CONFIDENCE INTERVALS FOR THE DIFFERENCE BETWEEN TWO PARTIAL AUCS

As new diagnostic tests are developed and marketed, it is very important to be able to compare the accuracy of a given two continuous‐scale diagnostic tests. An effective method to evaluate the difference between the diagnostic accuracy of two tests is to compare partial areas under the receiver operating characteristic curves (AUCs). In this paper, we review existing parametric methods. Then, we propose a new semiparametric method and a new nonparametric method to investigate the difference between two partial AUCs. For the difference between two partial AUCs under each method, we derive a normal approximation, define an empirical log‐likelihood ratio, and show that the empirical log‐likelihood ratio follows a scaled chi‐square distribution. We construct five confidence intervals for the difference based on normal approximation, bootstrap, and empirical likelihood methods. Finally, extensive simulation studies are conducted to compare the finite‐sample performances of these intervals, and a real example is used as an application of our recommended intervals. The simulation results indicate that the proposed hybrid bootstrap and empirical likelihood intervals outperform other existing intervals in most cases.     

Bootstrap confidence intervals for smoothing splines and their comparison to bayesian confidence intervals

We construct bootstrap confidence intervals for smoothing spline estimates based on Gaussian data, and penalized likelihood smoothing spline estimates based on data from .exponential families. Several vari- ations of bootstrap confidence intervals are considered and compared. We find that the commonly used ootstrap percentile intervals are inferior to the T intervals and to intervals based on bootstrap estimation of mean squared errors. The best variations of the bootstrap confidence intervals behave similar to the well known Bayesian confidence intervals. These bootstrap confidence intervals have an average coverage probability across the function being estimated, as opposed to a pointwise property.     

Adjusted empirical likelihood for right censored lifetime data

Adjusted empirical likelihood (AEL) is a method to improve the performance of the empirical likelihood (EL) particularly in the construction of the confidence interval based on completely observed data. In this paper, we extend AEL approach to the analysis of right censored data by adopting an influence function method. The main results include that the adjusted log-likelihood ratio is asymptotically Chi-squared distributed. Simulation results indicate that the proposed AEL-based confidence intervals perform better compared with normality-based or EL-based confidence intervals specifically for small sample size within the right-censoring setting. The proposed method is illustrated by analysis of survival time of patients after operation for spinal tumors.     

Statistical analysis of competing risks model from Marshall–Olkin extended Chen distribution under adaptive progressively interval censoring with random removals

In this paper, a new censoring scheme named by adaptive progressively interval censoring scheme is introduced. The competing risks data come from Marshall–Olkin extended Chen distribution under the new censoring scheme with random removals. We obtain the maximum likelihood estimators of the unknown parameters and the reliability function by using the EM algorithm based on the failure data. In addition, the bootstrap percentile confidence intervals and bootstrap-t confidence intervals of the unknown parameters are obtained. To test the equality of the competing risks model, the likelihood ratio tests are performed. Then, Monte Carlo simulation is conducted to evaluate the performance of the estimators under different sample sizes and removal schemes. Finally, a real data set is analyzed for illustration purpose.     

Confidence Intervals for the Current Status Model

We discuss a new way of constructing pointwise confidence intervals for the distribution function in the current status model. The confidence intervals are based on the smoothed maximum likelihood estimator, using local smooth functional theory and normal limit distributions. Bootstrap methods for constructing these intervals are considered. Other methods to construct confidence intervals, using the non‐standard limit distribution of the (restricted) maximum likelihood estimator, are compared with our approach via simulations and real data applications.     

Empirical Likelihood Inference for the Cox Model with Time-dependent Coefficients via Local Partial Likelihood

Abstract.  The Cox model with time-dependent coefficients has been studied by a number of authors recently. In this paper, we develop empirical likelihood (EL) pointwise confidence regions for the time-dependent regression coefficients via local partial likelihood smoothing. The EL simultaneous confidence bands for a linear combination of the coefficients are also derived based on the strong approximation methods. The EL ratio is formulated through the local partial log-likelihood for the regression coefficient functions. Our numerical studies indicate that the EL pointwise/simultaneous confidence regions/bands have satisfactory finite sample performances. Compared with the confidence regions derived directly based on the asymptotic normal distribution of the local constant estimator, the EL confidence regions are overall tighter and can better capture the curvature of the underlying regression coefficient functions. Two data sets, the gastric cancer data and the Mayo Clinic primary biliary cirrhosis data, are analysed using the proposed method.     

EMPIRICAL EVIDENCE FOR ADAPTIVE CONFIDENCE INTERVALS AND IDENTIFICATION OF OUTLDSRS USING METHODS OF TRIMMING

In an attempt to apply robust procedures, conventional t-tables are used to approximate critical values of a Studentized t-statistic which is formed from the ratio of a trimmed mean to the square root of a suitably normed Winsorized sum of squared deviations. It is shown here that the approximation is poor if the proportion of trimming is chosen to depend on the data. Instead a data dependent alternative is given which uses adaptive trimming proportions and confidence intervals based on trimmed likelihood statistics. Resulting statistics have high efficiency at the normal model, proper coverage for confidence intervals, yet retain breakdown point one half. Average lengths of confidence intervals are competitive with those of recent Studentized confidence intervals based on the biweight over a range of underlying distributions. In addition, the adaptive trimming is used to identify potential outliers. Evidence in the form of simulations and data analysis support the new adaptive trimming approach.     

Instrumental variable-based empirical likelihood inferences for varying-coefficient models with error-prone covariates

This paper presents the empirical likelihood inferences for a class of varying-coefficient models with error-prone covariates. We focus on the case that the covariance matrix of the measurement errors is unknown and neither repeated measurements nor validation data are available. We propose an instrumental variable-based empirical likelihood inference method and show that the proposed empirical log-likelihood ratio is asymptotically chi-squared. Then, the confidence intervals for the varying-coefficient functions are constructed. Some simulation studies and a real data application are used to assess the finite sample performance of the proposed empirical likelihood procedure.     

Generalized empirical likelihood inference in partial linear regression model for longitudinal data

In this paper, empirical likelihood inference for longitudinal data within the framework of partial linear regression models are investigated. The proposed procedures take into consideration the correlation within groups without involving direct estimation of nuisance parameters in the correlation matrix. The empirical likelihood method is used to estimate the regression coefficients and the baseline function, and to construct confidence intervals. A nonparametric version of Wilk's theorem for the limiting distribution of the empirical likelihood ratio is derived. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. The finite sample behaviour of the proposed method is evaluated with simulation and illustrated with an AIDS clinical trial data set.     

Empirical Likelihood for Nonparametric Components in Additive Partially Linear Models

Empirical likelihood-based inference for the nonparametric components in additive partially linear models is investigated. An empirical likelihood approach to construct the confidence intervals of the nonparametric components is proposed when the linear covariate is measured with and without errors. We show that the proposed empirical log-likelihood ratio is asymptotically standard chi-squared without requiring the undersmoothing of the nonparametric components. Then, it can be directly used to construct the confidence intervals for the nonparametric functions. A simulation study indicates that, compared with a normal approximation-based approach, the proposed method works better in terms of coverage probabilities and widths of the pointwise confidence intervals.     

Comparison of conditional and unconditional confidence intervals for the double exponential distribution

Conditional confidence intervals for the location parameter of the double exponential distribution based on maximum likelihood estimators conditioned on a set of ancillary statistics and the corresponding unconditional confidence intervals based on the maximum likelihood estimators alone are compared in two ways. Monte Carlo techniques are used and the conditional approach appears to give slightly better results although agreement as n becomes larger is noted     

Inference on P(Y < X) in Bivariate Rayleigh Distribution

This paper deals with the estimation of reliability R = P(Y < X) when X is a random strength of a component subjected to a random stress Y, and (X, Y) follows a bivariate Rayleigh distribution. The maximum likelihood estimator of R and its asymptotic distribution are obtained. An asymptotic confidence interval of R is constructed using the asymptotic distribution. Also, two confidence intervals are proposed based on Bootstrap method and a computational approach. Testing of the reliability based on asymptotic distribution of R is discussed. Simulation study to investigate performance of the confidence intervals and tests has been carried out. Also, a numerical example is given to illustrate the proposed approaches.     

Empirical likelihood inference for a common mean in the presence of heteroscedasticity

The authors develop empirical likelihood (EL) based methods of inference for a common mean using data from several independent but nonhomogeneous populations. For point estimation, they propose a maximum empirical likelihood (MEL) estimator and show that it is n‐consistent and asymptotically optimal. For confidence intervals, they consider two EL based methods and show that both intervals have approximately correct coverage probabilities under large samples. Finite‐sample performances of the MEL estimator and the EL based confidence intervals are evaluated through a simulation study. The results indicate that overall the MEL estimator and the weighted EL confidence interval are superior alternatives to the existing methods.     

Likelihood‐based Inference with Missing Data Under Missing‐at‐Random

Likelihood‐based inference with missing data is challenging because the observed log likelihood is often an (intractable) integration over the missing data distribution, which also depends on the unknown parameter. Approximating the integral by Monte Carlo sampling does not necessarily lead to a valid likelihood over the entire parameter space because the Monte Carlo samples are generated from a distribution with a fixed parameter value. We consider approximating the observed log likelihood based on importance sampling. In the proposed method, the dependency of the integral on the parameter is properly reflected through fractional weights. We discuss constructing a confidence interval using the profile likelihood ratio test. A Newton–Raphson algorithm is employed to find the interval end points. Two limited simulation studies show the advantage of the Wilks inference over the Wald inference in terms of power, parameter space conformity and computational efficiency. A real data example on salamander mating shows that our method also works well with high‐dimensional missing data.     

Empirical likelihood-based inference for parameter and nonparametric function in partially nonlinear models

This paper is concerned with statistical inference for partially nonlinear models. Empirical likelihood method for parameter in nonlinear function and nonparametric function is investigated. The empirical log-likelihood ratios are shown to be asymptotically chi-square and then the corresponding confidence intervals are constructed. By the empirical likelihood ratio functions, we also obtain the maximum empirical likelihood estimators of the parameter in nonlinear function and nonparametric function, and prove the asymptotic normality. A simulation study indicates that, compared with normal approximation-based method and the bootstrap method, the empirical likelihood method performs better in terms of coverage probabilities and average length/widths of confidence intervals/bands. An application to a real dataset is illustrated.     

Simultaneous Small Sample Inference for Linear Combinations of Generalized Linear Model Parameters

A method is proposed to construct simultaneous confidence intervals for multiple linear combinations of generalized linear model parameters, that uses a multivariate normal- or t-distribution together with the signed likelihood root statistic. In an application to a case study simultaneous confidence bands for logistic regression are calculated. A simulation study based on the example evaluation suggests superior performance compared to the common Wald-type approaches. The proposed methods are readily implemented in the R extension package mcprofile.