Empirical Likelihood for Censored Linear Regression

In this paper we investigate the empirical likelihood method in a linear regression model when the observations are subject to random censoring. An empirical likelihood ratio for the slope parameter vector is defined and it is shown that its limiting distribution is a weighted sum of independent chi-square distributions. This reduces to the empirical likelihood to the linear regression model first studied by Owen (1991) if there is no censoring present. Some simulation studies are presented to compare the empirical likelihood method with the normal approximation based method proposed in Lai et al. (1995). It was found that the empirical likelihood method performs much better than the normal approximation method.     

Empirical likelihood for truncation parameter in random truncation model

In this paper we use the empirical likelihood method to construct confidence interval for truncation parameter in random truncation model. The empirical log-likelihood ratio is derived and its asymptotic distribution is shown to be a weighted chi-square. Simulation studies are used to compare the confidence intervals based on empirical likelihood and those based on normal approximation. It is found that the empirical likelihood method provides improved confidence interval.     

Empirical likelihood for linear regression models under imputation for missing responses

The authors study the empirical likelihood method for linear regression models. They show that when missing responses are imputed using least squares predictors, the empirical log‐likelihood ratio is asymptotically a weighted sum of chi‐square variables with unknown weights. They obtain an adjusted empirical log‐likelihood ratio which is asymptotically standard chi‐square and hence can be used to construct confidence regions. They also obtain a bootstrap empirical log‐likelihood ratio and use its distribution to approximate that of the empirical log‐likelihood ratio. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals, and perform better than a normal approximation based method.     

Penalized Empirical Likelihood via Bridge Estimator in Cox's Proportional Hazard Model

We propose the penalized empirical likelihood method via bridge estimator in Cox's proportional hazard model for parameter estimation and variable selection. Under reasonable conditions, we show that penalized empirical likelihood in Cox's proportional hazard model has oracle property. A penalized empirical likelihood ratio for the vector of regression coefficients is defined and its limiting distribution is a chi-square distributions. The advantage of penalized empirical likelihood as a nonparametric likelihood approach is illustrated in testing hypothesis and constructing confidence sets. The method is illustrated by extensive simulation studies and a real example.     

Empirical likelihood for the difference of quantiles under censorship

In this paper, we use a smoothed empirical likelihood method to investigate the difference of quantiles under censorship. An empirical log-likelihood ratio is derived and its asymptotic distribution is shown to be chi-squared. Approximate confidence regions based on this method are constructed. Simulation studies are used to compare the empirical likelihood and the normal approximation method in terms of its coverage accuracy. It is found that the empirical likelihood method provides a much better performance. The research is supported by NSFC (10231030) and RFDP.     

Approximate jackknife empirical likelihood method for estimating equations

It is known that the profile empirical likelihood method based on estimating equations is computationally intensive when the number of nuisance parameters is large. Recently, Li, Peng, & Qi (2011) proposed a jackknife empirical likelihood method for constructing confidence regions for the parameters of interest by estimating the nuisance parameters separately. However, when the estimators for the nuisance parameters have no explicit formula, the computation of the jackknife empirical likelihood method is still intensive. In this paper, an approximate jackknife empirical likelihood method is proposed to reduce the computation in the jackknife empirical likelihood method when the nuisance parameters cannot be estimated explicitly. A simulation study confirms the advantage of the new method. The Canadian Journal of Statistics 40: 110–123; 2012 © 2012 Statistical Society of Canada     

Empirical likelihood-based inference for parameter and nonparametric function in partially nonlinear models

This paper is concerned with statistical inference for partially nonlinear models. Empirical likelihood method for parameter in nonlinear function and nonparametric function is investigated. The empirical log-likelihood ratios are shown to be asymptotically chi-square and then the corresponding confidence intervals are constructed. By the empirical likelihood ratio functions, we also obtain the maximum empirical likelihood estimators of the parameter in nonlinear function and nonparametric function, and prove the asymptotic normality. A simulation study indicates that, compared with normal approximation-based method and the bootstrap method, the empirical likelihood method performs better in terms of coverage probabilities and average length/widths of confidence intervals/bands. An application to a real dataset is illustrated.     

Jackknife Empirical Likelihood for the Accelerated Failure Time Model with Censored Data

Kendall and Gehan estimating functions are commonly used to estimate the regression parameter in accelerated failure time model with censored observations in survival analysis. In this paper, we apply the jackknife empirical likelihood method to overcome the computation difficulty about interval estimation. A Wilks’ theorem of jackknife empirical likelihood for U-statistic type estimating equations is established, which is used to construct the confidence intervals for the regression parameter. We carry out an extensive simulation study to compare the Wald-type procedure, the empirical likelihood method, and the jackknife empirical likelihood method. The proposed jackknife empirical likelihood method has a better performance than the existing methods. We also use a real data set to compare the proposed methods.     

Empirical Likelihood Ratio Test for a Change-Point in Linear Regression Model

A nonparametric method based on the empirical likelihood is proposed to detect the change-point in the coefficient of linear regression models. The empirical likelihood ratio test statistic is proved to have the same asymptotic null distribution as that with classical parametric likelihood. Under some mild conditions, the maximum empirical likelihood change-point estimator is also shown to be consistent. The simulation results show the sensitivity and robustness of the proposed approach. The method is applied to some real datasets to illustrate the effectiveness.     

Semiparametric inference with a functional-form empirical likelihood

A functional-form empirical likelihood method is proposed as an alternative method to the empirical likelihood method. The proposed method has the same asymptotic properties as the empirical likelihood method but has more flexibility in choosing the weight construction. Because it enjoys the likelihood-based interpretation, the profile likelihood ratio test can easily be constructed with a chi-square limiting distribution. Some computational details are also discussed, and results from finite-sample simulation studies are presented.     

Two-sample empirical likelihood method for difference between coefficients in linear regression model

The empirical likelihood method is proposed to construct the confidence regions for the difference in value between coefficients of two-sample linear regression model. Unlike existing empirical likelihood procedures for one-sample linear regression models, as the empirical likelihood ratio function is not concave, the usual maximum empirical likelihood estimation cannot be obtained directly. To overcome this problem, we propose to incorporate a natural and well-explained restriction into likelihood function and obtain a restricted empirical likelihood ratio statistic (RELR). It is shown that RELR has an asymptotic chi-squared distribution. Furthermore, to improve the coverage accuracy of the confidence regions, a Bartlett correction is applied. The effectiveness of the proposed approach is demonstrated by a simulation study.     

Empirical Likelihood Based Synthetic Data Method for Censored Regression Analysis

In this article, we propose a new empirical likelihood method for linear regression analysis with a right censored response variable. The method is based on the synthetic data approach for censored linear regression analysis. A log-empirical likelihood ratio test statistic for the entire regression coefficients vector is developed and we show that it converges to a standard chi-squared distribution. The proposed method can also be used to make inferences about linear combinations of the regression coefficients. Moreover, the proposed empirical likelihood ratio provides a way to combine different normal equations derived from various synthetic response variables. Maximizing this empirical likelihood ratio yields a maximum empirical likelihood estimator which is asymptotically equivalent to the solution of the estimating equation that are optimal linear combination of the original normal equations. It improves the estimation efficiency. The method is illustrated by some Monte Carlo simulation studies as well as a real example.     

Reduce computation in profile empirical likelihood method

Since its introduction by Owen (1988, 1990), the empirical likelihood method has been extensively investigated and widely used to construct confidence regions and to test hypotheses in the literature. For a large class of statistics that can be obtained via solving estimating equations, the empirical likelihood function can be formulated from these estimating equations as proposed by Qin and Lawless (1994). If only a small part of parameters is of interest, a profile empirical likelihood method has to be employed to construct confidence regions, which could be computationally costly. In this article the authors propose a jackknife empirical likelihood method to overcome this computational burden. This proposed method is easy to implement and works well in practice. The Canadian Journal of Statistics 39: 370–384; 2011 © 2011 Statistical Society of Canada     

Empirical Likelihood Local Polynomial Regression Analysis of Clustered Data

Abstract. In this article, a naive empirical likelihood ratio is constructed for a non‐parametric regression model with clustered data, by combining the empirical likelihood method and local polynomial fitting. The maximum empirical likelihood estimates for the regression functions and their derivatives are obtained. The asymptotic distributions for the proposed ratio and estimators are established. A bias‐corrected empirical likelihood approach to inference for the parameters of interest is developed, and the residual‐adjusted empirical log‐likelihood ratio is shown to be asymptotically chi‐squared. These results can be used to construct a class of approximate pointwise confidence intervals and simultaneous bands for the regression functions and their derivatives. Owing to our bias correction for the empirical likelihood ratio, the accuracy of the obtained confidence region is not only improved, but also a data‐driven algorithm can be used for selecting an optimal bandwidth to estimate the regression functions and their derivatives. A simulation study is conducted to compare the empirical likelihood method with the normal approximation‐based method in terms of coverage accuracies and average widths of the confidence intervals/bands. An application of this method is illustrated using a real data set.     

Empirical Likelihood for the Additive Hazards Model with Current Status Data

We investigate empirical likelihood for the additive hazards model with current status data. An empirical log-likelihood ratio for a vector or subvector of regression parameters is defined and its limiting distribution is shown to be a standard chi-squared distribution. The proposed inference procedure enables us to make empirical likelihood-based inference for the regression parameters. Finite sample performance of the proposed method is assessed in simulation studies to compare with that of a normal approximation method, it shows that the empirical likelihood method provides more accurate inference than the normal approximation method. A real data example is used for illustration.     

Weighted empirical likelihood for generalized linear models with longitudinal data

In this paper, we introduce the empirical likelihood (EL) method to longitudinal studies. By considering the dependence within subjects in the auxiliary random vectors, we propose a new weighted empirical likelihood (WEL) inference for generalized linear models with longitudinal data. We show that the weighted empirical likelihood ratio always follows an asymptotically standard chi-squared distribution no matter which working weight matrix that we have chosen, but a well chosen working weight matrix can improve the efficiency of statistical inference. Simulations are conducted to demonstrate the accuracy and efficiency of our proposed WEL method, and a real data set is used to illustrate the proposed method.     

Empirical likelihood inference for parameters in a partially linear errors-in-variables model

In this paper, we consider the application of the empirical likelihood method to a partially linear model with measurement errors in the non-parametric part. It is shown that the empirical log-likelihood ratio at the true parameters converges to the standard chi-square distribution. Furthermore, we obtain the maximum empirical likelihood estimate of the unknown parameter by using the empirical log-likelihood ratio function, and the resulting estimator is shown to be asymptotically normal. Some simulations and an application are conducted to illustrate the proposed method.     

EMPIRICAL LIKELIHOOD METHODS FOR THE GINI INDEX

The Gini index and its generalizations have been used extensively for measuring inequality and poverty in the social sciences. Recently, interval estimation based on nonparametric statistics has been proposed in the literature, for example the naive bootstrap method, the iterated bootstrap method and the bootstrap method via a pivotal statistic. In this paper, we propose empirical likelihood methods to construct confidence intervals for the Gini index or the difference of two Gini indices. Simulation studies show that the proposed empirical likelihood method performs slightly worse than the bootstrap method based on a pivotal statistic in terms of coverage accuracy, but it requires less computation. However, the bootstrap calibration of the empirical likelihood method performs better than the bootstrap method based on a pivotal statistic.     

Instrumental variable-based empirical likelihood inferences for varying-coefficient models with error-prone covariates

This paper presents the empirical likelihood inferences for a class of varying-coefficient models with error-prone covariates. We focus on the case that the covariance matrix of the measurement errors is unknown and neither repeated measurements nor validation data are available. We propose an instrumental variable-based empirical likelihood inference method and show that the proposed empirical log-likelihood ratio is asymptotically chi-squared. Then, the confidence intervals for the varying-coefficient functions are constructed. Some simulation studies and a real data application are used to assess the finite sample performance of the proposed empirical likelihood procedure.     

Empirical likelihood inference for semiparametric model with linear process errors

The purpose of this article is to use the empirical likelihood method to study the confidence regions construction for the parameters of interest in semiparametric model with linear process errors under martingale difference. It is shown that the adjusted empirical log-likelihood ratio at the true parameters is asymptotically chi-squared. A simulation study indicates that the adjusted empirical likelihood works better than a normal approximation-based approach.