Generalized Empirical Likelihood Inference in Generalized Linear Models for Longitudinal Data

In this article, the generalized linear model for longitudinal data is studied. A generalized empirical likelihood method is proposed by combining generalized estimating equations and quadratic inference functions based on the working correlation matrix. It is proved that the proposed generalized empirical likelihood ratios are asymptotically chi-squared under some suitable conditions, and hence it can be used to construct the confidence regions of the parameters. In addition, the maximum empirical likelihood estimates of parameters are obtained, and their asymptotic normalities are proved. Some simulations are undertaken to compare the generalized empirical likelihood and normal approximation-based method in terms of coverage accuracies and average areas/lengths of confidence regions/intervals. An example of a real data is used for illustrating our methods.     

Empirical Likelihood for Generalized Partially Linear Single-index Models

Empirical-likelihood based inference for the parameters in a generalized partially linear single-index models (GPLSIM) is investigated. Based on the local linear estimators of the nonparametric parts of the GPLSIM, an estimated empirical likelihood-based statistic of the parametric components is proposed. We show that the resulting statistic is asymptotically standard chi-squared distributed, the confidence regions for the parametric components are constructed. Some simulations are conducted to illustrate the proposed method.     

Sieve Empirical Likelihood and Extensions of the Generalized Least Squares

The empirical likelihood cannot be used directly sometimes when an infinite dimensional parameter of interest is involved. To overcome this difficulty, the sieve empirical likelihoods are introduced in this paper. Based on the sieve empirical likelihoods, a unified procedure is developed for estimation of constrained parametric or non-parametric regression models with unspecified error distributions. It shows some interesting connections with certain extensions of the generalized least squares approach. A general asymptotic theory is provided. In the parametric regression setting it is shown that under certain regularity conditions the proposed estimators are asymptotically efficient even if the restriction functions are discontinuous. In the non-parametric regression setting the convergence rate of the maximum estimator based on the sieve empirical likelihood is given. In both settings, it is shown that the estimator is adaptive for the inhomogeneity of conditional error distributions with respect to predictor, especially for heteroscedasticity.     

Combining least-squares and quantile regressions

Least-squares and quantile regressions are method of moments techniques that are typically used in isolation. A leading example where efficiency may be gained by combining least-squares and quantile regressions is one where some information on the error quantiles is available but the error distribution cannot be fully specified. This estimation problem may be cast in terms of solving an over-determined estimating equation (EE) system for which the generalized method of moments (GMM) and empirical likelihood (EL) are approaches of recognized importance. The major difficulty with implementing these techniques here is that the EEs associated with the quantiles are non-differentiable. In this paper, we develop a kernel-based smoothing technique for non-smooth EEs, and derive the asymptotic properties of the GMM and maximum smoothed EL (MSEL) estimators based on the smoothed EEs. Via a simulation study, we investigate the finite sample properties of the GMM and MSEL estimators that combine least-squares and quantile moment relationships. Applications to real datasets are also considered.     

Empirical Likelihood Method for Censored Median Regression Models

Based on the semiparametric median regression analysis for the right-censored data developed by Ying et al. (1995 Ying , Z. , Jung , S. H. , Wei , L. J. ( 1995 ). Survival analysis with median regression models . J. Amer. Statist. Assoc. 90 : 178 – 184 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), an empirical likelihood based inferential procedure for the regression coefficients is proposed. The limiting distribution of the proposed log-empirical likelihood ratio test statistic follows a chi-squared distribution, which corresponds to the standard asymptotic results of the empirical likelihood method. The inference about the subsets of the entire regression coefficients vector is discussed. The proposed method is illustrated by some simulation studies.     

Empirical Likelihood Method for General Additive-Multiplicative Hazard Models

An empirical likelihood-based inferential procedure is developed for a class of general additive-multiplicative hazard models. The proposed log-empirical likelihood ratio test statistic for the parameter vector is shown to have a chi-squared limiting distribution. The result can be used to make inference about the entire parameter vector as well as any linear combination of it. The asymptotic power of the proposed test statistic under contiguous alternatives is discussed. The method is illustrated by extensive simulation studies and a real example.     

Empirical Likelihood for Nonparametric Components in Additive Partially Linear Models

Empirical likelihood-based inference for the nonparametric components in additive partially linear models is investigated. An empirical likelihood approach to construct the confidence intervals of the nonparametric components is proposed when the linear covariate is measured with and without errors. We show that the proposed empirical log-likelihood ratio is asymptotically standard chi-squared without requiring the undersmoothing of the nonparametric components. Then, it can be directly used to construct the confidence intervals for the nonparametric functions. A simulation study indicates that, compared with a normal approximation-based approach, the proposed method works better in terms of coverage probabilities and widths of the pointwise confidence intervals.     

An Empirical Likelihood Ratio Test for Normality

The empirical likelihood ratio (ELR) test for the problem of testing for normality is derived in this article. The sampling properties of the ELR test and four other commonly used tests are provided and analyzed using the Monte Carlo simulation technique. The power comparisons against a wide range of alternative distributions show that the ELR test is the most powerful of these tests in certain situations.     

Empirical Likelihood Based Rank Regression Inference

Rank regression procedures have been proposed and studied for numerous research applications that do not satisfy the underlying assumptions of the more common linear regression models. This article develops confidence regions for the slope parameter of rank regression using an empirical likelihood (EL) ratio method. It has the advantage of not requiring variance estimation which is required for the normal approximation method. The EL method is also range respecting and results in asymmetric confidence intervals. Simulation studies are used to compare and evaluate normal approximation versus EL inference methods for various conditions such as different sample size or error distribution. The simulation study demonstrates our proposed EL method almost outperforms the traditional method in terms of coverage probability, lower-tail side error, and upper-tail side error. An application of stability analysis also shows the EL method results in shorter confidence intervals for real life data.     

Testing Homogeneity of Inverse Gaussian Scale Parameters Based on Generalized Likelihood Ratio

This article presents a new procedure for testing homogeneity of scale parameters from k independent inverse Gaussian populations. Based on the idea of generalized likelihood ratio method, a new generalized p-value is derived. Some simulation results are presented to compare the performance of the proposed method and existing methods. Numerical results show that the proposed test has good size and power performance.     

Empirical Likelihood for Threshold Autoregressive Models

This article develops empirical likelihood for threshold autoregressive models. We propose general estimating equations based on moment constraint. Under some suitable conditions, we show the empirical likelihood estimators for parameter are asymptotically normally distributed, and the proposed log empirical likelihood ratio statistic asymptotically follows a standard chi-squared distribution.     

Empirical Likelihood Based Synthetic Data Method for Censored Regression Analysis

In this article, we propose a new empirical likelihood method for linear regression analysis with a right censored response variable. The method is based on the synthetic data approach for censored linear regression analysis. A log-empirical likelihood ratio test statistic for the entire regression coefficients vector is developed and we show that it converges to a standard chi-squared distribution. The proposed method can also be used to make inferences about linear combinations of the regression coefficients. Moreover, the proposed empirical likelihood ratio provides a way to combine different normal equations derived from various synthetic response variables. Maximizing this empirical likelihood ratio yields a maximum empirical likelihood estimator which is asymptotically equivalent to the solution of the estimating equation that are optimal linear combination of the original normal equations. It improves the estimation efficiency. The method is illustrated by some Monte Carlo simulation studies as well as a real example.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

ABSTRACT

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

Minimum Contrast Empirical Likelihood Inference of Discontinuity in Density*

Abstract

This article investigates the asymptotic properties of a simple empirical-likelihood-based inference method for discontinuity in density. The parameter of interest is a function of two one-sided limits of the probability density function at (possibly) two cut-off points. Our approach is based on the first-order conditions from a minimum contrast problem. We investigate both first-order and second-order properties of the proposed method. We characterize the leading coverage error of our inference method and propose a coverage-error-optimal (CE-optimal, hereafter) bandwidth selector. We show that the empirical likelihood ratio statistic is Bartlett correctable. An important special case is the manipulation testing problem in a regression discontinuity design (RDD), where the parameter of interest is the density difference at a known threshold. In RDD, the continuity of the density of the assignment variable at the threshold is considered as a “no-manipulation” behavioral assumption, which is a testable implication of an identifying condition for the local average treatment effect. When specialized to the manipulation testing problem, the CE-optimal bandwidth selector has an explicit form. We propose a data-driven CE-optimal bandwidth selector for use in practice. Results from Monte Carlo simulations are presented. Usefulness of our method is illustrated by an empirical example.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

Empirical Likelihood Inference for Population Quantiles with Unbalanced Ranked Set Samples

We consider nonparametric interval estimation for the population quantiles based on unbalanced ranked set samples. We derived the large sample distribution of the empirical log likelihood ratio statistic for the quantiles. Approximate intervals for quantiles are obtained by inverting the likelihood ratio statistic. The performance of the empirical likelihood interval is investigated and compared with the performance of the intervals based on the ranked set sample order statistics.     

Empirical Likelihood for Linear Models Under Linear Process Errors

In this article, we study the construction of confidence intervals for regression parameters in a linear model under linear process errors by using the blockwise technique. It is shown that the blockwise empirical likelihood (EL) ratio statistic is asymptotically χ²-type distributed. The result is used to obtain EL based confidence regions for regression parameters. The finite-sample performance of the method is evaluated through a simulation study.     

An Empirical Likelihood Estimate of the Finite Population Correlation Coefficient

In this article, the problem of the estimation of finite population correlation coefficient is considered using the empirical likelihood method. A new estimator that makes the use of both the known mean and variance of an auxiliary variable is proposed. The percent relative bias and percent relative efficiency of the proposed new estimator with respect to the usual estimator of the correlation coefficient is investigated through extensive simulation study for values of the correlation coefficient from ?0.90 to +0.90. The proposed estimator is found to perform better than the simple correlation coefficient from both the bias and relative efficiency points of views, for the population, considered in the investigation. At the end, the proposed estimator has been extended to complex survey designs. Supplementary materials for this article are available online.     

Empirical Likelihood for a Heteroscedastic Partial Linear Errors-in-Variables Model

The purpose of this article is to use the empirical likelihood method to study construction of the confidence region for the parameter of interest in heteroscedastic partially linear errors-in-variables model with martingale difference errors. When the variance functions of the errors are known or unknown, we propose the empirical log-likelihood ratio statistics for the parameter of interest. For each case, a nonparametric version of Wilks’ theorem is derived. The results are then used to construct confidence regions of the parameter. A simulation study is carried out to assess the performance of the empirical likelihood method.     

Empirical Likelihood-based Inference for Stationary-ergodicity of the Generalized Random Coefficient Autoregressive Model

In this article, we consider the application of the empirical likelihood method to the generalized random coefficient autoregressive (GRCA) model. When the order of the model is 1, we derive an empirical likelihood ratio test statistic to test the stationary-ergodicity. Some simulation studies are also conducted to investigate the finite sample performances of the proposed test.