Empirical likelihood for linear regression models under imputation for missing responses

The authors study the empirical likelihood method for linear regression models. They show that when missing responses are imputed using least squares predictors, the empirical log‐likelihood ratio is asymptotically a weighted sum of chi‐square variables with unknown weights. They obtain an adjusted empirical log‐likelihood ratio which is asymptotically standard chi‐square and hence can be used to construct confidence regions. They also obtain a bootstrap empirical log‐likelihood ratio and use its distribution to approximate that of the empirical log‐likelihood ratio. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals, and perform better than a normal approximation based method.     

Empirical Likelihood for Censored Linear Regression and Variable Selection

The linear regression model for right censored data, also known as the accelerated failure time model using the logarithm of survival time as the response variable, is a useful alternative to the Cox proportional hazards model. Empirical likelihood as a non‐parametric approach has been demonstrated to have many desirable merits thanks to its robustness against model misspecification. However, the linear regression model with right censored data cannot directly benefit from the empirical likelihood for inferences mainly because of dependent elements in estimating equations of the conventional approach. In this paper, we propose an empirical likelihood approach with a new estimating equation for linear regression with right censored data. A nested coordinate algorithm with majorization is used for solving the optimization problems with non‐differentiable objective function. We show that the Wilks' theorem holds for the new empirical likelihood. We also consider the variable selection problem with empirical likelihood when the number of predictors can be large. Because the new estimating equation is non‐differentiable, a quadratic approximation is applied to study the asymptotic properties of penalized empirical likelihood. We prove the oracle properties and evaluate the properties with simulated data. We apply our method to a Surveillance, Epidemiology, and End Results small intestine cancer dataset.     

Empirical likelihood ratio under infinite second moment

In this article, we show that the log empirical likelihood ratio statistic for the population mean converges in distribution to χ²₍₁₎ as n → ∞ when the population is in the domain of attraction of normal law but has infinite variance. The simulation results show that the empirical likelihood ratio method is applicable under the infinite second moment condition.     

Empirical likelihood dimension reduction inference for partially non-linear error-in-responses models with validation data

ABSTRACT

In this article, partially non linear models when the response variable is measured with error and explanatory variables are measured exactly are considered. Without specifying any error structure equation, a semiparametric dimension reduction technique is employed. Two estimators of unknown parameter in non linear function are obtained and asymptotic normality is proved. In addition, empirical likelihood method for parameter vector is provided. It is shown that the estimated empirical log-likelihood ratio has asymptotic Chi-square distribution. A simulation study indicates that, compared with normal approximation method, empirical likelihood method performs better in terms of coverage probabilities and average length of the confidence intervals.     

Empirical Likelihood for First-order Autoregressive Error-in-variable of Models With Validation Data

In this article, we consider the empirical likelihood for the autoregressive error-in-explanatory variable models. With the help of validation, we first develop an empirical likelihood ratio test statistic for the parameters of interest, and prove that its asymptotic distribution is that of a weighted sum of independent standard χ²₁ random variables with unknown weights. Also, we propose an adjusted empirical likelihood and prove that its asymptotic distribution is a standard χ². Furthermore, an empirical likelihood-based confidence region is given. Simulation results indicate that the proposed method works well for practical situations.     

A NEW CALIBRATION METHOD OF CONSTRUCTING EMPIRICAL LIKELIHOOD-BASED CONFIDENCE INTERVALS FOR THE TAIL INDEX

Empirical likelihood has attracted much attention in the literature as a nonparametric method. A recent paper by Lu & Peng (2002) [Likelihood based confidence intervals for the tail index. Extremes 5, 337–352] applied this method to construct a confidence interval for the tail index of a heavy‐tailed distribution. It turns out that the empirical likelihood method, as well as other likelihood‐based methods, performs better than the normal approximation method in terms of coverage probability. However, when the sample size is small, the confidence interval computed using the χ² approximation has a serious undercoverage problem. Motivated by Tsao (2004) [A new method of calibration for the empirical loglikelihood ratio. Statist. Probab. Lett. 68, 305–314], this paper proposes a new method of calibration, which corrects the undercoverage problem.     

Modified likelihood ratio statistics for inflated beta regressions

The class of inflated beta regression models generalizes that of beta regressions [S.L.P. Ferrari and F. Cribari-Neto, Beta regression for modelling rates and proportions, J. Appl. Stat. 31 (2004), pp. 799–815] by incorporating a discrete component that allows practitioners to model data on rates and proportions with observations that equal an interval limit. For instance, one can model responses that assume values in (0, 1]. The likelihood ratio test tends to be quite oversized (liberal, anticonservative) in inflated beta regressions estimated with a small number of observations. Indeed, our numerical results show that its null rejection rate can be almost twice the nominal level. It is thus important to develop alternative testing strategies. This paper develops small-sample adjustments to the likelihood ratio and signed likelihood ratio test statistics in inflated beta regression models. The adjustments do not require orthogonality between the parameters of interest and the nuisance parameters and are fairly simple since they only require first- and second-order log-likelihood cumulants. Simulation results show that the modified likelihood ratio tests deliver much accurate inference in small samples. An empirical application is presented and discussed.     

Parameter Estimation for the Discrete Stable Family

The discrete stable family constitutes an interesting two-parameter model of distributions on the non-negative integers with a Paretian tail. The practical use of the discrete stable distribution is inhibited by the lack of an explicit expression for its probability function. Moreover, the distribution does not possess moments of any order. Therefore, the usual tools—such as the maximum-likelihood method or even the moment method—are not feasible for parameter estimation. However, the probability generating function of the discrete stable distribution is available in a simple form. Hence, we initially explore the application of some existing estimation procedures based on the empirical probability generating function. Subsequently, we propose a new estimation method by minimizing a suitable weighted L ²-distance between the empirical and the theoretical probability generating functions. In addition, we provide a goodness-of-fit statistic based on the same distance.     

Empirical Likelihood Inferences for Semiparametric Varying-Coefficient Partially Linear Models with Longitudinal Data

In this article, empirical likelihood inferences for semiparametric varying-coefficient partially linear models with longitudinal data are investigated. We propose a groupwise empirical likelihood procedure to handle the inter-series dependence of the longitudinal data. By using residual-adjustment, an empirical likelihood ratio function for the nonparametric component is constructed, and a nonparametric version Wilks' phenomenons is proved. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. A simulation study is undertaken to assess the finite sample performance of the proposed confidence regions.     

EMPIRICAL LIKELIHOOD‐BASED INFERENCES FOR PARTIALLY LINEAR MODELS WITH MISSING COVARIATES

This paper considers statistical inference for partially linear models Y = X ^? β +ν(Z) +? when the linear covariate X is missing with missing probability π depending upon (Y, Z). We propose empirical likelihood‐based statistics to construct confidence regions for β and ν(z). The resulting empirical likelihood ratio statistics are shown to be asymptotically chi‐squared‐distributed. The finite‐sample performance of the proposed statistics is assessed by simulation experiments. The proposed methods are applied to a dataset from an AIDS clinical trial.     

Approximate jackknife empirical likelihood method for estimating equations

It is known that the profile empirical likelihood method based on estimating equations is computationally intensive when the number of nuisance parameters is large. Recently, Li, Peng, & Qi (2011) proposed a jackknife empirical likelihood method for constructing confidence regions for the parameters of interest by estimating the nuisance parameters separately. However, when the estimators for the nuisance parameters have no explicit formula, the computation of the jackknife empirical likelihood method is still intensive. In this paper, an approximate jackknife empirical likelihood method is proposed to reduce the computation in the jackknife empirical likelihood method when the nuisance parameters cannot be estimated explicitly. A simulation study confirms the advantage of the new method. The Canadian Journal of Statistics 40: 110–123; 2012 © 2012 Statistical Society of Canada     

Regularized proportional odds models

The proportional odds model (POM) is commonly used in regression analysis to predict the outcome for an ordinal response variable. The maximum likelihood estimation (MLE) approach is typically used to obtain the parameter estimates. The likelihood estimates do not exist when the number of parameters, p, is greater than the number of observations n. The MLE also does not exist if there are no overlapping observations in the data. In a situation where the number of parameters is less than the sample size but p is approaching to n, the likelihood estimates may not exist, and if they exist they may have quite large standard errors. An estimation method is proposed to address the last two issues, i.e. complete separation and the case when p approaches n, but not the case when p>n. The proposed method does not use any penalty term but uses pseudo-observations to regularize the observed responses by downgrading their effect so that they become close to the underlying probabilities. The estimates can be computed easily with all commonly used statistical packages supporting the fitting of POMs with weights. Estimates are compared with MLE in a simulation study and an application to the real data.     

Adjusted empirical likelihood inference for additive hazards regression

ABSTRACT

This article develops an adjusted empirical likelihood (EL) method for the additive hazards model. The adjusted EL ratio is shown to have a central chi-squared limiting distribution under the null hypothesis. We also evaluate its asymptotic distribution as a non central chi-squared distribution under the local alternatives of order n^{? 1/2}, deriving the expression for the asymptotic power function. Simulation studies and a real example are conducted to evaluate the finite sample performance of the proposed method. Compared with the normal approximation-based method, the proposed method tends to have more larger empirical power and smaller confidence regions with comparable coverage probabilities.     

Non Null Asymptotic Distributions of Some Criteria in Censored Exponential Regression

In this article, we consider the class of censored exponential regression models which is very useful for modeling lifetime data. Under a sequence of Pitman alternatives, the asymptotic expansions up to order n^{? 1/2} of the non null distribution functions of the likelihood ratio, Wald, Rao score, and gradient statistics are derive in this class of models. The non null asymptotic distribution functions of these statistics are obtained for testing a composite null hypothesis in the presence of nuisance parameters. The power of all four tests, which are equivalent to first order, are compared based on these non null asymptotic expansions. Furthermore, in order to compare the finite-sample performance of these tests in this class of models, we consider Monte Carlo simulations. We also present an empirical application for illustrative purposes.     

Empirical likelihood inference for a semiparametric hazards regression model

ABSTRACT

We investigated the empirical likelihood inference approach under a general class of semiparametric hazards regression models with survival data subject to right-censoring. An empirical likelihood ratio for the full 2p regression parameters involved in the model is obtained. We showed that it converged weakly to a random variable which could be written as a weighted sum of 2p independent chi-squared variables with one degree of freedom. Using this, we could construct a confidence region for parameters. We also suggested an adjusted version for the preceding statistic, whose limit followed a standard chi-squared distribution with 2p degrees of freedom.     

Generalized empirical likelihood inference in partial linear regression model for longitudinal data

In this paper, empirical likelihood inference for longitudinal data within the framework of partial linear regression models are investigated. The proposed procedures take into consideration the correlation within groups without involving direct estimation of nuisance parameters in the correlation matrix. The empirical likelihood method is used to estimate the regression coefficients and the baseline function, and to construct confidence intervals. A nonparametric version of Wilk's theorem for the limiting distribution of the empirical likelihood ratio is derived. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. The finite sample behaviour of the proposed method is evaluated with simulation and illustrated with an AIDS clinical trial data set.     

Empirical likelihood for parameters in an additive partially linear errors-in-variables model with longitudinal data

Empirical likelihood inferences for the parameter component in an additive partially linear errors-in-variables model with longitudinal data are investigated in this article. A corrected-attenuation block empirical likelihood procedure is used to estimate the regression coefficients, a corrected-attenuation block empirical log-likelihood ratio statistic is suggested and its asymptotic distribution is obtained. Compared with the method based on normal approximations, our proposed method does not require any consistent estimator for the asymptotic variance and bias. Simulation studies indicate that our proposed method performs better than the method based on normal approximations in terms of relatively higher coverage probabilities and smaller confidence regions. Furthermore, an example of an air pollution and health data set is used to illustrate the performance of the proposed method.     

On Comparisons of Exact Powers of Bivariate GMANOVA Tests

Exact powers of four classical tests in a GMANOVA model are compared numerically when the order of the error sum of square matrix is 2. The four tests are likelihood ratio (=LR), Pillai's V, Hotelling's T ², and Roy's largest root tests. It turns out that for small sizes, there are a few cases in which Rothenberg's condition for the relative magnitude of asymptotic powers of three standard tests does not hold.     

On Nonsmooth Estimating Functions via Jackknife Empirical Likelihood

In many applications, the parameters of interest are estimated by solving non‐smooth estimating functions with U‐statistic structure. Because the asymptotic covariances matrix of the estimator generally involves the underlying density function, resampling methods are often used to bypass the difficulty of non‐parametric density estimation. Despite its simplicity, the resultant‐covariance matrix estimator depends on the nature of resampling, and the method can be time‐consuming when the number of replications is large. Furthermore, the inferences are based on the normal approximation that may not be accurate for practical sample sizes. In this paper, we propose a jackknife empirical likelihood‐based inferential procedure for non‐smooth estimating functions. Standard chi‐square distributions are used to calculate the p‐value and to construct confidence intervals. Extensive simulation studies and two real examples are provided to illustrate its practical utilities.     

Empirical likelihood ratio tests for the linear regression model with inequality constraints

Abstract

In this article, empirical likelihood is applied to the linear regression model with inequality constraints. We prove that asymptotic distribution of the adjusted empirical likelihood ratio test statistic is a weighted mixture of chi-square distribution.