Empirical likelihood for single index model with missing covariates at random

In this paper, we investigate the empirical-likelihood-based inference for the construction of confidence intervals and regions of the parameters of interest in single index models with missing covariates at random. An augmented inverse probability weighted-type empirical likelihood ratio for the parameters of interest is defined such that this ratio is asymptotically standard chi-squared. Our approach is to directly calibrate the empirical log-likelihood ratio, and does not need multiplication by an adjustment factor for the original ratio. Our bias-corrected empirical likelihood is self-scale invariant and no plug-in estimator for the limiting variance is needed. Some simulation studies are carried out to assess the performance of our proposed method.     

Empirical likelihood for a partially linear model with covariate data missing at random

In this paper, we consider the partial linear model with the covariables missing at random. Empirical likelihood ratios for the regression coefficients and the baseline function are investigated, the empirical log-likelihood ratios are proven to be asymptotically chi-squared and the corresponding confidence regions for the parameters of interest are then constructed. The finite sample behavior of the proposed method is evaluated with simulation and illustrated with an AIDS clinical trial dataset.     

Maximum likelihood estimation for a nearly random walk model

This paper proposes an effective reparameterization method for the maximum likelihood estimation of a nearly random walk ARIMA (1,1,1) model, an important case where standard method of locating the MLE is not satisfactory. This model is equivalent to the permanent and temporary components model that Fama &French (1988) and others used to capture the slow mean reversion behavior of stock prices. The reparameterization method we prppose for estimating the nearly cancelled AR and MA parameters performs satisfactorily. The exact likelihood function based on the transformed parameters is studied. We argue that the region of interest will get magnified and emphasized in the transformed space, thus making the search for MLE more thorough and effective. Substantiai simuiation evidences are provided to demonstrate the effectiveness of the method. The sample size requirement is critical and is discussed in details. For application, this method is applied to estimate a nearly random walk ARIMA (1,1,1) model for NYSE/AMEX value-weighted market return in daily and longer holding-period horizons.     

Empirical likelihood inference for a semiparametric hazards regression model

ABSTRACT

We investigated the empirical likelihood inference approach under a general class of semiparametric hazards regression models with survival data subject to right-censoring. An empirical likelihood ratio for the full 2p regression parameters involved in the model is obtained. We showed that it converged weakly to a random variable which could be written as a weighted sum of 2p independent chi-squared variables with one degree of freedom. Using this, we could construct a confidence region for parameters. We also suggested an adjusted version for the preceding statistic, whose limit followed a standard chi-squared distribution with 2p degrees of freedom.     

Maximum likelihood estimator in a multi-phase random regression model

We consider a random regression model with several-fold change-points. The results for one change-point are generalized. The maximum likelihood estimator of the parameters is shown to be consistent, and the asymptotic distribution for the estimators of the coefficients is shown to be Gaussian. The estimators of the change-points converge, with n ^?1 rate, to the vector whose components are the left end points of the maximizing interval with respect to each change-point. The likelihood process is asymptotically equivalent to the sum of independent compound Poisson processes.     

Empirical likelihood inference for parameters in a partially linear errors-in-variables model

In this paper, we consider the application of the empirical likelihood method to a partially linear model with measurement errors in the non-parametric part. It is shown that the empirical log-likelihood ratio at the true parameters converges to the standard chi-square distribution. Furthermore, we obtain the maximum empirical likelihood estimate of the unknown parameter by using the empirical log-likelihood ratio function, and the resulting estimator is shown to be asymptotically normal. Some simulations and an application are conducted to illustrate the proposed method.     

Empirical likelihood inference for semiparametric model with linear process errors

The purpose of this article is to use the empirical likelihood method to study the confidence regions construction for the parameters of interest in semiparametric model with linear process errors under martingale difference. It is shown that the adjusted empirical log-likelihood ratio at the true parameters is asymptotically chi-squared. A simulation study indicates that the adjusted empirical likelihood works better than a normal approximation-based approach.     

Empirical likelihood in a regression model with noised variables

This paper is concerned with a recently developed regression model with noised variables in which the means of the response and some covariable components are nonparametric functions of an auxiliary variable. Previous results have shown that the de-noised estimators of the parameters of interest are asymptotically normal when undersmoothing is applied. But undersmoothing causes difficulties in bandwidth selection. To avoid this problem, we propose an empirical log-likelihood ratio for the regression coefficients and derive a nonparametric version of Wilk's theorem. The confidence region based on the empirical likelihood has three advantages compared with those based on asymptotic normality: (1) It does not have the predetermined symmetry, which enables it to better reflect the true shape of the underlying distribution; (2) it does not involve any asymptotic covariance matrix estimation and hence is robust against the heteroscedasticity; and (3) it avoids undersmoothing the regressor functions so that optimal bandwidth can be used. A small simulation is conducted to compare the finite sample performances of these two methods. An example of application on a set of advertising data is also illustrated.     

Empirical likelihood for high-dimensional partially linear model with martingale difference errors

In this paper, we focus on the empirical likelihood (EL) inference for high-dimensional partially linear model with martingale difference errors. An empirical log-likelihood ratio statistic of unknown parameter is constructed and is shown to have asymptotically normality distribution under some suitable conditions. This result is different from those derived before. Furthermore, an empirical log-likelihood ratio for a linear combination of unknown parameter is also proposed and its asymptotic distribution is chi-squared. Based on these results, the confidence regions both for unknown parameter and a linear combination of parameter can be obtained. A simulation study is carried out to show that our proposed approach performs better than normal approximation-based method.     

Empirical likelihood inference for partial functional linear model with missing responses

In this paper, we consider the empirical likelihood inferences of the partial functional linear model with missing responses. Two empirical log-likelihood ratios of the parameters of interest are constructed, and the corresponding maximum empirical likelihood estimators of parameters are derived. Under some regularity conditions, we show that the proposed two empirical log-likelihood ratios are asymptotic standard Chi-squared. Thus, the asymptotic results can be used to construct the confidence intervals/regions for the parameters of interest. We also establish the asymptotic distribution theory of corresponding maximum empirical likelihood estimators. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals. An example of real data is also used to illustrate our proposed methods.     

Empirical likelihood based detection procedure for change point in mean residual life functions under random censorship

The mean residual life (MRL) function is one of the basic parameters of interest in survival analysis that describes the expected remaining time of an individual after a certain age. The study of changes in the MRL function is practical and interesting because it may help us to identify some factors such as age and gender that may influence the remaining lifetimes of patients after receiving a certain surgery. In this paper, we propose a detection procedure based on the empirical likelihood for the changes in MRL functions with right censored data. Two real examples are also given: Veterans' administration lung cancer study and Stanford heart transplant to illustrate the detecting procedure. Copyright © 2016 John Wiley & Sons, Ltd.     

Empirical likelihood for the response mean of generalized linear models with missing at random responses

In this article, we present a new empirical likelihood ratio for constructing the confidence interval of the response mean of generalized linear models with missing at random responses. Compared with the existing methods, the proposal can avoid the so-called “curse of dimensionality” problem when the dimension of covariates is high, and is still chi-squared distributed asymptotically, nevertheless. Simulation studies are also provided to illustrate the performance of the developed method.     

Empirical likelihood confidence intervals under imputation for missing survey data from stratified simple random sampling

Missing observations due to non‐response are commonly encountered in data collected from sample surveys. The focus of this article is on item non‐response which is often handled by filling in (or imputing) missing values using the observed responses (donors). Random imputation (single or fractional) is used within homogeneous imputation classes that are formed on the basis of categorical auxiliary variables observed on all the sampled units. A uniform response rate within classes is assumed, but that rate is allowed to vary across classes. We construct confidence intervals (CIs) for a population parameter that is defined as the solution to a smooth estimating equation with data collected using stratified simple random sampling. The imputation classes are assumed to be formed across strata. Fractional imputation with a fixed number of random draws is used to obtain an imputed estimating function. An empirical likelihood inference method under the fractional imputation is proposed and its asymptotic properties are derived. Two asymptotically correct bootstrap methods are developed for constructing the desired CIs. In a simulation study, the proposed bootstrap methods are shown to outperform traditional bootstrap methods and some non‐bootstrap competitors under various simulation settings. The Canadian Journal of Statistics 47: 281–301; 2019 © 2019 Statistical Society of Canada     

Maximum likelihood estimation in the proportional hazards model of random censorship

The maximum likelihood estimator (MLE) for the survival function S_Tunder the proportional hazards model of censorship is derived and shown to differ from the Abdushukurov-Cheng-Lin estimator when the class of allowable distributions includes all continuous and discrete distributions. The estimators are compared via an example. The MLE is calculated using a Newton-Raphson iterative procedure and implemented via a FORTRAN algorithm.     

Empirical likelihood ratio tests for the linear regression model with inequality constraints

Abstract

In this article, empirical likelihood is applied to the linear regression model with inequality constraints. We prove that asymptotic distribution of the adjusted empirical likelihood ratio test statistic is a weighted mixture of chi-square distribution.     

Empirical likelihood for density-weighted average derivatives

In this paper, we investigate empirical likelihood (EL) inference for density-weighted average derivatives in nonparametric multiple regression models. A simply adjusted empirical log-likelihood ratio for the vector of density-weighted average derivatives is defined and its limiting distribution is shown to be a standard Chi-square distribution. To increase the accuracy and coverage probability of confidence regions, an EL inference procedure for the rescaled parameter vector is proposed by using a linear instrumental variables regression. The new method shares the same properties of the regular EL method with i.i.d. samples. For example, estimation of limiting variances and covariances is not needed. A Monte Carlo simulation study is presented to compare the new method with the normal approximation method and an existing EL method.     

Empirical likelihood confidence regions in the single-index model with growing dimensions

This paper investigates statistical inference for the single-index model when the number of predictors grows with sample size. Empirical likelihood method for constructing confidence region for the index vector, which does not require a multivariate non parametric smoothing, is employed. However, the classical empirical likelihood ratio for this model does not remain valid because plug-in estimation of an infinite-dimensional nuisance parameter causes a non negligible bias and the diverging number of parameters/predictors makes the limit not chi-squared any more. To solve these problems, we define an empirical likelihood ratio based on newly proposed weighted estimating equations and show that it is asymptotically normal. Also we find that different weights used in the weighted residuals require, for asymptotic normality, different diverging rate of the number of predictors. However, the rate n^1/3, which is a possible fastest rate when there are no any other conditions assumed in the setting under study, is still attainable. A simulation study is carried out to assess the performance of our method.