Empirical Likelihood Local Polynomial Regression Analysis of Clustered Data

Abstract. In this article, a naive empirical likelihood ratio is constructed for a non‐parametric regression model with clustered data, by combining the empirical likelihood method and local polynomial fitting. The maximum empirical likelihood estimates for the regression functions and their derivatives are obtained. The asymptotic distributions for the proposed ratio and estimators are established. A bias‐corrected empirical likelihood approach to inference for the parameters of interest is developed, and the residual‐adjusted empirical log‐likelihood ratio is shown to be asymptotically chi‐squared. These results can be used to construct a class of approximate pointwise confidence intervals and simultaneous bands for the regression functions and their derivatives. Owing to our bias correction for the empirical likelihood ratio, the accuracy of the obtained confidence region is not only improved, but also a data‐driven algorithm can be used for selecting an optimal bandwidth to estimate the regression functions and their derivatives. A simulation study is conducted to compare the empirical likelihood method with the normal approximation‐based method in terms of coverage accuracies and average widths of the confidence intervals/bands. An application of this method is illustrated using a real data set.     

Penalized minimum-distance estimates in finite mixture models

When finite mixture models are used to fit data, it is sometimes important to estimate the number of mixture components. A nonparametric maximum-likelihood approach may result in too many support points and, in general, does not yield a consistent estimator. A penalized likelihood approach tends to produce a fit with fewer components, but it is not known whether that approach produces a consistent estimate of the number of mixture components. We suggest the use of a penalized minimum-distance method. It is shown that the estimator obtained is consistent for both the mixing distribution and the number of mixture components.     

Regularized robust estimation in binary regression models

In this paper, we investigate robust parameter estimation and variable selection for binary regression models with grouped data. We investigate estimation procedures based on the minimum-distance approach. In particular, we employ minimum Hellinger and minimum symmetric chi-squared distances criteria and propose regularized minimum-distance estimators. These estimators appear to possess a certain degree of automatic robustness against model misspecification and/or for potential outliers. We show that the proposed non-penalized and penalized minimum-distance estimators are efficient under the model and simultaneously have excellent robustness properties. We study their asymptotic properties such as consistency, asymptotic normality and oracle properties. Using Monte Carlo studies, we examine the small-sample and robustness properties of the proposed estimators and compare them with traditional likelihood estimators. We also study two real-data applications to illustrate our methods. The numerical studies indicate the satisfactory finite-sample performance of our procedures.     

Jackknife Empirical Likelihood for the Accelerated Failure Time Model with Censored Data

Kendall and Gehan estimating functions are commonly used to estimate the regression parameter in accelerated failure time model with censored observations in survival analysis. In this paper, we apply the jackknife empirical likelihood method to overcome the computation difficulty about interval estimation. A Wilks’ theorem of jackknife empirical likelihood for U-statistic type estimating equations is established, which is used to construct the confidence intervals for the regression parameter. We carry out an extensive simulation study to compare the Wald-type procedure, the empirical likelihood method, and the jackknife empirical likelihood method. The proposed jackknife empirical likelihood method has a better performance than the existing methods. We also use a real data set to compare the proposed methods.     

Empirical likelihood based variable selection

Information criteria form an important class of model/variable selection methods in statistical analysis. Parametric likelihood is a crucial part of these methods. In some applications such as the generalized linear models, the models are only specified by a set of estimating functions. To overcome the non-availability of well defined likelihood function, the information criteria under empirical likelihood are introduced. Under this setup, we successfully solve the existence problem of the profile empirical likelihood due to the over constraint in variable selection problems. The asymptotic properties of the new method are investigated. The new method is shown to be consistent at selecting the variables under mild conditions. Simulation studies find that the proposed method has comparable performance to the parametric information criteria when a suitable parametric model is available, and is superior when the parametric model assumption is violated. A real data set is also used to illustrate the usefulness of the new method.     

Empirical likelihood-based inference for parameter and nonparametric function in partially nonlinear models

This paper is concerned with statistical inference for partially nonlinear models. Empirical likelihood method for parameter in nonlinear function and nonparametric function is investigated. The empirical log-likelihood ratios are shown to be asymptotically chi-square and then the corresponding confidence intervals are constructed. By the empirical likelihood ratio functions, we also obtain the maximum empirical likelihood estimators of the parameter in nonlinear function and nonparametric function, and prove the asymptotic normality. A simulation study indicates that, compared with normal approximation-based method and the bootstrap method, the empirical likelihood method performs better in terms of coverage probabilities and average length/widths of confidence intervals/bands. An application to a real dataset is illustrated.     

Empirical Likelihood Confidence Intervals for Response Mean with Data Missing at Random

Abstract.  A kernel regression imputation method for missing response data is developed. A class of bias-corrected empirical log-likelihood ratios for the response mean is defined. It is shown that any member of our class of ratios is asymptotically chi-squared, and the corresponding empirical likelihood confidence interval for the response mean is constructed. Our ratios share some of the desired features of the existing methods: they are self-scale invariant and no plug-in estimators for the adjustment factor and asymptotic variance are needed; when estimating the non-parametric function in the model, undersmoothing to ensure root- n consistency of the estimator for the parameter is avoided. Since the range of bandwidths contains the optimal bandwidth for estimating the regression function, the existing data-driven algorithm is valid for selecting an optimal bandwidth. We also study the normal approximation-based method. A simulation study is undertaken to compare the empirical likelihood with the normal approximation method in terms of coverage accuracies and average lengths of confidence intervals.     

Model selection of the generalized von Mises distribution based on empirical mode decomposition with data analyses

This paper presents a method for selecting a distribution within the generalized von Mises (GvM) class. In this method, the logarithmic form of the GvM probability frequency function is regarded as the sum of a constant and several cosine functions with different frequencies. Based on the empirical mode decomposition (EMD) method, the corresponding logarithmic series is decomposed to several intrinsic mode functions (IMF) whose corresponding instantaneous frequencies (IF) are used to be the basis of the GvM model selection. The applications of the proposed method are illustrated using simulated circular data and real wind direction data. The results demonstrate that the method proposed here can provide a good choice for the GvM model selection.     

Empirical Likelihood for Semiparametric Varying-Coefficient Heteroscedastic Partially Linear Errors-in-Variables Models

The purpose of this article is to use the empirical likelihood method to study construction of the confidence region for the parameter of interest in semiparametric varying-coefficient heteroscedastic partially linear errors-in-variables models. When the variance functions of the errors are known or unknown, we propose the empirical log-likelihood ratio statistics for the parameter of interest. For each case, a nonparametric version of Wilks’ theorem is derived. The results are then used to construct confidence regions of the parameter. A simulation study is carried out to assess the performance of the empirical likelihood method.     

On the Empirical Likelihood Ratio for Smooth Functions of M-functionals

It is known that the empirical likelihood ratio can be used to construct confidence regions for smooth functions of the mean, Fréchet differentiable statistical functionals and for a class of M-functionals. In this paper, we argue that this use can be extended to the class of functionals which are smooth functions of M-functionals. In particular, we find the conditions under which the empirical log-likelihood ratio for this kind of functionals admits a χ² approxima tion. Furthermore, we investigate, by simulation methods, the related approximation error in some contexts of practical interest.     

Empirical Likelihood for a Heteroscedastic Partial Linear Errors-in-Variables Model

The purpose of this article is to use the empirical likelihood method to study construction of the confidence region for the parameter of interest in heteroscedastic partially linear errors-in-variables model with martingale difference errors. When the variance functions of the errors are known or unknown, we propose the empirical log-likelihood ratio statistics for the parameter of interest. For each case, a nonparametric version of Wilks’ theorem is derived. The results are then used to construct confidence regions of the parameter. A simulation study is carried out to assess the performance of the empirical likelihood method.     

Profile empirical-likelihood inferences for the single-index-coefficient regression model

This article deals with a new profile empirical-likelihood inference for a class of frequently used single-index-coefficient regression models (SICRM), which were proposed by Xia and Li (J. Am. Stat. Assoc. 94:1275–1285, 1999a). Applying the empirical likelihood method (Owen in Biometrika 75:237–249, 1988), a new estimated empirical log-likelihood ratio statistic for the index parameter of the SICRM is proposed. To increase the accuracy of the confidence region, a new profile empirical likelihood for each component of the relevant parameter is obtained by using maximum empirical likelihood estimators (MELE) based on a new and simple estimating equation for the parameters in the SICRM. Hence, the empirical likelihood confidence interval for each component is investigated. Furthermore, corrected empirical likelihoods for functional components are also considered. The resulting statistics are shown to be asymptotically standard chi-squared distributed. Simulation studies are undertaken to assess the finite sample performance of our method. A study of real data is also reported.     

Generalized Empirical Likelihood Inference in Generalized Linear Models for Longitudinal Data

In this article, the generalized linear model for longitudinal data is studied. A generalized empirical likelihood method is proposed by combining generalized estimating equations and quadratic inference functions based on the working correlation matrix. It is proved that the proposed generalized empirical likelihood ratios are asymptotically chi-squared under some suitable conditions, and hence it can be used to construct the confidence regions of the parameters. In addition, the maximum empirical likelihood estimates of parameters are obtained, and their asymptotic normalities are proved. Some simulations are undertaken to compare the generalized empirical likelihood and normal approximation-based method in terms of coverage accuracies and average areas/lengths of confidence regions/intervals. An example of a real data is used for illustrating our methods.     

Optimal cut-off for rare events and unbalanced misclassification costs

This paper develops a method for handling two-class classification problems with highly unbalanced class sizes and misclassification costs. When the class sizes are highly unbalanced and the minority class represents a rare event, conventional classification methods tend to strongly favour the majority class, resulting in very low detection of the minority class. A method is proposed to determine the optimal cut-off for asymmetric misclassification costs and for unbalanced class sizes. Monte Carlo simulations show that this proposal performs better than the method based on the notion of classification accuracy. Finally, the proposed method is applied to empirical data on Italian small and medium enterprises to classify them into default and non-default groups.     

Characteristic Function‐based Semiparametric Inference for Skew‐symmetric Models

Skew‐symmetric models offer a very flexible class of distributions for modelling data. These distributions can also be viewed as selection models for the symmetric component of the specified skew‐symmetric distribution. The estimation of the location and scale parameters corresponding to the symmetric component is considered here, with the symmetric component known. Emphasis is placed on using the empirical characteristic function to estimate these parameters. This is made possible by an invariance property of the skew‐symmetric family of distributions, namely that even transformations of random variables that are skew‐symmetric have a distribution only depending on the symmetric density. A distance metric between the real components of the empirical and true characteristic functions is minimized to obtain the estimators. The method is semiparametric, in that the symmetric component is specified, but the skewing function is assumed unknown. Furthermore, the methodology is extended to hypothesis testing. Two tests for a null hypothesis of specific parameter values are considered, as well as a test for the hypothesis that the symmetric component has a specific parametric form. A resampling algorithm is described for practical implementation of these tests. The outcomes of various numerical experiments are presented.     

General tests of independence based on empirical processes indexed by functions

The present paper is mainly concerned with the statistical tests of the independence problem between random vectors. We develop an approach based on general empirical processes indexed by a particular class of functions. We prove two abstract approximation theorems that include some existing results as particular cases. Finally, we characterize the limiting behavior of the Möbius transformation of empirical processes indexed by functions under contiguous sequences of alternatives.     

Semiparametric estimation and inference for distributional and general treatment effects

Summary.  There is a large literature on methods of analysis for randomized trials with noncompliance which focuses on the effect of treatment on the average outcome. The paper considers evaluating the effect of treatment on the entire distribution and general functions of this effect. For distributional treatment effects, fully non-parametric and fully parametric approaches have been proposed. The fully non-parametric approach could be inefficient but the fully parametric approach is not robust to the violation of distribution assumptions. We develop a semiparametric instrumental variable method based on the empirical likelihood approach. Our method can be applied to general outcomes and general functions of outcome distributions and allows us to predict a subject's latent compliance class on the basis of an observed outcome value in observed assignment and treatment received groups. Asymptotic results for the estimators and likelihood ratio statistic are derived. A simulation study shows that our estimators of various treatment effects are substantially more efficient than the currently used fully non-parametric estimators. The method is illustrated by an analysis of data from a randomized trial of an encouragement intervention to improve adherence to prescribed depression treatments among depressed elderly patients in primary care practices.     

A class of distortion measures generated from expectile and its estimation

We construct a specific form of piecewise distortion function which can distort a random risk to its expectile. After analyzing this kind of distortion functions, we define a class of distortion functions which are generated from random variables. The consistent estimation of the expectile distortion parameter is given by the maximum empirical likelihood method. The expectile distortion not only inherits the good properties of concave distortion measures but also has its own advantages. Since that, we discuss the potential usage of this measure and imagine a new premium principle based on the non self form of this measure.     

Empirical likelihood for varying-coefficient semiparametric mixed-effects errors-in-variables models with longitudinal data

In this paper, the empirical likelihood inferences for varying-coefficient semiparametric mixed-effects errors-in-variables models with longitudinal data are investigated. We construct the empirical log-likelihood ratio function for the fixed-effects parameters and the mean parameters of random-effects. The empirical log-likelihood ratio at the true parameters is proven to be asymptotically $\chi ^2_{q+r}$ , where $q$ and $r$ are dimensions of the fixed and random effects respectively, and the corresponding confidence regions for them are then constructed. We also obtain the maximum empirical likelihood estimator of the parameters of interest, and prove it is the asymptotically normal under some suitable conditions. A simulation study and a real data application are undertaken to assess the finite sample performance of the proposed method.     

Empirical likelihood for generalized linear models with missing responses

The paper uses the empirical likelihood method to study the construction of confidence intervals and regions for regression coefficients and response mean in generalized linear models with missing response. By using the inverse selection probability weighted imputation technique, the proposed empirical likelihood ratios are asymptotically chi-squared. Our approach is to directly calibrate the empirical likelihood ratio, which is called as a bias-correction method. Also, a class of estimators for the parameters of interest is constructed, and the asymptotic distributions of the proposed estimators are obtained. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths/areas of confidence intervals/regions. An example of a real data set is used for illustrating our methods.