On the asymptotic non‐equivalence of efficient‐GMM and MEL estimators in models with missing data

The generalized method of moments (GMM) and empirical likelihood (EL) are popular methods for combining sample and auxiliary information. These methods are used in very diverse fields of research, where competing theories often suggest variables satisfying different moment conditions. Results in the literature have shown that the efficient‐GMM (GMM_E) and maximum empirical likelihood (MEL) estimators have the same asymptotic distribution to order n^?1/2 and that both estimators are asymptotically semiparametric efficient. In this paper, we demonstrate that when data are missing at random from the sample, the utilization of some well‐known missing‐data handling approaches proposed in the literature can yield GMM_E and MEL estimators with nonidentical properties; in particular, it is shown that the GMM_E estimator is semiparametric efficient under all the missing‐data handling approaches considered but that the MEL estimator is not always efficient. A thorough examination of the reason for the nonequivalence of the two estimators is presented. A particularly strong feature of our analysis is that we do not assume smoothness in the underlying moment conditions. Our results are thus relevant to situations involving nonsmooth estimating functions, including quantile and rank regressions, robust estimation, the estimation of receiver operating characteristic (ROC) curves, and so on.     

广义矩估计的延伸——广义经验似然估计

从广义矩估计(GMM)到广义经验似然估计(GEL)的发展,是由于GMM估计量小样本性质的不足,促使人们寻求方法的改进和拓展。通过必要的证明和推导,详细解析GEL类估计量(包括EL,ET,CUE)的逻辑关系和数理结构,认识GEL的内在本质,并运用随机模拟方法证实了在小样本场合GEL类估计量比GMM估计量具有更小的估计偏差和均方误差,即GEL类估计改进了GMM估计的小样本性质。     

The Information Geometric Structure of Generalized Empirical Likelihood Estimators

The generalized empirical likelihood (GEL) method produces a class of estimators of parameters defined via general estimating equations. This class includes several important estimators, such as empirical likelihood (EL), exponential tilting (ET), and continuous updating estimators (CUE). We examine the information geometric structure of GEL estimators. We introduce a class of estimators closely related to the class of minimum divergence (MD) estimators and show that there is a one-to-one correspondence between this class and the class GEL.     

Structural change tests for GEL criteria

This article examines structural change tests based on generalized empirical likelihood methods in the time series context, allowing for dependent data. Standard structural change tests for the Generalized method of moments (GMM) are adapted to the generalized empirical likelihood (GEL) context. We show that when moment conditions are properly smoothed, these test statistics converge to the same asymptotic distribution as in the GMM, in cases with known and unknown breakpoints. New test statistics specific to GEL methods, and that are robust to weak identification, are also introduced. A simulation study examines the small sample properties of the tests and reveals that GEL-based robust tests performed well, both in terms of the presence and location of a structural change and in terms of the nature of identification.     

Some Classes of Estimators for Median Estimation in Survey Sampling

In this article, we have suggested some classes of estimators for estimating finite population median using information on an auxiliary variable. To study the properties of suggested classes of estimators under large sample approximation, a generalized class of estimators has been suggested with its properties. It has been shown that the suggested classes of estimators are more efficient than other existing estimators. The results have been illustrated through an empirical study.     

A general class of chain estimators for ratio and product of two means of a finite population

This paper proposes a class of estimators for estimating ratio and product of two means of a finite population using information on two auxiliary characters. Asymptotic expression to terms of order 0(n^-1) for bias and mean square error (MSE) of the proposed class of estimators are derived. Optimum conditions are obtained under which the proposed class of estimators has the minimum MSE. An empirical study is carried out to compare the performance of various estimators of ratio with the conventional estimators.     

Generalized empirical likelihood inference in partially linear model for longitudinal data with missing response variables and error-prone covariates

In this article, we consider statistical inference for longitudinal partial linear models when the response variable is sometimes missing with missingness probability depending on the covariate that is measured with error. A generalized empirical likelihood (GEL) method is proposed by combining correction attenuation and quadratic inference functions. The method that takes into consideration the correlation within groups is used to estimate the regression coefficients. Furthermore, residual-adjusted empirical likelihood (EL) is employed for estimating the baseline function so that undersmoothing is avoided. The empirical log-likelihood ratios are proven to be asymptotically Chi-squared, and the corresponding confidence regions for the parameters of interest are then constructed. Compared with methods based on NAs, the GEL does not require consistent estimators for the asymptotic variance and bias. The numerical study is conducted to compare the performance of the EL and the normal approximation-based method, and a real example is analysed.     

Empirical Likelihood Inferences for Semiparametric Varying-Coefficient Partially Linear Models with Longitudinal Data

In this article, empirical likelihood inferences for semiparametric varying-coefficient partially linear models with longitudinal data are investigated. We propose a groupwise empirical likelihood procedure to handle the inter-series dependence of the longitudinal data. By using residual-adjustment, an empirical likelihood ratio function for the nonparametric component is constructed, and a nonparametric version Wilks' phenomenons is proved. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. A simulation study is undertaken to assess the finite sample performance of the proposed confidence regions.     

Estimation of Bowley's Coefficient of Skewness in the Presence of Auxiliary Information

In this paper, we suggest regression-type estimators for estimating the Bowley's coefficient of skewness using auxiliary information. To the first degree of approximation, the bias and mean-squared error expressions of the regression-type estimators are obtained, and the regions under which these estimators are more efficient than the conventional estimator are also determined. Further, a general class of estimators of the Bowley's coefficient of skewness is defined along with its properties. A class of estimators based on estimated optimum values is also defined. It is shown to the first degree of approximations that the variance of the class of estimators based on estimated optimum values is the same as that of the minimum variance of the proposed class of estimators. A simulation study is carried out to demonstrate the performance of the proposed difference estimator over the usual estimator.     

Estimation of population mean based on dual use of auxiliary information in non response

Whenever there is auxiliary information available in any form, the researchers want to utilize it in the method of estimation to obtain the most efficient estimator. When there exists enough amount of correlation between the study and the auxiliary variables, and parallel to these associations, the ranks of the auxiliary variables are also correlated with the study variable, which can be used a valuable device for enhancing the precision of an estimator accordingly. This article addresses the problem of estimating the finite population mean that utilizes the complementary information in the presence of (i) the auxiliary variable and (ii) the ranks of the auxiliary variable for non response. We suggest an improved estimator for estimating the finite population mean using the auxiliary information in the presence of non response. Expressions for bias and mean squared error of considered estimators are derived up to the first order of approximation. The performance of estimators is compared theoretically and numerically. A numerical study is carried out to evaluate the performances of estimators. It is observed that the proposed estimator is more efficient than the usual sample mean and the regression estimators, and some other families of ratio and exponential type of estimators.     

Combining least-squares and quantile regressions

Least-squares and quantile regressions are method of moments techniques that are typically used in isolation. A leading example where efficiency may be gained by combining least-squares and quantile regressions is one where some information on the error quantiles is available but the error distribution cannot be fully specified. This estimation problem may be cast in terms of solving an over-determined estimating equation (EE) system for which the generalized method of moments (GMM) and empirical likelihood (EL) are approaches of recognized importance. The major difficulty with implementing these techniques here is that the EEs associated with the quantiles are non-differentiable. In this paper, we develop a kernel-based smoothing technique for non-smooth EEs, and derive the asymptotic properties of the GMM and maximum smoothed EL (MSEL) estimators based on the smoothed EEs. Via a simulation study, we investigate the finite sample properties of the GMM and MSEL estimators that combine least-squares and quantile moment relationships. Applications to real datasets are also considered.     

A comparison of LS/ML and GMM estimation in a simple AR(1) model

This paper compares least squares (LS)/maximum likelihood (ML) and generalised method of moments (GMM) estimation in a simple. Gaussian autoregressive of order one (AR(1)) model. First, we show that the usual LS/ML estimator is a corner solution to a general minimisation problem that involves two moment conditions, while the new GMM we devise is not. Secondly, we examine asymptotic and finite sample properties of the new GMM estimator in comparison to the usual LS/ML estimator in a simple AR(1) model. For both stable and unstable (unit root) specifications, we show asymptotic equivalence of the distributions of the two estimators. However, in finite samples, the new GMM estimator performs better.     

Generalized empirical likelihood inference in partial linear regression model for longitudinal data

In this paper, empirical likelihood inference for longitudinal data within the framework of partial linear regression models are investigated. The proposed procedures take into consideration the correlation within groups without involving direct estimation of nuisance parameters in the correlation matrix. The empirical likelihood method is used to estimate the regression coefficients and the baseline function, and to construct confidence intervals. A nonparametric version of Wilk's theorem for the limiting distribution of the empirical likelihood ratio is derived. Compared with methods based on normal approximations, the empirical likelihood does not require consistent estimators for the asymptotic variance and bias. The finite sample behaviour of the proposed method is evaluated with simulation and illustrated with an AIDS clinical trial data set.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

Quantile Estimation in the Presence of Auxiliary Information under Negatively Associated Samples

In this article, we apply the empirical likelihood technique to propose a new class of quantile estimators in the presence of some auxiliary information under negatively associated samples. It is shown that the proposed quantile estimators are asymptotically normally distributed with smaller asymptotic variances than those of the usual quantile estimators. It is also shown that blocking technique is an useful tool in estimating asymptotic variance under negatively associated samples, which makes it possible to construct normal approximation based confidence intervals for quantiles.     

A new procedure for variance estimation in simple random sampling using auxiliary information

In this article we have envisaged an efficient generalized class of estimators for finite population variance of the study variable in simple random sampling using information on an auxiliary variable. Asymptotic expressions of the bias and mean square error of the proposed class of estimators have been obtained. Asymptotic optimum estimator in the proposed class of estimators has been identified with its mean square error formula. We have shown that the proposed class of estimators is more efficient than the usual unbiased, difference, Das and Tripathi (Sankhya C 40:139–148, 1978), Isaki (J. Am. Stat. Assoc. 78:117–123, 1983), Singh et al. (Curr. Sci. 57:1331–1334, 1988), Upadhyaya and Singh (Vikram Math. J. 19:14–17, 1999b), Kadilar and Cingi (Appl. Math. Comput. 173:2, 1047–1059, 2006a) and other estimators/classes of estimators. In the support of the theoretically results we have given an empirical study.     

Estimation of population coefficient of variation in simple and stratified random sampling under two-phase sampling scheme when using two auxiliary variables

We propose an improved class of exponential ratio type estimators for coefficient of variation (CV) of a finite population in simple and stratified random sampling using two auxiliary variables under two-phase sampling scheme. We examine the properties of the proposed estimators based on first order of approximation. The proposed class of estimators is more efficient than the usual sample CV estimator, ratio estimator, exponential ratio estimator, usual difference estimator and modified difference type estimator. We also use real data sets for numerical comparisons.     

A family of efficient estimators of the finite population mean in simple random sampling

In this paper an estimator of the finite population mean using auxiliary information in sample surveys has been proposed. The bias and mean squared error are obtained under large sample approximation. It has been shown that the proposed estimator performs better than some recently published estimators.     

Finite Sample Properties of the Two-Step Empirical Likelihood Estimator

ABSTRACT

We investigate the finite sample properties of two-step empirical likelihood (EL) estimators. These estimators are shown to have the same third-order bias properties as EL itself. The Monte Carlo study provides evidence that (i) higher order asymptotics fails to provide a good approximation in the sense that the bias of the two-step EL estimators can be substantial and sensitive to the number of moment restrictions and (ii) the two-step EL estimators may have heavy tails.     

A Class of Estimators of Population Variance Using Auxiliary Information in Sample Surveys

This article advocates the problem of estimating the population variance of the study variable using information on certain known parameters of an auxiliary variable. A class of estimators for population variance using information on an auxiliary variable has been defined. In addition to many estimators, usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999), and Kadilar and Cingi's (2006) estimators are shown as members of the proposed class of estimators. Asymptotic expressions for bias and mean square error of the proposed class of estimators have been obtained. An empirical study has been carried out to judge the performance of the various estimators of population variance generated from the proposed class of estimators over usual unbiased estimator, Isaki's (1983), Upadhyaya and Singh's (1999) and Kadilar and Cingi's (2006) estimators.