Exclusion restrictions in instrumental variables equations

In this paper we consider two-stage estimators of parameters of a structural equation in a model with recursive exclusion restrictions on the instrumental variables equations. The estimations considered are simple OLS and GLS estimators after substitution of estimates of the systematic part of the IV equations for the endogenous variables. It is known in the literature that neither imposing the restrictions in the first stage nor ignoring them will in general be more efficient than the alternative. We introduce a class of mixed instrumental variables estimators (MIV) with these possibilities as special cases which yields an estimator which is not only more efficient than the two stage estimators considered in the literature but as efficient as an efficient system estimator like 3SLS.     

Estimation of population mean based on dual use of auxiliary information in non response

Whenever there is auxiliary information available in any form, the researchers want to utilize it in the method of estimation to obtain the most efficient estimator. When there exists enough amount of correlation between the study and the auxiliary variables, and parallel to these associations, the ranks of the auxiliary variables are also correlated with the study variable, which can be used a valuable device for enhancing the precision of an estimator accordingly. This article addresses the problem of estimating the finite population mean that utilizes the complementary information in the presence of (i) the auxiliary variable and (ii) the ranks of the auxiliary variable for non response. We suggest an improved estimator for estimating the finite population mean using the auxiliary information in the presence of non response. Expressions for bias and mean squared error of considered estimators are derived up to the first order of approximation. The performance of estimators is compared theoretically and numerically. A numerical study is carried out to evaluate the performances of estimators. It is observed that the proposed estimator is more efficient than the usual sample mean and the regression estimators, and some other families of ratio and exponential type of estimators.     

Estimation for the autoregressive moving average process observed with noise

SUMMARY The autoregressive moving average process ARMA (p,q) observed with noise has another ARMA (p,k) representation, where k = max (p,q). Parameters for the ARMA (p,k) representation satisfy some non-linear restrictions. We develop restricted Newton-Raphson estimators of the ARMA (p,k) process which takes advantage of the information given in the non-linear restrictions. The asymptotic relative efficiency of the estimators indicates that the proposed restricted Newton-Raphson estimator is more efficient than the unrestricted Newton-Raphson estimator. In a Monte Carlo experiment, the proposed estimator is shown to perform better than the unrestricted estimator of the ARMA (p,k) process.     

The relative efficiency of the restricted estimators in linear regression models

This paper deals with the problem of multicollinearity in a multiple linear regression model with linear equality restrictions. The restricted two parameter estimator which was proposed in case of multicollinearity satisfies the restrictions. The performance of the restricted two parameter estimator over the restricted least squares (RLS) estimator and the ordinary least squares (OLS) estimator is examined under the mean square error (MSE) matrix criterion when the restrictions are correct and not correct. The necessary and sufficient conditions for the restricted ridge regression, restricted Liu and restricted shrunken estimators, which are the special cases of the restricted two parameter estimator, to have a smaller MSE matrix than the RLS and the OLS estimators are derived when the restrictions hold true and do not hold true. Theoretical results are illustrated with numerical examples based on Webster, Gunst and Mason data and Gorman and Toman data. We conduct a final demonstration of the performance of the estimators by running a Monte Carlo simulation which shows that when the variance of the error term and the correlation between the explanatory variables are large, the restricted two parameter estimator performs better than the RLS estimator and the OLS estimator under the configurations examined.     

Efficient estimation in partially linear single‐index models for longitudinal data

In this paper, we consider the estimation of both the parameters and the nonparametric link function in partially linear single‐index models for longitudinal data that may be unbalanced. In particular, a new three‐stage approach is proposed to estimate the nonparametric link function using marginal kernel regression and the parametric components with generalized estimating equations. The resulting estimators properly account for the within‐subject correlation. We show that the parameter estimators are asymptotically semiparametrically efficient. We also show that the asymptotic variance of the link function estimator is minimized when the working error covariance matrices are correctly specified. The new estimators are more efficient than estimators in the existing literature. These asymptotic results are obtained without assuming normality. The finite‐sample performance of the proposed method is demonstrated by simulation studies. In addition, two real‐data examples are analyzed to illustrate the methodology.     

Separate Ratio Estimators for the Population Variance in Stratified Random Sampling

We propose separate ratio estimators for population variance in stratified random sampling. We obtain mean square error equations and compare proposed estimators about efficiency with each other. By these comparisons, we find the conditions which make proposed estimators more efficient than others. It has been shown that proposed classes of estimators are more efficient than usual unbiased estimator. We find that separate ratio estimators are more efficient than combined ratio estimators for population variance. The theoretical results are supported by a numerical illustration with original data. A simulation study is also carried out to investigate empirical performance of estimators.     

Trimmed least squares estimator as best trimmed linear conditional estimator for linear regression model

A class of trimmed linear conditional estimators based on regression quantiles for the linear regression model is introduced. This class serves as a robust analogue of non-robust linear unbiased estimators. Asymptotic analysis then shows that the trimmed least squares estimator based on regression quantiles ( Koenker and Bassett ( 1978 ) ) is the best in this estimator class in terms of asymptotic covariance matrices. The class of trimmed linear conditional estimators contains the Mallows-type bounded influence trimmed means ( see De Jongh et al ( 1988 ) ) and trimmed instrumental variables estimators. A large sample methodology based on trimmed instrumental variables estimator for confidence ellipsoids and hypothesis testing is also provided.     

Count Data Models with Correlated Unobserved Heterogeneity

Abstract. As previously argued, the correlation between included and omitted regressors generally causes inconsistency of standard estimators for count data models. Non‐linear instrumental variables estimation of an exponential model under conditional moment restrictions is one of the proposed remedies. This approach is extended here by fully exploiting the model assumptions and thereby improving efficiency of the resulting estimator. Empirical likelihood in particular has favourable properties in this setting compared with the two‐step generalized method of moments, as demonstrated in a Monte Carlo experiment. The proposed method is applied to the estimation of a cigarette demand function.     

Estimation of population coefficient of variation in simple and stratified random sampling under two-phase sampling scheme when using two auxiliary variables

We propose an improved class of exponential ratio type estimators for coefficient of variation (CV) of a finite population in simple and stratified random sampling using two auxiliary variables under two-phase sampling scheme. We examine the properties of the proposed estimators based on first order of approximation. The proposed class of estimators is more efficient than the usual sample CV estimator, ratio estimator, exponential ratio estimator, usual difference estimator and modified difference type estimator. We also use real data sets for numerical comparisons.     

New calibration estimator based on two auxiliary variables in stratified sampling

In recent years, calibration estimation has become an important field of research in survey sampling. This paper proposes a new calibration estimator for the population mean in the presence of two auxiliary variables in stratified sampling. The theory of new calibration estimator is given and optimum calibration weights are derived. A simulation study is carried out to performance of the proposed calibration estimator over other existing calibration estimators. The results reveal that the proposed calibration estimators are more efficient than other existing calibration estimators in stratified sampling.     

Improved methods for moment restriction models with data combination and an application to two-sample instrumental variable estimation

Combining-100 information from multiple samples is often needed in biomedical and economic studies, but differences between these samples must be appropriately taken into account in the analysis of the combined data. We study the estimation for moment restriction models with data combined from two samples under an ignorability-type assumption while allowing for different marginal distributions of variables common to both samples. Suppose that an outcome regression (OR) model and a propensity score (PS) model are specified. By leveraging semi-parametric efficiency theory, we derive an augmented inverse probability-weighted (AIPW) estimator that is locally efficient and doubly robust with respect to these models. Furthermore, we develop calibrated regression and likelihood estimators that are not only locally efficient and doubly robust but also intrinsically efficient in achieving smaller variances than the AIPW estimator when the PS model is correctly specified but the OR model may be mispecified. As an important application, we study the two-sample instrumental variable problem and derive the corresponding estimators while allowing for incompatible distributions of variables common to the two samples. Finally, we provide a simulation study and an econometric application on public housing projects to demonstrate the superior performance of our improved estimators. The Canadian Journal of Statistics 48: 259–284; 2020 © 2019 Statistical Society of Canada     

Estimation of finite population mean in simple and stratified random sampling using two auxiliary variables

We propose an improved difference-cum-exponential ratio type estimator for estimating the finite population mean in simple and stratified random sampling using two auxiliary variables. We obtain properties of the estimators up to first order of approximation. The proposed class of estimators is found to be more efficient than the usual sample mean estimator, ratio estimator, exponential ratio type estimator, usual two difference type estimators, Rao (1991) estimator, Gupta and Shabbir (2008) estimator, and Grover and Kaur (2011) estimator. We use six real data sets in simple random sampling and two in stratified sampling for numerical comparisons.     

A class of estimators using auxiliary information in sample surveys

A large class of estimators is considered for the mean of a finite population using information on an auxiliary variable. It is shown that members of this class of estimators are asymptotically no more efficient than the linear regression estimator.     

Confidence regions based on inefficient estimators

We consider an unbiased estimator of a function of mean value parameters, which is not efficient. This inefficient estimator is correlated with a residual vector. Thus, if a unit dispersion is unknown, it is impossible to determine the correct confidence region for a function of mean value parameters via a standard estimator of an unknown dispersion with the exception of the case when the ordinary least squares (OLS) estimator is considered in a model with a special covariance structure such that the OLS and the generalized least squares (GLS) estimator are the same, that is the OLS estimator is efficient. Two different estimators of a unit dispersion independent of an inefficient estimator are derived in a singular linear statistical model. Their quality was verified by simulations for several types of experimental designs. Two new estimators of the unit dispersion were compared with the standard estimators based on the GLS and the OLS estimators of the function of the mean value parameters. The OLS estimator was considered in the incorrect model with a different covariance matrix such that the originally inefficient estimator became efficient. The numerical examples led to a slightly surprising result which seems to be due to data behaviour. An example from geodetic practice is presented in the paper.     

Statistical inference for a semiparametric measurement error regression model with heteroscedastic errors

Efficient inference for regression models requires that the heteroscedasticity be taken into account. We consider statistical inference under heteroscedasticity in a semiparametric measurement error regression model, in which some covariates are measured with errors. This paper has multiple components. First, we propose a new method for testing the heteroscedasticity. The advantages of the proposed method over the existing ones are that it does not need any nonparametric estimation and does not involve any mismeasured variables. Second, we propose a new two-step estimator for the error variances if there is heteroscedasticity. Finally, we propose a weighted estimating equation-based estimator (WEEBE) for the regression coefficients and establish its asymptotic properties. Compared with existing estimators, the proposed WEEBE is asymptotically more efficient, avoids undersmoothing the regressor functions and requires less restrictions on the observed regressors. Simulation studies show that the proposed test procedure and estimators have nice finite sample performance. A real data set is used to illustrate the utility of our proposed methods.     

Estimation of Finite Population Mean in Stratified Random Sampling with Two Auxiliary Variables under Double Sampling Design

In this article, a chain ratio-product type exponential estimator is proposed for estimating finite population mean in stratified random sampling with two auxiliary variables under double sampling design. Theoretical and empirical results show that the proposed estimator is more efficient than the existing estimators, i.e., usual stratified random sample mean estimator, Chand (1975) chain ratio estimator, Choudhary and Singh (2012) estimator, chain ratio-product-type estimator, Sahoo et al. (1993) difference type estimator, and Kiregyera (1984) regression-type estimator. Two data sets are used to illustrate the performances of different estimators.     

Equation-solving estimator based on Metropolis-Hastings algorithm with delayed rejection

Numerous works have recently attempted to develop more efficient estimators for MCMC inference than classical ones. In this perspective and approximate nonstandard discrete distributions, Liang and Liu proposed the equation solving estimator as an alternative to the conventional frequency estimator. The specific MCMC method used is the Metropolis-Hastings (M-H) algorithm. In this work, we propose to adapt the equation-solving estimator to the context of simulation using the Metropolis-Hastings algorithm with delayed rejection (MHDR). Developed originally by Mira, this algorithm is considered an improved version of the standard M-H sampler which aims to reduce the variance of MCMC estimators. An application to a Bayesian hypothesis test problem shows the superiority of the equation-solving estimator, based on MHDR sampling, over the one introduced by Liang and Liu.     

Generalized Method of Moments Estimation When a Parameter Is on a Boundary

This article establishes the asymptotic distributions of generalized method of moments (GMM) estimators when the true parameter lies on the boundary of the parameter space. The conditions allow the estimator objective function to be nonsmooth and to depend on preliminary estimators. The boundary of the parameter space may be curved and/or kinked. The article discusses three examples: (1) instrumental variables (IV) estimation of a regression model with nonlinear equality and/or inequality restrictions on the parameters; (2) method of simulated moments estimation of a multinomial discrete response model with some random coefficient variances equal to 0, some random effect variances equal to 0, or some measurement error variances equal to 0; and (3) semiparametric least squares estimation of a partially linear regression model with nonlinear equality and/or inequality restrictions on the parameters.     

A Robust and Almost Fully Efficient M-Estimator

Simultaneous robust estimates of location and scale parameters are derived from a class of M-estimating equations. A coefficient p ( p > 0), which plays a role similar to that of a tuning constant in the theory of M-estimation, determines the estimating equations. These estimating equations may be obtained as the gradient of a strictly convex criterion function. This article shows that the estimators are uniquely defined, asymptotically bi-variate normal and have positive breakdown for some choices of p . When p = 0.12 and p = 0.3, the estimators are almost fully efficient for normal and exponential distributions: efficiencies with respect to the maximum likelihood estimators are 1.00 and 0.99, respectively. It is shown that the location estimator for known scale has the maximum breakdown point 0.5 independent of p , when the target model is symmetric. Also it is shown that the scale estimator has a positive breakdown point which depends on the choice of p . A simulation study finds that the proposed location estimator has smaller variance than the Hodges–Lehmann estimator, Huber's minimax and bisquare M-estimators.     

A new estimator combining the ridge regression and the restricted least squares methods of estimation

It is well-known in the literature on multicollinearity that one of the major consequences of multicollinearity on the ordinary least squares estimator is that the estimator produces large sampling variances, which in turn might inappropriately lead to exclusion of otherwise significant coefficients from the model. To circumvent this problem, two accepted estimation procedures which are often suggested are the restricted least squares method and the ridge regression method. While the former leads to a reduction in the sampling variance of the estimator, the later ensures a smaller mean square error value for the estimator. In this paper we have proposed a new estimator which is based on a criterion that combines the ideas underlying these two estimators. The standard properties of this new estimator have been studied in the paper. It has also been shown that this estimator is superior to both the restricted least squares as well as the ordinary ridge regression estimators by the criterion of mean sauare error of the estimator of the regression coefficients when the restrictions are indeed correct. The conditions for superiority of this estimator over the other two have also been derived for the situation when the restrictions are not correct.