Quasi maximum likelihood estimation of dynamic panel data models

This article establishes the almost sure convergence and asymptotic normality of levels and differenced quasi maximum likelihood (QML) estimators of dynamic panel data models. The QML estimators are robust with respect to initial conditions, conditional and time-series heteroskedasticity, and misspecification of the log-likelihood. The article also provides an ECME algorithm for calculating levels QML estimates. Finally, it compares the finite-sample performance of levels and differenced QML estimators, the differenced generalized method of moments (GMM) estimator, and the system GMM estimator. The QML estimators usually have smaller— typically substantially smaller—bias and root mean squared errors than the panel data GMM estimators.     

Testing the information matrix equality with robust estimators

The information matrix (IM) equality can be used to test for misspecification of a parametric model. We study the behavior of the IM test when the maximum-likelihood (ML) estimators used in the construction of this test are replaced with robust estimators. The latter do not suffer from the masking effect in the presence of outliers and can improve the power of the IM test. At the normal location-scale model, the IM test using the ML estimators is known as the Jarque–Bera test, and uses skewness and kurtosis to detect deviations from normality. When robust estimators are employed to test the IM equality, a robust version of the Jarque–Bera test emerges. We investigate in detail the local asymptotic power of the IM test, for various estimators and under a variety of local alternatives. For the normal regression model, it is shown by simulations under fixed alternatives that in many cases the use of robust estimators substantially increases the power of the IM test.     

Yule–Walker type estimators in periodic bilinear models: strong consistency and asymptotic normality

This paper studies the covariance structure and the asymptotic properties of Yule–Walker (YW) type estimators for a bilinear time series model with periodically time-varying coefficients. We give necessary and sufficient conditions ensuring the existence of moments up to eighth order. Expressions of second and third order joint moments, as well as the limiting covariance matrix of the sample moments are given. Strong consistency and asymptotic normality of the YW estimator as well as hypotheses testing via Wald’s procedure are derived. We use a residual bootstrap version to construct bootstrap estimators of the YW estimates. Some simulation results will demonstrate the large sample behavior of the bootstrap procedure.     

GMM estimation in partial linear models with endogenous covariates causing an over-identified problem

ABSTRACT

We study partial linear models where the linear covariates are endogenous and cause an over-identified problem. We propose combining the profile principle with local linear approximation and the generalized moment methods (GMM) to estimate the parameters of interest. We show that the profiled GMM estimators are root? n consistent and asymptotically normally distributed. By appropriately choosing the weight matrix, the estimators can attain the efficiency bound. We further consider variable selection by using the moment restrictions imposed on endogenous variables when the dimension of the covariates may be diverging with the sample size, and propose a penalized GMM procedure, which is shown to have the sparsity property. We establish asymptotic normality of the resulting estimators of the nonzero parameters. Simulation studies have been presented to assess the finite-sample performance of the proposed procedure.     

Statistic inference for a single-index ARCH-M model

For a single-index autoregressive conditional heteroscedastic (ARCH-M) model, estimators of the parametric and non parametric components are proposed by the profile likelihood method. The research results had shown that all the estimators have consistency and the parametric estimators have asymptotic normality. We extend this line of research by deriving the asymptotic normality of the non parametric estimator. Based on the asymptotic properties, we propose Wald statistic and generalized likelihood ratio statistic to investigate the testing problems for ARCH effect and goodness of fit, respectively. A simulation study is conducted to evaluate the finite-sample performance of the proposed estimation methodology and testing procedure.     

Inference in Approximately Sparse Correlated Random Effects Probit Models With Panel Data

Abstract

We propose a simple procedure based on an existing “debiased” l₁-regularized method for inference of the average partial effects (APEs) in approximately sparse probit and fractional probit models with panel data, where the number of time periods is fixed and small relative to the number of cross-sectional observations. Our method is computationally simple and does not suffer from the incidental parameters problems that come from attempting to estimate as a parameter the unobserved heterogeneity for each cross-sectional unit. Furthermore, it is robust to arbitrary serial dependence in underlying idiosyncratic errors. Our theoretical results illustrate that inference concerning APEs is more challenging than inference about fixed and low-dimensional parameters, as the former concerns deriving the asymptotic normality for sample averages of linear functions of a potentially large set of components in our estimator when a series approximation for the conditional mean of the unobserved heterogeneity is considered. Insights on the applicability and implications of other existing Lasso-based inference procedures for our problem are provided. We apply the debiasing method to estimate the effects of spending on test pass rates. Our results show that spending has a positive and statistically significant average partial effect; moreover, the effect is comparable to found using standard parametric methods.     

Statistical Analysis of Parameter Estimation for 2-D Harmonics in Multiplicative and Additive Noise

This article considers the problem of parameter estimation for two dimensional (2-D) multi-component harmonics in non zero-mean multiplicative and additive noise. The least squares estimators (LSEs) are proposed to estimate the coherent model parameters, and some statistical results of the LSEs are obtained, including strong consistency, strong convergence rate, and asymptotic normality. Furthermore, the LSEs-based estimators are proposed to estimate the noncoherent model parameters, and the strong consistency and the asymptotic normality are also proved. Finally, some numerical experiments are performed to see how the asymptotic results work for finite sample sizes.     

Variable selection for semiparametric errors-in-variables regression model with longitudinal data

In this paper, we focus on the variable selection for the semiparametric regression model with longitudinal data when some covariates are measured with errors. A new bias-corrected variable selection procedure is proposed based on the combination of the quadratic inference functions and shrinkage estimations. With appropriate selection of the tuning parameters, we establish the consistency and asymptotic normality of the resulting estimators. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed variable selection procedure. We further illustrate the proposed procedure with an application.     

Minimum Hellinger distance estimators for multivariate distributions from the Johnson system

In this paper, we study minimum Hellinger distance estimators (MHDEs) for multivariate distributions from the Johnson system. We prove some properties of these estimators, such as consistency and asymptotic normality, and show that they represent a robust alternative for other existing estimators.     

A semiparametric estimation of copula models based on the method of moments

Using the classical estimation method of moments, we propose a new semiparametric estimation procedure for multi-parameter copula models. Consistency and asymptotic normality of the obtained estimators are established. By considering an Archimedean copula model, an extensive simulation study, comparing these estimators with the pseudo maximum likelihood, rho-inversion and tau-inversion ones, is carried out. We show that, with regard to the other methods, the moment based estimation is quick and simple to use with reasonable bias and root mean squared error.     

Generalized Method of Moments for Additive Hazards Model with Clustered Dental Survival Data

For multivariate survival data, we study the generalized method of moments (GMM) approach to estimation and inference based on the marginal additive hazards model. We propose an efficient iterative algorithm using closed‐form solutions, which dramatically reduces the computational burden. Asymptotic normality of the proposed estimators is established, and the corresponding variance–covariance matrix can be consistently estimated. Inference procedures are derived based on the asymptotic chi‐squared distribution of the GMM objective function. Simulation studies are conducted to empirically examine the finite sample performance of the proposed method, and a real data example from a dental study is used for illustration.     

Quantile regression for robust inference on varying coefficient partially nonlinear models

In this paper, we propose a robust statistical inference approach for the varying coefficient partially nonlinear models based on quantile regression. A three-stage estimation procedure is developed to estimate the parameter and coefficient functions involved in the model. Under some mild regularity conditions, the asymptotic properties of the resulted estimators are established. Some simulation studies are conducted to evaluate the finite performance as well as the robustness of our proposed quantile regression method versus the well known profile least squares estimation procedure. Moreover, the Boston housing price data is given to further illustrate the application of the new method.     

Point and Interval Estimation for a Generalized Logistic Distribution Under Progressive Type II Censoring

The likelihood equations based on a progressively Type II censored sample from a Type I generalized logistic distribution do not provide explicit solutions for the location and scale parameters. We present a simple method of deriving explicit estimators by approximating the likelihood equations appropriately. We examine numerically the bias and variance of these estimators and show that these estimators are as efficient as the maximum likelihood estimators (MLEs). The probability coverages of the pivotal quantities (for location and scale parameters) based on asymptotic normality are shown to be unsatisfactory, especially when the effective sample size is small. Therefore we suggest using unconditional simulated percentage points of these pivotal quantities for the construction of confidence intervals. A wide range of sample sizes and progressive censoring schemes have been considered in this study. Finally, we present a numerical example to illustrate the methods of inference developed here.     

Variable Selection for Partially Linear Models with Randomly Censored Data

This article proposes a variable selection procedure for partially linear models with right-censored data via penalized least squares. We apply the SCAD penalty to select significant variables and estimate unknown parameters simultaneously. The sampling properties for the proposed procedure are investigated. The rate of convergence and the asymptotic normality of the proposed estimators are established. Furthermore, the SCAD-penalized estimators of the nonzero coefficients are shown to have the asymptotic oracle property. In addition, an iterative algorithm is proposed to find the solution of the penalized least squares. Simulation studies are conducted to examine the finite sample performance of the proposed method.     

固定效应部分线性变系数面板模型的快速有效估计

本文将最小二乘支持向量机(LSSVM) 和二次推断函数法(QIF) 相结合，为个体内具有相关结构的固定效应部分线性变系数面板模型提供了一种新的快速估计方法；在一定的正则条件下，论证了参数估计量的渐近正态性和非参数估计量的收敛速度；采用Monte Carlo模拟考察了估计方法在有限样本下的表现并将估计技术应用于现实数据分析。该方法不仅保证了估计的有效性和统计推断力，而且程序运行速度得到较大幅度提升。     

Partial covariate adjusted regression

Covariate adjusted regression (CAR) is a recently proposed adjustment method for regression analysis where both the response and predictors are not directly observed [?entürk, D., Müller, H.G., 2005. Covariate adjusted regression. Biometrika 92, 75–89]. The available data have been distorted by unknown functions of an observable confounding covariate. CAR provides consistent estimators for the coefficients of the regression between the variables of interest, adjusted for the confounder. We develop a broader class of partial covariate adjusted regression (PCAR) models to accommodate both distorted and undistorted (adjusted/unadjusted) predictors. The PCAR model allows for unadjusted predictors, such as age, gender and demographic variables, which are common in the analysis of biomedical and epidemiological data. The available estimation and inference procedures for CAR are shown to be invalid for the proposed PCAR model. We propose new estimators and develop new inference tools for the more general PCAR setting. In particular, we establish the asymptotic normality of the proposed estimators and propose consistent estimators of their asymptotic variances. Finite sample properties of the proposed estimators are investigated using simulation studies and the method is also illustrated with a Pima Indians diabetes data set.     

Estimation and Asymptotic Properties in Periodic GARCH(1, 1) Models

This article studies the probabilistic structure and asymptotic inference of the first-order periodic generalized autoregressive conditional heteroscedasticity (PGARCH(1, 1)) models in which the parameters in volatility process are allowed to switch between different regimes. First, we establish necessary and sufficient conditions for a PGARCH(1, 1) process to have a unique stationary solution (in periodic sense) and for the existence of moments of any order. Second, using the representation of squared PGARCH(1, 1) model as a PARMA(1, 1) model, we then consider Yule-Walker type estimators for the parameters in PGARCH(1, 1) model and derives their consistency and asymptotic normality. The estimator can be surprisingly efficient for quite small numbers of autocorrelations and, in some cases can be more efficient than the least squares estimate (LSE). We use a residual bootstrap to define bootstrap estimators for the Yule-Walker estimates and prove the consistency of this bootstrap method. A set of numerical experiments illustrates the practical relevance of our theoretical results.     

Median regression analysis from data with left and right censored observations

Median regression models provide a robust alternative to regression based on the mean. We propose a methodology for fitting a median regression model from data with both left and right censored observations, in which the left censoring variable is always observed. First we set up an adjusted least absolute deviation estimating function using the inverse censoring weighted approach, whose solution specifies the estimator. We derive the consistency and asymptotic normality of the proposed estimator and describe the inference procedure for the regression parameter. Finally, we check the finite sample performance of the proposed procedure through simulation.     

Estimation and Inference for Linear Panel Data Models Under Misspecification When Both n and T are Large

This article considers fixed effects (FE) estimation for linear panel data models under possible model misspecification when both the number of individuals, n, and the number of time periods, T, are large. We first clarify the probability limit of the FE estimator and argue that this probability limit can be regarded as a pseudo-true parameter. We then establish the asymptotic distributional properties of the FE estimator around the pseudo-true parameter when n and T jointly go to infinity. Notably, we show that the FE estimator suffers from the incidental parameters bias of which the top order is O(T^{? 1}), and even after the incidental parameters bias is completely removed, the rate of convergence of the FE estimator depends on the degree of model misspecification and is either (nT)^{? 1/2} or n^{? 1/2}. Second, we establish asymptotically valid inference on the (pseudo-true) parameter. Specifically, we derive the asymptotic properties of the clustered covariance matrix (CCM) estimator and the cross-section bootstrap, and show that they are robust to model misspecification. This establishes a rigorous theoretical ground for the use of the CCM estimator and the cross-section bootstrap when model misspecification and the incidental parameters bias (in the coefficient estimate) are present. We conduct Monte Carlo simulations to evaluate the finite sample performance of the estimators and inference methods, together with a simple application to the unemployment dynamics in the U.S.     

Asymptotic properties of a quast-maximum likelihood estimator in truncated regression model with serial correlation

Robinson (1982a) presented a general approach to serial correlation in limited dependent variable models and proved the strong consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) for the Tobit model with serial correlation, obtained under the assumption of independent errors. This paper proves the strong consistency and asymptotic normality of the QMLE based on independent errors for the truncated regression model with serial correlation and gives consistent estimators for the limiting covariance matrix of the QMLE.