Quasi-maximum likelihood estimation and inference in dynamic models with time-varying covariances

We study the properties of the quasi-maximum likelihood estimator (QMLE) and related test statistics in dynamic models that jointly parameterize conditional means and conditional covariances, when a normal log-likelihood os maximized but the assumption of normality is violated. Because the score of the normal log-likelihood has the martingale difference property when the forst two conditional moments are correctly specified, the QMLE is generally Consistent and has a limiting normal destribution. We provide easily computable formulas for asymptotic standard errors that are valid under nonnormality. Further, we show how robust LM tests for the adequacy of the jointly parameterized mean and variance can be computed from simple auxiliary regressions. An appealing feature of these robyst inference procedures is that only first derivatives of the conditional mean and variance functions are needed. A monte Carlo study indicates that the asymptotic results carry over to finite samples. Estimation of several AR and AR-GARCH time series models reveals that in most sotuations the robust test statistics compare favorably to the two standard (nonrobust) formulations of the Wald and IM tests. Also, for the GARCH models and the sample sizes analyzed here, the bias in the QMLE appears to be relatively small. An empirical application to stock return volatility illustrates the potential imprtance of computing robust statistics in practice.     

Quasi-maximum likelihood estimation of GARCH models in the presence of missing values

This work presents a new method to deal with missing values in financial time series. Previous works are generally based in state-space models and Kalman filter and few consider ARCH family models. The traditional approach is to bound the data together and perform the estimation without considering the presence of missing values. The existing methods generally consider missing values in the returns. The proposed method considers the presence of missing values in the price of the assets instead of in the returns. The performance of the method in estimating the parameters and the volatilities is evaluated through a Monte Carlo simulation. Value at risk is also considered in the simulation. An empirical application to NASDAQ 100 Index series is presented.     

Local maximum likelihood estimation and inference

Local maximum likelihood estimation is a nonparametric counterpart of the widely used parametric maximum likelihood technique. It extends the scope of the parametric maximum likelihood method to a much wider class of parametric spaces. Associated with this nonparametric estimation scheme is the issue of bandwidth selection and bias and variance assessment. This paper provides a unified approach to selecting a bandwidth and constructing confidence intervals in local maximum likelihood estimation. The approach is then applied to least squares nonparametric regression and to nonparametric logistic regression. Our experiences in these two settings show that the general idea outlined here is powerful and encouraging.     

Quasi maximum likelihood estimation of dynamic panel data models

This article establishes the almost sure convergence and asymptotic normality of levels and differenced quasi maximum likelihood (QML) estimators of dynamic panel data models. The QML estimators are robust with respect to initial conditions, conditional and time-series heteroskedasticity, and misspecification of the log-likelihood. The article also provides an ECME algorithm for calculating levels QML estimates. Finally, it compares the finite-sample performance of levels and differenced QML estimators, the differenced generalized method of moments (GMM) estimator, and the system GMM estimator. The QML estimators usually have smaller— typically substantially smaller—bias and root mean squared errors than the panel data GMM estimators.     

Statistical inference in partially time-varying coefficient models

A partially time-varying coefficient time series model is introduced to characterize the nonlinearity and trending phenomenon. To estimate the regression parameter and the nonlinear coefficient function, the profile least squares approach is applied with the help of local linear approximation. The asymptotic distributions of the proposed estimators are established under mild conditions. Meanwhile, the generalized likelihood ratio test is studied and the test statistics are demonstrated to follow asymptotic χ²-distribution under the null hypothesis. Furthermore, some extensions of the proposed model are discussed and several numerical examples are provided to illustrate the finite sample behavior of the proposed methods.     

Small-sample likelihood inference in extreme-value regression models

We deal with a general class of extreme-value regression models introduced by Barreto-Souza and Vasconcellos [Bias and skewness in a general extreme-value regression model, Comput. Statist. Data Anal. 55 (2011), pp. 1379–1393]. Our goal is to derive an adjusted likelihood ratio statistic that is approximately distributed as χ² with a high degree of accuracy. Although the adjusted statistic requires more computational effort than its unadjusted counterpart, it is shown that the adjustment term has a simple compact form that can be easily implemented in standard statistical software. Further, we compare the finite-sample performance of the three classical tests (likelihood ratio, Wald, and score), the gradient test that has been recently proposed by Terrell [The gradient statistic, Comput. Sci. Stat. 34 (2002), pp. 206–215], and the adjusted likelihood ratio test obtained in this article. Our simulations favour the latter. Applications of our results are presented.     

Nonparametric likelihood inference for general autoregressive models

This paper shows how nonparametric likelihood inference for autoregressive models can be based on the family of “empirical” Cressie–Read statistics. The results of the paper apply to possibly nonstationary autoregressive models with innovations that form a martingale difference sequence, and can accommodate multiple and complex unit roots, as well as deterministic components. As an application, the paper considers nonparametric likelihood-based tests for seasonal unit roots and for double unit roots. Monte Carlo evidence seems to suggest that the proposed tests have competitive finite sample properties.     

Quasi-maximum exponential likelihood estimation for a non stationary GARCH(1,1) model

ABSTRACT

This article investigates a quasi-maximum exponential likelihood estimator(QMELE) for a non stationary generalized autoregressive conditional heteroscedastic (GARCH(1,1)) model. Asymptotic normality of this estimator is derived under a non stationary condition. A simulation study and a real example are given to evaluate the performance of QMELE for this model.     

Empirical likelihood inference in partially linear single-index models with endogenous covariates

In this article, we consider how to construct the confidence regions of the unknown parameters for partially linear single-index models with endogenous covariates. To eliminate the influence of the endogenous covariates, an empirical likelihood method is proposed based on instrumental variables. Under some regularly conditions, the asymptotic distribution of the proposed empirical log-likelihood ratio is proved to be a Chi-squared distribution. We investigate the finite-sample performance of the proposed method via simulation studies.     

Statistical inference for partially time-varying coefficient errors-in-variables models

This paper studies the partially time-varying coefficient models where some covariates are measured with additive errors. In order to overcome the bias of the usual profile least squares estimation when measurement errors are ignored, we propose a modified profile least squares estimator of the regression parameter and construct estimators of the nonlinear coefficient function and error variance. The proposed three estimators are proved to be asymptotically normal under mild conditions. In addition, we introduce the profile likelihood ratio test and then demonstrate that it follows an asymptotically χ²${\chi }^2$ distribution under the null hypothesis. Finite sample behavior of the estimators is investigated via simulations too.     

Restricted likelihood inference for generalized linear mixed models

We aim to promote the use of the modified profile likelihood function for estimating the variance parameters of a GLMM in analogy to the REML criterion for linear mixed models. Our approach is based on both quasi-Monte Carlo integration and numerical quadrature, obtaining in either case simulation-free inferential results. We will illustrate our idea by applying it to regression models with binary responses or count data and independent clusters, covering also the case of two-part models. Two real data examples and three simulation studies support the use of the proposed solution as a natural extension of REML for GLMMs. An R package implementing the methodology is available online.     

Maximum likelihood estimation in convex hull models

In this paper we consider models involving the convex hull operation of the parameter and the noise i.e. Y_i = CH(A, X_X). Then we generalize the basic models to ANOVA models; i.e. Y_ij=CH(A∪B_j,X_ij). In some cases the consistent estimators for the J U new parameters are derived. Assuming the existence of density forrandom convex sets, we derive the likelihood for the convex hull model. We then find the maximum Likelihood Estimators for the parameters. Examples for some random convex sets with finite dimensional distributions are derived to show how good these estimators are.     

Empirical likelihood inference for general transformation models with right censored data

In this work, we consider empirical likelihood inference for general transformation models with right censored data. The models are a class of flexible semiparametric survival models and include many popular survival models as their special cases. Based on the marginal likelihood function, we define an empirical likelihood ratio statistic. Under some regularity conditions, we show that the empirical likelihood ratio statistic asymptotically follows a standard chi-squared distribution. Through some simulation studies and a real data application, we show that our proposed procedure can work fairly well even for relatively small sample size and high censoring.     

On maximum likelihood estimation of the semi-parametric Cox model with time-varying covariates

Including time-varying covariates is a popular extension to the Cox model and a suitable approach for dealing with non-proportional hazards. However, partial likelihood (PL) estimation of this model has three shortcomings: (i) estimated regression coefficients can be less accurate in small samples with heavy censoring; (ii) the baseline hazard is not directly estimated and (iii) a covariance matrix for both the regression coefficients and the baseline hazard is not easily produced.We address these by developing a maximum likelihood (ML) approach to jointly estimate regression coefficients and baseline hazard using a constrained optimisation ensuring the latter''s non-negativity. We demonstrate asymptotic properties of these estimates and show via simulation their increased accuracy compared to PL estimates in small samples and show our method produces smoother baseline hazard estimates than the Breslow estimator.Finally, we apply our method to two examples, including an important real-world financial example to estimate time to default for retail home loans. We demonstrate using our ML estimate for the baseline hazard can give much clearer corroboratory evidence of the ‘humped hazard’, whereby the risk of loan default rises to a peak and then later falls.     

Maximum likelihood estimation in hazard rate models with a change-point

The problem of estimation of parameters in hazard rate models with a change-point is considered. An interesting feature of this problem is that the likelihood function is unbounded. A maximum likelihood estimator of the change-point subject to a natural constraint is proposed, which is shown to be consistent.The limiting distributions are also derived.     

Statistical inference in dynamic panel data models

Anderson and his collaborators have made seminal contributions to inference with instrumental variables and to dynamic panel data models. We review these contributions and the extensive economic and statistical literature that these contributions spawned. We describe our recent work in these two areas, presenting new approaches to (a) making valid inferences in the presence of weak instruments and (b) instrument and model selection for dynamic panel data models. Both approaches use empirical likelihood and resampling. For inference in the presence of weak instruments, our approach uses model averaging to achieve asymptotic efficiency with strong instruments but maintain valid inferences with weak instruments. For instrument and model selection, our approach aims at choosing valid instruments that are strong enough to be useful.     

Pseudo‐likelihood estimation in ARCH models

The author presents asymptotic results for the class of pseudo‐likelihood estimators in the autoregressive conditional heteroscedastic models introduced by Engle (1982). Unlike what is required for the quasi‐likelihood estimator, some estimators in the class he considers do not require the finiteness of the fourth moment of the error density. Thus his method is applicable to heavy‐tailed error distributions for which moments higher than two may not exist.     

Efficient estimation for time-varying coefficient longitudinal models

For estimation of time-varying coefficient longitudinal models, the widely used local least-squares (LS) or covariance-weighted local LS smoothing uses information from the local sample average. Motivated by the fact that a combination of multiple quantiles provides a more complete picture of the distribution, we investigate quantile regression-based methods to improve efficiency by optimally combining information across quantiles. Under the working independence scenario, the asymptotic variance of the proposed estimator approaches the Cramér–Rao lower bound. In the presence of dependence among within-subject measurements, we adopt a prewhitening technique to transform regression errors into independent innovations and show that the prewhitened optimally weighted quantile average estimator asymptotically achieves the Cramér–Rao bound for the independent innovations. Fully data-driven bandwidth selection and optimal weights estimation are implemented through a two-step procedure. Monte Carlo studies show that the proposed method delivers more robust and superior overall performance than that of the existing methods.