Pseudo maximum likelihood estimation of the univariate GARCH (2,2) and asymptotic normality under dependent innovations

In this paper, we first consider the pseudo maximum likelihood estimation of the univariate GARCH (2,2) model and derive the underlying estimator. Then, we make use of the technique of martingales to establish the asymptotic normality of the pseudo-maximum likelihood estimator (PMLE) of the univariate GARCH (2,2) model. Contrary to previous approaches encountered in the statistical literature, the pseudo-likelihood function uses the general form of the density laws of the quadratic exponential family.     

Interval estimation for the Sharpe Ratio when returns are not i.i.d. with special emphasis on the GARCH(1,1) process with symmetric innovations

In this paper, assuming that returns follows a stationary and ergodic stochastic process, the asymptotic distribution of the natural estimator of the Sharpe Ratio is explicitly given. This distribution is used in order to define an approximated confidence interval for the Sharpe ratio. Particular attention is devoted to the case of the GARCH(1,1) process. In this latter case, a simulation study is performed in order to evaluate the minimum sample size for reaching a good coverage accuracy of the asymptotic confidence intervals.     

QMLE of periodic time-varying bilinear– GARCH models

In the current paper, we explore some necessary probabilistic properties for the asymptotic inference of a broad class of periodic bilinear– GARCH processes (P – BLGARCH) obtained by adding to the standard periodic GARCH models one or more interaction components between the observed series and its volatility process. In these models, the parameters of conditional variance are allowed to switch periodically between different regimes. This specification lead us to obtain a new model which is able to capture the asymmetry and hence leverage effect characterized by the negativity of the correlation between returns shocks and subsequent shocks in volatility patterns for seasonal financial time series. So, the goal here is to give in first part some basic structural properties of P – BLGARCH necessary for the remainder of the paper. In the second part, we study the consistency and the asymptotic normality of the quasi-maximum likelihood estimator (QMLE) illustrated by a Monte Carlo study and applied to model the exchange rate of the Algerian Dinar against the US-dollar.     

Power periodic threshold GARCH model: Structure and estimation

Abstract

In this paper, we introduce and study the Power Periodic Threshold GARCH Model (PPTGARCH). We give the necessary and sufficient conditions for the existence of the unique strictly periodically stationary solution of the model and the necessary and sufficient conditions for the existence of moments. A sufficient condition for the periodic geometric ergodicity and β – mixing property using the uniform countable additivity condition is given. We prove the consistency and asymptotic normality of the Quasi-Maximum Likelihood estimator (QMLE) of the parameters. Simulation studies to illustrate consistency and asymptotic normality of the estimators for different underlying error distributions are presented.     

Pseudo MLE for semiparametric transformation model with doubly truncated data

In this article, we consider the efficient estimation of the semiparametric transformation model with doubly truncated data. We propose a two-step approach for obtaining the pseudo maximum likelihood estimators (PMLE) of regression parameters. In the first step, the truncation time distribution is estimated by the nonparametric maximum likelihood estimator (Shen, 2010a) when the distribution function $K$ of the truncation time is unspecified or by the conditional maximum likelihood estimator (Bilker and Wang, 1996) when $K$ is parameterized. In the second step, using the pseudo complete-data likelihood function with the estimated distribution of truncation time, we propose expectation–maximization algorithms for obtaining the PMLE. We establish the consistency of the PMLE. The simulation study indicates that the PMLE performs well in finite samples. The proposed method is illustrated using an AIDS data set.     

Modified ridge-type for the Poisson regression model: simulation and application

The Poisson regression model (PRM) is employed in modelling the relationship between a count variable (y) and one or more explanatory variables. The parameters of PRM are popularly estimated using the Poisson maximum likelihood estimator (PMLE). There is a tendency that the explanatory variables grow together, which results in the problem of multicollinearity. The variance of the PMLE becomes inflated in the presence of multicollinearity. The Poisson ridge regression (PRRE) and Liu estimator (PLE) have been suggested as an alternative to the PMLE. However, in this study, we propose a new estimator to estimate the regression coefficients for the PRM when multicollinearity is a challenge. We perform a simulation study under different specifications to assess the performance of the new estimator and the existing ones. The performance was evaluated using the scalar mean square error criterion and the mean squared error prediction error. The aircraft damage data was adopted for the application study and the estimators’ performance judged by the SMSE and the mean squared prediction error. The theoretical comparison shows that the proposed estimator outperforms other estimators. This is further supported by the simulation study and the application result.KEYWORDS: Poisson regression model, Poisson maximum likelihood estimator, multicollinearity, Poisson ridge regression, Liu estimator, simulation     

A New Pearson-Type QMLE for Conditionally Heteroscedastic Models

This article proposes a novel Pearson-type quasi-maximum likelihood estimator (QMLE) of GARCH(p, q) models. Unlike the existing Gaussian QMLE, Laplacian QMLE, generalized non-Gaussian QMLE, or LAD estimator, our Pearsonian QMLE (PQMLE) captures not just the heavy-tailed but also the skewed innovations. Under strict stationarity and some weak moment conditions, the strong consistency and asymptotic normality of the PQMLE are obtained. With no further efforts, the PQMLE can be applied to other conditionally heteroscedastic models. A simulation study is carried out to assess the performance of the PQMLE. Two applications to four major stock indexes and two exchange rates further highlight the importance of our new method. Heavy-tailed and skewed innovations are often observed together in practice, and the PQMLE now gives us a systematic way to capture these two coexisting features.     

Ultrahigh dimensional variable selection through the penalized maximum trimmed likelihood estimator

The penalized maximum likelihood estimator (PMLE) has been widely used for variable selection in high-dimensional data. Various penalty functions have been employed for this purpose, e.g., Lasso, weighted Lasso, or smoothly clipped absolute deviations. However, the PMLE can be very sensitive to outliers in the data, especially to outliers in the covariates (leverage points). In order to overcome this disadvantage, the usage of the penalized maximum trimmed likelihood estimator (PMTLE) is proposed to estimate the unknown parameters in a robust way. The computation of the PMTLE takes advantage of the same technology as used for PMLE but here the estimation is based on subsamples only. The breakdown point properties of the PMTLE are discussed using the notion of $d$ -fullness. The performance of the proposed estimator is evaluated in a simulation study for the classical multiple linear and Poisson linear regression models.     

UNIT ROOT TESTING IN THE PRESENCE OF HEAVY‐TAILED GARCH ERRORS

We derive the asymptotic distributions of the Dickey–Fuller (DF) and augmented DF (ADF) tests for unit root processes with Generalized Autoregressive Conditional Heteroscedastic (GARCH) errors under fairly mild conditions. We show that the asymptotic distributions of the DF tests and ADF t‐type test are the same as those obtained in the independent and identically distributed Gaussian cases, regardless of whether the fourth moment of the underlying GARCH process is finite or not. Our results go beyond earlier ones by showing that the fourth moment condition on the scaled conditional errors is totally unnecessary. Some Monte Carlo simulations are provided to illustrate the finite‐sample‐size properties of the tests.     

Profile Hellinger distance estimation

The successful application of the Hellinger distance approach to fully parametric models is well known. The corresponding optimal estimators, known as minimum Hellinger distance (MHD) estimators, are efficient and have excellent robustness properties [Beran R. Minimum Hellinger distance estimators for parametric models. Ann Statist. 1977;5:445–463]. This combination of efficiency and robustness makes MHD estimators appealing in practice. However, their application to semiparametric statistical models, which have a nuisance parameter (typically of infinite dimension), has not been fully studied. In this paper, we investigate a methodology to extend the MHD approach to general semiparametric models. We introduce the profile Hellinger distance and use it to construct a minimum profile Hellinger distance estimator of the finite-dimensional parameter of interest. This approach is analogous in some sense to the profile likelihood approach. We investigate the asymptotic properties such as the asymptotic normality, efficiency, and adaptivity of the proposed estimator. We also investigate its robustness properties. We present its small-sample properties using a Monte Carlo study.     

Quasi-Maximum Likelihood Estimation of GARCH Models With Heavy-Tailed Likelihoods

The non-Gaussian maximum likelihood estimator is frequently used in GARCH models with the intention of capturing heavy-tailed returns. However, unless the parametric likelihood family contains the true likelihood, the estimator is inconsistent due to density misspecification. To correct this bias, we identify an unknown scale parameter η_f that is critical to the identification for consistency and propose a three-step quasi-maximum likelihood procedure with non-Gaussian likelihood functions. This novel approach is consistent and asymptotically normal under weak moment conditions. Moreover, it achieves better efficiency than the Gaussian alternative, particularly when the innovation error has heavy tails. We also summarize and compare the values of the scale parameter and the asymptotic efficiency for estimators based on different choices of likelihood functions with an increasing level of heaviness in the innovation tails. Numerical studies confirm the advantages of the proposed approach.     

Zero variance Markov chain Monte Carlo for Bayesian estimators

Interest is in evaluating, by Markov chain Monte Carlo (MCMC) simulation, the expected value of a function with respect to a, possibly unnormalized, probability distribution. A general purpose variance reduction technique for the MCMC estimator, based on the zero-variance principle introduced in the physics literature, is proposed. Conditions for asymptotic unbiasedness of the zero-variance estimator are derived. A central limit theorem is also proved under regularity conditions. The potential of the idea is illustrated with real applications to probit, logit and GARCH Bayesian models. For all these models, a central limit theorem and unbiasedness for the zero-variance estimator are proved (see the supplementary material available on-line).     

Quasi-maximum likelihood estimation and inference in dynamic models with time-varying covariances

We study the properties of the quasi-maximum likelihood estimator (QMLE) and related test statistics in dynamic models that jointly parameterize conditional means and conditional covariances, when a normal log-likelihood os maximized but the assumption of normality is violated. Because the score of the normal log-likelihood has the martingale difference property when the forst two conditional moments are correctly specified, the QMLE is generally Consistent and has a limiting normal destribution. We provide easily computable formulas for asymptotic standard errors that are valid under nonnormality. Further, we show how robust LM tests for the adequacy of the jointly parameterized mean and variance can be computed from simple auxiliary regressions. An appealing feature of these robyst inference procedures is that only first derivatives of the conditional mean and variance functions are needed. A monte Carlo study indicates that the asymptotic results carry over to finite samples. Estimation of several AR and AR-GARCH time series models reveals that in most sotuations the robust test statistics compare favorably to the two standard (nonrobust) formulations of the Wald and IM tests. Also, for the GARCH models and the sample sizes analyzed here, the bias in the QMLE appears to be relatively small. An empirical application to stock return volatility illustrates the potential imprtance of computing robust statistics in practice.     

Quasi-maximum likelihood estimation and inference in dynamic models with time-varying covariances

We study the properties of the quasi-maximum likelihood estimator (QMLE) and related test statistics in dynamic models that jointly parameterize conditional means and conditional covariances, when a normal log-likelihood os maximized but the assumption of normality is violated. Because the score of the normal log-likelihood has the martingale difference property when the forst two conditional moments are correctly specified, the QMLE is generally Consistent and has a limiting normal destribution. We provide easily computable formulas for asymptotic standard errors that are valid under nonnormality. Further, we show how robust LM tests for the adequacy of the jointly parameterized mean and variance can be computed from simple auxiliary regressions. An appealing feature of these robyst inference procedures is that only first derivatives of the conditional mean and variance functions are needed. A monte Carlo study indicates that the asymptotic results carry over to finite samples. Estimation of several AR and AR-GARCH time series models reveals that in most sotuations the robust test statistics compare favorably to the two standard (nonrobust) formulations of the Wald and IM tests. Also, for the GARCH models and the sample sizes analyzed here, the bias in the QMLE appears to be relatively small. An empirical application to stock return volatility illustrates the potential imprtance of computing robust statistics in practice.     

On the estimation of the marginal density of a moving average process

The authors present a new convolution‐type kernel estimator of the marginal density of an MA(1) process with general error distribution. They prove the √n; ‐consistency of the nonparametric estimator and give asymptotic expressions for the mean square and the integrated mean square error of some unobservable version of the estimator. An extension to MA(q) processes is presented in the case of the mean integrated square error. Finally, a simulation study shows the good practical behaviour of the estimator and the strong connection between the estimator and its unobservable version in terms of the choice of the bandwidth.     

Asymptotics for an Adaptive Trimmed Likelihood Location Estimator

An asymptotic normality result is given for an adaptive trimmed likelihood estimator of location, which parallels the asymptotic normality result for the adaptive trimmed mean. The new result comes out of studying the adaptive trimmed likelihood estimator modelled parametrically by a normal family but then examining the behavior when the underlying distribution is in fact some F different from normal. The asymptotic variance of the adaptive estimator is equal to the asymptotic variance of the trimmed likelihood estimator at the optimal trimming proportion for the distribution F, subject to that trimming proportion being positive and F being suitably smooth.     

A robust closed-form estimator for the GARCH(1,1) model

In this paper we extend the closed-form estimator for the generalized autoregressive conditional heteroscedastic (GARCH(1,1)) proposed by Kristensen and Linton [A closed-form estimator for the GARCH(1,1) model. Econom Theory. 2006;22:323–337] to deal with additive outliers. It has the advantage that is per se more robust that the maximum likelihood estimator (ML) often used to estimate this model, it is easy to implement and does not require the use of any numerical optimization procedure. The robustification of the closed-form estimator is done by replacing the sample autocorrelations by a robust estimator of these correlations and by estimating the volatility using robust filters. The performance of our proposal in estimating the parameters and the volatility of the GARCH(1,1) model is compared with the proposals existing in the literature via intensive Monte Carlo experiments and the results of these experiments show that our proposal outperforms the ML and quasi-maximum likelihood estimators-based procedures. Finally, we fit the robust closed-form estimator and the benchmarks to one series of financial returns and analyse their performances in estimating and forecasting the volatility and the value-at-risk.     

Estimating Spatial Autocorrelation With Sampled Network Data

Spatial autocorrelation is a parameter of importance for network data analysis. To estimate spatial autocorrelation, maximum likelihood has been popularly used. However, its rigorous implementation requires the whole network to be observed. This is practically infeasible if network size is huge (e.g., Facebook, Twitter, Weibo, WeChat, etc.). In that case, one has to rely on sampled network data to infer about spatial autocorrelation. By doing so, network relationships (i.e., edges) involving unsampled nodes are overlooked. This leads to distorted network structure and underestimated spatial autocorrelation. To solve the problem, we propose here a novel solution. By temporarily assuming that the spatial autocorrelation is small, we are able to approximate the likelihood function by its first-order Taylor’s expansion. This leads to the method of approximate maximum likelihood estimator (AMLE), which further inspires the development of paired maximum likelihood estimator (PMLE). Compared with AMLE, PMLE is computationally superior and thus is particularly useful for large-scale network data analysis. Under appropriate regularity conditions (without assuming a small spatial autocorrelation), we show theoretically that PMLE is consistent and asymptotically normal. Numerical studies based on both simulated and real datasets are presented for illustration purpose.     

Diagnostic Checking for GARCH-Type Models

The asymptotic distributions of squared and absolute residual autocorrelations for GARCH model estimated by M-estimators are derived. Two diagnostic tests are developed which can be used to check the adequacy of GARCH model fitted by using M-estimators. Simulation results show that the empirical sizes of both tests are close to the nominal size in most of the cases. The power of test based on absolute residual autocorrelation is found better than test based on squared residual autocorrelations. Our results reveal that there are estimators that can fit GARCH-type models better than the commonly used quasi-maximum likelihood estimator under non normal errors. An application to real data set is also presented.     

Estimation of proportion ratio in non-compliance randomized trials with repeated measurements in binary data

It is not uncommon to encounter a randomized clinical trial (RCT) in which each patient is treated with several courses of therapies and his/her response is taken after treatment with each course because of the nature of a treatment design for a disease. On the basis of a simple multiplicative risk model proposed elsewhere for repeated binary measurements, we derive the maximum likelihood estimator (MLE) for the proportion ratio (PR) of responses between two treatments in closed form without the need of modeling the complicated relationship between patient’s compliance and patient’s response. We further derive the asymptotic variance of the MLE and propose an asymptotic interval estimator for the PR using the logarithmic transformation. We also consider two other asymptotic interval estimators. One is derived from the principle of Fieller’s Theorem and the other is derived by using the randomization-based approach suggested elsewhere. To evaluate and compare the finite-sample performance of these interval estimators, we apply the Monte Carlo simulation. We find that the interval estimator using the logarithmic transformation of the MLE consistently outperforms the other two estimators with respect to efficiency. This gain in efficiency can be substantial especially when there are patients not complying with their assigned treatments. Finally, we employ the data regarding the trial of using macrophage colony stimulating factor (M-CSF) over three courses of intensive chemotherapies to reduce febrile neutropenia incidence for acute myeloid leukemia patients to illustrate the use of these estimators.