Recursive Estimation of GARCH Models

This article develops three recursive on-line algorithms, based on a two-stage least squares scheme for estimating generalized autoregressive conditionally heteroskedastic (GARCH) models. The first one, denoted by 2S-RLS, is an adaptation of the recursive least squares method for estimating autoregressive conditionally heteroskedastic (ARCH) models. The second and the third ones (denoted, respectively, by 2S-PLR and 2S-RML) are adapted versions of the pseudolinear regression (PLR) and the recursive maximum likelihood (RML) methods to the GARCH case. We show that the proposed algorithms give consistent estimators and that the 2S-RLS and the 2S-RML estimators are asymptotically Gaussian. These methods seem very adequate for modeling the sequential feature of financial time series, which are observed on a high-frequency basis. The performance of these algorithms is shown via a simulation study.     

A new algorithm for maximum likelihood estimation in normal scale-mixture generalized autoregressive conditional heteroskedastic models

In this paper, we propose a new generalized autoregressive conditional heteroskedastic (GARCH) model using infinite normal scale-mixtures which can suitably avoid order selection problems in the application of finite normal scale-mixtures. We discuss its theoretical properties and develop a two-stage algorithm for the maximum likelihood estimator to estimate the mixing distribution non-parametric maximum likelihood estimator (NPMLE) as well as GARCH parameters (two-stage MLE). For the estimation of a mixing distribution, we employ a fast computational algorithm proposed by Wang [On fast computation of the non-parametric maximum likelihood estimate of a mixing distribution. J R Stat Soc Ser B. 2007;69:185–198] under the gradient characterization of the non-parametric mixture likelihood. The GARCH parameters are then estimated either using the expectation-mazimization algorithm or general optimization scheme. In addition, we propose a new forecasting algorithm of value-at-risk (VaR) using the two-stage MLE and the NPMLE. Through a simulation study and real data analysis, we compare the performance of the two-stage MLE with the existing ones including quasi-maximum likelihood estimator based on the standard normal density and the finite normal mixture quasi maximum estimated-likelihood estimator (cf. Lee S, Lee T. Inference for Box–Cox transformed threshold GARCH models with nuisance parameters. Scand J Stat. 2012;39:568–589) in terms of the relative efficiency and accuracy of VaR forecasting.     

Semiparametric Time Series Models with Log‐concave Innovations: Maximum Likelihood Estimation and its Consistency

We study semiparametric time series models with innovations following a log‐concave distribution. We propose a general maximum likelihood framework that allows us to estimate simultaneously the parameters of the model and the density of the innovations. This framework can be easily adapted to many well‐known models, including autoregressive moving average (ARMA), generalized autoregressive conditionally heteroscedastic (GARCH), and ARMA‐GARCH models. Furthermore, we show that the estimator under our new framework is consistent in both ARMA and ARMA‐GARCH settings. We demonstrate its finite sample performance via a thorough simulation study and apply it to model the daily log‐return of the FTSE 100 index.     

Heteroskedasticity in the Tobit model

The paper deals with parameter estimation and the testing of individual parameters in heteroskedastic Tobit models. The statistical properties of semiparametric and maximum likelihood estimators are evaluated. Correspondingt-test statistics are compared. Results from a Monte Carlo experiment indicate that the semiparametric estimator performs relatively better than the maximum likelihood estimator. The associatedt-test statistics appear to perform better than the corresponding maximum likelihood test statistics. *** DIRECT SUPPORT *** A06GP002 00008     

APPROXIMATING VOLATILITIES BY ASYMMETRIC POWER GARCH FUNCTIONS

ARCH/GARCH representations of financial series usually attempt to model the serial correlation structure of squared returns. Although it is undoubtedly true that squared returns are correlated, there is increasing empirical evidence of stronger correlation in the absolute returns than in squared returns. Rather than assuming an explicit form for volatility, we adopt an approximation approach; we approximate the γth power of volatility by an asymmetric GARCH function with the power index γ chosen so that the approximation is optimum. Asymptotic normality is established for both the quasi-maximum likelihood estimator (qMLE) and the least absolute deviations estimator (LADE) in our approximation setting. A consequence of our approach is a relaxation of the usual stationarity condition for GARCH models. In an application to real financial datasets, the estimated values for γ are found to be close to one, consistent with the stylized fact that the strongest autocorrelation is found in the absolute returns. A simulation study illustrates that the qMLE is inefficient for models with heavy-tailed errors, whereas the LADE is more robust.     

Modified maximum likelihood estimator under the Jones and Faddy's skew t-error distribution for censored regression model

It is well-known that classical Tobit estimator of the parameters of the censored regression (CR) model is inefficient in case of non-normal error terms. In this paper, we propose to use the modified maximum likelihood (MML) estimator under the Jones and Faddy''s skew t-error distribution, which covers a wide range of skew and symmetric distributions, for the CR model. The MML estimators, providing an alternative to the Tobit estimator, are explicitly expressed and they are asymptotically equivalent to the maximum likelihood estimator. A simulation study is conducted to compare the efficiencies of the MML estimators with the classical estimators such as the ordinary least squares, Tobit, censored least absolute deviations and symmetrically trimmed least squares estimators. The results of the simulation study show that the MML estimators work well among the others with respect to the root mean square error criterion for the CR model. A real life example is also provided to show the suitability of the MML methodology.     

Tobit regression for modeling mean survival time using data subject to multiple sources of censoring

Mean survival time is often of inherent interest in medical and epidemiologic studies. In the presence of censoring and when covariate effects are of interest, Cox regression is the strong default, but mostly due to convenience and familiarity. When survival times are uncensored, covariate effects can be estimated as differences in mean survival through linear regression. Tobit regression can validly be performed through maximum likelihood when the censoring times are fixed (ie, known for each subject, even in cases where the outcome is observed). However, Tobit regression is generally inapplicable when the response is subject to random right censoring. We propose Tobit regression methods based on weighted maximum likelihood which are applicable to survival times subject to both fixed and random censoring times. Under the proposed approach, known right censoring is handled naturally through the Tobit model, with inverse probability of censoring weighting used to overcome random censoring. Essentially, the re‐weighting data are intended to represent those that would have been observed in the absence of random censoring. We develop methods for estimating the Tobit regression parameter, then the population mean survival time. A closed form large‐sample variance estimator is proposed for the regression parameter estimator, with a semiparametric bootstrap standard error estimator derived for the population mean. The proposed methods are easily implementable using standard software. Finite‐sample properties are assessed through simulation. The methods are applied to a large cohort of patients wait‐listed for kidney transplantation.     

A Conditionally Unbiased Estimator for the Equal-Catchability Model

ABSTRACT

In this article we reconsider an estimator of population size previously advocated for use when sampling from a population subdivided into different types. We show that it may be usefully adopted in the simple equal-catchability model used in mark-recapture. Unlike the commonly used maximum likelihood estimator, this conditionally unbiased estimator is always finite-valued. Except in situations in which the data contain little relevant information, its performance, in terms of bias and precision, is seen to be at least as good as that of the maximum likelihood estimator. Two estimators of the standard deviation of the conditionally unbiased estimator are considered.     

Pseudo maximum likelihood estimation of the univariate GARCH (2,2) and asymptotic normality under dependent innovations

In this paper, we first consider the pseudo maximum likelihood estimation of the univariate GARCH (2,2) model and derive the underlying estimator. Then, we make use of the technique of martingales to establish the asymptotic normality of the pseudo-maximum likelihood estimator (PMLE) of the univariate GARCH (2,2) model. Contrary to previous approaches encountered in the statistical literature, the pseudo-likelihood function uses the general form of the density laws of the quadratic exponential family.     

Semiparametric ARCH Models: An Estimating Function Approach

We introduce the method of estimating functions to study the class of autoregressive conditional heteroscedasticity (ARCH) models. We derive the optimal estimating functions by combining linear and quadratic estimating functions. The resultant estimators are more efficient than the quasi-maximum likelihood estimator. If the assumption of conditional normality is imposed, the estimator obtained by using the theory of estimating functions is identical to that obtained by using the maximum likelihood method in finite samples. The relative efficiencies of the estimating function (EF) approach in comparison with the quasi-maximum likelihood estimator are developed. We illustrate the EF approach using a univariate GARCH(1,1) model with conditional normal, Student-t, and gamma distributions. The efficiency benefits of the EF approach relative to the quasi-maximum likelihood approach are substantial for the gamma distribution with large skewness. Simulation analysis shows that the finite-sample properties of the estimators from the EF approach are attractive. EF estimators tend to display less bias and root mean squared error than the quasi-maximum likelihood estimator. The efficiency gains are substantial for highly nonnormal distributions. An example demonstrates that implementation of the method is straightforward.     

Adaptive likelihood estimator of conditional variance function

Modelling volatility in the form of conditional variance function has been a popular method mainly due to its application in financial risk management. Among others, we distinguish the parametric GARCH models and the nonparametric local polynomial approximation using weighted least squares or gaussian likelihood function. We introduce an alternative likelihood estimate of conditional variance and we show that substitution of the error density with its estimate yields similar asymptotic properties, that is, the proposed estimate is adaptive to the error distribution. Theoretical comparison with existing estimates reveals substantial gains in efficiency, especially if error distribution has fatter tails than Gaussian distribution. Simulated data confirm the theoretical findings while an empirical example demonstrates the gains of the proposed estimate.     

GMM estimation of spatial autoregressive models in a system of simultaneous equations with heteroskedasticity

This paper proposes a GMM estimation framework for the SAR model in a system of simultaneous equations with heteroskedastic disturbances. Besides linear moment conditions, the proposed GMM estimator also utilizes quadratic moment conditions based on the covariance structure of model disturbances within and across equations. Compared with the QML approach, the GMM estimator is easier to implement and robust under heteroskedasticity of unknown form. We derive the heteroskedasticity-robust standard error for the GMM estimator. Monte Carlo experiments show that the proposed GMM estimator performs well in finite samples.     

A Tobit Ridge Regression Estimator

This article analyzes the effects of multicollienarity on the maximum likelihood (ML) estimator for the Tobit regression model. Furthermore, a ridge regression (RR) estimator is proposed since the mean squared error (MSE) of ML becomes inflated when the regressors are collinear. To investigate the performance of the traditional ML and the RR approaches we use Monte Carlo simulations where the MSE is used as performance criteria. The simulated results indicate that the RR approach should always be preferred to the ML estimation method.     

On maximum likelihood estimation of the long-memory parameter in fractional Gaussian noise

Approximate normality and unbiasedness of the maximum likelihood estimate (MLE) of the long-memory parameter H of a fractional Brownian motion hold reasonably well for sample sizes as small as 20 if the mean and scale parameter are known. We show in a Monte Carlo study that if the latter two parameters are unknown the bias and variance of the MLE of H both increase substantially. We also show that the bias can be reduced by using a parametric bootstrap procedure. In very large samples, maximum likelihood estimation becomes problematic because of the large dimension of the covariance matrix that must be inverted. To overcome this difficulty, we propose a maximum likelihood method based upon first differences of the data. These first differences form a short-memory process. We split the data into a number of contiguous blocks consisting of a relatively small number of observations. Computation of the likelihood function in a block then presents no computational problem. We form a pseudo-likelihood function consisting of the product of the likelihood functions in each of the blocks and provide a formula for the standard error of the resulting estimator of H. This formula is shown in a Monte Carlo study to provide a good approximation to the true standard error. The computation time required to obtain the estimate and its standard error from large data sets is an order of magnitude less than that required to obtain the widely used Whittle estimator. Application of the methodology is illustrated on two data sets.     

A robust closed-form estimator for the GARCH(1,1) model

In this paper we extend the closed-form estimator for the generalized autoregressive conditional heteroscedastic (GARCH(1,1)) proposed by Kristensen and Linton [A closed-form estimator for the GARCH(1,1) model. Econom Theory. 2006;22:323–337] to deal with additive outliers. It has the advantage that is per se more robust that the maximum likelihood estimator (ML) often used to estimate this model, it is easy to implement and does not require the use of any numerical optimization procedure. The robustification of the closed-form estimator is done by replacing the sample autocorrelations by a robust estimator of these correlations and by estimating the volatility using robust filters. The performance of our proposal in estimating the parameters and the volatility of the GARCH(1,1) model is compared with the proposals existing in the literature via intensive Monte Carlo experiments and the results of these experiments show that our proposal outperforms the ML and quasi-maximum likelihood estimators-based procedures. Finally, we fit the robust closed-form estimator and the benchmarks to one series of financial returns and analyse their performances in estimating and forecasting the volatility and the value-at-risk.     

Consistency of maximum likelihood estimators for the regime-switching GARCH model

The regime-switching GARCH (generalized autoregressive conditionally heteroscedastic) model incorporates the idea of Markov switching into the more restrictive GARCH model, which significantly extends the GARCH model. However, the statistical inference for such an extended model is rather difficult because observations at any time point then depend on the whole regime path and the likelihood becomes intractable quickly as the length of observations increases. In this paper, by transforming it into an infinite order ARCH model, we obtain the possibility of writing a likelihood which can be handled directly and the consistency of the maximum likelihood estimators is proved. Simulation studies to illustrate the consistency and asymptotic normality of the estimators (for both Gaussian and non-Gaussian innovations) and a model specification problem are presented.     

Empirical distribution function under heteroscedasticity

Neglecting heteroscedasticity of error terms may imply the wrong identification of a regression model (see appendix). Employment of (heteroscedasticity resistent) White's estimator of covariance matrix of estimates of regression coefficients may lead to the correct decision about the significance of individual explanatory variables under heteroscedasticity. However, White's estimator of covariance matrix was established for least squares (LS)-regression analysis (in the case when error terms are normally distributed, LS- and maximum likelihood (ML)-analysis coincide and hence then White's estimate of covariance matrix is available for ML-regression analysis, tool). To establish White's-type estimate for another estimator of regression coefficients requires Bahadur representation of the estimator in question, under heteroscedasticity of error terms. The derivation of Bahadur representation for other (robust) estimators requires some tools. As the key too proved to be a tight approximation of the empirical distribution function (d.f.) of residuals by the theoretical d.f. of the error terms of the regression model. We need the approximation to be uniform in the argument of d.f. as well as in regression coefficients. The present paper offers this approximation for the situation when the error terms are heteroscedastic.     

Quasi-Maximum Likelihood Estimation of GARCH Models With Heavy-Tailed Likelihoods

The non-Gaussian maximum likelihood estimator is frequently used in GARCH models with the intention of capturing heavy-tailed returns. However, unless the parametric likelihood family contains the true likelihood, the estimator is inconsistent due to density misspecification. To correct this bias, we identify an unknown scale parameter η_f that is critical to the identification for consistency and propose a three-step quasi-maximum likelihood procedure with non-Gaussian likelihood functions. This novel approach is consistent and asymptotically normal under weak moment conditions. Moreover, it achieves better efficiency than the Gaussian alternative, particularly when the innovation error has heavy tails. We also summarize and compare the values of the scale parameter and the asymptotic efficiency for estimators based on different choices of likelihood functions with an increasing level of heaviness in the innovation tails. Numerical studies confirm the advantages of the proposed approach.     

Normal Mixture Quasi-maximum Likelihood Estimator for GARCH Models

Abstract.  The generalized autoregressive conditional heteroscedastic (GARCH) model has been popular in the analysis of financial time series data with high volatility. Conventionally, the parameter estimation in GARCH models has been performed based on the Gaussian quasi-maximum likelihood. However, when the innovation terms have either heavy-tailed or skewed distributions, the quasi-maximum likelihood estimator (QMLE) does not function well. In order to remedy this defect, we propose the normal mixture QMLE (NM-QMLE), which is obtained from the normal mixture quasi-likelihood, and demonstrate that the NM-QMLE is consistent and asymptotically normal. Finally, we present simulation results and a real data analysis in order to illustrate our findings.     

A Spline‐Based Semiparametric Maximum Likelihood Estimation Method for the Cox Model with Interval‐Censored Data

Abstract. We propose a spline‐based semiparametric maximum likelihood approach to analysing the Cox model with interval‐censored data. With this approach, the baseline cumulative hazard function is approximated by a monotone B‐spline function. We extend the generalized Rosen algorithm to compute the maximum likelihood estimate. We show that the estimator of the regression parameter is asymptotically normal and semiparametrically efficient, although the estimator of the baseline cumulative hazard function converges at a rate slower than root‐n. We also develop an easy‐to‐implement method for consistently estimating the standard error of the estimated regression parameter, which facilitates the proposed inference procedure for the Cox model with interval‐censored data. The proposed method is evaluated by simulation studies regarding its finite sample performance and is illustrated using data from a breast cosmesis study.