Combining estimating functions for volatility

Accurate estimates of volatility are needed in risk management. Generalized autoregressive conditional heteroscedastic (GARCH) models and random coefficient autoregressive (RCA) models have been used for volatility modelling. Following Heyde [1997. Quasi-likelihood and its Applications. Springer, New York], volatility estimates are obtained by combining two different estimating functions. It turns out that the combined estimating function for the parameter in autoregressive processes with GARCH errors and RCA models contains maximum information. The combination of the least squares (LS) estimating function and the least absolute deviation (LAD) estimating function with application to GARCH model error identification is discussed as an application.     

Indirect estimation of randomized generalized autoregressive conditional heteroskedastic models

The class of generalized autoregressive conditional heteroskedastic (GARCH) models can be used to describe the volatility with less parameters than autoregressive conditional heteroskedastic (ARCH)-type models, their distributions are heavy-tailed, with time-dependent conditional variance, and are able to model clustering of volatility. Despite all these facts, the way that GARCH models are built imposes limits on the heaviness of the tails of their unconditional distribution. The class of randomized generalized autoregressive conditional heteroskedastic (R-GARCH) models includes the ARCH and GARCH models allowing the use of stable innovations. Estimation methods and empirical analysis of R-GARCH models are the focus of this work. We present the indirect inference method to estimate the R-GARCH models, some simulations and an empirical application.     

Adaptive LASSO estimation for ARDL models with GARCH innovations

ABSTRACT

In this paper, we show the validity of the adaptive least absolute shrinkage and selection operator (LASSO) procedure in estimating stationary autoregressive distributed lag(p,q) models with innovations in a broad class of conditionally heteroskedastic models. We show that the adaptive LASSO selects the relevant variables with probability converging to one and that the estimator is oracle efficient, meaning that its distribution converges to the same distribution of the oracle-assisted least squares, i.e., the least square estimator calculated as if we knew the set of relevant variables beforehand. Finally, we show that the LASSO estimator can be used to construct the initial weights. The performance of the method in finite samples is illustrated using Monte Carlo simulation.     

Value-at-risk forecasting based on Gaussian mixture ARMA–GARCH model

In this paper, we develop a new forecasting algorithm for value-at-risk (VaR) based on ARMA–GARCH (autoregressive moving average–generalized autoregressive conditional heteroskedastic) models whose innovations follow a Gaussian mixture distribution. For the parameter estimation, we employ the conditional least squares and quasi-maximum-likelihood estimator (QMLE) for ARMA and GARCH parameters, respectively. In particular, Gaussian mixture parameters are estimated based on the residuals obtained from the QMLE of GARCH parameters. Our algorithm provides a handy methodology, spending much less time in calculation than the existing resampling and bias-correction method developed in Hartz et al. [Accurate value-at-risk forecasting based on the normal-GARCH model, Comput. Stat. Data Anal. 50 (2006), pp. 3032–3052]. Through a simulation study and a real-data analysis, it is shown that our method provides an accurate VaR prediction.     

Best Spatial Two-Stage Least Squares Estimators for a Spatial Autoregressive Model with Autoregressive Disturbances

Estimation of a cross-sectional spatial model containing both a spatial lag of the dependent variable and spatially autoregressive disturbances are considered. [Kelejian and Prucha (1998)]described a generalized two-stage least squares procedure for estimating such a spatial model. Their estimator is, however, not asymptotically optimal. We propose best spatial 2SLS estimators that are asymptotically optimal instrumental variable (IV) estimators. An associated goodness-of-fit (or over identification) test is available. We suggest computationally simple and tractable numerical procedures for constructing the optimal instruments.     

An On-Line Estimation Algorithm for Periodic Autoregressive Models

This paper develops an on-line estimation algorithm for periodic autoregressive models (PAR). Indeed, we provide an adaptation of the well known recursive least squares algorithm (RLS), which has been successfully applied to classical autoregressive models (AR), to deal with PAR models. The obtained estimators are shown to be asymptotically efficient under mild conditions. Moreover, the performance of the periodic least squares algorithm (PRLS) is assessed via an intensive simulation study.     

Inference for linear and nonlinear stable error processes via estimating functions

This paper describes an estimating function approach for parameter estimation in linear and nonlinear times series models with infinite variance stable errors. Joint estimates of location and scale parameters are derived for classes of autoregressive (AR) models and random coefficient autoregressive (RCA) models with stable errors, as well as for AR models with stable autoregressive conditionally heteroscedastic (ARCH) errors. Fast, on-line, recursive parametric estimation for the location parameter based on estimating functions is discussed using simulation studies. A real financial time series is also discussed in some detail.     

Self-weighted recursive estimation of GARCH models

The generalized autoregressive conditional heteroscedasticity (GARCH) processes are frequently used to investigate and model financial returns. They are routinely estimated by computationally complex off-line estimation methods, for example, by the conditional maximum likelihood procedure. However, in many empirical applications (especially in the context of high-frequency financial data), it seems necessary to apply numerically more effective techniques to calibrate and monitor such models. The aims of this contribution are: (i) to review the previously introduced recursive estimation algorithms and to derive self-weighted alternatives applying general recursive identification instruments, and (ii) to examine these methods by means of simulations and an empirical application.     

Two-stage estimation of inequality-constrained marginal linear models with longitudinal data

Inequality-constrained regression models have received increased attention in longitudinal analysis during recent years. Regression parameters are usually obtained from iteration algorithms. An analytical formulae of the estimators cannot be provided. Therefore, the asymptotic behavior of estimators has not been fully clarified yet. This paper presents a TS estimation (TS for short) and the asymptotic distribution of the estimators. Simulations are conducted to compare constrained TS estimation, constrained ordinary least squares (OLS) estimation and TS estimation in terms of sample bias, sample mean-square error (MSE) and sample variance of the estimators.     

Consistency of maximum likelihood estimators for the regime-switching GARCH model

The regime-switching GARCH (generalized autoregressive conditionally heteroscedastic) model incorporates the idea of Markov switching into the more restrictive GARCH model, which significantly extends the GARCH model. However, the statistical inference for such an extended model is rather difficult because observations at any time point then depend on the whole regime path and the likelihood becomes intractable quickly as the length of observations increases. In this paper, by transforming it into an infinite order ARCH model, we obtain the possibility of writing a likelihood which can be handled directly and the consistency of the maximum likelihood estimators is proved. Simulation studies to illustrate the consistency and asymptotic normality of the estimators (for both Gaussian and non-Gaussian innovations) and a model specification problem are presented.     

Asymptotic Behavior of Conditional Least Squares Estimators for Unstable Integer‐valued Autoregressive Models of Order 2

In this paper, the asymptotic behavior of the conditional least squares estimators of the autoregressive parameters, of the mean of the innovations, and of the stability parameter for unstable integer‐valued autoregressive processes of order 2 is described. The limit distributions and the scaling factors are different according to the following three cases: (i) decomposable, (ii) indecomposable but not positively regular, and (iii) positively regular models.     

Generalized Least Squares Model Averaging

In this article, we propose a method of averaging generalized least squares estimators for linear regression models with heteroskedastic errors. The averaging weights are chosen to minimize Mallows’ C_p-like criterion. We show that the weight vector selected by our method is optimal. It is also shown that this optimality holds even when the variances of the error terms are estimated and the feasible generalized least squares estimators are averaged. The variances can be estimated parametrically or nonparametrically. Monte Carlo simulation results are encouraging. An empirical example illustrates that the proposed method is useful for predicting a measure of firms’ performance.     

Variance bounds for estimators in autoregressive models with constraints

We consider nonlinear and heteroscedastic autoregressive models whose residuals are martingale increments with conditional distributions that fulfil certain constraints. We treat two classes of constraints: residuals depending on the past through some function of the past observations only, and residuals that are invariant under some finite group of transformations. We determine the efficient influence function for estimators of the autoregressive parameter in such models, calculate variance bounds, discuss information gains, and suggest how to construct efficient estimators. Without constraints, efficient estimators can be given by weighted least squares estimators. With the constraints considered here, efficient estimators are obtained differently, as one-step improvements of some initial estimator, similarly as in autoregressive models with independent increments.     

Estimating multivariate autoregressive moving average models by fitting long autoregressions

Some simple methods for the estimation of mixed multivariate autoregressive moving average time series models are introduced. The methods require the fitting of a long autoregression to the data and the computation of consistent initial estimates for the parameters of the model. After these preliminaries the estimators of the paper are obtained by applying weighted least squares to a multivariate auxiliary regression model. Two types of weight matrices are considered. Both of them yield estimators which are strongly consistent and asymptotically normally distributed. The first estimators are also asymptotically efficient while the second ones are not fully efficient but computationally simple. A simulation study is performed to illustrate the behaviour of the estimators in finite samples.     

Misspecification tests for periodic long memory GARCH models

Distributional theory for Quasi-Maximum Likelihood estimators in long memory conditional heteroskedastic models is not formally defined, even asymptotically. Because of that, this paper analyses the real size and power of the likelihood ratio and the Lagrange multiplier misspecification tests when periodic long memory GARCH models are involved. The performance of these tests is studied by means of Monte Carlo simulations with respect to the class of generalized long memory GARCH models. For this class of models, analytical derivatives are developed. An application to the USD/JPY exchange rate is also provided.     

A tobit model with garch errors

In the context of time series regression, we extend the standard Tobit model to allow for the possibility of conditional heteroskedastic error processes of the GARCH type. We discuss the likelihood function of the Tobit model in the presence of conditionally heteroskedastic errors. Expressing the exact likelihood function turns out to be infeasible, and we propose an approximation by treating the model as being conditionally Gaussian. The performance of the estimator is investigated by means of Monte Carlo simulations. We find that, when the error terms follow a GARCH process, the proposed estimator considerably outperforms the standard Tobit quasi maximum likelihood estimator. The efficiency loss due to the approximation of the likelihood is finally evaluated.     

Exploring the Impact of Multivariate GARCH Innovations on Hypothesis Testing for Cointegrating Vectors

This article investigates the impact of multivariate generalized autoregressive conditional heteroskedastic (GARCH) errors on hypothesis testing for cointegrating vectors. The study reviews a cointegrated vector autoregressive model incorporating multivariate GARCH innovations and a regularity condition required for valid asymptotic inferences. Monte Carlo experiments are then conducted on a test statistic for a hypothesis on the cointegrating vectors. The experiments demonstrate that the regularity condition plays a critical role in rendering the hypothesis testing operational. It is also shown that Bartlett-type correction and wild bootstrap are useful in improving the small-sample size and power performance of the test statistic of interest.     

Estimation in conditional first order autoregression with discrete support

We consider estimation in the class of first order conditional linear autoregressive models with discrete support that are routinely used to model time series of counts. Various groups of estimators proposed in the literature are discussed: moment-based estimators; regression-based estimators; and likelihood-based estimators. Some of these have been used previously and others not. In particular, we address the performance of new types of generalized method of moments estimators and propose an exact maximum likelihood procedure valid for a Poisson marginal model using backcasting. The small sample properties of all estimators are comprehensively analyzed using simulation. Three situations are considered using data generated with: a fixed autoregressive parameter and equidispersed Poisson innovations; negative binomial innovations; and, additionally, a random autoregressive coefficient. The first set of experiments indicates that bias correction methods, not hitherto used in this context to our knowledge, are some-times needed and that likelihood-based estimators, as might be expected, perform well. The second two scenarios are representative of overdispersion. Methods designed specifically for the Poisson context now perform uniformly badly, but simple, bias-corrected, Yule-Walker and least squares estimators perform well in all cases.     

Semiparametric ARCH Models: An Estimating Function Approach

We introduce the method of estimating functions to study the class of autoregressive conditional heteroscedasticity (ARCH) models. We derive the optimal estimating functions by combining linear and quadratic estimating functions. The resultant estimators are more efficient than the quasi-maximum likelihood estimator. If the assumption of conditional normality is imposed, the estimator obtained by using the theory of estimating functions is identical to that obtained by using the maximum likelihood method in finite samples. The relative efficiencies of the estimating function (EF) approach in comparison with the quasi-maximum likelihood estimator are developed. We illustrate the EF approach using a univariate GARCH(1,1) model with conditional normal, Student-t, and gamma distributions. The efficiency benefits of the EF approach relative to the quasi-maximum likelihood approach are substantial for the gamma distribution with large skewness. Simulation analysis shows that the finite-sample properties of the estimators from the EF approach are attractive. EF estimators tend to display less bias and root mean squared error than the quasi-maximum likelihood estimator. The efficiency gains are substantial for highly nonnormal distributions. An example demonstrates that implementation of the method is straightforward.     

Nonparametric maximum likelihood estimators for ar and ma time series

The problem of estimating the parameters of moving average or autoregressive time series is studied when the error distribution is completely unknown. Four nonparametric maximum likelihood estimators (NPMLE) are presented for this purpose. These estimators are compared with the classical moment and least squares estimators in a simulation study. The behavior of these NPMLEs is much better than the classical ones, suggesting that they should be used extensively when no parametric information is known in advance about the error distribution. An application of these estimators to coal mining accidents data is also included.