Maximum Likelihood Estimation for Stochastic Differential Equations with Random Effects

Abstract. We consider N independent stochastic processes (X _i (t), t ∈ [0,T _i ]), i=1,…, N, defined by a stochastic differential equation with drift term depending on a random variable φ _i . The distribution of the random effect φ _i depends on unknown parameters which are to be estimated from the continuous observation of the processes X_i. We give the expression of the exact likelihood. When the drift term depends linearly on the random effect φ _i and φ _i has Gaussian distribution, an explicit formula for the likelihood is obtained. We prove that the maximum likelihood estimator is consistent and asymptotically Gaussian, when T _i =T for all i and N tends to infinity. We discuss the case of discrete observations. Estimators are computed on simulated data for several models and show good performances even when the length time interval of observations is not very large.     

Quasi-maximum exponential likelihood estimation for a non stationary GARCH(1,1) model

ABSTRACT

This article investigates a quasi-maximum exponential likelihood estimator(QMELE) for a non stationary generalized autoregressive conditional heteroscedastic (GARCH(1,1)) model. Asymptotic normality of this estimator is derived under a non stationary condition. A simulation study and a real example are given to evaluate the performance of QMELE for this model.     

Inference for Box–Cox Transformed Threshold GARCH Models with Nuisance Parameters

Abstract. Generalized autoregressive conditional heteroscedastic (GARCH) models have been widely used for analyzing financial time series with time‐varying volatilities. To overcome the defect of the Gaussian quasi‐maximum likelihood estimator (QMLE) when the innovations follow either heavy‐tailed or skewed distributions, Berkes & Horváth (Ann. Statist., 32, 633, 2004) and Lee & Lee (Scand. J. Statist. 36, 157, 2009) considered likelihood methods that use two‐sided exponential, Cauchy and normal mixture distributions. In this paper, we extend their methods for Box–Cox transformed threshold GARCH model by allowing distributions used in the construction of likelihood functions to include parameters and employing the estimated quasi‐likelihood estimators (QELE) to handle those parameters. We also demonstrate that the proposed QMLE and QELE are consistent and asymptotically normal under regularity conditions. Simulation results are provided for illustration.     

Pseudo maximum-likelihood estimation of the univariate GARCH (1,1) and asymptotic properties

One provides in this paper the pseudo-likelihood estimator (PMLE) and asymptotic theory for the GARCH (1,1) process. Strong consistency of the pseudo-maximum-likelihood estimator (MLE) is established by appealing to conditions given in Jeantheau (1998) concerning the existence of a stationary and ergodic solution to the multivariate GARCH (p, q) process. One proves the asymptotic normality of the PMLE by appealing to martingales' techniques.     

Estimation of probability of extinction of a multitype branchihg process

Maximoa likelihood estimation of the probability of ultimata extinction of a possibly age dependentaultitype branching process is studied when independent random samples from off spring distributions are available, In multitype daIton-fatson branching process     

Higher Moments and Prediction‐Based Estimation for the COGARCH(1,1) Model

COGARCH models are continuous time versions of the well‐known GARCH models of financial returns. The first aim of this paper is to show how the method of prediction‐based estimating functions can be applied to draw statistical inference from observations of a COGARCH(1,1) model if the higher‐order structure of the process is clarified. A second aim of the paper is to provide recursive expressions for the joint moments of any fixed order of the process. Asymptotic results are given, and a simulation study shows that the method of prediction‐based estimating function outperforms the other available estimation methods.     

Estimation and Properties of a Time-Varying EGARCH(1,1) in Mean Model

Time-varying GARCH-M models are commonly employed in econometrics and financial economics. Yet the recursive nature of the conditional variance makes likelihood analysis of these models computationally infeasible. This article outlines the issues and suggests to employ a Markov chain Monte Carlo algorithm which allows the calculation of a classical estimator via the simulated EM algorithm or a simulated Bayesian solution in only O(T) computational operations, where T is the sample size. Furthermore, the theoretical dynamic properties of a time-varying-parameter EGARCH(1,1)-M are derived. We discuss them and apply the suggested Bayesian estimation to three major stock markets.     

Pseudo maximum likelihood estimation of the univariate GARCH (2,2) and asymptotic normality under dependent innovations

In this paper, we first consider the pseudo maximum likelihood estimation of the univariate GARCH (2,2) model and derive the underlying estimator. Then, we make use of the technique of martingales to establish the asymptotic normality of the pseudo-maximum likelihood estimator (PMLE) of the univariate GARCH (2,2) model. Contrary to previous approaches encountered in the statistical literature, the pseudo-likelihood function uses the general form of the density laws of the quadratic exponential family.     

Inference for the tail index of a GARCH(1,1) model and an AR(1) model with ARCH(1) errors

For a GARCH(1,1) sequence or an AR(1) model with ARCH(1) errors, one can estimate the tail index by solving an estimating equation with unknown parameters replaced by the quasi maximum likelihood estimation, and a profile empirical likelihood method can be employed to effectively construct a confidence interval for the tail index. However, this requires that the errors of such a model have at least a finite fourth moment. In this article, we show that the finite fourth moment can be relaxed by employing a least absolute deviations estimate for the unknown parameters by noting that the estimating equation for determining the tail index is invariant to a scale transformation of the underlying model.     

Edgeworth and Moment Approximations: The Case of MM and QML Estimators for the MA(1) Models

Extending the results in Sargan (1976 Sargan , J. D. ( 1976 ). Econometric estimators and the Edgeworth approximation . Econometrica 44 : 421 – 448 .[Crossref], [Web of Science ®] , [Google Scholar]) and Tanaka (1984 Tanaka , K. ( 1984 ). An asymptotic expansion associated with the maximum likelihood estimators in ARMA models . J. Roy. Statist. Soc. B 46 : 58 – 67 . [Google Scholar]), we derive the asymptotic expansions of the distribution, the bias and the mean squared error of the MM and QML estimators of the first-order autocorrelation and the MA parameter for the MA(1) model. It turns out that the asymptotic properties of the estimators depend on whether the mean of the process is known or estimated. A comparison of the moment expansions, either in terms of bias or MSE, reveals that there is not uniform superiority of neither of the estimators, when the mean of the process is estimated. This is also confirmed by simulations. In the zero-mean case, and on theoretical grounds, the QMLEs are superior to the MM ones in both bias and MSE terms. We also discuss how the approximations are affected by moderate deviations from the unit root case. The results presented here are important for bias correction and increasing the efficiency of the estimators.     

A stochastic variant of the EM algorithm to fit mixed (discrete and continuous) longitudinal data with nonignorable missingness

Abstract

In longitudinal studies data are collected on the same set of units for more than one occasion. In medical studies it is very common to have mixed Poisson and continuous longitudinal data. In such studies, for different reasons, some intended measurements might not be available resulting in a missing data setting. When the probability of missingness is related to the missing values, the missingness mechanism is termed nonrandom. The stochastic expectation-maximization (SEM) algorithm and the parametric fractional imputation (PFI) method are developed to handle nonrandom missingness in mixed discrete and continuous longitudinal data assuming different covariance structures for the continuous outcome. The proposed techniques are evaluated using simulation studies. Also, the proposed techniques are applied to the interstitial cystitis data base (ICDB) data.