Maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes

In this paper, we investigate the maximum likelihood estimation for the reflected Ornstein-Uhlenbeck (ROU) processes based on continuous observations. Both the cases with one-sided barrier and two-sided barriers are considered. We derive the explicit formulas for the estimators, and then prove their strong consistency and asymptotic normality. Moreover, the bias and mean square errors are represented in terms of the solutions to some PDEs with homogeneous Neumann boundary conditions. We also illustrate the asymptotic behavior of the estimators through a simulation study.     

On maximum likelihood estimation of the long-memory parameter in fractional Gaussian noise

Approximate normality and unbiasedness of the maximum likelihood estimate (MLE) of the long-memory parameter H of a fractional Brownian motion hold reasonably well for sample sizes as small as 20 if the mean and scale parameter are known. We show in a Monte Carlo study that if the latter two parameters are unknown the bias and variance of the MLE of H both increase substantially. We also show that the bias can be reduced by using a parametric bootstrap procedure. In very large samples, maximum likelihood estimation becomes problematic because of the large dimension of the covariance matrix that must be inverted. To overcome this difficulty, we propose a maximum likelihood method based upon first differences of the data. These first differences form a short-memory process. We split the data into a number of contiguous blocks consisting of a relatively small number of observations. Computation of the likelihood function in a block then presents no computational problem. We form a pseudo-likelihood function consisting of the product of the likelihood functions in each of the blocks and provide a formula for the standard error of the resulting estimator of H. This formula is shown in a Monte Carlo study to provide a good approximation to the true standard error. The computation time required to obtain the estimate and its standard error from large data sets is an order of magnitude less than that required to obtain the widely used Whittle estimator. Application of the methodology is illustrated on two data sets.     

A comparison of estimation methods in non-stationary ARFIMA processes

This paper reports an extensive Monte Carlo simulation study based on six estimators for the long memory fractional parameter when the time series is non-stationary, i.e., ARFIMA(p, d, q) process for d?>?0.5. Parametric and semiparametric methods are compared. In addition, the effect of the parameter estimation is investigated for small and large sample sizes and non-Gaussian error innovations. The methodology is applied to a well known data set, the so-called UK short interest rates.     

Maximum likelihood estimation of ARFIMA models with a Box-Cox transformation

In this paper we study the interaction between the estimation of the fractional differencing parameter d of ARFIMA models and the common practice of instantaneous transformation of the observed time series. At this aim, we first discuss the effect of a nonlinear transformation of the data on the identification of the process and on the estimate of d. Thus, we propose a joint estimation of the Box-Cox parameter and d by means of a modified normalized version of the Whittle likelihood. Then, the variance and covariance matrix of the parameters estimates is obtained. Finally, a Monte Carlo study is performed in order to check the behaviour of the proposed estimators in finite samples.The paper is the result of a joint research of the two authors. As far as it concerns this version of the work, A. DElia wrote Sects. 2, 3, 4, while D. Piccolo wrote Sects. 1, 5, 6.     

Maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes with jumps

In this paper, we investigate the maximum likelihood estimation for the reflected Ornstein-Uhlenbeck processes with jumps based on continuous observations. We derive likelihood functions by using semimartingale theory. From this we get explicit formulas for estimators. The strong consistence and asymptotic normality of estimators are proved by using the method of stochastic integration.     

Maximum simulated likelihood estimation of the panel sample selection model

Heckman's (1976 Heckman, J. J. (1976). The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement 15:475–492. [Google Scholar], 1979 Heckman, J. J. (1979). Sample selection bias as a specification error. Econometrica 47(1):153–161.[Crossref], [Web of Science ®] , [Google Scholar]) sample selection model has been employed in many studies of linear and nonlinear regression applications. It is well known that ignoring the sample selectivity may result in inconsistency of the estimator due to the correlation between the statistical errors in the selection and main equations. In this article, we reconsider the maximum likelihood estimator for the panel sample selection model in Keane et al. (1988 Keane, M., Moffitt, R., Runkle, D. (1988). Real wages over the business cycle: Estimating the impact of heterogeneity with micro data. Journal of Political Economy 96:1232–1266.[Crossref], [Web of Science ®] , [Google Scholar]). Since the panel data model contains individual effects, such as fixed or random effects, the likelihood function is more complicated than that of the classical Heckman model. As an alternative to the existing derivation of the likelihood function in the literature, we show that the conditional distribution of the main equation follows a closed skew-normal (CSN) distribution, of which the linear transformation is still a CSN. Although the evaluation of the likelihood function involves high-dimensional integration, we show that the integration can be further simplified into a one-dimensional problem and can be evaluated by the simulated likelihood method. Moreover, we also conduct a Monte Carlo experiment to investigate the finite sample performance of the proposed estimator and find that our estimator provides reliable and quite satisfactory results.     

ARFIMA processes and outliers: a weighted likelihood approach

In this paper, we consider the problem of robust estimation of the fractional parameter, d, in long memory autoregressive fractionally integrated moving average processes, when two types of outliers, i.e. additive and innovation, are taken into account without knowing their number, position or intensity. The proposed method is a weighted likelihood estimation (WLE) approach for which needed definitions and algorithm are given. By an extensive Monte Carlo simulation study, we compare the performance of the WLE method with the performance of both the approximated maximum likelihood estimation (MLE) and the robust M-estimator proposed by Beran (Statistics for Long-Memory Processes, Chapman & Hall, London, 1994). We find that robustness against the two types of considered outliers can be achieved without loss of efficiency. Moreover, as a byproduct of the procedure, we can classify the suspicious observations in different kinds of outliers. Finally, we apply the proposed methodology to the Nile River annual minima time series.     

An algorithm for the multivariate group lasso with covariance estimation

We study a group lasso estimator for the multivariate linear regression model that accounts for correlated error terms. A block coordinate descent algorithm is used to compute this estimator. We perform a simulation study with categorical data and multivariate time series data, typical settings with a natural grouping among the predictor variables. Our simulation studies show the good performance of the proposed group lasso estimator compared to alternative estimators. We illustrate the method on a time series data set of gene expressions.     

Parameter estimation for multivariate diffusion processes with the time inhomogeneously positive semidefinite diffusion matrix

Statistical inference for the diffusion coefficients of multivariate diffusion processes has been well established in recent years; however, it is not the case for the drift coefficients. Furthermore, most existing estimation methods for the drift coefficients are proposed under the assumption that the diffusion matrix is positive definite and time homogeneous. In this article, we put forward two estimation approaches for estimating the drift coefficients of the multivariate diffusion models with the time inhomogeneously positive semidefinite diffusion matrix. They are maximum likelihood estimation methods based on both the martingale representation theorem and conditional characteristic functions and the generalized method of moments based on conditional characteristic functions, respectively. Consistency and asymptotic normality of the generalized method of moments estimation are also proved in this article. Simulation results demonstrate that these methods work well.     

On the maximum likelihood estimation of parameters of a spatial discrimination model

Consideration is given here to the problem of maximum likelihood estimation of parameters in a sparial discrimination model which was proposed by switzer (1980). some moments of these estimators are derived. These results extend the work of Mardia (1984) who gave expressions for these estimators without their moments.     

Maximum likelihood estimation in convex hull models

In this paper we consider models involving the convex hull operation of the parameter and the noise i.e. Y_i = CH(A, X_X). Then we generalize the basic models to ANOVA models; i.e. Y_ij=CH(A∪B_j,X_ij). In some cases the consistent estimators for the J U new parameters are derived. Assuming the existence of density forrandom convex sets, we derive the likelihood for the convex hull model. We then find the maximum Likelihood Estimators for the parameters. Examples for some random convex sets with finite dimensional distributions are derived to show how good these estimators are.     

Maximum likelihood estimation for the negative multinomial log-linear model

A log-linear model is defined for multiway contingency tables with negative multinomial frequency counts. The maximum likelihood estimator of the model parameters and the estimator covariance matrix is given. The likelihood ratio test for the general log-linear hypothesis also is presented.     

Pseudo maximum likelihood estimation for the dirichlet-multinomial distribution

Pseudo maximum likelihood estimation (PML) for the Dirich-let-multinomial distribution is proposed and examined in this pa-per. The procedure is compared to that based on moments (MM) for its asymptotic relative efficiency (ARE) relative to the maximum likelihood estimate (ML). It is found that PML, requiring much less computational effort than ML and possessing considerably higher ARE than MM, constitutes a good compromise between ML and MM. PML is also found to have very high ARE when an estimate for the scale parameter in the Dirichlet-multinomial distribution is all that is needed.     

Wavelet Estimation of an Unknown Function Observed with Correlated Noise

Tests based on rank statistics are introduced to test for systematic changes in a sequence of independent observations. Proposed tests include a rank test analogous to the parametric likelihood ratio test and others analogous to parametric Bayes tests. The tests are usable with either one- or two-sided alternative hypotheses, and their asymptotic distributions are studied. The results of the general model are applied to two special cases, and their asymptotic distributions are also investigated. A Monte Carlo study verifies the applicability of asymptotic critical points in samples of moderate size, and other simulation studies compare power of the competing tests and their special-case versions. Finally, these tests are applied to a data set of traffic fatalities.     

Parametric estimation under a class of multivariate distributions

In this paper the parameters of some members of a class of multivariate distributions, which was constructed by AL-Hussaini and Ateya (2003), are estimated by using the maximum likelihood and Bayes methods.     

Asymptotic approximation of the likelihood of stationary determinantal point processes

Continuous determinantal point processes (DPPs) are a class of repulsive point processes on ${ℝ}^d$ with many statistical applications. Although an explicit expression of their density is known, it is too complicated to be used directly for maximum likelihood estimation. In the stationary case, an approximation using Fourier series has been suggested, but it is limited to rectangular observation windows and no theoretical results support it. In this contribution, we investigate a different way to approximate the likelihood by looking at its asymptotic behavior when the observation window grows toward ${ℝ}^d$. This new approximation is not limited to rectangular windows, is faster to compute than the previous one, does not require any tuning parameter, and some theoretical justifications are provided. It moreover provides an explicit formula for estimating the asymptotic variance of the associated estimator. The performances are assessed in a simulation study on standard parametric models on ${ℝ}^d$ and compare favorably to common alternative estimation methods for continuous DPPs.     

Maximum penalized likelihood estimation for skew-normal and skew-t distributions

The skew-normal and the skew-t distributions are parametric families which are currently under intense investigation since they provide a more flexible formulation compared to the classical normal and t distributions by introducing a parameter which regulates their skewness. While these families enjoy attractive formal properties from the probability viewpoint, a practical problem with their usage in applications is the possibility that the maximum likelihood estimate of the parameter which regulates skewness diverges. This situation has vanishing probability for increasing sample size, but for finite samples it occurs with non-negligible probability, and its occurrence has unpleasant effects on the inferential process. Methods for overcoming this problem have been put forward both in the classical and in the Bayesian formulation, but their applicability is restricted to simple situations. We formulate a proposal based on the idea of penalized likelihood, which has connections with some of the existing methods, but it applies more generally, including the multivariate case.     

A semiparametric approach for modelling multivariate nonlinear time series

In this article, a semiparametric time‐varying nonlinear vector autoregressive (NVAR) model is proposed to model nonlinear vector time series data. We consider a combination of parametric and nonparametric estimation approaches to estimate the NVAR function for both independent and dependent errors. We use the multivariate Taylor series expansion of the link function up to the second order which has a parametric framework as a representation of the nonlinear vector regression function. After the unknown parameters are estimated by the maximum likelihood estimation procedure, the obtained NVAR function is adjusted by a nonparametric diagonal matrix, where the proposed adjusted matrix is estimated by the nonparametric kernel estimator. The asymptotic consistency properties of the proposed estimators are established. Simulation studies are conducted to evaluate the performance of the proposed semiparametric method. A real data example on short‐run interest rates and long‐run interest rates of United States Treasury securities is analyzed to demonstrate the application of the proposed approach. The Canadian Journal of Statistics 47: 668–687; 2019 © 2019 Statistical Society of Canada     

A nonparametric estimation procedure for the Hawkes process: comparison with maximum likelihood estimation

In earlier work, Kirchner [An estimation procedure for the Hawkes process. Quant Financ. 2017;17(4):571–595], we introduced a nonparametric estimation method for the Hawkes point process. In this paper, we present a simulation study that compares this specific nonparametric method to maximum-likelihood estimation. We find that the standard deviations of both estimation methods decrease as power-laws in the sample size. Moreover, the standard deviations are proportional. For example, for a specific Hawkes model, the standard deviation of the branching coefficient estimate is roughly 20% larger than for MLE – over all sample sizes considered. This factor becomes smaller when the true underlying branching coefficient becomes larger. In terms of runtime, our method clearly outperforms MLE. The present bias of our method can be well explained and controlled. As an incidental finding, we see that also MLE estimates seem to be significantly biased when the underlying Hawkes model is near criticality. This asks for a more rigorous analysis of the Hawkes likelihood and its optimization.     

Time varying long memory parameter estimation for locally stationary long memory processes

The semiparametric estimators of time varying long memory parameter are investigated for locally stationary long memory processes. The GPH estimator and the local Whittle estimator are considered. Under some mild regularity assumptions, the weak consistency and the asymptotic normality of the estimators are obtained. The finite sample performance of the estimators is discussed through a small simulation study.