Maximum likelihood estimation for the beta distribution

A fast method of calculating the two-parameter maximum-likelihood estimates of the beta distribution is given which does not require starting values and is generally free from convergence problems.     

Maximum likelihood estimation for branching migration process

The individuals of a population reproduce according to either the line arbirth process or the line arbirth- death process and simultaneously and independently migrate on the set of all integers according to a random walk in continuous time. The maximum likelihood estimators of the transition rates are obtained and their finite time and asymptotic properties are studied.     

Maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes

In this paper, we investigate the maximum likelihood estimation for the reflected Ornstein-Uhlenbeck (ROU) processes based on continuous observations. Both the cases with one-sided barrier and two-sided barriers are considered. We derive the explicit formulas for the estimators, and then prove their strong consistency and asymptotic normality. Moreover, the bias and mean square errors are represented in terms of the solutions to some PDEs with homogeneous Neumann boundary conditions. We also illustrate the asymptotic behavior of the estimators through a simulation study.     

Maximum likelihood estimation for bivariate SUR Tobit modeling in presence of two right-censored dependent variables

This article extends the analysis of the Seemingly Unrelated Regression (SUR) Tobit model for two right-censored dependent variables by modeling its nonlinear dependence structure through the rotated by 180 degrees version of the Clayton copula. An advantage of our approach is to provide unbiased point estimates of the marginal and copula parameters. Moreover, we discuss the construction of confidence intervals using bootstrap resampling procedures. The results of the performed simulation study demonstrate the good performance of the proposed methods. We illustrate our procedures using bivariate customer churn data from a Brazilian commercial bank.     

Maximum likelihood estimation of dirichlet distributions

Global concavity of the likelihood function is proved by means of an inequality involving the trigamma function. The computation of maximum likelihood estimates is discussed.     

Maximum likelihood estimation for the generalized poisson distribution

The generalized Poisson distribution;containing two

parameters and studied by many researchers; describes the distribution of busy periods under a queueing system and has very interesting properties; The probabilities for successive classes depend upon the previous occurrences; The problem of admissible maximum likelihood estimators for for the parameters Is discussed and a necessary and sufficient condition is derived for which unique admissible maximum likelihood estimators exist; The first; order terms in the biases; variances and the covariance of these maximum likelihood estimators are obtained.     

Maximum likelihood estimation for directional conditionally autoregressive models

A spatial process observed over a lattice or a set of irregular regions is usually modeled using a conditionally autoregressive (CAR) model. The neighborhoods within a CAR model are generally formed using only the inter-distances or boundaries between the regions. To accommodate directional spatial variation, a new class of spatial models is proposed using different weights given to neighbors in different directions. The proposed model generalizes the usual CAR model by accounting for spatial anisotropy. Maximum likelihood estimators are derived and shown to be consistent under some regularity conditions. Simulation studies are presented to evaluate the finite sample performance of the new model as compared to the CAR model. Finally, the method is illustrated using a data set on the crime rates of Columbus, OH and on the elevated blood lead levels of children under the age of 72 months observed in Virginia in the year of 2000.     

Maximum likelihood estimation for the wrapped Cauchy distribution

The wrapped Cauchy distribution is an alternative to the Fisher-von Mises distribution for modeling symmetric data on the circle, and its maximum likelihood estimate (m.l.e.) represents a robust alternative to the mean direction for estimating the location for circular data. Surprisingly, there appear to be no previous results on the m.l.e. for the wrapped Cauchy distribution. It is shown that for sample sizes greater than two, the m.l.e. exists, is unique, and can be found by solving the likelihood equations. Also, a simple algorithm is presented which converges to the m.l.e.     

Maximum likelihood drift estimation for a threshold diffusion

We study the maximum likelihood estimator of the drift parameters of a stochastic differential equation, with both drift and diffusion coefficients constant on the positive and negative axis, yet discontinuous at zero. This threshold diffusion is called drifted oscillating Brownian motion. For this continuously observed diffusion, the maximum likelihood estimator coincides with a quasi-likelihood estimator with constant diffusion term. We show that this estimator is the limit, as observations become dense in time, of the (quasi)-maximum likelihood estimator based on discrete observations. In long time, the asymptotic behaviors of the positive and negative occupation times rule the ones of the estimators. Differently from most known results of the literature, we do not restrict ourselves to the ergodic framework: indeed, depending on the signs of the drift, the process may be ergodic, transient, or null recurrent. For each regime, we establish whether or not the estimators are consistent; if they are, we prove the convergence in long time of the properly rescaled difference of the estimators towards a normal or mixed normal distribution. These theoretical results are backed by numerical simulations.     

Maximum likelihood estimation for outcome‐dependent samples

In outcome‐dependent sampling, the continuous or binary outcome variable in a regression model is available in advance to guide selection of a sample on which explanatory variables are then measured. Selection probabilities may either be a smooth function of the outcome variable or be based on a stratification of the outcome. In many cases, only data from the final sample is accessible to the analyst. A maximum likelihood approach for this data configuration is developed here for the first time. The likelihood for fully general outcome‐dependent designs is stated, then the special case of Poisson sampling is examined in more detail. The maximum likelihood estimator differs from the well‐known maximum sample likelihood estimator, and an information bound result shows that the former is asymptotically more efficient. A simulation study suggests that the efficiency difference is generally small. Maximum sample likelihood estimation is therefore recommended in practice when only sample data is available. Some new smooth sample designs show considerable promise.     

Maximum likelihood estimation for a nearly random walk model

This paper proposes an effective reparameterization method for the maximum likelihood estimation of a nearly random walk ARIMA (1,1,1) model, an important case where standard method of locating the MLE is not satisfactory. This model is equivalent to the permanent and temporary components model that Fama &French (1988) and others used to capture the slow mean reversion behavior of stock prices. The reparameterization method we prppose for estimating the nearly cancelled AR and MA parameters performs satisfactorily. The exact likelihood function based on the transformed parameters is studied. We argue that the region of interest will get magnified and emphasized in the transformed space, thus making the search for MLE more thorough and effective. Substantiai simuiation evidences are provided to demonstrate the effectiveness of the method. The sample size requirement is critical and is discussed in details. For application, this method is applied to estimate a nearly random walk ARIMA (1,1,1) model for NYSE/AMEX value-weighted market return in daily and longer holding-period horizons.     

Maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes with jumps

In this paper, we investigate the maximum likelihood estimation for the reflected Ornstein-Uhlenbeck processes with jumps based on continuous observations. We derive likelihood functions by using semimartingale theory. From this we get explicit formulas for estimators. The strong consistence and asymptotic normality of estimators are proved by using the method of stochastic integration.     

Maximum likelihood estimation for the negative multinomial log-linear model

A log-linear model is defined for multiway contingency tables with negative multinomial frequency counts. The maximum likelihood estimator of the model parameters and the estimator covariance matrix is given. The likelihood ratio test for the general log-linear hypothesis also is presented.     

Maximum likelihood estimation in convex hull models

In this paper we consider models involving the convex hull operation of the parameter and the noise i.e. Y_i = CH(A, X_X). Then we generalize the basic models to ANOVA models; i.e. Y_ij=CH(A∪B_j,X_ij). In some cases the consistent estimators for the J U new parameters are derived. Assuming the existence of density forrandom convex sets, we derive the likelihood for the convex hull model. We then find the maximum Likelihood Estimators for the parameters. Examples for some random convex sets with finite dimensional distributions are derived to show how good these estimators are.     

Distribution of a linear function of correlated ordered variables

In this paper, we have considered the problem of finding the distribution of a linear combination of the minimum and the maximum for a general bivariate distribution. The general results are used to obtain the required distribution in the case of bivariate normal, bivariate exponential of Arnold and Strauss, absolutely continuous bivariate exponential distribution of Block and Basu, bivariate exponential distribution of Raftery, Freund's bivariate exponential distribution and Gumbel's bivariate exponential distribution. The distributions of the minimum and maximum are obtained as special cases.     

Maximum likelihood estimation of the logarithmic series distribution

This paper discusses the maximum likelihood estimation of the parameter of the logarithmic series distribution. The univariate case is treated in Part I, the multivariate case in Part II. A simple numerical estimation procedure is suggested using a fixed point approach. Convergence to the maximum likelihood estimator is shown. In Part III convergence rate is proven to be linear which is also demonstrated through example. In addition, comparisons with Newton’s method and the secant method in the univariate case, and with Newton’s method and the projected gradient method in the multivariate case are provided.     

Maximum likelihood estimation of multivariate non-linear functional relationships

The results of Dolby (1972) and Dolby and Feeeman (1975) on the estimation of an explicit non-linear functional relationship are examined for the multivariate case with Σknown up to a multiplicative constant. It is shown that in both univariate and multivariate situations the method of scoring for parameters is susceptible to major errors whenever the non-linearity implies asymmetric peaks or valleys and the data is relatively ”noisy”. Amendments to this method are proposed and demonstrated.     

Maximum likelihood estimation of stationary multivariate ARFIMA processes

This article considers the maximum likelihood estimation (MLE) of a class of stationary and invertible vector autoregressive fractionally integrated moving-average (VARFIMA) processes considered in Equation (26) of Luceño [A fast likelihood approximation for vector general linear processes with long series: Application to fractional differencing, Biometrika 83 (1996), pp. 603–614] or Model A of Lobato [Consistency of the averaged cross-periodogram in long memory series, J. Time Ser. Anal. 18 (1997), pp. 137–155] where each component y _{i, t} is a fractionally integrated process of order d _i , i=1, …, r. Under the conditions outlined in Assumption 1 of this article, the conditional likelihood function of this class of VARFIMA models can be efficiently and exactly calculated with a conditional likelihood Durbin–Levinson (CLDL) algorithm proposed herein. This CLDL algorithm is based on the multivariate Durbin–Levinson algorithm of Whittle [On the fitting of multivariate autoregressions and the approximate canonical factorization of a spectral density matrix, Biometrika 50 (1963), pp. 129–134] and the conditional likelihood principle of Box and Jenkins [Time Series Analysis, Forecasting, and Control, 2nd ed., Holden-Day, San Francisco, CA]. Furthermore, the conditions in the aforementioned Assumption 1 are general enough to include the model considered in Andersen et al. [Modeling and forecasting realized volatility, Econometrica 71 (2003), 579–625] for describing the behaviour of realized volatility and the model studied in Haslett and Raftery [Space–time modelling with long-memory dependence: Assessing Ireland's wind power resource, Appl. Statist. 38 (1989), pp. 1–50] for spatial data as its special cases. As the computational cost of implementing the CLDL algorithm is much lower than that of using the algorithms proposed in Sowell [Maximum likelihood estimation of fractionally integrated time series models, Working paper, Carnegie-Mellon University], we are thus able to conduct a Monte Carlo experiment to investigate the finite sample performance of the CLDL algorithm for the 3-dimensional VARFIMA processes with the sample size of 400. The simulation results are very satisfactory and reveal the great potentials of using the CLDL method for empirical applications.     

Maximum likelihood estimation in the presence of outiliers

This paper deals with the maximum likelihood estimation of parameters when the sample (x₁…x_n ) may heve k spuriously generated observations from another distribution, say G≠F, where F is the distribution of the target population. If G is stochastically larger than F, then these k observations may give rise to k extreme observations or ‘outliers’. This situation is often described by a so-called ‘k-outlier model’ in which in addition to the parameters involved in F and G, the set ν={ν₁,…,ν_k} of indices, for which x_νj , j=1,…,k, come from G, is also unknow.