Pseudo maximum likelihood estimation for the dirichlet-multinomial distribution

Pseudo maximum likelihood estimation (PML) for the Dirich-let-multinomial distribution is proposed and examined in this pa-per. The procedure is compared to that based on moments (MM) for its asymptotic relative efficiency (ARE) relative to the maximum likelihood estimate (ML). It is found that PML, requiring much less computational effort than ML and possessing considerably higher ARE than MM, constitutes a good compromise between ML and MM. PML is also found to have very high ARE when an estimate for the scale parameter in the Dirichlet-multinomial distribution is all that is needed.     

Parameter estimation from interval-valued data using the expectation-maximization algorithm

This paper investigates on the problem of parameter estimation in statistical model when observations are intervals assumed to be related to underlying crisp realizations of a random sample. The proposed approach relies on the extension of likelihood function in interval setting. A maximum likelihood estimate of the parameter of interest may then be defined as a crisp value maximizing the generalized likelihood function. Using the expectation-maximization (EM) to solve such maximizing problem therefore derives the so-called interval-valued EM algorithm (IEM), which makes it possible to solve a wide range of statistical problems involving interval-valued data. To show the performance of IEM, the following two classical problems are illustrated: univariate normal mean and variance estimation from interval-valued samples, and multiple linear/nonlinear regression with crisp inputs and interval output.     

Parameter estimation for multivariate diffusion processes with the time inhomogeneously positive semidefinite diffusion matrix

Statistical inference for the diffusion coefficients of multivariate diffusion processes has been well established in recent years; however, it is not the case for the drift coefficients. Furthermore, most existing estimation methods for the drift coefficients are proposed under the assumption that the diffusion matrix is positive definite and time homogeneous. In this article, we put forward two estimation approaches for estimating the drift coefficients of the multivariate diffusion models with the time inhomogeneously positive semidefinite diffusion matrix. They are maximum likelihood estimation methods based on both the martingale representation theorem and conditional characteristic functions and the generalized method of moments based on conditional characteristic functions, respectively. Consistency and asymptotic normality of the generalized method of moments estimation are also proved in this article. Simulation results demonstrate that these methods work well.     

A comparison of the parameter estimation methods for bimodal mixture Weibull distribution with complete data

Bimodal mixture Weibull distribution being a special case of mixture Weibull distribution has been used recently as a suitable model for heterogeneous data sets in many practical applications. The bimodal mixture Weibull term represents a mixture of two Weibull distributions. Although many estimation methods have been proposed for the bimodal mixture Weibull distribution, there is not a comprehensive comparison. This paper presents a detailed comparison of five kinds of numerical methods, such as maximum likelihood estimation, least-squares method, method of moments, method of logarithmic moments and percentile method (PM) in terms of several criteria by simulation study. Also parameter estimation methods are applied to real data.     

A consistent method of estimation for the parameters of the three-parameter inverse Gaussian distribution

In this paper, we propose a consistent method of estimation for the parameters of the three-parameter inverse Gaussian distribution. We then discuss some properties of these estimators and show by means of a Monte Carlo simulation study that the proposed estimators perform better than some other prominent estimators in terms of bias and root mean squared error. Finally, we present two real-life examples to illustrate the method of inference developed here.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.     

Transmuted Weibull distribution: Properties and estimation

In this article, we investigate the potential usefulness of the three-parameter transmuted Weibull distribution for modeling survival data. The main advantage of this distribution is that it has increasing, decreasing or constant instantaneous failure rate depending on the shape parameter and the new transmuting parameter. We obtain several mathematical properties of the transmuted Weibull distribution such as the expressions for the quantile function, moments, geometric mean, harmonic mean, Shannon, Rényi and q-entropies, mean deviations, Bonferroni and Lorenz curves, and the moments of order statistics. We propose a location-scale regression model based on the log-transmuted Weibull distribution for modeling lifetime data. Applications to two real datasets are given to illustrate the flexibility and potentiality of the transmuted Weibull family of lifetime distributions.     

On least squares estimation for categorical data

We consider a multinomial distribution in which the cell probabilities are known arbitrary functions of a vector parameter θ. It is desired to estimate θ by least squares. Three variations of the least squares approach are investigated, and each is found to be equivalent, in the very strong sense of being algebraically identical, to one of the following estimation procedures: maximum likelihood, minimum χ² and minimum modified χ². Two of these results also apply to the multiple hypergeometric distribution.     

Improving parameter estimation using constrained optimization methods

This paper presents a methodology based on transforming estimation methods in optimization problems in order to incorporate in a natural way some constraints that contain extra information not considered by standard estimation methods, with the aim of improving the quality of the parameter estimates. We include here three types of such information: bounds for the cumulative distribution function, bounds for the quantiles, and any restrictions on the parameters such as those imposed by the support of the random variable under consideration. The method is quite general and can be applied to many estimation methods such as the maximum likelihood (ML), the method of moments (MOM), the least squares, the least absolute values, and the minimax methods. The performances of the obtained estimates from several families of distributions are investigated for the ML and the MOM, using simulations. The simulation results show that for small sample sizes important gains can be achieved with respect to the case where the above information is ignored. In addition, we discuss sensitivity analysis methods for assessing the influence of observations on the proposed estimators. The method applies to both univariate and multivariate data.     

A comparison of estimation procedures for the parameters of the star model

A simulation experiment compares the accuracy and precision of three alternate estimation techniques for the parameters of the STARMA model. Maximum likelihood estimation, in most ways the "best" estimation procedure, involves a large amount of computational effort so that two approximate techniques, exact least squares and conditional maximum likelihood, are often proposed for series of moderate lengths. This simulation experiment compares the accuracy of these three estimation procedures for simulated series of various lengths, and discusses the appropriateness of the three procedures as a function of the length of the observed series.     

Parameter estimation for ihe birnbaum-saunders distribution based on symmetrically censored samples

Ihe Bimbaum-Saunders distribution was derived to model fatigue life. Frequently, it becomes necessary to stop a life testing process before all the test items have failed. Therefore, estimation procedures need to be developed for use when censoring occurs. In this article, we have derived estimators for the parameters of this distribution which may be used for complete samples or Type II symmetrically censored samples A simulation study was also conducted to examine the performance of these estimators.     

Residual variance estimation in moving average models

We consider time series models of the MA (moving average) family, and deal with the estimation of the residual variance. Results are known for maximum likelihood estimates under normality, both for known or unknown mean, in which case the asymptotic biases depend on the number of parameters (including the mean), and do not depend on the values of the parameters. For moment estimates the situation is different, because we find that the asymptotic biases depend on the values of the parameters, and become large as they approach the boundary of the region of invertibility. Our approach is to use Taylor series expansions, and the objective is to obtain asymptotic biases with error of o(l/T), where T is the sample size. Simulation results are presented, and corrections for bias suggested.     

Comparison of estimation methods for the Weibull distribution

Weibull distributions have received wide ranging applications in many areas including reliability, hydrology and communication systems. Many estimation methods have been proposed for Weibull distributions. But there has not been a comprehensive comparison of these estimation methods. Most studies have focused on comparing the maximum likelihood estimation (MLE) with one of the other approaches. In this paper, we first propose an L-moment estimator for the Weibull distribution. Then, a comprehensive comparison is made of the following methods: the method of maximum likelihood estimation (MLE), the method of logarithmic moments, the percentile method, the method of moments and the method of L-moments.     

Small sample properties of parameter estimation in the dirichlet distribution

A numerically feasible algorithm is proposed for maximum likelihood estimation of the parameters of the Dirichlet distribution. The performance of the proposed method is compared with the method of moments using bias ratio and squared errors by Monte Carlo simulation. For these criteria, it is found that even in small samples maximum likelihood estimation has advantages over the method of moments.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

Parametric estimation of mixtures of two uniform distributions

In this paper, we consider a mixture of two uniform distributions and derive L-moment estimators of its parameters. Three possible ways of mixing two uniforms, namely with neither overlap nor gap, with overlap, and with gap, are studied. The performance of these L-moment estimators in terms of bias and efficiency is compared to that obtained by means of the conventional method of moments (MM), modified maximum likelihood (MML) method and the usual maximum likelihood (ML) method. These intensive simulations reveal that MML estimators are the best in most of the cases, and the L-moment estimators are less subject to bias in estimation for some mixtures and more efficient in most of the cases than the conventional MM estimators. The L-moment estimators are, in some cases, more efficient than the ML and MML estimators.     

A note on the estimation of the mixing parameter in a mixture of two distributions

Various classical methods of estimation are compared with those proposed by From (1989) for the estimation of the mixing parameter in a mixture of two distributions. Emphasis is put on the actual implementation of the estimation methods.     

Parameter estimation under orthant restrictions

The authors consider the estimation of linear functions of a multivariate parameter under orthant restrictions. These restrictions are considered both for location models and for the Poisson distribution. For these models, situations are characterized for which the restricted maximum likelihood estimator dominates the unrestricted one for the estimation of any linear function of the parameter. The results obtained point directly to the importance of the dimension of the parameter space, the central direction of the cone and its vertex in these cases. Special attention is given to examples, such as the one‐way analysis of variance, where the estimation of individual interesting linear functions of the parameter, as the coordinates and the differences between them, is also treated.     

Parameter and quantile estimation for the three-parameter lognormal distribution based on statistics invariant to unknown location

Lognormal distribution is one of the popular distributions used for modelling positively skewed data, especially those encountered in economic and financial data. In this paper, we propose an efficient method for the estimation of parameters and quantiles of the three-parameter lognormal distribution, which avoids the problem of unbounded likelihood, by using statistics that are invariant to unknown location. Through a Monte Carlo simulation study, we then show that the proposed method performs well compared to other prominent methods in terms of both bias and mean-squared error. Finally, we present two illustrative examples.