Estimating the location of the cauchy distribution by numerical global optimization

The log-likelihood function (LLF) of the single (location) parameter Cauchy distribution can exhibit up to n relative maxima, where n is the sample size. To compute the maximum likelihood estimate of the location parameter, previously published methods have advocated scanning the LLF over a suf-ficiently large portion of the real line to locate the absolute maximum. This note shows that, given an easily derived upper bound on the second derivative of the negative LLF, Brent's univariate numerical global optimization method can be used to locate the absolute maximum among several relative maxima of the LLF without performing an exhaustive search over the real line.     

On exact computation of minimum sample size for restricted estimation of a binomial parameter

The problem of determining minimum sample size for the estimation of a binomial parameter with prescribed margin of error and confidence level is considered. It is assumed that available auxiliary information allows to restrict the parameter space to some interval whose left boundary is above zero. A range-preserving estimator resulting from the conditional maximization of the likelihood function is considered. A method for exact computation of minimum sample size controlling for the relative error is proposed. Several tables of minimum sample sizes for typical situations are also presented. The range-preserving estimator achieves the same precision and confidence level as the unrestricted maximum likelihood estimator but with a smaller sample.     

Maximum likelihood estimation of un1modal and decreasing densities based on arbitrarily right-censored data

Nonparametric maximum likelihood estimation of decreasing and unimodal density functions based on observations subject to arbitrary right censorship is considered. The maximum likelihood estimator of both types of densities is shown to exist and is a step function. The estimators may be computed for small samples by maximizing nonlinear equations subject to linear constraints, and the SUMT algorithm for constrained nonlinear optimization is used for the necessary calculations in an example.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

Estimation for the generalized pareto distribution with censored data

We present a methodology for computing the point and interval maximum likelihood parameter estimation for the two-parameter generalized Pareto distribution (GPD) with censored data. The basic idea underlying our method is a reduction of the two-dimensional numerical search for the zeros of the GPD log-likelihood gradient vector to a one-dimensional numerical search. We describe a computationally efficient algorithm which implement this approach. Two illustrative examples are presented. Simulation results indicate that the estimates derived by maximum likelihood estimation are more reliable against those of method of moments. An evaluation of the practical sample size requirements for the asymptotic normality is also included.     

A fast algorithm for univariate log‐concave density estimation

A new fast algorithm for computing the nonparametric maximum likelihood estimate of a univariate log‐concave density is proposed and studied. It is an extension of the constrained Newton method for nonparametric mixture estimation. In each iteration, the newly extended algorithm includes, if necessary, new knots that are located via a special directional derivative function. The algorithm renews the changes of slope at all knots via a quadratically convergent method and removes the knots at which the changes of slope become zero. Theoretically, the characterisation of the nonparametric maximum likelihood estimate is studied and the algorithm is guaranteed to converge to the unique maximum likelihood estimate. Numerical studies show that it outperforms other algorithms that are available in the literature. Applications to some real‐world financial data are also given.     

Standard and goodness-of-fit parameter estimation methods for the three-parameter lognormal distribution

A class of goodness-of-fit estimators is found to provide a useful alternative in certain situations to the standard maximum likelihood method which has some undesirable estimation characteristics for estimation from the three-parameter lognormal distribution. The class of goodness-of-fit tests considered include the Shapiro-Wilk and Filliben tests which reduce to a weighted linear combination of the order statistics that can be maximized in estimation problems. The weighted order statistic estimators are compared to the standard procedures in Monte Carlo simulations. Robustness of the procedures are examined and example data sets analyzed.     

Maximum Likelihood Estimation for the 4-Parameter Beta Distribution

This paper addresses the problem of obtaining maximum likelihood estimates for the parameters of the Pearson Type I distribution (beta distribution with unknown end points and shape parameters). Since they do not seem to have appeared in the literature, the likelihood equations and the information matrix are derived. The regularity conditions which ensure asymptotic normality and efficiency are examined, and some apparent conflicts in the literature are noted. To ensure regularity, the shape parameters must be greater than two, giving an (assymmetrical) bell-shaped distribution with high contact in the tails. A numerical investigation was carried out to explore the bias and variance of the maximum likelihood estimates and their dependence on sample size. The numerical study indicated that only for large samples (n ≥ 1000) does the bias in the estimates become small and does the Cramér-Rao bound give a good approximation for their variance. The likelihood function has a global maximum which corresponds to parameter estimates that are inadmissable. Useful parameter estimates can be obtained at a local maximum, which is sometimes difficult to locate when the sample size is small.     

The evaluation of exact maximum likelihood estimates for varma models

This paper describes an algorithm for the evaluation of the exact likelihood function in order to obtain estimates of the coefficients of vector autoregressive moving average (VARMA) models. The use of the algorithm is illustrated by a Monte Carlo experiment and an application to the analysis of a set of bivariate animal population data. Fanally it is shown how to extend the algorithm, in a simple manner, to obtain exact maximum likelihood estimates of the coefficients of vector autoregressive moving average models with included exogenous variables.     

Estimating the Burr XII Parameters in Constant-Stress Partially Accelerated Life Tests Under Multiple Censored Data

In this article, we present the performance of the maximum likelihood estimates of the Burr XII parameters for constant-stress partially accelerated life tests under multiple censored data. Two maximum likelihood estimation methods are considered. One method is based on observed-data likelihood function and the maximum likelihood estimates are obtained by using the quasi-Newton algorithm. The other method is based on complete-data likelihood function and the maximum likelihood estimates are derived by using the expectation-maximization (EM) algorithm. The variance–covariance matrices are derived to construct the confidence intervals of the parameters. The performance of these two algorithms is compared with each other by a simulation study. The simulation results show that the maximum likelihood estimation via the EM algorithm outperforms the quasi-Newton algorithm in terms of the absolute relative bias, the bias, the root mean square error and the coverage rate. Finally, a numerical example is given to illustrate the performance of the proposed methods.     

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Approximate Bayesian computation (ABC) is a popular technique for analysing data for complex models where the likelihood function is intractable. It involves using simulation from the model to approximate the likelihood, with this approximate likelihood then being used to construct an approximate posterior. In this paper, we consider methods that estimate the parameters by maximizing the approximate likelihood used in ABC. We give a theoretical analysis of the asymptotic properties of the resulting estimator. In particular, we derive results analogous to those of consistency and asymptotic normality for standard maximum likelihood estimation. We also discuss how sequential Monte Carlo methods provide a natural method for implementing our likelihood‐based ABC procedures.     

A Spline‐Based Semiparametric Maximum Likelihood Estimation Method for the Cox Model with Interval‐Censored Data

Abstract. We propose a spline‐based semiparametric maximum likelihood approach to analysing the Cox model with interval‐censored data. With this approach, the baseline cumulative hazard function is approximated by a monotone B‐spline function. We extend the generalized Rosen algorithm to compute the maximum likelihood estimate. We show that the estimator of the regression parameter is asymptotically normal and semiparametrically efficient, although the estimator of the baseline cumulative hazard function converges at a rate slower than root‐n. We also develop an easy‐to‐implement method for consistently estimating the standard error of the estimated regression parameter, which facilitates the proposed inference procedure for the Cox model with interval‐censored data. The proposed method is evaluated by simulation studies regarding its finite sample performance and is illustrated using data from a breast cosmesis study.     

Bayes estimation of reliability for the two-parameter lognormal distribution

Bayes estimators of reliability for the lognormal failure distribution with two parameters (M,∑) are obtained both for informative priors of normal-gamma type and for the vague prior of Jeffreys. The estimators are in terms of the t-distribution function. The Bayes estimators are compared with the maximum likelihood and minimum variance unbiased estimators of reliabil-ity using Monte Carlo simulations.     

Pseudo maximum likelihood estimation for the dirichlet-multinomial distribution

Pseudo maximum likelihood estimation (PML) for the Dirich-let-multinomial distribution is proposed and examined in this pa-per. The procedure is compared to that based on moments (MM) for its asymptotic relative efficiency (ARE) relative to the maximum likelihood estimate (ML). It is found that PML, requiring much less computational effort than ML and possessing considerably higher ARE than MM, constitutes a good compromise between ML and MM. PML is also found to have very high ARE when an estimate for the scale parameter in the Dirichlet-multinomial distribution is all that is needed.     

Constrained estimation and likelihood intervals for censored data

The authors propose a reduction technique and versions of the EM algorithm and the vertex exchange method to perform constrained nonparametric maximum likelihood estimation of the cumulative distribution function given interval censored data. The constrained vertex exchange method can be used in practice to produce likelihood intervals for the cumulative distribution function. In particular, the authors show how to produce a confidence interval with known asymptotic coverage for the survival function given current status data.     

The Cox Proportional Hazards Model with a Partly Linear Relative Risk Function

The conventional Cox proportional hazards regression model contains a loglinear relative risk function, linking the covariate information to the hazard ratio with a finite number of parameters. A generalization, termed the partly linear Cox model, allows for both finite dimensional parameters and an infinite dimensional parameter in the relative risk function, providing a more robust specification of the relative risk function. In this work, a likelihood based inference procedure is developed for the finite dimensional parameters of the partly linear Cox model. To alleviate the problems associated with a likelihood approach in the presence of an infinite dimensional parameter, the relative risk is reparameterized such that the finite dimensional parameters of interest are orthogonal to the infinite dimensional parameter. Inference on the finite dimensional parameters is accomplished through maximization of the profile partial likelihood, profiling out the infinite dimensional nuisance parameter using a kernel function. The asymptotic distribution theory for the maximum profile partial likelihood estimate is established. It is determined that this estimate is asymptotically efficient; the orthogonal reparameterization enables employment of profile likelihood inference procedures without adjustment for estimation of the nuisance parameter. An example from a retrospective analysis in cancer demonstrates the methodology.     

利率期限结构模型改进极大似然估计效率研究

考虑一种改进的极大似然估计算法估计一维利率期限结构模型的未知参数,该方法首先利用Crank-Nicolson差分法求解与该扩散模型相关联的偏微分方程(PDE),获得累积分布函数,然后利用数值微分得到转移密度函数的近似值。数值模拟实验结果表明,当取较小空间步长时,该改进估计法比Euler法具有更高的效率,并考察该改进估计法在中国银行间同业拆借利率的实证分析,实证结果表明,在所考虑的样本区间内,中国利率的长期水平值是0.025 1,且中国货币市场利率粘性系数的值接近于0.5。     

A class of local likelihood methods and near-parametric asymptotics

The local maximum likelihood estimate θ^ _t of a parameter in a statistical model f ( x , θ) is defined by maximizing a weighted version of the likelihood function which gives more weight to observations in the neighbourhood of t . The paper studies the sense in which f ( t , θ^ _t ) is closer to the true distribution g ( t ) than the usual estimate f ( t , θ^) is. Asymptotic results are presented for the case in which the model misspecification becomes vanishingly small as the sample size tends to ∞. In this setting, the relative entropy risk of the local method is better than that of maximum likelihood. The form of optimum weights for the local likelihood is obtained and illustrated for the normal distribution.     

Suitable Algorithm Associated with a Parameterization for the Three-Parameter Log-Normal Distribution

Associated with a parameterization for the three-parameter lognormal distribution, an algorithm was proposed by Komori and Hirose, which can find a local maximum likelihood (ML) estimate surely if it exists. Nevertheless, by Vera and Díaz-García it was shown that performance in finding a local ML estimate deteriorated by adopting the parameterization only and using other algorithm. In the present article, it will be shown that Komori and Hirose’s algorithm should be used for the parameterization. This work will also give MATLAB codes as a useful tool for the parameter estimation of the distribution.     

Maximum likelihood estimation in the proportional hazards model of random censorship

The maximum likelihood estimator (MLE) for the survival function S_Tunder the proportional hazards model of censorship is derived and shown to differ from the Abdushukurov-Cheng-Lin estimator when the class of allowable distributions includes all continuous and discrete distributions. The estimators are compared via an example. The MLE is calculated using a Newton-Raphson iterative procedure and implemented via a FORTRAN algorithm.