Bias Reduction for the Maximum Likelihood Estimator of the Parameters of the Generalized Rayleigh Family of Distributions

We derive analytic expressions for the biases, to O(n^{? 1}), of the maximum likelihood estimators of the parameters of the generalized Rayleigh distribution family. Using these expressions to bias-correct the estimators is found to be extremely effective in terms of bias reduction, and generally results in a small reduction in relative mean squared error. In general, the analytic bias-corrected estimators are also found to be superior to the alternative of bias-correction via the bootstrap.     

On the Bias of the Maximum Likelihood Estimator for the Two-Parameter Lomax Distribution

The Lomax (Pareto II) distribution has found wide application in a variety of fields. We analyze the second-order bias of the maximum likelihood estimators of its parameters for finite sample sizes, and show that this bias is positive. We derive an analytic bias correction which reduces the percentage bias of these estimators by one or two orders of magnitude, while simultaneously reducing relative mean squared error. Our simulations show that this performance is very similar to that of a parametric bootstrap correction based on a linear bias function. Three examples with actual data illustrate the application of our bias correction.     

A Note on Bias of Closed-Form Estimators for the Gamma Distribution Derived From Likelihood Equations

We discuss here an alternative approach for decreasing the bias of the closed-form estimators for the gamma distribution recently proposed by Ye and Chen in 2017. We show that, the new estimator has also closed-form expression, is positive, and can be computed for n?>?2. Moreover, the corrective approach returns better estimates when compared with the former ones.     

Estimation of the Bias of the Maximum Likelihood Estimators in an Extreme Value Context

Interest is centered on the maximum likelihood (ML) estimators of the parameters of the Generalized Pareto Distribution in an extreme value context. Our aim consists of reducing the bias of these estimates for which no explicit expression is available. To circumvent this difficulty, we prove that these estimators are asymptotically equivalent to one-step estimators introduced by Beirlant et al. (2010 Beirlant , J. , Guillou , A. , Toulemonde , G. ( 2010 ). Peaks-over-threshold modeling under random censoring . Commun. Statist. Theor. Meth.  [Google Scholar]) in a right-censoring context. Then, using this equivalence property, we estimate the bias of these one-step estimators to approximate the asymptotic bias of the ML-estimators. Finally, a small simulation study and an application to a real data set are provided to illustrate that these new estimators actually exhibit reduced bias.     

Interval Estimation for the Scaled Half-Logistic Distribution Under Progressive Type-II Censoring

In this article, we propose an exact confidence interval and an exact test for the scale parameter of the scaled half-logistic distribution based on progressively Type-II censored sample. Using the Monte Carlo method, we compare the expected length of the proposed confidence interval with one of confidence interval proposed by Balakrishnan and Asgharzadeh (2005 Balakrishnan , N. , Asgharzadeh , A. ( 2005 ). Inference for the scaled half-logistic distribution based on progressively Type-II censored sample . Commun. Statist. Theor. Meth. 34 : 73 – 87 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The simulation results show that the proposed confidence interval performs better. Finally, we present a numerical example to illustrate the proposed procedures.     

Asymptotic Distribution of the Maximum Likelihood Estimators of the Parameters of the Right-Truncated Dagum Distribution

In this work we have determined the asymptotic distribution of the maximum likelihood estimators of the parameters β, λ, and δ for the right-truncated Dagum model. Some numerical comparisons show that, for each combination of the parameters and for each sample size, the variance of maximum likelihood estimators increases as the truncation point decreases, i.e., with the increase in the cut of the right tail of distribution.     

Bias-Corrected Maximum Likelihood Estimators in Nonlinear Heteroscedastic Models

Nonlinear heteroscedastic models are widely used in econometrics and statistical applications. We derive matrix formulae for the second-order biases of the maximum likelihood estimators of the parameters in the mean and variance response which generalize previous results by Cook et al. (1986 Cook , D. R. , Tsai , C. L. , Wei , B. C. ( 1986 ). Bias in nonlinear regression . Biometrika 73 : 615 – 623 .[Crossref], [Web of Science ®] , [Google Scholar]) and Cordeiro (1993 Cordeiro , G. M. ( 1993 ). Bartlett corrections and bias correction for two heteroscedastic regression models . Commun. Statist. Theor. Meth. 22 : 169 – 188 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The biases of the estimators are easily obtained as vectors of regression coefficients from suitable weighted linear regressions. The practical use of such biases is illustrated in a simulation study and in an application to a real data set.     

Bias Reduction of Likelihood Estimators in Semiparametric Frailty Models

Abstract. Frailty models with a non‐parametric baseline hazard are widely used for the analysis of survival data. However, their maximum likelihood estimators can be substantially biased in finite samples, because the number of nuisance parameters associated with the baseline hazard increases with the sample size. The penalized partial likelihood based on a first‐order Laplace approximation still has non‐negligible bias. However, the second‐order Laplace approximation to a modified marginal likelihood for a bias reduction is infeasible because of the presence of too many complicated terms. In this article, we find adequate modifications of these likelihood‐based methods by using the hierarchical likelihood.     

Corrections for Bias in Maximum Likelihood Parameter Estimates Due to Nuisance Parameters

Abstract

In his Fisher Lecture, Efron (Efron, B. R. A. (1998 Efron, B. R. A. 1998. Fisher in the 21st century (with discussion). Statistical Science, 13: 95–122. [Crossref], [Web of Science ®] , [Google Scholar]). Fisher in the 21st Century (with discussion). Statistical Science 13:95–122) pointed out that maximum likelihood estimates (MLE) can be badly biased in certain situations involving many nuisance parameters. He predicted that with modern computing equipment a computer-modified version of the MLE that was less biased could become the default estimator of choice in applied problems in the 21st century. This article discusses three modifications—Lindsay's conditional likelihood, integrated likelihood, and Bartlett's bias-corrected estimating function. Each is evaluated through a study of the bias and MSE of the estimates in a stratified Weibull model with a moderate number of nuisance parameters. In Lindsay's estimating equation, three different methods for estimation of the nuisance parameters are evaluated—the restricted maximum likelihood estimate (RMLE), a Bayes estimator, and a linear Bayes estimator. In our model, the conditional likelihood with RMLE of the nuisance parameters is equivalent to Bartlett's bias-corrected estimating function. In the simulation we show that Lindsay's conditional likelihood is in general preferred, irrespective of the estimator of the nuisance parameters. Although the integrated likelihood has smaller MSE when the precise nature of the prior distribution of the nuisance parameters is known, this approach may perform poorly in cases where the prior distribution of the nuisance parameters is not known, especially using a non-informative prior. In practice, Lindsay's method using the RMLE of the nuisance parameters is recommended.     

Bias Corrected Maximum Likelihood Estimator Under the Generalized Linear Model for a Binary Variable

Under the generalized linear models for a binary variable, an approximate bias of the maximum likelihood estimator of the coefficient, that is a special case of linear parameter in Cordeiro and McCullagh (1991), is derived without a calculation of the third-order derivative of the log likelihood function. Using the obtained approximate bias of the maximum likelihood estimator, a bias-corrected maximum likelihood estimator is defined. Through a simulation study, we show that the bias-corrected maximum likelihood estimator and its variance estimator have a better performance than the maximum likelihood estimator and its variance estimator.     

Closed-Form Estimators for the Gamma Distribution Derived From Likelihood Equations

It is well-known that maximum likelihood (ML) estimators of the two parameters in a gamma distribution do not have closed forms. This poses difficulties in some applications such as real-time signal processing using low-grade processors. The gamma distribution is a special case of a generalized gamma distribution. Surprisingly, two out of the three likelihood equations of the generalized gamma distribution can be used as estimating equations for the gamma distribution, based on which simple closed-form estimators for the two gamma parameters are available. Intuitively, performance of the new estimators based on likelihood equations should be close to the ML estimators. The study consolidates this conjecture by establishing the asymptotic behaviors of the new estimators. In addition, the closed-forms enable bias-corrections to these estimators. The bias-correction significantly improves the small-sample performance.     

Maximum Likelihood Estimators in Regression Models for Error‐prone Group Testing Data

Since Dorfman's seminal work on the subject, group testing has been widely adopted in epidemiological studies. In Dorfman's context of detecting syphilis, group testing entails pooling blood samples and testing the pools, as opposed to testing individual samples. A negative pool indicates all individuals in the pool free of syphilis antigen, whereas a positive pool suggests one or more individuals carry the antigen. With covariate information collected, researchers have considered regression models that allow one to estimate covariate‐adjusted disease probability. We study maximum likelihood estimators of covariate effects in these regression models when the group testing response is prone to error. We show that, when compared with inference drawn from individual testing data, inference based on group testing data can be more resilient to response misclassification in terms of bias and efficiency. We provide valuable guidance on designing the group composition to alleviate adverse effects of misclassification on statistical inference.     

Robust Estimators for the Parameters of Multivariate Lognormal Distribution

Abstract

In this paper, we introduce a class of location and scale estimators for the p-variate lognormal distribution. These estimators are obtained by applying a log transform to the data, computing robust Fisher consistent estimators for the obtained Gaussian data and transforming those estimators for the lognormal using the relationship between the parameters of both distributions. We prove some of the properties of these estimators, such as Fisher consistency, robustness and asymptotic normality.     

The Third-Order Bias of Nonlinear Estimators

The third-order bias of nonlinear estimators is derived and illustrated using a variety of estimators popular in applied econometrics. A simulation using the exponential regression model indicates that the third-order analytical correction reduces bias substantially compared to higher-order bootstrap and Jackknife corrections, particularly in very small samples.     

Maximum Likelihood Estimation for the 4-Parameter Beta Distribution

This paper addresses the problem of obtaining maximum likelihood estimates for the parameters of the Pearson Type I distribution (beta distribution with unknown end points and shape parameters). Since they do not seem to have appeared in the literature, the likelihood equations and the information matrix are derived. The regularity conditions which ensure asymptotic normality and efficiency are examined, and some apparent conflicts in the literature are noted. To ensure regularity, the shape parameters must be greater than two, giving an (assymmetrical) bell-shaped distribution with high contact in the tails. A numerical investigation was carried out to explore the bias and variance of the maximum likelihood estimates and their dependence on sample size. The numerical study indicated that only for large samples (n ≥ 1000) does the bias in the estimates become small and does the Cramér-Rao bound give a good approximation for their variance. The likelihood function has a global maximum which corresponds to parameter estimates that are inadmissable. Useful parameter estimates can be obtained at a local maximum, which is sometimes difficult to locate when the sample size is small.     

Maximum Likelihood Estimators in a Two Step Model for PLS

Univariate partial least squares regression (PLS1) is a method of modeling relationships between a response variable and explanatory variables, especially when the explanatory variables are almost collinear. The purpose is to predict a future response observation, although in many applications there is an interest to understand the contributions of each explanatory variable. It is an algorithmic approach. In this article, we are going to use the algorithm presented by Helland (1988 Helland , I. S. ( 1988 ). On the structure of partial least squares regression . Commun. Statist. Simul. Computat. 17 : 581 – 607 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The population PLS predictor is linked to a linear model including a Krylov design matrix and a two-step estimation procedure. For the first step, the maximum likelihood approach is applied to a specific multivariate linear model, generating tools for evaluating the information in the explanatory variables. It is shown that explicit maximum likelihood estimators of the dispersion matrix can be obtained where the dispersion matrix, besides representing the variation in the error, also includes the Krylov structured design matrix describing the mean.     

Estimation for the Generalized Pareto Distribution Using Maximum Likelihood and Goodness of Fit

In this article, we introduce a new estimator for the generalized Pareto distribution, which is based on the maximum likelihood estimation and the goodness of fit. The asymptotic normality of the new estimator is shown and a small simulation. From the simulation, the performance of the new estimator is roughly comparable with maximum likelihood for positive values of the shape parameter and often much better than maximum likelihood for negative values.     

On Existence of Maximum Likelihood Estimators in Exponential Families

We propose a simple necessary and sufficient condition for existence of maximum likelihood estimators in a large class of canonical exponential families. We give an application to log-spline families.     

Estimators for the inverse powers of a normal mean

Given a sample from a normal population unbiased estimators are obtained for positive powers of the mean and estimators of almost exponentially small bias are obtained for negative powers of the mean. Simulation studies show superior performance of these estimators versus known ones.