Moment properties of estimators for a type 1 extreme-value regression model

A regression model is considered in which the response variable has a type 1 extreme-value distribution for smallest values. Bias approximations for the maximum likelihood estimators are pivm and a bias reduction estimator for the scale parameter is proposed. The small sample moment properties of the maximum likelihood estimators are compared with the properties of the ordinary least squares estimators and the best linear unbiased estimators based on order statistics for grouped data.     

Firth adjustment for Weibull current-status survival analysis

Abstract

Analysis of right-censored data is problematic due to infinite maximum likelihood estimates (MLE) and potentially biased estimates, especially for small numbers of events. Analyzing current-status data is especially troublesome because of the extreme loss of precision due to large failure intervals. We extend Firth’s method for regular parametric problems to current-status modeling with the Weibull distribution. Firth advocated a bias reduction method for MLE by systematically correcting the score equation. An advantage is that it is still applicable when the MLE does not exist. We present simulation studies and two illustrative analyses involving RFM mice lung tumor data.     

Estimating the negative binomial dispersion parameter with highly stratified surveys

We investigate several estimators of the negative binomial (NB) dispersion parameter for highly stratified count data for which the statistical model has a separate mean parameter for each stratum. If the number of samples per stratum is small then the model is highly parameterized and the maximum likelihood estimator (MLE) of the NB dispersion parameter can be biased and inefficient. Some of the estimators we investigate include adjustments for the number of mean parameters to reduce bias. We extend other estimators that were developed for the iid case, to reduce bias when there are many mean parameters. We demonstrate using simulations that an adjusted double extended quasi-likelihood estimator we proposed gives much improved estimates compared to the MLE. Adjusted extended quasi-likelihood and adjusted maximum likelihood estimators also give much-improved results. We illustrate the various estimators with stratified random bottom trawl survey data for cod (Gadus morhua) off the south coast of Newfoundland, Canada.     

Target estimation for the logistic regression model

The method of target estimation developed by Cabrera and Fernholz [(1999). Target estimation for bias and mean square error reduction. The Annals of Statistics, 27(3), 1080–1104.] to reduce bias and variance is applied to logistic regression models of several parameters. The expectation functions of the maximum likelihood estimators for the coefficients in the logistic regression models of one and two parameters are analyzed and simulations are given to show a reduction in both bias and variability after targeting the maximum likelihood estimators. In addition to bias and variance reduction, it is found that targeting can also correct the skewness of the original statistic. An example based on real data is given to show the advantage of using target estimators for obtaining better confidence intervals of the corresponding parameters. The notion of the target median is also presented with some applications to the logistic models.     

Bias-corrected maximum likelihood estimation of the parameters of the generalized Pareto distribution

ABSTRACT

We derive analytic expressions for the biases, to O(n^?1), of the maximum likelihood estimators of the parameters of the generalized Pareto distribution. Using these expressions to bias-correct the estimators in a selective manner is found to be extremely effective in terms of bias reduction, and can also result in a small reduction in relative mean squared error (MSE). In terms of remaining relative bias, the analytic bias-corrected estimators are somewhat less effective than their counterparts obtained by using a parametric bootstrap bias correction. However, the analytic correction out-performs the bootstrap correction in terms of remaining %MSE. It also performs credibly relative to other recently proposed estimators for this distribution. Taking into account the relative computational costs, this leads us to recommend the selective use of the analytic bias adjustment for most practical situations.     

Comparison of bias-reducing methods for estimating the parameter in dilution series

Ten different estimators of the parameter in a limiting or serial dilution assay are compared. Eight of them are constructed to reduce the bias of the commonly used maximum likelihood estimator. Extensive Monte Carlo experiments using various designs, and practical considerations, suggest that a particular jackknife version of the maximum likelihood estimator is preferred, provided that the design is not too small.     

Finite sample properties of ml and reml estimators in time series regression models with long memory noise

Finite sample properties of ML and REML estimators in time series regression models with fractional ARIMA noise are examined. In particular, theoretical approximations for bias of ML and REML estimators of the noise parameters are developed and their accuracy is assessed through simulations. The impact of noise parameter estimation on performance of t -statistics and likelihood ratio statistics for testing regression parameters is also investigated.     

Bias Reduction for the Maximum Likelihood Estimator of the Parameters of the Generalized Rayleigh Family of Distributions

We derive analytic expressions for the biases, to O(n^{? 1}), of the maximum likelihood estimators of the parameters of the generalized Rayleigh distribution family. Using these expressions to bias-correct the estimators is found to be extremely effective in terms of bias reduction, and generally results in a small reduction in relative mean squared error. In general, the analytic bias-corrected estimators are also found to be superior to the alternative of bias-correction via the bootstrap.     

Inference for Log-Gamma Distribution Based on Progressively Type-II Censored Data

We discuss the maximum likelihood estimates (MLEs) of the parameters of the log-gamma distribution based on progressively Type-II censored samples. We use the profile likelihood approach to tackle the problem of the estimation of the shape parameter κ. We derive approximate maximum likelihood estimators of the parameters μ and σ and use them as initial values in the determination of the MLEs through the Newton–Raphson method. Next, we discuss the EM algorithm and propose a modified EM algorithm for the determination of the MLEs. A simulation study is conducted to evaluate the bias and mean square error of these estimators and examine their behavior as the progressive censoring scheme and the shape parameter vary. We also discuss the interval estimation of the parameters μ and σ and show that the intervals based on the asymptotic normality of MLEs have very poor probability coverages for small values of m. Finally, we present two examples to illustrate all the methods of inference discussed in this paper.     

Bias-corrected estimators of scalar skew normal

One problem of skew normal model is the difficulty in estimating the shape parameter, for which the maximum likelihood estimate may be infinite when sample size is moderate. The existing estimators suffer from large bias even for moderate size samples. In this article, we proposed five estimators of the shape parameter for a scalar skew normal model, either by bias correction method or by solving a modified score equation. Simulation studies show that except bootstrap estimator, the proposed estimators have smaller bias compared to those estimators in literature for small and moderate samples.     

Bias-corrected maximum semiparametric likelihood estimation under logistic regression models based on case–control data

We consider the corrective approach (Theoretical Statistics, Chapman & Hall, London, 1974, p. 310) and preventive approach (Biometrica 80 (1993) 27) to bias reduction of maximum likelihood estimators under the logistic regression model based on case–control data. The proposed bias-corrected maximum likelihood estimators are based on the semiparametric profile log likelihood function under a two-sample semiparametric model, which is equivalent to the assumed logistic regression model. We show that the prospective and retrospective analyses on the basis of the corrective approach to bias reduction produce identical bias-corrected maximum likelihood estimators of the odds ratio parameter, but this does not hold when using the preventive approach unless the case and control sample sizes are identical. We present some results on simulation and on the analysis of two real data sets.     

Editorial collaborators

A simulation study of the binomial-logit model with correlated random effects is carried out based on the generalized linear mixed model (GLMM) methodology. Simulated data with various numbers of regression parameters and different values of the variance component are considered. The performance of approximate maximum likelihood (ML) and residual maximum likelihood (REML) estimators is evaluated. For a range of true parameter values, we report the average biases of estimators, the standard error of the average bias and the standard error of estimates over the simulations. In general, in terms of bias, the two methods do not show significant differences in estimating regression parameters. The REML estimation method is slightly better in reducing the bias of variance component estimates.     

Bias-corrected maximum likelihood estimation of the parameters of the generalized half-normal distribution

Cooray and Ananda introduced a two-parameter generalized Half-Normal distribution which is useful for modelling lifetime data, while its maximum likelihood estimators (MLEs) are biased in finite samples. This motivates us to construct nearly unbiased estimators for the unknown parameters of the model. In this paper, we adopt two approaches for bias reduction of the MLEs of the parameters of generalized Half-Normal distribution. The first approach is the analytical methodology suggested by Cox and Snell and the second is based on parametric Bootstrap resampling method. Additionally, the method of moments (MMEs) is used for comparison purposes. The numerical evidence shows that the analytic bias-corrected estimators significantly outperform their bootstrapped-based counterpart for small and moderate samples as well as for MLEs and MMEs. Also, it is apparent from the results that bias- corrected estimates of shape parameter perform better than that of scale parameter. Further, the results show that bias-correction scheme yields nearly unbiased estimates. Finally, six fracture toughness real data sets illustrate the application of our methods.     

Practical Point Estimation from Higher-Order Pivots

Point estimators for a scalar parameter of interest in the presence of nuisance parameters can be defined as zero-level confidence intervals as explained in Skovgaard (1989). A natural implementation of this approach is based on estimating equations obtained from higher-order pivots for the parameter of interest. In this paper, generalising the results in Pace and Salvan (1999) outside exponential families, we take as an estimating function the modified directed likelihood. This is a higher-order pivotal quantity that can be easily computed in practice for a wide range of models, using recent advances in higher-order asymptotics (HOA, 2000). The estimators obtained from these estimating equations are a refinement of the maximum likelihood estimators, improving their small sample properties and keeping equivariance under reparameterisation. Simple explicit approximate versions of these estimators are also derived and have the form of the maximum likelihood estimator plus a function of derivatives of the loglikelihood function. Some examples and simulation studies are discussed for widely-used model classes.     

On bias reduction estimators of skew-normal and skew-t distributions

A particular concerns of researchers in statistical inference is bias in parameters estimation. Maximum likelihood estimators are often biased and for small sample size, the first order bias of them can be large and so it may influence the efficiency of the estimator. There are different methods for reduction of this bias. In this paper, we proposed a modified maximum likelihood estimator for the shape parameter of two popular skew distributions, namely skew-normal and skew-t, by offering a new method. We show that this estimator has lower asymptotic bias than the maximum likelihood estimator and is more efficient than those based on the existing methods.     

Minimum-Distance Estimator for Stable Exponent

Assume that X ₁, X ₂,…, X _n is a sequence of i.i.d. random variables with α-stable distribution (α ∈ (0,2], the stable exponent, is the unknown parameter). We construct minimum distance estimators for α by minimizing the Kolmogorov distance or the Cramér–von-Mises distance between the empirical distribution function G _n , and a class of distributions defined based on the sum-preserving property of stable random variables. The minimum distance estimators can also be obtained by minimizing a U-statistic estimate of an empirical distribution function involving the stable exponent. They share the same invariance property with the maximum likelihood estimates. In this article, we prove the strong consistency of the minimum distance estimators. We prove the asymptotic normality of our estimators. Simulation study shows that the new estimators are competitive to the existing ones and perform very closely even to the maximum likelihood estimator.     

Estimation of the parameters of the gamma distribution by means of a maximal invariant

The use of a scale invariance criterion allows estimation of the shape parameter of the two parameter gamma distribution without estimating the scale parameter. Simulation experiments are used to show that the resulting estimators of both parameters are better than the usual maximum likelihood estimators in terms of both bias and mean square error. Approximately unbiased versions of the maximal invariant based estimators are derived and are shown to be as good as approximately unbiased versions of the usual maximum likelihood estimators     

Parameter estimation for a new distribution for the strength of brittle fibers: a simulation study

Parameter estimates of a new distribution for the strength of brittle fibers and composite materials are considered. An algorithm for generating random numbers from the distribution is suggested. Two parameter estimation methods, one based on a simple least squares procedure and the other based on the maximum likelihood principle, are studied using Monte Carlo simulation. In most cases, the maximum likelihood estimators were found to have somewhat smaller root mean squared error and bias than the least squares estimators. However, the least squares estimates are generally good and provide useful initial values for the numerical iteration used to find the maximum likelihood estimates.     

Computation of the exact likelihood function of an arima process

Acceptance of Arima processes as valuable univariate forecasting mechanisms is increasing. Maximum likelihood estimation of parameters is complicated, and least squares approximations are not always satisfactory. The singular vaiue decomposition is used here to determine numericaily accurate values of the likelihood function for a given set of parameter estimates. Suggestions for efficient computational search procedures of maximum likelihood estimators are made.     

Bias correction in logistic regression with missing categorical covariates

Logistic regression plays an important role in many fields. In practice, we often encounter missing covariates in different applied sectors, particularly in biomedical sciences. Ibrahim (1990) proposed a method to handle missing covariates in generalized linear model (GLM) setup. It is well known that logistic regression estimates using small or medium sized missing data are biased. Considering the missing data that are missing at random, in this paper we have reduced the bias by two methods; first we have derived a closed form bias expression using Cox and Snell (1968), and second we have used likelihood based modification similar to Firth (1993). Here we have analytically shown that the Firth type likelihood modification in Ibrahim led to the second order bias reduction. The proposed methods are simple to apply on an existing method, need no analytical work, with the exception of a little change in the optimization function. We have carried out extensive simulation studies comparing the methods, and our simulation results are also supported by a real world data.