On improved estimation of a gamma shape parameter

This paper deals with improved estimation of a gamma shape parameter from a decision-theoretic point of view. First we study the second-order properties of three estimators – (i) the maximum-likelihood estimator (MLE), (ii) a bias corrected version of the MLE, and (iii) an improved version (in terms of mean squared error) of the MLE. It is shown that all the three estimators mentioned above are second-order inadmissible. Next, we obtain superior estimators which are second order better than the above three estimators. Simulation results are provided to study the relative risk improvement of each improved estimator over the MLE.     

Estimation of the parameters of a truncated gamma distribution

This paper deals with the estimation of the parameters of a truncated gamma distribution over (0,τ), where τ is assumed to be a real number. We obtain a necessary and sufficient condition for the existence of the maximum likelihood estimator(MLE). The probability of nonexistence of MLE is observed to be positive. A simulation study indicates that the modified maximum likelihood estimator and the mixed estimator, which exist with probability one,are to be preferred over MLE. The bias, the mean square error, and the probability of nearness form a basis of our simulation study.     

Estimation of sample selection bias models

Econometric models with sample selection biases are widely used in various fields of economics, such as labor economics. The Maximum Likelihood Estimator (MLE) is seldom used to estimate models because of computational difficulty, while Heckman's two-step estimator is widely used to estimate these models. However, Heckman's two-step estimator sometimes performs poorly. In this paper, methods of calculating the MLE are analysed, and finite sample properties of the MLE and Heckman's two-step estimator are compared using Monte Carlo experiments and empirical examples.     

Estimation of sample selection bias models

Econometric models with sample selection biases are widely used in various fields of economics, such as labor economics. The Maximum Likelihood Estimator (MLE) is seldom used to estimate models because of computational difficulty, while Heckman's two-step estimator is widely used to estimate these models. However, Heckman's two-step estimator sometimes performs poorly. In this paper, methods of calculating the MLE are analysed, and finite sample properties of the MLE and Heckman's two-step estimator are compared using Monte Carlo experiments and empirical examples.     

Estimating the negative binomial dispersion parameter with highly stratified surveys

We investigate several estimators of the negative binomial (NB) dispersion parameter for highly stratified count data for which the statistical model has a separate mean parameter for each stratum. If the number of samples per stratum is small then the model is highly parameterized and the maximum likelihood estimator (MLE) of the NB dispersion parameter can be biased and inefficient. Some of the estimators we investigate include adjustments for the number of mean parameters to reduce bias. We extend other estimators that were developed for the iid case, to reduce bias when there are many mean parameters. We demonstrate using simulations that an adjusted double extended quasi-likelihood estimator we proposed gives much improved estimates compared to the MLE. Adjusted extended quasi-likelihood and adjusted maximum likelihood estimators also give much-improved results. We illustrate the various estimators with stratified random bottom trawl survey data for cod (Gadus morhua) off the south coast of Newfoundland, Canada.     

时变系数空间自回归面板数据模型的极大似然估计

本文对扰动项存在跨时期的异方差、但不存在序列相关的时变系数空间自回归模型提出了极大似然的估计方法,并证明了该估计量的一致性,同时,证明了该估计量渐进服从正态分布,由此说明该估计量具有优良的大样本性质。同时,我们还对本文所提出估计量的小样本性质进行了数值模拟。本文研究表明,估计量虽然在N较小时偏差较大,但是随着N的不断增加,估计量偏差减小,体现了比较优良的渐进性质。同时,估计量的偏差会随着时期数的增加而变大,这说明本文所提出的估计方法适用于个体数较多、时期数较少的短面板数据。     

Zero-inflated models and estimation in zero-inflated Poisson distribution

In this paper, we briefly overview different zero-inflated probability distributions. We compare the performance of the estimates of Poisson, Generalized Poisson, ZIP, ZIGP and ZINB models through Mean square error (MSE), bias and Standard error (SE) when the samples are generated from ZIP distribution. We propose a new estimator referred to as probability estimator (PE) of inflation parameter of ZIP distribution based on moment estimator (ME) of the mean parameter and compare its performance with ME and maximum likelihood estimator (MLE) through a simulation study. We use the PE along with ME and MLE to fit ZIP distribution to various zero-inflated datasets and observe that the results do not differ significantly. We recommend using PE in place of MLE since it is easy to calculate and the simulation study in this paper demonstrates that the PE performs as good as MLE irrespective of the sample size.     

带异质线性趋势的动态二元选择面板模型估计

本文提出了带异质线性趋势的动态二元面板模型的极大似然偏误纠正估计量和近似条件Logit估计量。我们给出了通常极大似然估计量偏误的解析形式,并提供了相应的估计方法。小样本实验表明近似条件似然函数可以很好的消除异质性参数的影响,而偏误纠正估计量可以显著的修正极大似然估计量的偏误。最后我们将本文提出的方法应用到现金红利支付模型。     

Strategies for handling missing data in longitudinal studies with questionnaires

Missing data methods, maximum likelihood estimation (MLE) and multiple imputation (MI), for longitudinal questionnaire data were investigated via simulation. Predictive mean matching (PMM) was applied at both item and scale levels, logistic regression at item level and multivariate normal imputation at scale level. We investigated a hybrid approach which is combination of MLE and MI, i.e. scales from the imputed data are eliminated if all underlying items were originally missing. Bias and mean square error (MSE) for parameter estimates were examined. ML seemed to provide occasionally the best results in terms of bias, but hardly ever on MSE. All imputation methods at the scale level and logistic regression at item level hardly ever showed the best performance. The hybrid approach is similar or better than its original MI. The PMM-hybrid approach at item level demonstrated the best MSE for most settings and in some cases also the smallest bias.     

Estimating the correlation coefficient in the presence of correlated observations from a bivariate normal population

Estimation of the correlation coefficient between two variates (p) in the presence of correlated observations from a bivar iate normal population is considered The estimated maximum likelihood estimator (EMLE), an estimate based on the maximum likelihood estimator (MLE), is proposed and studied for the estimation of p For the large sample case , approximate expressions foi the variance and the bias of the Pearson estimate of the correlation coefficient are derived. These expressions suggests that the Pearson’s estimator possesses high mean square error (MSE) in estimating ρ in comparison to the MLE The MSE is particularly high when the observations within clusters aie highly correlated. The Pearson’s estimate, the MLE, and the EMLE aie evaluated in a simulation study This study shows that the proposed EMLE pefoims bettei than the Pearson’s correlation coefficient except when the number of clusters is small.     

Implementing particle swarm optimization algorithm to estimate the mixture of two Weibull parameters with censored data

We present the maximum likelihood estimation (MLE) via particle swarm optimization (PSO) algorithm to estimate the mixture of two Weibull parameters with complete and multiple censored data. A simulation study is conducted to assess the performance of the MLE via PSO algorithm, quasi-Newton method and expectation-maximization (EM) algorithm for different parameter settings and sample sizes in both uncensored and censored cases. The simulation results showed that the PSO algorithm outperforms the quasi-Newton method and the EM algorithm in most cases regarding bias and root mean square errors. Two numerical examples are used to demonstrate the performance of our proposed method.     

Bias-correction for Weibull common shape estimation

A general method for correcting the bias of the maximum likelihood estimator (MLE) of the common shape parameter of Weibull populations, allowing a general right censorship, is proposed in this paper. Extensive simulation results show that the new method is very effective in correcting the bias of the MLE, regardless of censoring mechanism, sample size, censoring proportion and number of populations involved. The method can be extended to more complicated Weibull models.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Minimum bias designs with constraints

A new class of model-robust optimality criteria, based on the mean squared error, is introduced in this paper. The motivation is to find designs when the researcher is more concerned with controlling the variance than the bias, or vice versa. The set of criteria proposed here is also appealing from a mathematical perspective in the sense that, unlike the Box and Draper (1959, J. Amer. Statist. Assoc. 54, 622–654), criterion, they can be imbedded in the framework of convex design theory and, hence, facilitate the search for globally optimal designs. The basic idea is to minimize a convex function of the bias part of the mean squared error subject to a convex constraint on the variance part, or vice versa. Equivalence theorems are derived and examples for the linear and quadratic regression problems are provided.     

The bias of the mle of box's degrees of freedom correction factor for correlation in anova

Approximate expressions for the mean and variance of the MLE of Box's 2-way ANOVA degrees of freedom factor are given for the case when the usual F test for column effects is appropriate even though there is correlation across columns. A simulation study is performed showing the approximations are good for a variety of numbers of rows and columns. The results confirm that the estimated degrees of freedom factor is badly biased when no factor at all should be used.     

Estimation for two-parameter weibull distribution and extreme-value distribution under multiply type-II censoring

Compared to Type-II censoring, multiply Type-II censoring is a more general, yet mathematically and numerically much more complicated censoring scheme. For multiply Type II censored data from a two-parameter Weibull distribution, we propose several estimators, including MLE, approximate MLE, and estimators corresponding to the BLUE and BLIE from estimating parameters in extreme-value distribution. An approximately unbiased estimator for the shape parameter is also proposed which has the smallest MSE. Numerical examples show that this estimator is the best in terms of bias and MSE. Numerical examples also show that the approximate MLE which admits a closed form is better for estimating the scale parameter.     

Approximate MLE for the scale parameter of the generalized exponential distribution under random censoring

In this paper, we consider the maximum likelihood estimator (MLE) of the scale parameter of the generalized exponential (GE) distribution based on a random censoring model. We assume the censoring distribution also follows a GE distribution. Since the estimator does not provide an explicit solution, we propose a simple method of deriving an explicit estimator by approximating the likelihood function. In order to compare the performance of the estimators, Monte Carlo simulation is conducted. The results show that the MLE and the approximate MLE are almost identical in terms of bias and variance.     

A New Characterization and Estimation of the Zero–bias Bandwidth

It is well established that bandwidths exist that can yield an unbiased non–parametric kernel density estimate at points in particular regions (e.g. convex regions) of the underlying density. These zero–bias bandwidths have superior theoretical properties, including a 1/n convergence rate of the mean squared error. However, the explicit functional form of the zero–bias bandwidth has remained elusive. It is difficult to estimate these bandwidths and virtually impossible to achieve the higher–order rate in practice. This paper addresses these issues by taking a fundamentally different approach to the asymptotics of the kernel density estimator to derive a functional approximation to the zero–bias bandwidth. It develops a simple approximation algorithm that focuses on estimating these zero–bias bandwidths in the tails of densities where the convexity conditions favourable to the existence of the zerobias bandwidths are more natural. The estimated bandwidths yield density estimates with mean squared error that is O(n^–4/5), the same rate as the mean squared error of density estimates with other choices of local bandwidths. Simulation studies and an illustrative example with air pollution data show that these estimated zero–bias bandwidths outperform other global and local bandwidth estimators in estimating points in the tails of densities.     

Multiplicative bias correction for discrete kernels

In this paper, we prove that two multiplicative bias correction techniques (MBC) can be applied for discrete kernels in the context of probability mass function estimation. First, some properties of the MBC discrete kernel estimators (bias, variance and mean integrated squared error) are investigated. Second, the popular cross-validation technique is adapted for bandwidth selection. Finally, a simulation study and a real data application for discrete data illustrate the performance of the MBC estimators based on dirac discrete uniform and triangular discrete kernels.     

Firth adjustment for Weibull current-status survival analysis

Abstract

Analysis of right-censored data is problematic due to infinite maximum likelihood estimates (MLE) and potentially biased estimates, especially for small numbers of events. Analyzing current-status data is especially troublesome because of the extreme loss of precision due to large failure intervals. We extend Firth’s method for regular parametric problems to current-status modeling with the Weibull distribution. Firth advocated a bias reduction method for MLE by systematically correcting the score equation. An advantage is that it is still applicable when the MLE does not exist. We present simulation studies and two illustrative analyses involving RFM mice lung tumor data.