Efficiency of lattice conditional independence models for multinormal samples with non-monotone missing data

For multivariate normal data with non-monotone (i.e. arbitrary) missing data patterns, lattice conditional independence (LCI) models determined by the observed data patterns can be used to obtain closed-form MLEs (Andersson and Perlman, 1991, 1993). In this paper, three procedures — LCI models, the EM algorithm, and the complete-data method — are compared by means of a Monte Carlo experiment. When the LCI model is accepted by the LR test, the LCI estimate is more efficient than those based on the EM algorithm and the complete-data method. When the LCI model is not accepted, the LCI estimate may lose efficiency but still may be more efficient than the EM estimate if the observed data is sparse. When the LCI model appears too restrictive, it may be possible to obtain a less restrictive LCI model by.discarding only a small portion of the incomplete observations. LCI models appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain.     

Estimation of average treatment effects based on parametric propensity score model

In this paper, the estimation of average treatment effects is examined given that the propensity score is of a parametric form with some unknown parameters. Under the assumption that the treatment is ignorable given some observed characteristics, the MLEs for those unknown parameters in the probability assignment model have been achieved firstly and then three estimators have been defined by the inverse probability weighted, regression and imputation methods, respectively. All the estimators are shown asymptotically normal and more importantly, the substantial efficiency gains of the first two estimates have been obtained theoretically compared with the existing estimators in Hahn (1998) and Hirano et al. (2003), i.e., the inverse weighted probability estimator and the regression estimator have smaller asymptotic variances. Our simulation analysis verifies the theoretical results in terms of biases, SEs and MSEs.     

An evaluation of change-point estimators for a sequence of normal observations with unknown parameters

Performance of maximum likelihood estimators (MLE) of the change-point in normal series is evaluated considering three scenarios where process parameters are assumed to be unknown. Different shifts, sample sizes, and locations of a change-point were tested. A comparison is made with estimators based on cumulative sums and Bartlett's test. Performance analysis done with extensive simulations for normally distributed series showed that the MLEs perform better (or equal) in almost every scenario, with smaller bias and standard error. In addition, robustness of MLE to non-normality is also studied.     

Lattice conditional independence models for contingency tables with non-monotone missing data patterns

In the analysis of non-monotone missing data patterns in multinomial distributions for contingency tables, it is known that explicit MLEs of the unknown parameters cannot be obtained. Iterative procedures such as the EM-algorithm are therefore required to obtain the MLEs. These iterative procedures, however, may offer several potential difficulties. Andersson and Perlman [Ann. Statist. 21 (1993) 1318–1358] introduced lattice conditional independence (LCI) models for multivariate normal distributions, which can be applied to the analysis of non-monotone missing observations in continuous data (Andersson and Perlman, Statist. Probab. Lett. 12 (1991) 465–486). In this paper, we show that LCI models may also be applied to the analysis of categorical data with non-monotone missing data patterns. Under a parsimonious set of LCI assumptions naturally determined by the observed data pattern, the likelihood function for the observed data can be factored as in the monotone case and explicit MLEs can be obtained for the unknown parameters. Furthermore, the LCI assumptions can be tested by explicit likelihood ratio tests.     

The Effect of Estimation of Unknown Degrees of Freedom on Estimation of Remaining Parameters in Spanos’ Conditional t Heteroskedastic Model

This article investigates the effect of estimation of unknown degrees of freedom on efficient estimation of remaining parameters in Spanos’ conditional t heteroskedastic model. We compare by simulation three maximum likelihood estimators (MLEs) of the remaining parameters in the model: the MLE of the remaining parameters when all the parameters are estimated by the MLE, when the degrees of freedom is estimated by a method of moments estimator, and when the degrees of freedom is erroneously specified. The latter two methods are found to perform poorly compared to the former method for the inference of variance parameters in the model. Thus, efficient estimation of degrees of freedom by the MLE is important to estimate efficiently the remaining variance parameters.     

Estimating the parameters of a doubly truncated normal distribution

This paper deals with the maximum likelihood estimation of parameters for a doubly truncated normal distribution when the truncation points are known. We prove, in this case, that the MLEs are nonexistent (become infinite) with positive probability. For estimators that exist with probability one, the class of Bayes modal estimators or modified maximum likelihood estimators is explored. Another useful estimating procedure, called mixed estimation, is proposed. Simulations compare the behavior of the MLEs, the modified MLEs, and the mixed estimators which reveal that the MLE, in addition to being nonexistent with positive probability, behaves poorly near the upper boundary of the interval of its existence. The modified MLEs and the mixed estimators are seen to be remarkably better than the MLE     

Closed-form likelihood estimation for one type of affine point processes

ABSTRACT

This paper presents a closed-form likelihood approximation for one type of affine point processes widely used in financial credit risk models. We proceed by first conjecturing the concrete series form of the transition density, verifying our postulation and then establishing the related coefficients by means of Kolmogorov equations. The asymptotic properties of the maximum-likelihood estimators (MLEs) are given in the end.     

Bayesian Estimation for Poisson-exponential Model under Progressive Type-II Censoring Data with Binomial Removal and Its Application to Ovarian Cancer Data

In this article, we propose Maximum likelihood estimators (MLEs) and Bayes estimators of parameters of Poisson-exponential distribution (PED) under General entropy loss function (GELF) and Squared error loss function (SELF) for Progressive type-II censored data with binomial removals (PT-II CBRs). The MLEs and corresponding Bayes estimators are compared in terms of their risks based on simulated samples from PED. The proposed methodology is illustrated on a real dataset of ovarian cancer.     

Improved likelihood inferences for Weibull regression model

A general procedure is developed for bias-correcting the maximum likelihood estimators (MLEs) of the parameters of Weibull regression model with either complete or right-censored data. Following the bias correction, variance corrections and hence improved t-ratios for model parameters are presented. Potentially improved t-ratios for other reliability-related quantities are also discussed. Simulation results show that the proposed method is effective in correcting the bias of the MLEs, and the resulted t-ratios generally improve over the regular t-ratios.     

Exact Inference for a Simple Step-stress Model with Generalized Type-I Hybrid Censored Data from the Exponential Distribution

In this article, the simple step-stress model is considered based on generalized Type-I hybrid censored data from the exponential distribution. The maximum likelihood estimators (MLEs) of the unknown parameters are derived assuming a cumulative exposure model. We then derive the exact distributions of the MLEs of the parameters using conditional moment generating functions. The Bayesian estimators of the parameters are derived and then compared with the MLEs. We also derive confidence intervals for the parameters using these exact distributions, asymptotic distributions of the MLEs, Bayesian, and the parametric bootstrap methods. The problem of determining the optimal stress-changing point is discussed and the MLEs of the pth quantile and reliability functions at the use condition are obtained. Finally, Monte Carlo simulation and some numerical results are presented for illustrating all the inferential methods developed here.     

The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function

For the hierarchical Poisson and gamma model, we calculate the Bayes posterior estimator of the parameter of the Poisson distribution under Stein's loss function which penalizes gross overestimation and gross underestimation equally and the corresponding Posterior Expected Stein's Loss (PESL). We also obtain the Bayes posterior estimator of the parameter under the squared error loss and the corresponding PESL. Moreover, we obtain the empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior by two methods. In numerical simulations, we have illustrated: The two inequalities of the Bayes posterior estimators and the PESLs; the moment estimators and the Maximum Likelihood Estimators (MLEs) are consistent estimators of the hyperparameters; the goodness-of-fit of the model to the simulated data. The numerical results indicate that the MLEs are better than the moment estimators when estimating the hyperparameters. Finally, we exploit the attendance data on 314 high school juniors from two urban high schools to illustrate our theoretical studies.     

Estimation in step-stress partially accelerated life tests for the Burr type XII distribution using type I censoring

In this paper, step-stress partially accelerated life tests are considered when the lifetime of a product follows a Burr type XII distribution. Based on type I censoring, the maximum likelihood estimates (MLEs) are obtained for the distribution parameters and acceleration factor. In addition, asymptotic variance and covariance matrix of the estimators are given. An iterative procedure is used to obtain the estimators numerically using Mathcad (2001). Furthermore, confidence intervals of the estimators are presented. Simulation results are carried out to study the precision of the MLEs for the parameters involved.     

Practical considerations when analyzing discrete survival times using the grouped relative risk model

The grouped relative risk model (GRRM) is a popular semi-parametric model for analyzing discrete survival time data. The maximum likelihood estimators (MLEs) of the regression coefficients in this model are often asymptotically efficient relative to those based on a more restrictive, parametric model. However, in settings with a small number of sampling units, the usual properties of the MLEs are not assured. In this paper, we discuss computational issues that can arise when fitting a GRRM to small samples, and describe conditions under which the MLEs can be ill-behaved. We find that, overall, estimators based on a penalized score function behave substantially better than the MLEs in this setting and, in particular, can be far more efficient. We also provide methods of assessing the fit of a GRRM to small samples.     

Reducing Bias and Mean Squared Error Associated With Regression-Based Odds Ratio Estimators

Ratio estimators of effect are ordinarily obtained by exponentiating maximum-likelihood estimators (MLEs) of log-linear or logistic regression coefficients. These estimators can display marked positive finite-sample bias, however. We propose a simple correction that removes a substantial portion of the bias due to exponentiation. By combining this correction with bias correction on the log scale, we demonstrate that one achieves complete removal of second-order bias in odds ratio estimators in important special cases. We show how this approach extends to address bias in odds or risk ratio estimators in many common regression settings. We also propose a class of estimators that provide reduced mean bias and squared error, while allowing the investigator to control the risk of underestimating the true ratio parameter. We present simulation studies in which the proposed estimators are shown to exhibit considerable reduction in bias, variance, and mean squared error compared to MLEs. Bootstrapping provides further improvement, including narrower confidence intervals without sacrificing coverage.     

New Shrinkage Parameters for the Liu-type Logistic Estimators

The binary logistic regression is a widely used statistical method when the dependent variable has two categories. In most of the situations of logistic regression, independent variables are collinear which is called the multicollinearity problem. It is known that multicollinearity affects the variance of maximum likelihood estimator (MLE) negatively. Therefore, this article introduces new shrinkage parameters for the Liu-type estimators in the Liu (2003) in the logistic regression model defined by Huang (2012) in order to decrease the variance and overcome the problem of multicollinearity. A Monte Carlo study is designed to show the goodness of the proposed estimators over MLE in the sense of mean squared error (MSE) and mean absolute error (MAE). Moreover, a real data case is given to demonstrate the advantages of the new shrinkage parameters.     

Corrected maximum likelihood estimators in heteroscedastic symmetric nonlinear models

In this article, we derive general matrix formulae for second-order biases of maximum likelihood estimators (MLEs) in a class of heteroscedastic symmetric nonlinear regression models, thus generalizing some results in the literature. This class of regression models includes all symmetric continuous distributions, and has a wide range of practical applications in various fields such as engineering, biology, medicine and economics, among others. The variety of distributions with different kurtosis coefficients than the normal may give more flexibility in the choice of an appropriate distribution, particularly to accommodate outlying and influential observations. We derive a joint iterative process for estimating the mean and dispersion parameters. We also present simulation studies for the biases of the MLEs.     

Bayesian and maximum likelihood estimations of the inverse Weibull parameters under progressive type-II censoring

In this paper, the statistical inference of the unknown parameters of a two-parameter inverse Weibull (IW) distribution based on the progressive type-II censored sample has been considered. The maximum likelihood estimators (MLEs) cannot be obtained in explicit forms, hence the approximate MLEs are proposed, which are in explicit forms. The Bayes and generalized Bayes estimators for the IW parameters and the reliability function based on the squared error and Linex loss functions are provided. The Bayes and generalized Bayes estimators cannot be obtained explicitly, hence Lindley's approximation is used to obtain the Bayes and generalized Bayes estimators. Furthermore, the highest posterior density credible intervals of the unknown parameters based on Gibbs sampling technique are computed, and using an optimality criterion the optimal censoring scheme has been suggested. Simulation experiments are performed to see the effectiveness of the different estimators. Finally, two data sets have been analysed for illustrative purposes.     

Bias-corrected maximum likelihood estimation of the parameters of the generalized half-normal distribution

Cooray and Ananda introduced a two-parameter generalized Half-Normal distribution which is useful for modelling lifetime data, while its maximum likelihood estimators (MLEs) are biased in finite samples. This motivates us to construct nearly unbiased estimators for the unknown parameters of the model. In this paper, we adopt two approaches for bias reduction of the MLEs of the parameters of generalized Half-Normal distribution. The first approach is the analytical methodology suggested by Cox and Snell and the second is based on parametric Bootstrap resampling method. Additionally, the method of moments (MMEs) is used for comparison purposes. The numerical evidence shows that the analytic bias-corrected estimators significantly outperform their bootstrapped-based counterpart for small and moderate samples as well as for MLEs and MMEs. Also, it is apparent from the results that bias- corrected estimates of shape parameter perform better than that of scale parameter. Further, the results show that bias-correction scheme yields nearly unbiased estimates. Finally, six fracture toughness real data sets illustrate the application of our methods.     

Parametric inference based on judgment post stratified samples

In this paper, we consider a judgment post stratified (JPS) sample of set size $H$ from a location and scale family of distributions. In a JPS sample, ranks of measured units are random variables. By conditioning on these ranks, we derive the maximum likelihood (MLEs) and best linear unbiased estimators (BLUEs) of the location and scale parameters. Since ranks are random variables, by considering the conditional distributions of ranks given the measured observations we construct Rao-Blackwellized version of MLEs and BLUEs. We show that Rao-Blackwellized estimators always have smaller mean squared errors than MLEs and BLUEs in a JPS sample. In addition, the paper provides empirical evidence for the efficiency of the proposed estimators through a series of Monte Carlo simulations.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.