Missing covariates in generalized linear models when the missing data mechanism is non-ignorable

We propose a method for estimating parameters in generalized linear models with missing covariates and a non-ignorable missing data mechanism. We use a multinomial model for the missing data indicators and propose a joint distribution for them which can be written as a sequence of one-dimensional conditional distributions, with each one-dimensional conditional distribution consisting of a logistic regression. We allow the covariates to be either categorical or continuous. The joint covariate distribution is also modelled via a sequence of one-dimensional conditional distributions, and the response variable is assumed to be completely observed. We derive the E- and M-steps of the EM algorithm with non-ignorable missing covariate data. For categorical covariates, we derive a closed form expression for the E- and M-steps of the EM algorithm for obtaining the maximum likelihood estimates (MLEs). For continuous covariates, we use a Monte Carlo version of the EM algorithm to obtain the MLEs via the Gibbs sampler. Computational techniques for Gibbs sampling are proposed and implemented. The parametric form of the assumed missing data mechanism itself is not `testable' from the data, and thus the non-ignorable modelling considered here can be viewed as a sensitivity analysis concerning a more complicated model. Therefore, although a model may have `passed' the tests for a certain missing data mechanism, this does not mean that we have captured, even approximately, the correct missing data mechanism. Hence, model checking for the missing data mechanism and sensitivity analyses play an important role in this problem and are discussed in detail. Several simulations are given to demonstrate the methodology. In addition, a real data set from a melanoma cancer clinical trial is presented to illustrate the methods proposed.     

On hybrid censored Weibull distribution

A hybrid censoring is a mixture of Type-I and Type-II censoring schemes. This article presents the statistical inferences on Weibull parameters when the data are hybrid censored. The maximum likelihood estimators (MLEs) and the approximate maximum likelihood estimators are developed for estimating the unknown parameters. Asymptotic distributions of the MLEs are used to construct approximate confidence intervals. Bayes estimates and the corresponding highest posterior density credible intervals of the unknown parameters are obtained under suitable priors on the unknown parameters and using the Gibbs sampling procedure. The method of obtaining the optimum censoring scheme based on the maximum information measure is also developed. Monte Carlo simulations are performed to compare the performances of the different methods and one data set is analyzed for illustrative purposes.     

Statistical analysis of middle censored competing risks data with exponential distribution

In this paper, we consider some problems of estimation and reconstruction based on middle censored competing risks data. It is assumed that the lifetime distributions of the latent failure times are independent and exponential distributed with different parameters and also that the censoring mechanism is independent. The maximum likelihood estimators (MLEs) of the unknown parameters are obtained. We then use the asymptotic distribution of the MLEs to construct approximate confidence intervals. Based on gamma priors, Lindley's approximation method is applied to obtain the Bayesian estimates of the unknown parameters under squared error loss function. Since it is not possible to construct the credible intervals, we propose and implement the Gibbs sampling technique to construct the credible intervals. Several point reconstructors for failure time of censored units are provided. Finally, a simulation study is given by Monte-Carlo simulations to evaluate the performances of the different methods and a data set is analysed to illustrate the proposed procedures.     

On the estimation of the extreme value and normal distribution parameters based on progressive type-II hybrid-censored data

A progressive hybrid censoring scheme is a mixture of type-I and type-II progressive censoring schemes. In this paper, we mainly consider the analysis of progressive type-II hybrid-censored data when the lifetime distribution of the individual item is the normal and extreme value distributions. Since the maximum likelihood estimators (MLEs) of these parameters cannot be obtained in the closed form, we propose to use the expectation and maximization (EM) algorithm to compute the MLEs. Also, the Newton–Raphson method is used to estimate the model parameters. The asymptotic variance–covariance matrix of the MLEs under EM framework is obtained by Fisher information matrix using the missing information and asymptotic confidence intervals for the parameters are then constructed. This study will end up with comparing the two methods of estimation and the asymptotic confidence intervals of coverage probabilities corresponding to the missing information principle and the observed information matrix through a simulation study, illustrated examples and real data analysis.     

Some Further Issues Concerning Likelihood Inference for Left Truncated and Right Censored Lognormal Data

The maximum likelihood estimates (MLEs) of the parameters of a two-parameter lognormal distribution with left truncation and right censoring are developed through the Expectation Maximization (EM) algorithm. For comparative purpose, the MLEs are also obtained by the Newton–Raphson method. The asymptotic variance-covariance matrix of the MLEs is obtained by using the missing information principle, under the EM framework. Then, using asymptotic normality of the MLEs, asymptotic confidence intervals for the parameters are constructed. Asymptotic confidence intervals are also obtained using the estimated variance of the MLEs by the observed information matrix, and by using parametric bootstrap technique. Different confidence intervals are then compared in terms of coverage probabilities, through a Monte Carlo simulation study. A prediction problem concerning the future lifetime of a right censored unit is also considered. A numerical example is given to illustrate all the inferential methods developed here.     

Statistical Analysis in Constant-stress Accelerated Life Tests for Generalized Exponential Distribution with Progressive Type-I Hybrid Censoring

Based on progressive Type-I hybrid censored data, statistical analysis in constant-stress accelerated life test (CS-ALT) for generalized exponential (GE) distribution is discussed. The maximum likelihood estimates (MLEs) of the parameters and the reliability function are obtained with EM algorithm, as well as the observed Fisher information matrix, the asymptotic variance-covariance matrix of the MLEs, and the asymptotic unbiased estimate (AUE) of the scale parameter. Confidence intervals (CIs) for the parameters are derived using asymptotic normality of MLEs and percentile bootstrap (Boot-p) method. Finally, the point estimates and interval estimates of the parameters are compared separately through the Monte-Carlo method.     

Reliability estimation in multicomponent stress–strength model for Topp-Leone distribution

In this paper, we consider the estimation reliability in multicomponent stress-strength (MSS) model when both the stress and strengths are drawn from Topp-Leone (TL) distribution. The maximum likelihood (ML) and Bayesian methods are used in the estimation procedure. Bayesian estimates are obtained by using Lindley’s approximation and Gibbs sampling methods, since they cannot be obtained in explicit form in the context of TL. The asymptotic confidence intervals are constructed based on the ML estimators. The Bayesian credible intervals are also constructed using Gibbs sampling. The reliability estimates are compared via an extensive Monte-Carlo simulation study. Finally, a real data set is analysed for illustrative purposes.     

Estimation of parameters in incomplete data models defined by dynamical systems

Parametric incomplete data models defined by ordinary differential equations (ODEs) are widely used in biostatistics to describe biological processes accurately. Their parameters are estimated on approximate models, whose regression functions are evaluated by a numerical integration method. Accurate and efficient estimations of these parameters are critical issues. This paper proposes parameter estimation methods involving either a stochastic approximation EM algorithm (SAEM) in the maximum likelihood estimation, or a Gibbs sampler in the Bayesian approach. Both algorithms involve the simulation of non-observed data with conditional distributions using Hastings–Metropolis (H–M) algorithms. A modified H–M algorithm, including an original local linearization scheme to solve the ODEs, is proposed to reduce the computational time significantly. The convergence on the approximate model of all these algorithms is proved. The errors induced by the numerical solving method on the conditional distribution, the likelihood and the posterior distribution are bounded. The Bayesian and maximum likelihood estimation methods are illustrated on a simulated pharmacokinetic nonlinear mixed-effects model defined by an ODE. Simulation results illustrate the ability of these algorithms to provide accurate estimates.     

Bayesian Estimation of the Parameters of Bivariate Exponential Distributions

In this article, we develop an empirical Bayesian approach for the Bayesian estimation of parameters in four bivariate exponential (BVE) distributions. We have opted for gamma distribution as a prior for the parameters of the model in which the hyper parameters have been estimated based on the method of moments and maximum likelihood estimates (MLEs). A simulation study was conducted to compute empirical Bayesian estimates of the parameters and their standard errors. We use moment estimators or MLEs to estimate the hyper parameters of the prior distributions. Furthermore, we compare the posterior mode of parameters obtained by different prior distributions and the Bayesian estimates based on gamma priors are very close to the true values as compared to improper priors. We use MCMC method to obtain the posterior mean and compared the same using the improper priors and the classical estimates, MLEs.     

On estimating parameters of a progressively censored lognormal distribution

We consider the problem of making statistical inference on unknown parameters of a lognormal distribution under the assumption that samples are progressively censored. The maximum likelihood estimates (MLEs) are obtained by using the expectation-maximization algorithm. The observed and expected Fisher information matrices are provided as well. Approximate MLEs of unknown parameters are also obtained. Bayes and generalized estimates are derived under squared error loss function. We compute these estimates using Lindley's method as well as importance sampling method. Highest posterior density interval and asymptotic interval estimates are constructed for unknown parameters. A simulation study is conducted to compare proposed estimates. Further, a data set is analysed for illustrative purposes. Finally, optimal progressive censoring plans are discussed under different optimality criteria and results are presented.     

Inference for Log-Gamma Distribution Based on Progressively Type-II Censored Data

We discuss the maximum likelihood estimates (MLEs) of the parameters of the log-gamma distribution based on progressively Type-II censored samples. We use the profile likelihood approach to tackle the problem of the estimation of the shape parameter κ. We derive approximate maximum likelihood estimators of the parameters μ and σ and use them as initial values in the determination of the MLEs through the Newton–Raphson method. Next, we discuss the EM algorithm and propose a modified EM algorithm for the determination of the MLEs. A simulation study is conducted to evaluate the bias and mean square error of these estimators and examine their behavior as the progressive censoring scheme and the shape parameter vary. We also discuss the interval estimation of the parameters μ and σ and show that the intervals based on the asymptotic normality of MLEs have very poor probability coverages for small values of m. Finally, we present two examples to illustrate all the methods of inference discussed in this paper.     

Objective Bayesian Analysis for Log-logistic Distribution

In this article, Bayesian approach is applied to estimate the parameters of Log-logistic distribution under reference prior and Jeffreys’ prior. The reference prior is derived and it is found that the reference prior is also a second-order matching priors as for the case of any parameter of interest. The Bayesian estimators cannot be obtained in explicit forms. Metropolis within Gibbs sampling algorithm is used to obtain the Bayesian estimators. The Bayesian estimates are compared with the maximum likelihood estimates via simulation study. A real dataset is considered for illustrative purposes.     

Likelihood inference for lognormal data with left truncation and right censoring with an illustration

The lognormal distribution is quite commonly used as a lifetime distribution. Data arising from life-testing and reliability studies are often left truncated and right censored. Here, the EM algorithm is used to estimate the parameters of the lognormal model based on left truncated and right censored data. The maximization step of the algorithm is carried out by two alternative methods, with one involving approximation using Taylor series expansion (leading to approximate maximum likelihood estimate) and the other based on the EM gradient algorithm (Lange, 1995). These two methods are compared based on Monte Carlo simulations. The Fisher scoring method for obtaining the maximum likelihood estimates shows a problem of convergence under this setup, except when the truncation percentage is small. The asymptotic variance-covariance matrix of the MLEs is derived by using the missing information principle (Louis, 1982), and then the asymptotic confidence intervals for scale and shape parameters are obtained and compared with corresponding bootstrap confidence intervals. Finally, some numerical examples are given to illustrate all the methods of inference developed here.     

Inference for a series system with dependent masked data under progressive interval censoring

This paper considers the statistical analysis of masked data in a series system with Burr-XII distributed components. Based on progressively Type-I interval censored sample, the maximum likelihood estimators for the parameters are obtained by using the expectation maximization algorithm, and the associated approximate confidence intervals are also derived. In addition, Gibbs sampling procedure using important sampling is applied for obtaining the Bayesian estimates of the parameters, and Monte Carlo method is employed to construct the credible intervals. Finally, a simulation study is proposed to illustrate the efficiency of the methods under different removal schemes and masking probabilities.     

On Progressively Type-II Censored Two-parameter Rayleigh Distribution

Recently, Rayleigh distribution has received considerable attention in the statistical literature. In this article, we consider the point and interval estimation of the functions of the unknown parameters of a two-parameter Rayleigh distribution. First, we obtain the maximum likelihood estimators (MLEs) of the unknown parameters. The MLEs cannot be obtained in explicit forms, and we propose to use the maximization of the profile log-likelihood function to compute the MLEs. We further consider the Bayesian inference of the unknown parameters. The Bayes’ estimates and the associated credible intervals cannot be obtained in closed forms. We use the importance sampling technique to approximate (compute) the Bayes’ estimates and the associated credible intervals. For comparison purposes, we have also used the exact method to compute the Bayes’ estimates and the corresponding credible intervals. Monte Carlo simulations are performed to compare the performances of the proposed method, and one dataset has been analyzed for illustrative purposes. We further consider the Bayes’ prediction problem based on the observed samples, and provide the appropriate predictive intervals. A data example has been provided for illustrative purposes.     

Bayesian and maximum likelihood estimations of the inverse Weibull parameters under progressive type-II censoring

In this paper, the statistical inference of the unknown parameters of a two-parameter inverse Weibull (IW) distribution based on the progressive type-II censored sample has been considered. The maximum likelihood estimators (MLEs) cannot be obtained in explicit forms, hence the approximate MLEs are proposed, which are in explicit forms. The Bayes and generalized Bayes estimators for the IW parameters and the reliability function based on the squared error and Linex loss functions are provided. The Bayes and generalized Bayes estimators cannot be obtained explicitly, hence Lindley's approximation is used to obtain the Bayes and generalized Bayes estimators. Furthermore, the highest posterior density credible intervals of the unknown parameters based on Gibbs sampling technique are computed, and using an optimality criterion the optimal censoring scheme has been suggested. Simulation experiments are performed to see the effectiveness of the different estimators. Finally, two data sets have been analysed for illustrative purposes.     

Gamma lifetimes and associated inference for interval-censored cure rate model with COM–Poisson competing cause

In this article, we consider a competing cause scenario and assume the wider family of Conway–Maxwell–Poisson (COM–Poisson) distribution to model the number of competing causes. Assuming the type of the data to be interval censored, the main contribution is in developing the steps of the expectation maximization (EM) algorithm to determine the maximum likelihood estimates (MLEs) of the model parameters. A profile likelihood approach within the EM framework is proposed to estimate the COM–Poisson shape parameter. An extensive simulation study is conducted to evaluate the performance of the proposed EM algorithm. Model selection within the wider class of COM–Poisson distribution is carried out using likelihood ratio test and information-based criteria. A study to demonstrate the effect of model mis-specification is also carried out. Finally, the proposed estimation method is applied to a data on smoking cessation and a detailed analysis of the obtained results is presented.     

Analysis of hybrid censored competing risks data

In this paper, we consider the analysis of hybrid censored competing risks data, based on Cox's latent failure time model assumptions. It is assumed that lifetime distributions of latent causes of failure follow Weibull distribution with the same shape parameter, but different scale parameters. Maximum likelihood estimators (MLEs) of the unknown parameters can be obtained by solving a one-dimensional optimization problem, and we propose a fixed-point type algorithm to solve this optimization problem. Approximate MLEs have been proposed based on Taylor series expansion, and they have explicit expressions. Bayesian inference of the unknown parameters are obtained based on the assumption that the shape parameter has a log-concave prior density function, and for the given shape parameter, the scale parameters have Beta–Gamma priors. We propose to use Markov Chain Monte Carlo samples to compute Bayes estimates and also to construct highest posterior density credible intervals. Monte Carlo simulations are performed to investigate the performances of the different estimators, and two data sets have been analysed for illustrative purposes.     

基于Gibbs抽样算法的面板数据分位回归方法

 文章讨论了含有随机效应的面板数据模型,利用非对称Laplace分布与分位回归之间的关系,文章建立了一种贝叶斯分层分位回归模型。通过对非对称Laplace分布的分解,文章给出了Gibbs抽样算法下模型参数的点估计及区间估计,模拟结果显示,在处理含随机效应的面板数据模型中,特别是在误差非正态的情况下,本文的方法优于传统的均值模型方法。文章最后利用新方法对我国各地区经济与就业面板数据进行了实证研究,得到了有利于宏观调控的有用信息。     

On adaptive progressively Type-II censored competing risks data

In this article, a competing risks model based on exponential distributions is considered under the adaptive Type-II progressively censoring scheme introduced by Ng et al. [2009, Naval Research Logistics 56:687-698], for life testing or reliability experiment. Moreover, we assumed that some causes of failures are unknown. The maximum likelihood estimators (MLEs) of unknown parameters are established. The exact conditional and the asymptotic distributions of the obtained estimators are derived to construct the confidence intervals as well as the two different bootstraps of different unknown parameters. Under suitable priors on the unknown parameters, Bayes estimates and the corresponding two sides of Bayesian probability intervals are obtained. Also, for the purpose of evaluating the average bias and mean square error of the MLEs, and comparing the confidence intervals based on all mentioned methods, a simulation study was carried out. Finally, we present one real dataset to conduct the proposed methods.