An identity for exponential distributions with the common location parameter and its applications

An identity for exponential distributions with an unknown common location parameter and unknown and possibly unequal scale parameters is established.Through use of the identity the maximum likelihood estimator (MLE) and the uniformly minimum variance unbiased estimator (UMVUE) of a quantile of an exponential population are compared under the squared error loss.A class of estimators dominating both MLE and UMVUE is obtained by using the identity.     

Modified inference about the mean of the exponential distribution using moving extreme ranked set sampling

The maximum likelihood estimator (MLE) and the likelihood ratio test (LRT) will be considered for making inference about the scale parameter of the exponential distribution in case of moving extreme ranked set sampling (MERSS). The MLE and LRT can not be written in closed form. Therefore, a modification of the MLE using the technique suggested by Maharota and Nanda (Biometrika 61:601–606, 1974) will be considered and this modified estimator will be used to modify the LRT to get a test in closed form for testing a simple hypothesis against one sided alternatives. The same idea will be used to modify the most powerful test (MPT) for testing a simple hypothesis versus a simple hypothesis to get a test in closed form for testing a simple hypothesis against one sided alternatives. Then it appears that the modified estimator is a good competitor of the MLE and the modified tests are good competitors of the LRT using MERSS and simple random sampling (SRS).     

Partially-adaptive robust estimators of location via exponential embedding

A general method is presented for constructing a location estimator which is asymptotically efficient at any two different location-scale families of symmetric distributions as well as at an appropriately defined class of distributions lying in between. The method works by embedding the two families in a comprehensive parametric model and identifying the estimator with the MLE. The case when the families are Normal and Double exponential is examined in detail.     

Estimation of common location parameter of two exponential populations based on records

Consider the problem of estimating the common location parameter of two exponential populations using record data when the scale parameters are unknown. We derive the maximum likelihood estimator (MLE), the modified maximum likelihood estimator (MMLE) and the uniformly minimum variance unbiased estimator (UMVUE) of the common location parameter. Further, we derive a general result for inadmissibility of an equivariant estimator under the scaled-squared error loss function. Using this result, we conclude that the MLE and the UMVUE are inadmissible and better estimators are provided. A simulation study is conducted for comparing the performances of various competing estimators.     

Estimation for Continuous Branching Processes

The maximum-likelihood estimator for the curved exponential family given by continuous branching processes with immigration is investigated. These processes originated from population biology but also model the dynamics of interest rates and development of the state of technology in economics. It is proved that in contrast to branching processes with discrete space and/or time the MLE gives a unified approach to the inference. In order to include singular subdomains of the parameter space we modify the MLE slightly. Consistency and asymptotic normality for the MLE are considered. Concerning the asymptotic theory of the experiments, all three properties LAQ, LAN, and LAMN occur for different submodels     

Estimation of system reliability for exponential distributions based on L ranked set sampling

Abstract

In the case where strength and stress both follow exponential distributions, this paper considers the maximum likelihood estimator (MLE) of the system reliability based on L ranked set sampling (LRSS). The proposed MLE is shown to have existence, uniqueness and asymptotic normality, and its asymptotic variance is obtained by the Fisher information matrix of LRSS. The values of asymptotic relative efficiencies show that the proposed MLE is always more efficient than the MLE using simple random sampling (SRS). However, the MLE using LRSS cannot be written in closed form. Therefore, the modified MLE is proposed using the technique replaced some terms in the maximum likelihood equations by their expectations. The newly modified MLE using LRSS is shown to be superior to the MLE using SRS. Finally, the proposed method is applied to a real data set on metastatic renal carcinoma study.     

Exact distribution of the MLEs of the parameters and of the quantiles of two-parameter exponential distribution under hybrid censoring

Epstein [Truncated life tests in the exponential case, Ann. Math. Statist. 25 (1954), pp. 555–564] introduced a hybrid censoring scheme (called Type-I hybrid censoring) and Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring, Comm. Statist. Theory Methods 17 (1988), pp. 1857–1870] derived the exact distribution of the maximum-likelihood estimator (MLE) of the mean of a scaled exponential distribution based on a Type-I hybrid censored sample. Childs et al. [Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution, Ann. Inst. Statist. Math. 55 (2003), pp. 319–330] provided an alternate simpler expression for this distribution, and also developed analogous results for another hybrid censoring scheme (called Type-II hybrid censoring). The purpose of this paper is to derive the exact bivariate distribution of the MLE of the parameter vector of a two-parameter exponential model based on hybrid censored samples. The marginal distributions are derived and exact confidence bounds for the parameters are obtained. The results are also used to derive the exact distribution of the MLE of the pth quantile, as well as the corresponding confidence bounds. These exact confidence intervals are then compared with parametric bootstrap confidence intervals in terms of coverage probabilities. Finally, we present some numerical examples to illustrate the methods of inference developed here.     

Estimation of parameters for the truncated exponential distribution

We consider the right truncated exponential distribution where the truncation point is unknown and show that the ML equation has a unique solution over an extended parameter space. In the case of the estimation of the truncation point T we show that the asymptotic distribution of the MLE is not centered at T. A modified MLE is introduced which outperforms all other considered estimators including the minimum variance unbiased estimator. Asymptotic as well as small sample properties of different estimators are investigated and compared. The truncated exponential distribution has an increasing failure rate, ideally suited for use as a survival distribution for biological and industrial data.     

Set Compound Estimation Under Entropy Loss

Set compound estimation has been studied for nearly half a century. This paper explores, for the first time, set compound estimation under entropy (Kullback-Leibler information) loss for a k -dimensional standard exponential family with a compact parameter space. It makes detailed investigation of entropy loss with the exponential family and related proper-ties. Asymptotically optimal set compound estimators with rates O ( n ^−1/2) under this loss are established for some discrete exponential families by using power series, representing the Bayes estimators in terms of a mixture density and applying the Singh-Datta Lemma. Poisson, negative binomial families and a two-dimensional model serve as examples.     

Approximate MLE for the scale parameter of the generalized exponential distribution under random censoring

In this paper, we consider the maximum likelihood estimator (MLE) of the scale parameter of the generalized exponential (GE) distribution based on a random censoring model. We assume the censoring distribution also follows a GE distribution. Since the estimator does not provide an explicit solution, we propose a simple method of deriving an explicit estimator by approximating the likelihood function. In order to compare the performance of the estimators, Monte Carlo simulation is conducted. The results show that the MLE and the approximate MLE are almost identical in terms of bias and variance.     

Improved inference for the shape-scale family of distributions under type-II censoring

The presence of a nuisance parameter may often perturb the quality of the likelihood-based inference for a parameter of interest under small to moderate sample sizes. The article proposes a maximal scale invariant transformation for likelihood-based inference for the shape in a shape-scale family to circumvent the effect of the nuisance scale parameter. The transformation can be used under complete or type-II censored samples. Simulation-based performance evaluation of the proposed estimator for the popular Weibull, Gamma and Generalized exponential distribution exhibits markedly improved performance in all types of likelihood-based inference for the shape under complete and type-II censored samples. The simulation study leads to a linear relation between the bias of the classical maximum likelihood estimator (MLE) and the transformation-based MLE for the popular Weibull and Gamma distributions. The linearity is exploited to suggest an almost unbiased estimator of the shape parameter for these distributions. Allied estimation of scale is also discussed.     

LOSS OF INFORMATION ASSOCIATED WITH THE ORDER STATISTICS AND RELATED ESTIMATORS IN THE DOUBLE EXPONENTIAL DISTRIBUTION CASE

Fisher (1934) derived the loss of information of the maximum likelihood estimator (MLE) of the location parameter in the case of the double exponential distribution. Takeuchi & Akahira (1976) showed that the MLE is not second order asymptotically efficient. This paper extends these results by obtaining the (asymptotic) losses of information of order statistics and related estimators, and by comparing them via their asymptotic distributions up to the second order.     

Estimation of the mean of the exponential distribution using moving extremes ranked set sampling

Moving Extremes Ranked Set Sampling (MERSS) is a useful modification of Ranked Set Sampling (RSS). Unlike RSS, MERSS allows for an increase of set size without introducing too much ranking error. The method is considered parametrically under exponential distribution. Maximum likelihood estimator (MLE), and a modified MLE are considered and their properties are studied. The method is studied under both perfect and imperfect ranking (with error in ranking). It appears that these estimators can be real competitors to the MLE using the usual simple random sampling (SRS).     

Estimation of common location parameter of several heterogeneous exponential populations based on generalized order statistics

In this article, several independent populations following exponential distribution with common location parameter and unknown and unequal scale parameters are considered. From these populations, several independent samples of generalized order statistics (gos) are drawn. Under the setup of gos, the problem of estimation of common location parameter is discussed and various estimators of common location parameter are derived. The authors obtained maximum likelihood estimator (MLE), modified MLE and uniformly minimum variance unbiased estimator of common location parameter. Furthermore, under scaled-squared error loss function, a general inadmissibility result of invariant estimator is proposed. The derived results are further reduced for upper record values which is a special case of gos. Finally, simulation study and real life example are reported to show the performances of various competing estimators in terms of percentage risk improvement.     

Nonnegative Unbiased Estimation of Scale Parameters and Associated Quantiles Based on a Ranked Set Sample

In this article, we are interested in estimating the scale parameter in location and scale families. It is well known that the best linear unbiased estimator (BLUE) of scale parameter based on a simple random sample (SRS) is nonnegative. However, the BLUE of scale parameter based on a ranked set sample (RSS) can assume negative values. We suggest various modifications of BLUE of scale parameter based on RSS so that the resulting estimators are unbiased as well as nonnegative. Their performances in terms of relative efficiencies are compared and some recommendations are made for normal, logistic, double exponential, two-parameter exponential and Weibull distributions. We also briefly discuss an application of the proposed nonnegative BLUE of scale parameter for quantile estimation for the above populations.     

On a Correction of the Scale MLE for a Two-Parameter Exponential Distribution Under Progressive Type-I Censoring

In this article, we present a corrected version of the maximum likelihood estimator (MLE) of the scale parameter with progressively Type-I censored data from a two-parameter exponential distribution. Furthermore, we propose a bias correction of both the location and scale MLE. The properties of the estimates are analyzed by a simulation study which also illustrates the effect of the correction. Moreover, the presented estimators are applied to two data sets. Finally, it is shown that the correction of the scale estimator is also necessary for other distributions with a finite left endpoint of support (e.g., three-parameter Weibull distributions).     

A computer algebra package for approximate conditional inference

This paper presents a set of REDUCE procedures that make a number of existing higher-order asymptotic results available for both theoretical and practical research. Attention has been restricted to the context of exact and approximate inference for a parameter of interest conditionally either on an ancillary statistic or on a statistic partially sufficient for the nuisance parameter. In particular, the procedures apply to regression-scale models and multiparameter exponential families. Most of them support algebraic computation as well as numerical calculation for a given data set. Examples illustrate the code.     

On maximum likelihood estimation in parametric regression with missing covariates

We consider parametric regression problems with some covariates missing at random. It is shown that the regression parameter remains identifiable under natural conditions. When the always observed covariates are discrete, we propose a semiparametric maximum likelihood method, which does not require parametric specification of the missing data mechanism or the covariate distribution. The global maximum likelihood estimator (MLE), which maximizes the likelihood over the whole parameter set, is shown to exist under simple conditions. For ease of computation, we also consider a restricted MLE which maximizes the likelihood over covariate distributions supported by the observed values. Under regularity conditions, the two MLEs are asymptotically equivalent and strongly consistent for a class of topologies on the parameter set.     

Numerical maximum likelihood estimation for the g-and-k and generalized g-and-h distributions

Continuing increases in computing power and availability mean that many maximum likelihood estimation (MLE) problems previously thought intractable or too computationally difficult can now be tackled numerically. However, ML parameter estimation for distributions whose only analytical expression is as quantile functions has received little attention. Numerical MLE procedures for parameters of new families of distributions, the g-and-k and the generalized g-and-h distributions, are presented and investigated here. Simulation studies are included, and the appropriateness of using asymptotic methods examined. Because of the generality of these distributions, the investigations are not only into numerical MLE for these distributions, but are also an initial investigation into the performance and problems for numerical MLE applied to quantile-defined distributions in general. Datasets are also fitted using the procedures here. Results indicate that sample sizes significantly larger than 100 should be used to obtain reliable estimates through maximum likelihood.     

On Unbiased Estimation of Positive Integral Powers of the Natural Parameter in Exponential Families

We explore the structure of one‐parameter exponential families admitting an unbiased estimator for a positive integral power of the natural parameter. It is seen that only exponential families dominated by Lebesgue measure can have this property. It is outlined that similar results can be obtained for other functions of the natural parameter.