Estimating the parameters of a doubly truncated normal distribution

This paper deals with the maximum likelihood estimation of parameters for a doubly truncated normal distribution when the truncation points are known. We prove, in this case, that the MLEs are nonexistent (become infinite) with positive probability. For estimators that exist with probability one, the class of Bayes modal estimators or modified maximum likelihood estimators is explored. Another useful estimating procedure, called mixed estimation, is proposed. Simulations compare the behavior of the MLEs, the modified MLEs, and the mixed estimators which reveal that the MLE, in addition to being nonexistent with positive probability, behaves poorly near the upper boundary of the interval of its existence. The modified MLEs and the mixed estimators are seen to be remarkably better than the MLE     

Isotonic estimation of the intensity of a nonhomogeneous Poisson process: The multiple realization setup

In the 1950s Brunk and Van Eeden each obtained maximum-likelihood estimators of a finite product of probability density functions under partial or complete ordering of their parameters. Their results play an important role in the general theory of inference under order restrictions and lead to an isotonic estimator of the intensity of a nonhomogeneous Poisson process. Here an elementary derivation of the maximum likelihood estimator (m.l.e.) for the intensity of a nonhomogeneous Poisson process is given when several (possibly censored) realizations are available. Boswell obtained the m.l.e. based on a single realization as well as a conditional m.l.e. under the same conditions. An example is given to show that in the multirealization setup a conditional m.l.e. may not exist; the proofs are, we believe, new and elementary. An illustrative application is given.     

Estimation of the parameters of a truncated gamma distribution

This paper deals with the estimation of the parameters of a truncated gamma distribution over (0,τ), where τ is assumed to be a real number. We obtain a necessary and sufficient condition for the existence of the maximum likelihood estimator(MLE). The probability of nonexistence of MLE is observed to be positive. A simulation study indicates that the modified maximum likelihood estimator and the mixed estimator, which exist with probability one,are to be preferred over MLE. The bias, the mean square error, and the probability of nearness form a basis of our simulation study.     

Estimation with truncated inverse binomial sampling

Consider truncated samples taken from an infinite population with a fixed uumber n of observations recorded. A randon number X of items must be sampled in order to observe after trunca-tion. adified maximun liicel.ihooa estimators of X (assumed un-'mown) and of the population parameters are develo~cd, and a computing scheme is given for the exponential distribution. On the basis of asymptotu ,operties, some estimators are singled out and compared with the usual maximum likelihood estimators.     

Estimation in a truncated bivariate poisson distribution

Moment estimators for parameters in a truncated bivariate Poisson distribution are derived in Hamdan (1972) for the special case of λ₁ = λ₂, Where λ₁, λ₂ are the marginal means. Here we derive the maximum likelihood estimators for this special case. The information matrix is also obtained which provides asymptotic covariance matrix of the maximum likelihood estimators. The asymptotic covariance matrix of moment estimators is also derived. The asymptotic efficiency of moment estimators is computed and found to be very low.     

Inference on a progressive type I interval-censored truncated normal distribution

In this paper, we consider the problem of making statistical inference for a truncated normal distribution under progressive type I interval censoring. We obtain maximum likelihood estimators of unknown parameters using the expectation-maximization algorithm and in sequel, we also compute corresponding midpoint estimates of parameters. Estimation based on the probability plot method is also considered. Asymptotic confidence intervals of unknown parameters are constructed based on the observed Fisher information matrix. We obtain Bayes estimators of parameters with respect to informative and non-informative prior distributions under squared error and linex loss functions. We compute these estimates using the importance sampling procedure. The highest posterior density intervals of unknown parameters are constructed as well. We present a Monte Carlo simulation study to compare the performance of proposed point and interval estimators. Analysis of a real data set is also performed for illustration purposes. Finally, inspection times and optimal censoring plans based on the expected Fisher information matrix are discussed.     

Another generalization of the logarithmic series and the geometric distributions

A new generalization of the logarithmic series distribution is presented based on a generalized negative binomial distribution obtained from a generalized Poisson distribution compounded with the truncated gamma distribution. By length biasing this generalized log-series distribution, another generalized geometric distribution is uresented. For the generalized log-series distribution, maximum likelihood estimators are developed and an example is presented for illustration.     

The Poisson Maximum Entropy Model for Homogeneous Poisson Processes

Our main interest is parameter estimation using maximum entropy methods in the prediction of future events for Homogeneous Poisson Processes when the distribution governing the distribution of the parameters is unknown. We intend to use empirical Bayes techniques and the maximum entropy principle to model the prior information. This approach has also been motivated by the success of the gamma prior for this problem, since it is well known that the gamma maximizes Shannon entropy under appropriately chosen constraints. However, as an alternative, we propose here to apply one of the often used methods to estimate the parameters of the maximum entropy prior. It consists of moment matching, that is, maximizing the entropy subject to the constraint that the first two moments equal the empirical ones and we obtain the truncated normal distribution (truncated below at the origin) as a solution. We also use maximum likelihood estimation (MLE) methods to estimate the parameters of the truncated normal distribution for this case. These two solutions, the gamma and the truncated normal, which maximize the entropy under different constraints are tested as to their effectiveness for prediction of future events for homogeneous Poisson processes by measuring their coverage probabilities, the suitably normalized lengths of their prediction intervals and their goodness-of-fit measured by the Kullback–Leibler criterion and a discrepancy measure. The estimators obtained by these methods are compared in an extensive simulation study to each other as well as to the estimators obtained using the completely noninformative Jeffreys’ prior and the usual frequency methods. We also consider the problem of choosing between the two maximum entropy methods proposed here, that is, the gamma prior and the truncated normal prior, estimated both by matching of the first two moments and, by maximum likelihood, when faced with data and we advocate the use of the sample skewness and kurtosis. The methods are also illustrated on two examples: one concerning the occurrence of mammary tumors in laboratory animals taking part in a carcinogenicity experiment and the other, a warranty dataset from the automobile industry.     

Progressive type II censored order statistics from exponential distributions

In the model of progressive type II censoring, point and interval estimation as well as relations for single and product moments are considered. Based on two-parameter exponential distributions, maximum likelihood estimators (MLEs), uniformly minimum variance unbiased estimators (UMVUEs) and best linear unbiased estimators (BLUEs) are derived for both location and scale parameters. Some properties of these estimators are shown. Moreover, results for single and product moments of progressive type II censored order statistics are presented to obtain recurrence relations from exponential and truncated exponential distributions. These relations may then be used to compute all the means, variances and covariances of progressive type II censored order statistics based on exponential distributions for arbitrary censoring schemes. The presented recurrence relations simplify those given by Aggarwala and Balakrishnan (1996)     

Merging information for semiparametric density estimation

Summary.  The density ratio model specifies that the likelihood ratio of m −1 probability density functions with respect to the m th is of known parametric form without reference to any parametric model. We study the semiparametric inference problem that is related to the density ratio model by appealing to the methodology of empirical likelihood. The combined data from all the samples leads to more efficient kernel density estimators for the unknown distributions. We adopt variants of well-established techniques to choose the smoothing parameter for the density estimators proposed.     

Estimation and prediction of Marshall–Olkin extended exponential distribution under progressively type-II censored data

In this paper, we consider Marshall–Olkin extended exponential (MOEE) distribution which is capable of modelling various shapes of failure rates and aging criteria. The purpose of this paper is three fold. First, we derive the maximum likelihood estimators of the unknown parameters and the observed the Fisher information matrix from progressively type-II censored data. Next, the Bayes estimates are evaluated by applying Lindley’s approximation method and Markov Chain Monte Carlo method under the squared error loss function. We have performed a simulation study in order to compare the proposed Bayes estimators with the maximum likelihood estimators. We also compute 95% asymptotic confidence interval and symmetric credible interval along with the coverage probability. Third, we consider one-sample and two-sample prediction problems based on the observed sample and provide appropriate predictive intervals under classical as well as Bayesian framework. Finally, we analyse a real data set to illustrate the results derived.     

Unimodality of the pareto distribution likelihood function for multicensored samples and implications for estimation

This paper discusses maximum likelihood parameter estimation in the Pareto distribution for multicensored samples. In particu-

lar, the modality of the associated conditional log-likelihood function is investigated in order to resolve questions concerninc

the existence and uniqurneas of the lnarimum likelihood estimates.For the cases with one parameter known, the maximum likelihood

estimates of the remaining unknown parameters are shown to exist and to be unique. When both parameters are unknown, the maximum likelihood estimates may or may not exist and be unique. That is, their existence and uniqueness would seem to depend solely upon the information inherent in the sample data. In viav of the possible nonexistence and/or non-uniqueness of the maximum likelihood estimates when both parameters are unknown, alternatives to standard iterative numerical methods are explored.     

Estimation of parameters of a right truncated exponential distribution

The maximum likelihood, moment and mixture of the estimators are for samples from the right truncated exponential distribution. The estimators are compared empirically when all the parameters are unknown; their bias and mean square error are investigated with the help of numerical technique. We have shown that these estimators are asymptotically unbiased. At the end, we conclude that mixture estimators are better than the maximum likelihood and moment estimators.     

Estimation of the Entropy Rate of a Countable Markov Chain

We consider here ergodic homogeneous Markov chains with countable state spaces. The entropy rate of the chain is an explicit function of its transition and stationary distributions. We construct estimators for this entropy rate and for the entropy of the stationary distribution of the chain, in the parametric and nonparametric cases. We study estimation from one sample with long length and from many independent samples with given length. In the parametric case, the estimators are deduced by plug-in from the maximum likelihood estimator of the parameter. In the nonparametric case, the estimators are deduced by plug-in from the empirical estimators of the transition and stationary distributions. They are proven to have good asymptotic properties.     

Trimmed likelihood estimators for lifetime experiments and their influence functions

We study the behaviour of trimmed likelihood estimators (TLEs) for lifetime models with exponential or lognormal distributions possessing a linear or nonlinear link function. In particular, we investigate the difference between two possible definitions for the TLE, one called original trimmed likelihood estimator (OTLE) and one called modified trimmed likelihood estimator (MTLE) which is the finite sample version of a form for location and linear regression used by Bednarski and Clarke [Trimmed likelihood estimation of location and scale of the normal distribution. Aust J Statist. 1993;35:141–153, Asymptotics for an adaptive trimmed likelihood location estimator. Statistics. 2002;36:1–8] and Bednarski et al. [Adaptive trimmed likelihood estimation in regression. Discuss Math Probab Stat. 2010;30:203–219]. The OTLE is always an MTLE but the MTLE may not be unique even in cases where the OLTE is unique. We compare especially the functional forms of both types of estimators, characterize the difference with the implicit function theorem and indicate situations where they coincide and where they do not coincide. Since the functional form of the MTLE has a simpler form, we use it then for deriving the influence function, again with the help of the implicit function theorem. The derivation of the influence function for the functional form of the OTLE is similar but more complicated.     

Reliability inference for a general lower-truncated family of distributions under records

Based on record values, point and interval estimators are proposed in this paper for the parameters of a general lower-truncated family of distributions. Maximum likelihood and bias-corrected estimators are obtained for unknown model parameters. Based on a sufficient and complete statistic, the bias-corrected estimator is also shown to be uniformly minimum variance unbiased estimator. Different exact confidence intervals and exact confidence regions are constructed for the both model and truncated parameters, and other confidence interval estimates based on asymptotic distribution theory and bootstrap approaches are obtained as well. Finally, two real-life examples and a numerical study are presented to illustrate the performance of our methods.     

Estimates of the parameters of type-II extreme value distribution from censored samples

Maximum likelihood estimators of a Type-II extreme value distribution are derived from doubly censored samples. The asymptotic variances and covariances of the maximum likelihood estimators are discussed and these are numerically evaluated for different censoring proportions q₁ = 0.0(0. l) (0.9) from below and q₂ = 0.0 (0. l) (0.9- q₁) from above. The asymptotic relative efficiencies of the parameter estimates revealed that lower order statistics are more important for estimating the parameters of Type-II extreme value distribution as compared to higher order statistics.     

ESTIMATING THE PARAMETERS OF NORMAL AND LOGISTIC DISTRIBUTIONS FROM CENSORED SAMPLES1

Let g(z) be the ratio of the ordinate and the probability integral of the distribution of a variate z. The relation g(z)～+βz is used to derive (i) estimators μ_r and s?_r of the parameters of a truncated normal distribution and (ii) estimators μ_c and s?_c of the mean and standard deviation of a logistic distribution from doubly censored samples. The variances and eovariances of these estimators are obtained. They are shown to be nearly as efficient as the maximum likelihood estimators and easier to compute.     

Modelling and analysis of recall-based competing risks data

In this paper we consider the analysis of recall-based competing risks data. The chance of an individual recalling the exact time to event depends on the time of occurrence of the event and time of observation of the individual. In particular, it is assumed that the probability of recall depends on the time elapsed since the occurrence of an event. In this study we consider the likelihood-based inference for the analysis of recall-based competing risks data. The likelihood function is constructed by incorporating the information about the probability of recall. We consider the maximum likelihood estimation of parameters. Simulation studies are carried out to examine the performance of the estimators. The proposed estimation procedure is applied to a real life data set.     

Robust-efficient fitting of mixed linear models: Methodology and theory

In many areas of application mixed linear models serve as a popular tool for analyzing highly complex data sets. For inference about fixed effects and variance components, likelihood-based methods such as (restricted) maximum likelihood estimators, (RE)ML, are commonly pursued. However, it is well-known that these fully efficient estimators are extremely sensitive to small deviations from hypothesized normality of random components as well as to other violations of distributional assumptions. In this article, we propose a new class of robust-efficient estimators for inference in mixed linear models. The new three-step estimation procedure provides truncated generalized least squares and variance components' estimators with hard-rejection weights adaptively computed from the data. More specifically, our data re-weighting mechanism first detects and removes within-subject outliers, then identifies and discards between-subject outliers, and finally it employs maximum likelihood procedures on the “clean” data. Theoretical efficiency and robustness properties of this approach are established.