Exact confidence intervals for the shape parameter of the gamma distribution

In this paper exact confidence intervals (CIs) for the shape parameter of the gamma distribution are constructed using the method of Bølviken and Skovlund [Confidence intervals from Monte Carlo tests. J Amer Statist Assoc. 1996;91:1071–1078]. The CIs which are based on the maximum likelihood estimator or the moment estimator are compared to bootstrap CIs via a simulation study.     

Estimation of P(Y < X) for Weibull Distribution Under Progressive Type-II Censoring

Based on progressively Type II censored samples, we consider the estimation of R = P(Y < X) when X and Y are two independent Weibull distributions with different shape parameters, but having the same scale parameter. The maximum likelihood estimator, approximate maximum likelihood estimator, and Bayes estimator of R are obtained. Based on the asymptotic distribution of R, the confidence interval of R are obtained. Two bootstrap confidence intervals are also proposed. Analysis of a real data set is given for illustrative purposes. Monte Carlo simulations are also performed to compare the different proposed methods.     

The exact confidence interval for the scale parameter and the mvue of the laplace distribution

The exact distribution of the sample median, and of the maximum likelihood estimator of the scale parameter of the Laplace distribution is derived. Tables of Teans, variances and the distribution functions of the corresponding dislributions are evaluacted. Exact ,solutions to the problem of confidence interval and hypothesrs testing for the scale paramrter are provided. The minimum variance unbiased estimator (MVUE) of the p.d.f. of the Laplace distribution when the location parameter is known is also given.     

Odds ratio inference from stratified samples

One of the common problems encountered in applied statistics is that of comparing two proportions from stratified samples. One approach to this problem is via inference on the corresponding odds ratio. In this paper, the various point and interval estimators of and hypothesis testing procedures for a common odds ratio from multiple 2 ×2 tables are reviewed. Based On research to date, the conditional maximum likelihood and Mantel-Haenszel estimators are recommended as the point estimators of choice. Neither confidence intervals nor hypothesis testing metthods have been studied as well as the point estimators, but there is a confidence interval method associated with the Mantel-Haenszel estimator that is a good choice.     

Inferences on Stress-Strength Reliability from Lindley Distributions

This article deals with the estimation of the stress-strength parameter R = P(Y < X) when X and Y are independent Lindley random variables with different shape parameters. The uniformly minimum variance unbiased estimator has explicit expression, however, its exact or asymptotic distribution is very difficult to obtain. The maximum likelihood estimator of the unknown parameter can also be obtained in explicit form. We obtain the asymptotic distribution of the maximum likelihood estimator and it can be used to construct confidence interval of R. Different parametric bootstrap confidence intervals are also proposed. Bayes estimator and the associated credible interval based on independent gamma priors on the unknown parameters are obtained using Monte Carlo methods. Different methods are compared using simulations and one data analysis has been performed for illustrative purposes.     

Confidence intervals based on the deviance statistic for the hyperparameters in state space models

The main objective of this work is to evaluate the performance of confidence intervals, built using the deviance statistic, for the hyperparameters of state space models. The first procedure is a marginal approximation to confidence regions, based on the likelihood test, and the second one is based on the signed root deviance profile. Those methods are computationally efficient and are not affected by problems such as intervals with limits outside the parameter space, which can be the case when the focus is on the variances of the errors. The procedures are compared to the usual approaches existing in the literature, which includes the method based on the asymptotic distribution of the maximum likelihood estimator, as well as bootstrap confidence intervals. The comparison is performed via a Monte Carlo study, in order to establish empirically the advantages and disadvantages of each method. The results show that the methods based on the deviance statistic possess a better coverage rate than the asymptotic and bootstrap procedures.     

Estimation of the parameters of a truncated gamma distribution

This paper deals with the estimation of the parameters of a truncated gamma distribution over (0,τ), where τ is assumed to be a real number. We obtain a necessary and sufficient condition for the existence of the maximum likelihood estimator(MLE). The probability of nonexistence of MLE is observed to be positive. A simulation study indicates that the modified maximum likelihood estimator and the mixed estimator, which exist with probability one,are to be preferred over MLE. The bias, the mean square error, and the probability of nearness form a basis of our simulation study.     

Inference on constant stress accelerated life tests for log-location-scale lifetime distributions with type-I hybrid censoring

In this paper, we consider a constant stress accelerated life test terminated by a hybrid Type-I censoring at the first stress level. The model is based on a general log-location-scale lifetime distribution with mean life being a linear function of stress and with constant scale. We obtain the maximum likelihood estimators (MLE) and the approximate maximum likelihood estimators (AMLE) of the model parameters. Approximate confidence intervals, likelihood ratio tests and two bootstrap methods are used to construct confidence intervals for the unknown parameters of the Weibull and lognormal distributions using the MLEs. Finally, a simulation study and two illustrative examples are provided to demonstrate the performance of the developed inferential methods.     

A note on comparison and improvement of estimators based on likelihood

The problem of estimation of a parameter of interest in the presence of a nuisance parameter, which is either location or scale, is considered. Three estimators are taken into account: usual maximum likelihood (ML) estimator, maximum integrated likelihood estimator and the bias-corrected ML estimator. General results on comparison of these estimators w.r.t. the second-order risk based on the mean-squared error are obtained. Possible improvements of basic estimators via the notion of admissibility and methodology given in Ghosh and Sinha [A necessary and sufficient condition for second order admissibility with applications to Berkson's bioassay problem. Ann Stat. 1981;9(6):1334–1338] are considered. In the recent paper by Tanaka et al. [On improved estimation of a gamma shape parameter. Statistics. 2014; doi:10.1080/02331888.2014.915842], this problem was considered for estimating the shape parameter of gamma distribution. Here, we perform more accurate comparison of estimators for this case as well as for some other cases.     

Jackknife empirical likelihood-based inferences for Lorenz curve with kernel smoothing

The Lorenz curve describes the wealth proportion for an income-ordered population. In this paper, we introduce a kernel smoothing estimator for the Lorenz curve and propose a smoothed jackknife empirical likelihood method for constructing confidence intervals of Lorenz ordinates. Extensive simulation studies are conducted to evaluate finite sample performances of the proposed methods. A real dataset of Georgia professor’s income is used to illustrate the proposed methods.     

Inference of R = P[X < Y] for skew normal distribution

This article studies the estimation of R = P[X < Y] when X and Y are two independent skew normal distribution with different parameters. When the scale parameter is unknown, the maximum likelihood estimator of R is proposed. The maximum likelihood estimator, uniformly minimum variance unbiased estimator, Bayes estimation, and confidence interval of R are obtained when the common scale parameter is known. In the general case, the maximum likelihood estimator of R is also discussed. To compare the different proposed methods, Monte Carlo simulations are performed. At last, the analysis of a real dataset has been presented for illustrative purposes too.     

A new algorithm for maximum likelihood estimation in normal scale-mixture generalized autoregressive conditional heteroskedastic models

In this paper, we propose a new generalized autoregressive conditional heteroskedastic (GARCH) model using infinite normal scale-mixtures which can suitably avoid order selection problems in the application of finite normal scale-mixtures. We discuss its theoretical properties and develop a two-stage algorithm for the maximum likelihood estimator to estimate the mixing distribution non-parametric maximum likelihood estimator (NPMLE) as well as GARCH parameters (two-stage MLE). For the estimation of a mixing distribution, we employ a fast computational algorithm proposed by Wang [On fast computation of the non-parametric maximum likelihood estimate of a mixing distribution. J R Stat Soc Ser B. 2007;69:185–198] under the gradient characterization of the non-parametric mixture likelihood. The GARCH parameters are then estimated either using the expectation-mazimization algorithm or general optimization scheme. In addition, we propose a new forecasting algorithm of value-at-risk (VaR) using the two-stage MLE and the NPMLE. Through a simulation study and real data analysis, we compare the performance of the two-stage MLE with the existing ones including quasi-maximum likelihood estimator based on the standard normal density and the finite normal mixture quasi maximum estimated-likelihood estimator (cf. Lee S, Lee T. Inference for Box–Cox transformed threshold GARCH models with nuisance parameters. Scand J Stat. 2012;39:568–589) in terms of the relative efficiency and accuracy of VaR forecasting.     

Empirical likelihood inference for a common mean in the presence of heteroscedasticity

The authors develop empirical likelihood (EL) based methods of inference for a common mean using data from several independent but nonhomogeneous populations. For point estimation, they propose a maximum empirical likelihood (MEL) estimator and show that it is n‐consistent and asymptotically optimal. For confidence intervals, they consider two EL based methods and show that both intervals have approximately correct coverage probabilities under large samples. Finite‐sample performances of the MEL estimator and the EL based confidence intervals are evaluated through a simulation study. The results indicate that overall the MEL estimator and the weighted EL confidence interval are superior alternatives to the existing methods.     

Estimating Percentiles of Time-to-Failure Distribution Obtained from a Linear Degradation Model Using Kernel Density Method

In this article, we propose a nonparametric estimator for percentiles of the time-to-failure distribution obtained from a linear degradation model using the kernel density method. The properties of the proposed kernel estimator are investigated and compared with well-known maximum likelihood and ordinary least squares estimators via a simulation technique. The mean squared error and the length of the bootstrap confidence interval are used as the basis criteria of the comparisons. The simulation study shows that the performance of the kernel estimator is acceptable as a general estimator. When the distribution of the data is assumed to be known, the maximum likelihood and ordinary least squares estimators perform better than the kernel estimator, while the kernel estimator is superior when the assumption of our knowledge of the data distribution is violated. A comparison among different estimators is achieved using a real data set.     

Shape Constrained Non‐parametric Estimators of the Baseline Distribution in Cox Proportional Hazards Model

Abstract. We investigate non‐parametric estimation of a monotone baseline hazard and a decreasing baseline density within the Cox model. Two estimators of a non‐decreasing baseline hazard function are proposed. We derive the non‐parametric maximum likelihood estimator and consider a Grenander type estimator, defined as the left‐hand slope of the greatest convex minorant of the Breslow estimator. We demonstrate that the two estimators are strongly consistent and asymptotically equivalent and derive their common limit distribution at a fixed point. Both estimators of a non‐increasing baseline hazard and their asymptotic properties are obtained in a similar manner. Furthermore, we introduce a Grenander type estimator for a non‐increasing baseline density, defined as the left‐hand slope of the least concave majorant of an estimator of the baseline cumulative distribution function, derived from the Breslow estimator. We show that this estimator is strongly consistent and derive its asymptotic distribution at a fixed point.     

ASYMPTOTIC PROPERTIES OF RESTRICTED MAXIMUM LIKELIHOOD (REML) ESTIMATES FOR HIERARCHICAL MIXED LINEAR MODELS

This paper explores the asymptotic distribution of the restricted maximum likelihood estimator of the variance components in a general mixed model. Restricting attention to hierarchical models, central limit theorems are obtained using elementary arguments with only mild conditions on the covariates in the fixed part of the model and without having to assume that the data are either normally or spherically symmetrically distributed. Further, the REML and maximum likelihood estimators are shown to be asymptotically equivalent in this general framework, and the asymptotic distribution of the weighted least squares estimator (based on the REML estimator) of the fixed effect parameters is derived.     

On length and area-biased Maxwell distributions

This article addresses the various properties and different methods of estimation of the unknown parameter of length and area-biased Maxwell distributions. Although, our main focus is on estimation from both frequentist and Bayesian point of view, yet, various mathematical and statistical properties of length and area-biased Maxwell distributions (such as moments, moment-generating function (mgf), hazard rate function, mean residual lifetime function, residual lifetime function, reversed residual life function, conditional moments and conditional mgf, stochastic ordering, and measures of uncertainty) are derived. We briefly describe different frequentist approaches, namely, maximum likelihood estimator, moments estimator, least-square and weighted least-square estimators, maximum product of spacings estimator and compare them using extensive numerical simulations. Next we consider Bayes estimation under different types of loss function (symmetric and asymmetric loss functions) using inverted gamma prior for the scale parameter. Furthermore, Bayes estimators and their respective posterior risks are computed and compared using Markov chain Monte Carlo (MCMC) algorithm. Also, bootstrap confidence intervals using frequentist approaches are provided to compare with Bayes credible intervals. Finally, a real dataset has been analyzed for illustrative purposes.     

Umvu estimation for the inverse gaussian distribution I(μ,cμ2) with known c

The uniformly minimum variance unbiased estimator and the maximum likelihood estimator of μ for the inverse Gaussian distribution I(μc,μ ) with known c are constructed, and they are shown to be asymptoti- cally equivalent.     

On bias reduction estimators of skew-normal and skew-t distributions

A particular concerns of researchers in statistical inference is bias in parameters estimation. Maximum likelihood estimators are often biased and for small sample size, the first order bias of them can be large and so it may influence the efficiency of the estimator. There are different methods for reduction of this bias. In this paper, we proposed a modified maximum likelihood estimator for the shape parameter of two popular skew distributions, namely skew-normal and skew-t, by offering a new method. We show that this estimator has lower asymptotic bias than the maximum likelihood estimator and is more efficient than those based on the existing methods.     

On estimation of the PDF and CDF of the Lindley distribution

This article addresses two methods of estimation of the probability density function (PDF) and cumulative distribution function (CDF) for the Lindley distribution. Following estimation methods are considered: uniformly minimum variance unbiased estimator (UMVUE) and maximum likelihood estimator (MLE). Since the Lindley distribution is more flexible than the exponential distribution, the same estimators have been found out for the exponential distribution and compared. Monte Carlo simulations and a real data analysis are performed to compare the performances of the proposed methods of estimation.