Estimation of two ordered normal means when a covariance matrix is known

Estimation of two normal means with an order restriction is considered when a covariance matrix is known. It is shown that restricted maximum likelihood estimator (MLE) stochastically dominates both estimators proposed by Hwang and Peddada [Confidence interval estimation subject to order restrictions. Ann Statist. 1994;22(1):67–93] and Peddada et al. [Estimation of order-restricted means from correlated data. Biometrika. 2005;92:703–715]. The estimators are also compared under the Pitman nearness criterion and it is shown that the MLE is closer to ordered means than the other two estimators. Estimation of linear functions of ordered means is also considered and a necessary and sufficient condition on the coefficients is given for the MLE to dominate the other estimators in terms of mean squared error.     

Pitman closeness of the class of isotonic estimators for ordered scale parameters of two Gamma distributions

The problem of estimating order-restricted scale parameters of two Gamma distributions is considered under the Pitman closeness criterion. A class of isotonic estimators including the MLE is proposed. Some properties of this class of isotonic estimators is given under the Pitman closeness criterion. In particular, some properties of the MLE naturally follow. We use simulation comparisons to examine the results.     

On Non-parametric Estimation of the Survival Function with Competing Risks

The non-parametric maximum likelihood estimators (MLEs) are derived for survival functions associated with individual risks or system components in a reliability framework. Lifetimes are observed for systems that contain one or more of those components. Analogous to a competing risks model, the system is assumed to fail upon the first instance of any component failure; i.e. the system is configured in series. For any given risk or component type, the asymptotic distribution is shown to depend explicitly on the unknown survival function of the other risks, as well as the censoring distribution. Survival functions with increasing failure rate are investigated as a special case. The order restricted MLE is shown to be consistent under mild assumptions of the underlying component lifetime distributions.     

Laplace’s approximation for relative risk frailty models

Relative risk frailty models are used extensively in analyzing clustered and/or recurrent time-to-event data. In this paper, Laplace’s approximation for integrals is applied to marginal distributions of data arising from parametric relative risk frailty models. Under regularity conditions, the approximate maximum likelihood estimators (MLE) are consistent with a rate of convergence that depends on both the number of subjects and number of members per subject. We compare the approximate MLE against alternative estimators using limited simulation and demonstrate the utility of Laplace’s approximation approach by analyzing U.S. patient waiting time to deceased kidney transplant data.     

Estimation of parameters for the truncated exponential distribution

We consider the right truncated exponential distribution where the truncation point is unknown and show that the ML equation has a unique solution over an extended parameter space. In the case of the estimation of the truncation point T we show that the asymptotic distribution of the MLE is not centered at T. A modified MLE is introduced which outperforms all other considered estimators including the minimum variance unbiased estimator. Asymptotic as well as small sample properties of different estimators are investigated and compared. The truncated exponential distribution has an increasing failure rate, ideally suited for use as a survival distribution for biological and industrial data.     

On the small sample properties of norm-restricted maximum likelihood estimators for logistic regression models

This paper develops alternatives to maximum likelihood estimators (MLE) for logistic regression models and compares the mean squared error (MSE) of the estimators. The MLE for the vector of underlying success probabilities has low MSE only when the true probabilities are extreme (i.e., near 0 or 1). Extreme probabilities correspond to logistic regression parameter vectors which are large in norm. A competing “restricted” MLE and an empirical version of it are suggested as estimators with better performance than the MLE for central probabilities. An approximate EM-algorithm for estimating the restriction is described. As in the case of normal theory ridge estimators, the proposed estimators are shown to be formally derivable by Bayes and empirical Bayes arguments. The small sample operating characteristics of the proposed estimators are compared to the MLE via a simulation study; both the estimation of individual probabilities and of logistic parameters are considered.     

Estimation in the presence of incidental parameters

This paper considers the estimation of “structural” parameters when the number of unknown parameters increases with the sample size. Neyman and Scott (1948) had demonstrated that maximum likelihood estimators (MLE) of structural parameters may be inconsistent in this case. Patefield (1977) further observed that the asymptotic covariance matrix of the MLE is not equal to the inverse of the information matrix. In this paper we establish asymptotic properties of estimators (which include in particular the MLE) obtained via the usual likelihood approach when the incidental parameters are first replaced by their estimates (which are allowed to depend on the structural parameters). Conditions for consistency and asymptotic normality together with a proper formula for the asymptotic covariance matrix are given. The results are illustrated and applied to the problem of estimating linear functional relationships, and mild conditions on the incidental parameters for the MLE (or an adjusted MLE) to be consistent and asymptotically normal are obtained. These conditions are weaker than those imposed by previous authors.     

On improved estimation of a gamma shape parameter

This paper deals with improved estimation of a gamma shape parameter from a decision-theoretic point of view. First we study the second-order properties of three estimators – (i) the maximum-likelihood estimator (MLE), (ii) a bias corrected version of the MLE, and (iii) an improved version (in terms of mean squared error) of the MLE. It is shown that all the three estimators mentioned above are second-order inadmissible. Next, we obtain superior estimators which are second order better than the above three estimators. Simulation results are provided to study the relative risk improvement of each improved estimator over the MLE.     

Aalen's linear model for doubly censored data

Double censoring often occurs in registry studies when left censoring is present in addition to right censoring. In this work, we examine estimation of Aalen's nonparametric regression coefficients based on doubly censored data. We propose two estimation techniques. The first type of estimators, including ordinary least squared (OLS) estimator and weighted least squared (WLS) estimators, are obtained using martingale arguments. The second type of estimator, the maximum likelihood estimator (MLE), is obtained via expectation-maximization (EM) algorithms that treat the survival times of left censored observations as missing. Asymptotic properties, including the uniform consistency and weak convergence, are established for the MLE. Simulation results demonstrate that the MLE is more efficient than the OLS and WLS estimators.     

Smooth Estimation of the Reliability Function

Problems with censored data arise quite frequently in reliability applications. Estimation of the reliability function is usually of concern. Reliability function estimators proposed by Kaplan and Meier (1958), Breslow (1972), are generally used when dealing with censored data. These estimators have the known properties of being asymptotically unbiased, uniformly strongly consistent, and weakly convergent to the same Gaussian process, when properly normalized. We study the properties of the smoothed Kaplan-Meier estimator with a suitable kernel function in this paper. The smooth estimator is compared with the Kaplan-Meier and Breslow estimators for large sample sizes giving an exact expression for an appropriately normalized difference of the mean square error (MSE) of the two estimators. This quantifies the deficiency of the Kaplan-Meier estimator in comparison to the smoothed version. We also obtain a non-asymptotic bound on an expected ₁-type error under weak conditions. Some simulations are carried out to examine the performance of the suggested method.     

Joint analysis of interval-censored failure time data and panel count data

Interval-censored failure time data and panel count data are two types of incomplete data that commonly occur in event history studies and many methods have been developed for their analysis separately (Sun in The statistical analysis of interval-censored failure time data. Springer, New York, 2006; Sun and Zhao in The statistical analysis of panel count data. Springer, New York, 2013). Sometimes one may be interested in or need to conduct their joint analysis such as in the clinical trials with composite endpoints, for which it does not seem to exist an established approach in the literature. In this paper, a sieve maximum likelihood approach is developed for the joint analysis and in the proposed method, Bernstein polynomials are used to approximate unknown functions. The asymptotic properties of the resulting estimators are established and in particular, the proposed estimators of regression parameters are shown to be semiparametrically efficient. In addition, an extensive simulation study was conducted and the proposed method is applied to a set of real data arising from a skin cancer study.     

Ordering conditional lifetimes of coherent systems

Consider a system of n components that has the property that there exists a number r  (r<n)$(r<n)$, such that if it is known that at most r components have failed, the system is still functioning with probability 1. Suppose that such a system is equipped with a warning light that comes up at the time of the failure of the rth component. The system is still working then, and we are interested in its residual life. In this paper we obtain some results which stochastically compare the residual lives of such systems with the same type, or with different types, of components. Some applications are given. In particular, we derive upper and lower bounds on the expected residual lives of such systems given that the warning light has not come up yet, and given that the component hazard rate functions are bounded from below or from above by a known constant.     

On second-order admissibilities of the estimators of gamma shape vector

Simultaneous estimation problem of gamma shape vector is considered.First, it is shown that the maximum likelihood estimator (MLE), the bias corrected MLE, and the conditional MLE of shape vector are second-order inadmissible. Second, these estimators are improved up to the second order. Finally, we identify whether these improved estimators are second-order admissible or not. Simulation studies are also given.     

Estimation of the scale parameter of the Rayleigh distribution with multiply type–II censored sample

Based on a multiply type-II censored sample, the maximum likelihood estimator (MLE) and Bayes estimator for the scale parameter and the reliability function of the Rayleigh distribution are derived. However, since the MLE does not exist an explicit form, an approximate MLE which is the maximizer of an approximate likelihood function will be given. The comparisons among estimators are investigated through Monte Carlo simulations. An illustrative example with the real data concerning the 23 ball bearing in the life test is presented.     

Estimation for two-parameter weibull distribution and extreme-value distribution under multiply type-II censoring

Compared to Type-II censoring, multiply Type-II censoring is a more general, yet mathematically and numerically much more complicated censoring scheme. For multiply Type II censored data from a two-parameter Weibull distribution, we propose several estimators, including MLE, approximate MLE, and estimators corresponding to the BLUE and BLIE from estimating parameters in extreme-value distribution. An approximately unbiased estimator for the shape parameter is also proposed which has the smallest MSE. Numerical examples show that this estimator is the best in terms of bias and MSE. Numerical examples also show that the approximate MLE which admits a closed form is better for estimating the scale parameter.     

Estimating the negative binomial dispersion parameter with highly stratified surveys

We investigate several estimators of the negative binomial (NB) dispersion parameter for highly stratified count data for which the statistical model has a separate mean parameter for each stratum. If the number of samples per stratum is small then the model is highly parameterized and the maximum likelihood estimator (MLE) of the NB dispersion parameter can be biased and inefficient. Some of the estimators we investigate include adjustments for the number of mean parameters to reduce bias. We extend other estimators that were developed for the iid case, to reduce bias when there are many mean parameters. We demonstrate using simulations that an adjusted double extended quasi-likelihood estimator we proposed gives much improved estimates compared to the MLE. Adjusted extended quasi-likelihood and adjusted maximum likelihood estimators also give much-improved results. We illustrate the various estimators with stratified random bottom trawl survey data for cod (Gadus morhua) off the south coast of Newfoundland, Canada.