A matrix variance inequality

In the course of solving a variational problem Chernoff (Ann. Probab. 9 (1981) 533) obtained what appears to be a specialized inequality for a variance, namely, that for a standard normal variable X, Var[g(X)]E[g^′(X)]². However, both the simplicity and usefulness of the inequality has generated a plethora of extensions, as well as alternative proofs. All previous papers have focused on a single function. We provide here an inequality for the covariance matrix of k functions, which leads to a matrix inequality in the sense of Loewner.     

Estimation of binomial parameters when both , are unknown

We revisit the classic problem of estimation of the binomial parameters when both parameters n,p are unknown. We start with a series of results that illustrate the fundamental difficulties in the problem. Specifically, we establish lack of unbiased estimates for essentially any functions of just n or just p. We also quantify just how badly biased the sample maximum is as an estimator of n. Then, we motivate and present two new estimators of n. One is a new moment estimate and the other is a bias correction of the sample maximum. Both are easy to motivate, compute, and jackknife. The second estimate frequently beats most common estimates of n in the simulations, including the Carroll–Lombard estimate. This estimate is very promising. We end with a family of estimates for p; a specific one from the family is compared to the presently common estimate and the improvements in mean-squared error are often very significant. In all cases, the asymptotics are derived in one domain. Some other possible estimates such as a truncated MLE and empirical Bayes methods are briefly discussed.     

Law of iterated logarithm and almost sure limit points for random sums

Let {X_n,n≥1} be a sequence of independent identically distributed (i.i.d) random variables with a common distribution function F. When F belongs to the domain of partial attraction of a Semi-Stable law with index ,0<<2, we give complete solution to the results of R. Vasudeva and G. Divanji [Law of iterated logarithm for random subsequences, Statist. Probab. Lett. 12 (1991) 189–194], where they obtained Chover’s form of the law of iterated logarithm for random subsequences. Further, we extended the situation in obtaining almost sure limit points for random subsequences.     

Evaluation of asymptotic approximations for a two-stage Bernoulli bandit

We consider a two-stage procedure for allocating two treatments to yield a total of N dichoto-mous responses, where one of the treatments has a known probability of success. In the first stage, observations may be made on either of the treatments and observed successes are discounted by a factor β. One of the treatments must be chosen for the second stage, where observed successes are no longer discounted. We adopt a Bayesian approach and develop a continuous time approximation for this problem that turns out to be identical to one developed in Petkau (J. Amer. Statist. Assoc. 73 (1978) 328). Examination of both stopping boundaries and Bayes risks demonstrates that suboptimal strategies provided by the solution of the continuous time problem are excellent approximations to the optimal strategies for the discrete time problem. A “continuity correction” developed by Cheroff and Petkau (Ann. Probab. 4 (1976) 875) plays an important role in enhancing the naive approximation provided by the solution of the continuous time problem.     

Optimal Progressive Type-II Censoring Schemes for Nonparametric Confidence Intervals of Quantiles

In this article, optimal progressive censoring schemes are examined for the nonparametric confidence intervals of population quantiles. The results obtained can be universally applied to any continuous probability distribution. By using the interval mass as an optimality criterion, the optimization process is free of the actual observed values from the sample and needs only the initial sample size n and the number of complete failures m. Using several sample sizes combined with various degrees of censoring, the results of the optimization are presented here for the population median at selected levels of confidence (99, 95, and 90%). With the optimality criterion under consideration, the efficiencies of the worst progressive Type-II censoring scheme and ordinary Type-II censoring scheme are also examined in comparison to the best censoring scheme obtained for fixed n and m.     

Local information and the design of sequential hypothesis tests

Various results on sequential hypotheses testing are reviewed. Optimal stopping rules are related to a local measure of statistical information. In some cases, local information can be approximated by L-numbers discovered by Lorden, and simple rules based on these approximations are asymptotically optimal to better order than the cost for a single observation.     

A unified and elementary proof of serial and nonserial, univariate and multivariate, Chernoff–Savage results

We provide a simple proof that the Chernoff–Savage [H. Chernoff, I.R. Savage, Asymptotic normality and efficiency of certain nonparametric tests, Ann. Math. Statist. 29 (1958) 972–994] result, establishing the uniform dominance of normal-score rank procedures over their Gaussian competitors, also holds in a broad class of problems involving serial and/or multivariate observations. The non-admissibility of the corresponding everyday practice Gaussian procedures (multivariate least-squares estimators, multivariate t-tests and F-tests, correlogram-based methods, multivariate portmanteau and Durbin–Watson tests, etc.) follows. The proof, which generalizes to the multivariate—possibly serial—set-up the idea developed in J.L. Gastwirth, S.S. Wolff [An elementary method for obtaining lower bounds on the asymptotic power of rank tests, Ann. Math. Statist. 39 (1968) 2128–2130] in the context of univariate location problems, allows for avoiding technical convexity and variational arguments.     

On progressive hybrid censored exponential distribution

In this paper, we introduce a new adaptive Type-I progressive hybrid censoring scheme, which has some advantages over the progressive hybrid censoring schemes already discussed in the literature. Based on an adaptive Type-I progressively hybrid censored sample, we derive the exact distribution of the maximum-likelihood estimator (MLE) of the mean lifetime of an exponential distribution as well as confidence intervals for the failure rate using exact distribution, asymptotic distribution, and three parametric bootstrap resampling methods. Furthermore, we provide computational formula for the expected number of failures and investigate the performance of the point and interval estimation for the failure rate in this case. An alternative simple form for the distribution of the MLE under adaptive Type-II progressive hybrid censoring scheme proposed by Ng et al. [Statistical analysis of exponential lifetimes under an adaptive Type-II progressive censoring scheme, Naval Res. Logist. 56 (2009), pp. 687–698] is obtained. Finally, from the exact distribution of the MLE, we establish the explicit expression for the Bayes risk of a sampling plan under adaptive Type-II progressive hybrid censoring scheme when a general loss function is used, and present some optimal Bayes solutions under four different progressive hybrid censoring schemes to illustrate the effectiveness of the proposed method.     

EM algorithms for beta kernel distributions

The EM algorithm is employed to compute maximum-likelihood estimates for beta kernel distributions. Estimation is considered under two censoring schemes: the progressive Type-I censoring and progressive Type-II right censoring schemes. As an application, the EM algorithm is executed to obtain maximum-likelihood estimates for the beta Weibull distribution under the two censoring schemes. A simulation study and two real data sets are used to show the efficiency of the EM algorithm.     

Bayesian Analysis of Different Hybrid and Progressive Life Tests

Type-I and Type-II censoring schemes are the widely used censoring schemes available for life testing experiments. A mixture of Type-I and Type-II censoring schemes is known as a hybrid censoring scheme. Different hybrid censoring schemes have been introduced in recent years. In the last few years, a progressive censoring scheme has also received considerable attention. In this article, we mainly consider the Bayesian inference of the unknown parameters of two-parameter exponential distribution under different hybrid and progressive censoring schemes. It is observed that in general the Bayes estimate and the associated credible interval of any function of the unknown parameters, cannot be obtained in explicit form. We propose to use the Monte Carlo sampling procedure to compute the Bayes estimate and also to construct the associated credible interval. Monte Carlo Simulation experiments have been performed to see the effectiveness of the proposed method in case of Type-I hybrid censored samples. The performances are quite satisfactory. One data analysis has been performed for illustrative purposes.     

Statistical Analysis of the Log-Normal Distribution under Type-II Progressive Hybrid Censoring Schemes

In this article, we obtain the maximum likelihood estimators (MLEs) and approximate maximum likelihood estimators (AMLEs) of the parameters, from a two-parameter log-normal distribution based on the adaptive Type-II progressive hybrid censoring scheme, which was introduced by Ng et al. (2009 Ng , H. K. T. , Kundu , D. , Chan , P. S. ( 2009 ). Statistical analysis of exponential lifetimes under an adaptive Type-II progressively censoring scheme . Naval Research Logistics 56 : 687 – 698 .[Crossref], [Web of Science ®] , [Google Scholar]) for life testing or reliability experiment. In order to compare the results, we calculate corresponding estimators of the Type-II progressive hybrid censoring scheme. In particular, we provide computational formulas of the expected total test time and the expected number of failures for each scheme. We also compute the observed Fisher information matrix and use them to obtain the asymptotic confidence intervals. A simulation study carries out to evaluate the bias and mean square error of the MLEs and AMLEs from the two above-mentioned schemes. Finally, we present a numerical example to illustrate the methods of inference discussed here.     

Pitman closeness as a criterion for the determination of the optimal progressive censoring scheme

Selecting the optimal progressive censoring scheme for the exponential distribution according to Pitman closeness criterion is discussed. For small sample sizes the Pitman closeness probabilities are calculated explicitly, and it is shown that the optimal progressive censoring scheme is the usual Type-II right censoring case. It is conjectured that this to be the case for all sample sizes. A general algorithm is also presented for the numerical computation of the Pitman closeness probabilities between any two progressive censoring schemes of the same size.     

Pitman closeness as a criterion for the determination of the optimal progressive censoring scheme

Selecting the optimal progressive censoring scheme for the exponential distribution according to Pitman closeness criterion is discussed. For small sample sizes the Pitman closeness probabilities are calculated explicitly, and it is shown that the optimal progressive censoring scheme is the usual Type-II right censoring case. It is conjectured that this to be the case for all sample sizes. A general algorithm is also presented for the numerical computation of the Pitman closeness probabilities between any two progressive censoring schemes of the same size.     

Asymptotically optimal progressive censoring plans based on Fisher information

Considering the Fisher information about a single parameter contained in a progressively Type-II censored sample, the problem of optimal progressive censoring plans arises. By introducing the notion of asymptotically optimal designs, we show that right censoring is ‘almost’ optimal for many important distributions including scale families of extreme value, normal, logistic, and Laplace distributions. Moreover, it turns out that for the extreme value distribution right censoring is the only asymptotically optimal one-step censoring scheme.     

Optimal experimental plan for multi-level stress testing with Weibull regression under progressive Type-II extremal censoring

In the design of constant-stress life-testing experiments, the optimal allocation in a multi-level stress test with Type-I or Type-II censoring based on the Weibull regression model has been studied in the literature. Conventional Type-I and Type-II censoring schemes restrict our ability to observe extreme failures in the experiment and these extreme failures are important in the estimation of upper quantiles and understanding of the tail behaviors of the lifetime distribution. For this reason, we propose the use of progressive extremal censoring at each stress level, whereas the conventional Type-II censoring is a special case. The proposed experimental scheme allows some extreme failures to be observed. The maximum likelihood estimators of the model parameters, the Fisher information, and asymptotic variance–covariance matrices of the maximum likelihood estimates are derived. We consider the optimal experimental planning problem by looking at four different optimality criteria. To avoid the computational burden in searching for the optimal allocation, a simple search procedure is suggested. Optimal allocation of units for two- and four-stress-level situations is determined numerically. The asymptotic Fisher information matrix and the asymptotic optimal allocation problem are also studied and the results are compared with optimal allocations with specified sample sizes. Finally, conclusions and some practical recommendations are provided.     

Inference and optimal censoring schemes for progressively censored Birnbaum–Saunders distribution

The aim of this paper is twofold. First we discuss the maximum likelihood estimators of the unknown parameters of a two-parameter Birnbaum–Saunders distribution when the data are progressively Type-II censored. The maximum likelihood estimators are obtained using the EM algorithm by exploiting the property that the Birnbaum–Saunders distribution can be expressed as an equal mixture of an inverse Gaussian distribution and its reciprocal. From the proposed EM algorithm, the observed information matrix can be obtained quite easily, which can be used to construct the asymptotic confidence intervals. We perform the analysis of two real and one simulated data sets for illustrative purposes, and the performances are quite satisfactory. We further propose the use of different criteria to compare two different sampling schemes, and then find the optimal sampling scheme for a given criterion. It is observed that finding the optimal censoring scheme is a discrete optimization problem, and it is quite a computer intensive process. We examine one sub-optimal censoring scheme by restricting the choice of censoring schemes to one-step censoring schemes as suggested by Balakrishnan (2007), which can be obtained quite easily. We compare the performances of the sub-optimal censoring schemes with the optimal ones, and observe that the loss of information is quite insignificant.     

Parameter Estimation of Type-II Hybrid Censored Weighted Exponential Distribution

A hybrid censoring scheme is a mixture of Type-I and Type-II censoring schemes. We study the estimation of parameters of weighted exponential distribution based on Type-II hybrid censored data. By applying the EM algorithm, maximum likelihood estimators are evaluated. Using Fisher information matrix, asymptotic confidence intervals are provided. By applying Markov chain Monte Carlo techniques, Bayes estimators, and corresponding highest posterior density confidence intervals of parameters are obtained. Monte Carlo simulations are performed to compare the performances of the different methods, and one dataset is analyzed for illustrative purposes.     

Fisher information in progressive hybrid censoring schemes

The hybrid censoring scheme, which is a mixture of Type-I and Type-II censoring schemes, has been extended to the case of progressive censoring schemes by Kundu and Joarder [Analysis of Type-II progressively hybrid censored data, Comput. Stat. Data Anal. 50 (2006), pp. 2509–2528] and Childs et al. [Exact likelihood inference for an exponential parameter under progressive hybrid censoring schemes, in Statistical Models and Methods for Biomedical and Technical Systems, F. Vonta, M. Nikulin, N. Limnios, and C. Huber-Carol, eds., Birkhäuser, Boston, MA, 2007, pp. 323–334]. In this paper, we derive a simple expression for the Fisher information contained in Type-I and Type-II progressively hybrid censored data. An illustrative example is provided applicable to a scaled-exponential distribution to demonstrate our methodologies.     

Estimation for the Parameters of the Pareto Distribution Under Progressive Censoring

In this article, progressive Type-II right censored sample from Pareto distribution is considered. Exact confidence region is derived for the parameters of the corresponding distribution under progressive censoring. Simulation study is performed to investigate the coverage probabilities of the proposed confidence region. Illustrative example is also given.