Exact Non-parametric Confidence Intervals for Quantiles with Progressive Type-II Censoring

It is shown how various exact non-parametric inferences based on order statistics in one or two random samples can be generalized to situations with progressive type-II censoring, which is a kind of evolutionary right censoring. Ordinary type-II right censoring is a special case of such progressive censoring. These inferences include confidence intervals for a given parent quantile, prediction intervals for a given order statistic of a future sample, and related two-sample inferences based on exceedance probabilities. The proposed inferences are valid for any parent distribution with continuous distribution function. The key result is that each observable uncensored order statistic that becomes available with progressive type-II censoring can be represented as a mixture with known weights of underlying ordinary order statistics. The importance of this mixture representation lies in that various properties of such observable order statistics can be deduced immediately from well-known properties of ordinary order statistics.     

Gap-ratio goodness of fit tests for weibull or extreme value distribution assumptions with left or right censored data

With data collection in environmental science and bioassay, left censoring because of nondetects is a problem. Similarly in reliability and life data analysis right censoring frequently occurs. There is a need for goodness of fit tests that can adapt to left or right censored data and be used to check important distributional assumptions without becoming too difficult to regularly implement in practice. A new test statistic is derived from a plot of the standardized spacings between the order statistics versus their ranks. Any linear or curvilinear pattern is evidence against the null distribution. When testing the Weibull or extreme value null hypothesis this statistic has a null distribution that is approximately F for most combinations of sample size and censoring of practical interest. Our statistic is compared to the Mann-Scheuer-Fertig statistic which also uses the standardized spacings between the order statistics. The results of a simulation study show the two tests are competitive in terms of power. Although the Mann-Scheuer-Fertig statistic is somewhat easier to compute, our test enjoys advantages in the accuracy of the F approximation and the availability of a graphical diagnostic.     

Table of percentage points of ratios of linear combinations of order statistics of samples from exponential distributions

A form of the distribution function of ratios of linear combinations of order statistics of samples from an exponential distribution is given. From the distribution, tables of percentage points of the statistic for α = .05, .95, and n = 3(1)50, and for censoring up to five observations are presented. Use of the tables is made to find critical values of the most powerful scale and location invariant test of exponentiality against uniformity, and also to find critical values for a test of outliers in an exponential population.     

A pseudo-complete sample technique for estimation from censored samples

An iterative procedure is presented whereby singly right censored samples are transformed into pseudo-complete samples. This involves the use of order statistics to calculate expected “complete” values of the censored observations. Estimates of the distribution parameters are then calculated by employing standard complete sample estimators. This procedure is applicable to various types of distributions.     

Subgroup Analysis with Time‐to‐Event Data Under a Logistic‐Cox Mixture Model

Subgroup detection has received increasing attention recently in different fields such as clinical trials, public management and market segmentation analysis. In these fields, people often face time‐to‐event data, which are commonly subject to right censoring. This paper proposes a semiparametric Logistic‐Cox mixture model for subgroup analysis when the interested outcome is event time with right censoring. The proposed method mainly consists of a likelihood ratio‐based testing procedure for testing the existence of subgroups. The expectation–maximization iteration is applied to improve the testing power, and a model‐based bootstrap approach is developed to implement the testing procedure. When there exist subgroups, one can also use the proposed model to estimate the subgroup effect and construct predictive scores for the subgroup membership. The large sample properties of the proposed method are studied. The finite sample performance of the proposed method is assessed by simulation studies. A real data example is also provided for illustration.     

Exact Tests for 2 × 2 Contingency Tables

Fisher's exact test, difference in proportions, log odds ratio, Pearson's chi-squared, and likelihood ratio are compared as test statistics for testing independence of two dichotomous factors when the associated p values are computed by using the conditional distribution given the marginals. The statistics listed above that can be used for a one-sided alternative give identical p values. For a two-sided alternative, many of the above statistics lead to different p values. The p values are shown to differ only by which tables in the opposite tail from the observed table are considered more extreme than the observed table.     

Testing for the partial Koziol–Green model with covariates

In this paper we consider some non-parametric goodness-of-fit statistics for testing the partial Koziol–Green regression model. In this model, the response at a given covariate value is subject to random right censoring by two independent censoring times. One of these censoring times is informative in the sense that its survival function is some power of the survival function of the response. The goodness-of-fit statistics are based on an underlying empirical process for which large sample theory is obtained.     

A simulation study on power comparisons for group sequential tests of non-parametric statistics

In this article, a group sequential test (GST) of non-parametric statistics for survival data is briefly reviewed. An asymptotic joint distribution of the test statistics, obtained after each interim analysis, is given to illustrate the applicability of the critical values of the GST procedures. It should be noted that censored observations are generally seen in survival data. Therefore, if one makes power calculations irrespective of censoring, reliable results may not be achieved, due to the lack of information about the censoring structure. A wide simulation study, covering different censoring rates and tied observations, is conducted to make the power comparisons under various scenarios. The simulation results are interpreted and compared with the results obtained by using power analysis and sample size (PASS) software.     

A test for equality of variances with censored samples

A variance homogeneity test for type II right-censored samples is proposed. The test is based on Bartlett's statistic. The asymptotic distribution of the statistic is investigated. The limiting distribution is that of a linear combination of i.i.d. chi-square variables with 1 degree of freedom. By using simulation, the critical values of the null distribution of the modified Bartlett's statistic for testing the homogeneity of variances of two normal populations are obtained when the sample sizes and censoring levels are not equal. Also, we investigate the properties of the proposed test (size, power and robustness). Results show that the distribution of the test statistic depends on the censoring level. An example of the use of the new methodology in animal science involving reproduction in ewes is provided.     

Distributions with maximum entropy subject to constraints on their L-moments or expected order statistics

We find the distribution that has maximum entropy conditional on having specified values of its first r  L$L$-moments. This condition is equivalent to specifying the expected values of the order statistics of a sample of size r. The maximum-entropy distribution has a density-quantile function, the reciprocal of the derivative of the quantile function, that is a polynomial of degree r; the quantile function of the distribution can then be found by integration. This class of maximum-entropy distributions includes the uniform, exponential and logistic, and two new generalizations of the logistic distribution. It provides a new method of nonparametric fitting of a distribution to a data sample. We also derive maximum-entropy distributions subject to constraints on expected values of linear combinations of order statistics.     

High precision implementation of Steck's recursion method for use in goodness-of-fit tests

Classical continuous goodness-of-fit (GOF) testing is employed for examining whether the data come from an assumed parametric model. In many cases, GOF tests assume a uniform null distribution and examine extreme values of the order statistics of the samples. Many of these statistics can be expressed by a function of the order statistics and the p-values amount to a joint probability statement based on the uniform order statistics. In this paper, we utilize Steck''s recursion method and propose two high precision computing algorithms to compute the p-values for these GOF statistics. The numerical difficulties in implementing Steck''s method are discussed and compared with solutions provided in high precision libraries.     

Exact nonparametric confidence,prediction and tolerance intervals based on multi-sample Type-II right censored data

Exact nonparametric inference based on ordinary Type-II right censored samples has been extended here to the situation when there are multiple samples with Type-II censoring from a common continuous distribution. It is shown that marginally, the order statistics from the pooled sample are mixtures of the usual order statistics with multivariate hypergeometric weights. Relevant formulas are then derived for the construction of nonparametric confidence intervals for population quantiles, prediction intervals, and tolerance intervals in terms of these pooled order statistics. It is also shown that this pooled-sample approach assists in achieving higher confidence levels when estimating large quantiles as compared to a single Type-II censored sample with same number of observations from a sample of comparable size. We also present some examples to illustrate all the methods of inference developed here.     

Demystifying the Integrated Tail Probability Expectation Formula

ABSTRACT

Calculating the expected values of different types of random variables is a central topic in mathematical statistics. Targeted toward students and instructors in both introductory probability and statistics courses and graduate-level measure-theoretic probability courses, this pedagogical note casts light on a general expectation formula stated in terms of distribution and survival functions of random variables and discusses its educational merits. Often consigned to an end-of-chapter exercise in mathematical statistics textbooks with minimal discussion and presented under superfluous technical assumptions, this unconventional expectation formula provides an invaluable opportunity for students to appreciate the geometric meaning of expectations, which is overlooked in most undergraduate and graduate curricula, and serves as an efficient tool for the calculation of expected values that could be much more laborious by traditional means. For students’ benefit, this formula deserves a thorough in-class treatment in conjunction with the teaching of expectations. Besides clarifying some commonly held misconceptions and showing the pedagogical value of the expectation formula, this note offers guidance for instructors on teaching the formula taking the background of the target student group into account.     

Two-sample inference procedures under nonproportional hazards

We introduce a new two-sample inference procedure to assess the relative performance of two groups over time. Our model-free method does not assume proportional hazards, making it suitable for scenarios where nonproportional hazards may exist. Our procedure includes a diagnostic tau plot to identify changes in hazard timing and a formal inference procedure. The tau-based measures we develop are clinically meaningful and provide interpretable estimands to summarize the treatment effect over time. Our proposed statistic is a U-statistic and exhibits a martingale structure, allowing us to construct confidence intervals and perform hypothesis testing. Our approach is robust with respect to the censoring distribution. We also demonstrate how our method can be applied for sensitivity analysis in scenarios with missing tail information due to insufficient follow-up. Without censoring, Kendall's tau estimator we propose reduces to the Wilcoxon-Mann–Whitney statistic. We evaluate our method using simulations to compare its performance with the restricted mean survival time and log-rank statistics. We also apply our approach to data from several published oncology clinical trials where nonproportional hazards may exist.     

INFERENCE FOR CENSORED MATCHED PAIRS USING SIGNED RANKS

Using the marginal likelihood based on the signed ranks derived from matched pairs data, inferences are made for regression parameters. Both members of a given pair are subject to the same censoring time, while different pairs are subject to different censoring times. Censoring is independent of the response and on the right. Easily calculated logistic density scores are used to provide an approximate analysis so that inferences can be made about a regression parameter in the presence of a difference within the matched pairs. Inference for the survival times of matched skin grafts is considered.     

Kolmogorov–Smirnov test for life test data with hybrid censoring

This work considers goodness-of-fit for the life test data with hybrid censoring. An alternative representation of the Kolmogorov–Smirnov (KS) statistics is provided under Type-I censoring. The alternative representation leads us to approximate the limiting distributions of the KS statistic as a functional of the Brownian bridge for Type-II, Type-I hybrid, and Type-II hybrid censored data. The approximated distributions are used to obtain the critical values of the tests in this context. We found that the proposed KS test procedure for Type-II censoring has more power than the available one(s) in literature.     

A new test for two-sample location problem based on empirical distribution function

We propose a new test for testing the equality of location parameter of two populations based on empirical distribution function (ECDF). The test statistics is obtained as a power divergence between two ECDFs. The test is shown to be distribution free, and its null distribution is obtained. We conducted empirical power comparison of the proposed test with several other available tests in the literature. We found that the proposed test performs better than its competitors considered here under several population structures. We also used two real datasets to illustrate the procedure.     

Bayesian Estimation of Bivariate Exponential Distributions Based on Linex and Quadratic Loss Functions: A Survival Approach with Censored Samples

In this article, four bivariate exponential (BVE) distributions with subject to right censoring samples are presented. Bayesian estimates of the parameters of BVE are obtained through Linex and quadratic loss functions. Gamma prior distribution has been suggested to reforming the posterior function. The estimations and standard errors of parameters have also been obtained through simulation method. Markov chain Monte Carlo (MCMC) method is employed for the case of Block-Buse bivariate distribution because there was no closed form for estimator criteria. Simulation studies have been conducted to show that the computation parts can be implemented easily and comparing the estimated values due to two methods and with the true values as well.     

Recurrence relations for single and product moments of progressively Type-II censored order statistics from generalized logistic distribution with applications to inference

In this article, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a generalized logistic distribution. The use of these relations in a systematic manner allow us to compute all the means, variances, and covariances of progressively Type-II right censored order statistics from the generalized logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R₁, …, R_m). These moments are then utilized to derive best linear unbiased estimators of the scale and location-scale parameters of the generalized logistic distribution. A comparison of these estimators with the maximum likelihood estimates is then made through Monte Carlo simulations. Finally, the best linear unbiased predictors of censored failure times is discussed briefly.     

Test for independence between time to failure and cause of failure in competing risks with k causes

In this paper, we develop a simple nonparametric test for testing the independence of time to failure and cause of failure in competing risks set up. We generalise the test to the situation where failure data is right censored. We obtain the asymptotic distribution of the test statistics for complete and censored data. The efficiency loss due to censoring is studied using Pitman efficiency. The performance of the proposed test is evaluated through simulations. Finally we illustrate our test procedure using three real data sets.