Win-probabilities for comparing two binary outcomes

This article considers the problem of choosing between two treatments that have binary outcomes with unknown success probabilities p₁ and p₂. The choice is based upon the information provided by two observations X₁ ～ B(n₁, p₁) and X₂ ～ B(n₂, p₂) from independent binomial distributions. Standard approaches to this problem utilize basic statistical inference methodologies such as hypothesis tests and confidence intervals for the difference p₁ ? p₂ of the success probabilities. However, in this article the analysis of win-probabilities is considered. If X*₁ represents a potential future observation from Treatment 1 while X*₂ represents a potential future observation from Treatment 2, win-probabilities are defined in terms of the comparisons of X*₁ and X*₂. These win-probabilities provide a direct assessment of the relative advantages and disadvantages of choosing either treatment for one future application, and their interpretation can be combined with other factors such as costs, side-effects, and the availabilities of the two treatments. In this article, it is shown how confidence intervals for the win-probabilities can be constructed, and examples of their use are provided. Computer code for the implementation of this new methodology is available from the authors.     

Win-probabilities for comparing two Poisson variables

ABSTRACT

This article considers the problem of choosing between two possible treatments which are each modeled with a Poisson distribution. Win-probabilities are defined as the probabilities that a single potential future observation from one of the treatments will be better than, or at least as good as, a potential future observation from the other treatment. Using historical data from the two treatments, it is shown how estimates and confidence intervals can be constructed for the win-probabilities. Extensions to situations with three or more treatments are also discussed. Some examples and illustrations are provided, and the relationship between this methodology and standard inference procedures on the Poisson parameters is discussed.     

Win-probabilities for regression models

This paper considers inferences concerning future observations for regression models. Specifically, the differences between future observations at two designated sets of input values are considered. Win-probabilities, which are the probabilities that one of the future observations will exceed the other, constitute a special case of this analysis. These win-probabilities, together with the more general inferences on the difference between the future observations, provide a useful and easily interpretable tool with which a practitioner can assess the information provided by the regression model, and can make decisions regarding which of the two designated sets of input values would be optimal. A multiple-linear-regression model is considered in detail, although the results can be applied to any regression model with normally distributed errors. Central and non-central $t$-distributions are used for the analysis, and several examples of the methodologies are presented.     

Simultaneous Inferences on the Cumulative Distribution Function of a Normal Distribution

This paper addresses the problem of constructing simultaneous confidence intervals for the cumulative distribution function of a normal distribution at several specified points. The procedure is based upon the observation of a random sample of independent observations from a normal distribution with an unknown mean and variance. A new methodology is proposed for obtaining confidence intervals with a specified overall simultaneous confidence level through the inversion of acceptance sets. Both one-sided and two-sided confidence intervals are considered. Some illustrations of the new method are provided, and comparisons are made with other approaches to the problem.     

Estimating the precision of a bivariate population

Quick efficient estimates are proposed for estimating the standard deviation of a circular bivariate population. Two procedures based on extreme observations are considered. The first of these employs the 100 p percent largest observations, while the second utilizes the extreme observations in k radial sectors.     

Non-parametric predictive inference for future order statistics

This article presents non-parametric predictive inference for future order statistics. Given the data consisting of n real-valued observations, m future observations are considered and predictive probabilities are presented for the rth-ordered future observation. In addition, joint and conditional probabilities for events involving multiple future order statistics are presented. The article further presents the use of such predictive probabilities for order statistics in statistical inference, in particular considering pairwise and multiple comparisons based on two or more independent groups of data.     

Prediction intervals for the future record values from exponential distribution: comparative study

!n this paper we consider the predicf an problem of the future nth record value based an the first m (m < n) observed record values from one-parameter exponential distribution. We introduce four procedures for obtaining prediction intervals for the nth record value. The performance of the so obtained intervals is assessed through numerical and simulation studies. In these studies, we provide the means and standard errors of lower limits. upper limits and lengths of prediction intervals. Further, we check the validation of these intervals based on some point predictors.     

Prediction Intervals for an Ordered Observation from Weibull Distribution Based on Censored Samples

In this article, we provide some suitable pivotal quantities for constructing prediction intervals for the jth future ordered observation from the two-parameter Weibull distribution based on censored samples. Our method is more general in the sense that it can be applied to any data scheme. We present a simulation of our method to analyze its performance. Two illustrative examples are also included. For further study, our method is easily applied to other location and scale family distributions.     

Confidence Intervals for Quantiles of a Two-parameter Exponential Distribution under Progressive Type-II Censoring

Confidence intervals for the pth-quantile Q of a two-parameter exponential distribution provide useful information on the plausible range of Q, and only inefficient equal-tail confidence intervals have been discussed in the statistical literature so far. In this article, the construction of the shortest possible confidence interval within a family of two-sided confidence intervals is addressed. This shortest confidence interval is always shorter, and can be substantially shorter, than the corresponding equal-tail confidence interval. Furthermore, the computational intensity of both methodologies is similar, and therefore it is advantageous to use the shortest confidence interval. It is shown how the results provided in this paper can apply to data obtained from progressive Type II censoring, with standard Type II censoring as a special case. The applications of more complex confidence interval constructions through acceptance set inversions that can employ prior information are also discussed.     

Using hidden Markov models with raw,triaxial wrist accelerometry data to determine sleep stages

Accelerometry is a low‐cost and noninvasive method that has been used to discriminate sleep from wake, however, its utility to detect sleep stages is unclear. We detail the development and comparison of methods which utilise raw, triaxial accelerometry data to classify varying stages of sleep, ranging from sleep/wake detection to discriminating rapid eye movement sleep, stage one sleep, stage two sleep, deep sleep and wake. First‐ and second‐order hidden Markov models (HMMs) with time‐homogeneous and time‐varying transition probability matrices, along with continuous acceleration observations in the form of a Gaussian‐observation HMM and K‐means classified acceleration in a discrete‐observation HMM were explored. In addition, generalised linear mixed models (GLMMs) with binary and multinomial responses and logit link functions were considered as was whether incorporating adjoining acceleration information into the models improved prediction. Model predictions were compared to the reference‐standard in sleep detection (polysomnography) and outcome accuracies were calculated. Consistently, HMMs yielded greater sleep stage detection than GLMMs but there was little difference between first‐ and second‐order HMMs. Varying degrees of difference were observed when comparing Gaussian‐observation HMMs to discrete‐observation HMMs, and time‐varying HMMs yielded greater discrimination than time‐homogeneous HMMs, as did models which considered adjoining acceleration information. These results suggest that wrist‐worn accelerometry data may be able to detect sleep stages but that further investigation is required to optimise classification accuracy.     

Comparing several exponential populations with more than one control

Suppose there are k ₁ (k ₁ ≥ 1) test treatments that we wish to compare with k ₂ (k ₂ ≥ 1) control treatments. Assume that the observations from the ith test treatment and the jth control treatment follow a two-parameter exponential distribution and , where θ is a common scale parameter and and are the location parameters of the ith test and the jth control treatment, respectively, i = 1, . . . ,k ₁; j = 1, . . . ,k ₂. In this paper, simultaneous one-sided and two-sided confidence intervals are proposed for all k ₁ k ₂ differences between the test treatment location and control treatment location parameters, namely , and the required critical points are provided. Discussions of multiple comparisons of all test treatments with the best control treatment and an optimal sample size allocation are given. Finally, it is shown that the critical points obtained can be used to construct simultaneous confidence intervals for Pareto distribution location parameters.     

Confidence intervals for the difference in paired Youden indices

Comparison of accuracy between two diagnostic tests can be implemented by investigating the difference in paired Youden indices. However, few literature articles have discussed the inferences for the difference in paired Youden indices. In this paper, we propose an exact confidence interval for the difference in paired Youden indices based on the generalized pivotal quantities. For comparison, the maximum likelihood estimate‐based interval and a bootstrap‐based interval are also included in the study for the difference in paired Youden indices. Abundant simulation studies are conducted to compare the relative performance of these intervals by evaluating the coverage probability and average interval length. Our simulation results demonstrate that the exact confidence interval outperforms the other two intervals even with small sample size when the underlying distributions are normal. A real application is also used to illustrate the proposed intervals. Copyright © 2012 John Wiley & Sons, Ltd.     

Exact average coverage probabilities and confidence coefficients of confidence intervals for discrete distributions

For a confidence interval (L(X),U(X)) of a parameter θ in one-parameter discrete distributions, the coverage probability is a variable function of θ. The confidence coefficient is the infimum of the coverage probabilities, inf  _θ P _θ (θ∈(L(X),U(X))). Since we do not know which point in the parameter space the infimum coverage probability occurs at, the exact confidence coefficients are unknown. Beside confidence coefficients, evaluation of a confidence intervals can be based on the average coverage probability. Usually, the exact average probability is also unknown and it was approximated by taking the mean of the coverage probabilities at some randomly chosen points in the parameter space. In this article, methodologies for computing the exact average coverage probabilities as well as the exact confidence coefficients of confidence intervals for one-parameter discrete distributions are proposed. With these methodologies, both exact values can be derived.     

The simultaneous confidence intervals for all distances from the extreme populations for two-parameter exponential populations based on the multiply type II censored samples

Among k independent two-parameter exponential distributions which have the common scale parameter, the lower extreme population (LEP) is the one with the smallest location parameter and the upper extreme population (UEP) is the one with the largest location parameter. Given a multiply type II censored sample from each of these k independent two-parameter exponential distributions, 14 estimators for the unknown location parameters and the common unknown scale parameter are considered. Fourteen simultaneous confidence intervals (SCIs) for all distances from the extreme populations (UEP and LEP) and from the UEP from these k independent exponential distributions under the multiply type II censoring are proposed. The critical values are obtained by the Monte Carlo method. The optimal SCIs among 14 methods are identified based on the criteria of minimum confidence length for various censoring schemes. The subset selection procedures of extreme populations are also proposed and two numerical examples are given for illustration.     

Optimal two treatment repeated measurement designs for three periods

Repeated Measurement Designs, with two treatments, n (experimental) units and p periods are examined, the two treatments are denoted A and B. The model with independent observations within and between treatment sequences is used. Optimal designs are derived for: (i) the difference of direct treatment effects and the difference of residual effects, (ii) the difference of direct treatment effects, and (iii) the difference of residual effects. We prove that for three periods when n is odd the optimal design in the three cases (i), (ii), and (iii) is determined by taking the sequences BAA and ABB in numbers differing by one. If n is even, the optimal design in cases (i), (ii), and (iii) is again the same, by taking the sequences ABB and BAA in equal numbers. In case (i), for n even or odd, in the optimal design there is no correlation between the two estimated parameters. For n even, case (i) was solved by Cheng and Wu in 1980. The above imply that with two treatments in practice are preferable to use three periods instead of two.     

Confidence intervals for two sample binomial distribution

This paper considers confidence intervals for the difference of two binomial proportions. Some currently used approaches are discussed. A new approach is proposed. Under several generally used criteria, these approaches are thoroughly compared. The widely used Wald confidence interval (CI) is far from satisfactory, while the Newcombe's CI, new recentered CI and score CI have very good performance. Recommendations for which approach is applicable under different situations are given.     

Charting small sample characteristics of asymptotic confidence intervals for the binomial parameterp

Small sample properties of seven confidence intervals for the binomial parameterp (based on various normal approximations) and of the Clopper-Pearson interval are compared. Coverage probabilities and expected lower and upper limits of the intervals are graphically displayed as functions of the binomial parameterp for various sample sizes.     

Comparing the Fisher information in record data and random observations

We compare the Fisher information (FI) contained in the firstn record values and record times with the FI inn i. i. d. observations. General results are established for exponential family and Weibull type setups, and a summary table is provided listing several common distributions. We show that the FI in record data improves notably once the record times are included, often changing from being less to being equal or greater than the FI in a random sample of the same size. The behavior in the Weibull case is surprising. There it depends onn, whether the record or the i.i. d. observations have more FI. We propose new estimators based on record data. The results may be of interest in some life testing situations. Supported in part by Fondo Nacional de Desarrollo Cientifico y Tecnologico (FONDECYT) grant # 1010222 of Chile.     

CONSTRUCTING MORE POWERFUL EXACT TESTS OF EQUIVALENCE FROM BINARY MATCHED PAIRS

In randomized clinical trials, it is often necessary to demonstrate that a new medical treatment does not substantially differ from a standard reference treatment. Formal testing of such ‘equivalence hypotheses’ is typically done by combining two one‐sided tests (TOST). A quite different strand of research has demonstrated that replacing nuisance parameters with a null estimate produces P‐values that are close to exact ( Lloyd 2008a ) and that maximizing over the residual dependence on the nuisance parameter produces P‐values that are exact and optimal within a class ( Röhmel & Mansmann 1999 ; Lloyd 2008a ). The three procedures – TOST, estimation and maximization of a nuisance parameter – can each be expressed as a transformation of an approximate P‐value. In this paper, we point out that TOST‐based P‐values will generally be conservative, even if based on exact and optimal one‐sided tests. This conservatism is avoided by applying the three transforms in a certain order – estimation followed by TOST followed by maximization. We compare this procedure with existing alternatives through a numerical study of binary matched pairs where the two treatments are compared by the difference of response rates. The resulting tests are uniformly more powerful than the considered competitors, although the difference in power can range from very small to moderate.     

Tolerance limits under Poisson regression based on small-sample asymptotic methodology

This article explores the calculation of tolerance limits for the Poisson regression model based on the profile likelihood methodology and small-sample asymptotic corrections to improve the coverage probability performance. The data consist of n counts, where the mean or expected rate depends upon covariates via the log regression function. This article evaluated upper tolerance limits as a function of covariates. The upper tolerance limits are obtained from upper confidence limits of the mean. To compute upper confidence limits the following methodologies were considered: likelihood based asymptotic methods, small-sample asymptotic methods to improve the likelihood based methodology, and the delta method. Two applications are discussed: one application relating to defects in semiconductor wafers due to plasma etching and the other examining the number of surface faults in upper seams of coal mines. All three methodologies are illustrated for the two applications.