Equal‐tailed confidence intervals for comparison of rates

Several methods are available for generating confidence intervals for rate difference, rate ratio, or odds ratio, when comparing two independent binomial proportions or Poisson (exposure‐adjusted) incidence rates. Most methods have some degree of systematic bias in one‐sided coverage, so that a nominal 95% two‐sided interval cannot be assumed to have tail probabilities of 2.5% at each end, and any associated hypothesis test is at risk of inflated type I error rate. Skewness‐corrected asymptotic score methods have been shown to have superior equal‐tailed coverage properties for the binomial case. This paper completes this class of methods by introducing novel skewness corrections for the Poisson case and for odds ratio, with and without stratification. Graphical methods are used to compare the performance of these intervals against selected alternatives. The skewness‐corrected methods perform favourably in all situations—including those with small sample sizes or rare events—and the skewness correction should be considered essential for analysis of rate ratios. The stratified method is found to have excellent coverage properties for a fixed effects analysis. In addition, another new stratified score method is proposed, based on the t‐distribution, which is suitable for use in either a fixed effects or random effects analysis. By using a novel weighting scheme, this approach improves on conventional and modern meta‐analysis methods with weights that rely on crude estimation of stratum variances. In summary, this paper describes methods that are found to be robust for a wide range of applications in the analysis of rates.     

Confidence Intervals for Difference Between Two Poisson Rates

In this article, we develop four explicit asymptotic two-sided confidence intervals for the difference between two Poisson rates via a hybrid method. The basic idea of the proposed method is to estimate or recover the variances of the two Poisson rate estimates, which are required for constructing the confidence interval for the rate difference, from the confidence limits for the two individual Poisson rates. The basic building blocks of the approach are reliable confidence limits for the two individual Poisson rates. Four confidence interval estimators that have explicit solutions and good coverage levels are employed: the first normal with continuity correction, Rao score, Freeman and Tukey, and Jeffreys confidence intervals. Using simulation studies, we examine the performance of the four hybrid confidence intervals and compare them with three existing confidence intervals: the non-informative prior Bayes confidence interval, the t confidence interval based on Satterthwait's degrees of freedom, and the Bayes confidence interval based on Student's t confidence coefficient. Simulation results show that the proposed hybrid Freeman and Tukey, and the hybrid Jeffreys confidence intervals can be highly recommended because they outperform the others in terms of coverage probabilities and widths. The other methods tend to be too conservative and produce wider confidence intervals. The application of these confidence intervals are illustrated with three real data sets.     

Resampling approaches for common intraclass correlation coefficients

In this paper, we present several resampling methods for interval estimation for the common intraclass correlation coefficients. Comparisons are made on the coverage probabilities and average lengths with confidence intervals estimated by using the generalized pivots. Most of the methods proposed in this article produce confidence intervals with better probabilities and shorter average lengths than that produced by using generalized pivots.     

Confidence intervals for the closed population size under inverse sampling without replacement

Inverse sampling is an appropriate design for the second phase of capture-recapture experiments which provides an exactly unbiased estimator of the population size. However, the sampling distribution of the resulting estimator tends to be highly right skewed for small recapture samples, so, the traditional Wald-type confidence intervals appear to be inappropriate. The objective of this paper is to study the performance of interval estimators for the population size under inverse recapture sampling without replacement. To this aim, we consider the Wald-type, the logarithmic transformation-based, the Wilson score, the likelihood ratio and the exact methods. Also, we propose some bootstrap confidence intervals for the population size, including the with-replacement bootstrap (BWR), the without replacement bootstrap (BWO), and the Rao–Wu’s rescaling method. A Monte Carlo simulation is employed to evaluate the performance of suggested methods in terms of the coverage probability, error rates and standardized average length. Our results show that the likelihood ratio and exact confidence intervals are preferred to other competitors, having the coverage probabilities close to the desired nominal level for any sample size, with more balanced error rate for exact method and shorter length for likelihood ratio method. It is notable that the BWO and Rao–Wu’s rescaling methods also may provide good intervals for some situations, however, those coverage probabilities are not invariant with respect to the population arguments, so one must be careful to use them.     

Confidence limits for estimates of totals from stratified samples, with application to medicare Part B overpayment audits

Superpopulation models are proposed that should be appropriate for modelling sample-based audits of Medicare payments and other overpayment situations. Simulations are used to estimate the coverage probabilities of confidence intervals formed using the standard Stratified Expansion and Combined Ratio estimators of the total. Despite severe departures from the usual model of normal deviations, these methods have actual coverage probabilities reasonably close to the nominal level specified by the US government's sampling guidelines. An exception occurs when all claims from a single sampling unit are either completely allowed, or completely denied, and for this situation an alternative is explored. A balanced sampling design is also examined, but shown to make no improvement over ordinary stratified samples used in conjunction with ratio estimates.     

A Simple Approximate Procedure for Constructing Binomial and Poisson Tolerance Intervals

The problems of constructing tolerance intervals for the binomial and Poisson distributions are considered. Closed-form approximate equal-tailed tolerance intervals (that control percentages in both tails) are proposed for both distributions. Exact coverage probabilities and expected widths are evaluated for the proposed equal-tailed tolerance intervals and the existing intervals. Furthermore, an adjustment to the nominal confidence level is suggested so that an equal-tailed tolerance interval can be used as a tolerance interval which includes a specified proportion of the population, but does not necessarily control percentages in both tails. Comparison of such coverage-adjusted tolerance intervals with respect to coverage probabilities and expected widths indicates that the closed-form approximate tolerance intervals are comparable with others, and less conservative, with minimum coverage probabilities close to the nominal level in most cases. The approximate tolerance intervals are simple and easy to compute using a calculator, and they can be recommended for practical applications. The methods are illustrated using two practical examples.     

Coverage Properties of Confidence Intervals for Generalized Additive Model Components

Abstract. We study the coverage properties of Bayesian confidence intervals for the smooth component functions of generalized additive models (GAMs) represented using any penalized regression spline approach. The intervals are the usual generalization of the intervals first proposed by Wahba and Silverman in 1983 and 1985, respectively, to the GAM component context. We present simulation evidence showing these intervals have close to nominal ‘across‐the‐function’ frequentist coverage probabilities, except when the truth is close to a straight line/plane function. We extend the argument introduced by Nychka in 1988 for univariate smoothing splines to explain these results. The theoretical argument suggests that close to nominal coverage probabilities can be achieved, provided that heavy oversmoothing is avoided, so that the bias is not too large a proportion of the sampling variability. The theoretical results allow us to derive alternative intervals from a purely frequentist point of view, and to explain the impact that the neglect of smoothing parameter variability has on confidence interval performance. They also suggest switching the target of inference for component‐wise intervals away from smooth components in the space of the GAM identifiability constraints.     

Properties of simultaneous confidence intervals for multinomial proportions

Inversion of Pearson's chi-square statistic yields a confidence ellipsoid that can be used for simultaneous inference concerning multinomial proportions. Because the ellipsoid is difficult to interpret, methods of simultaneous confidence interval construction have been proposed by Quesenberry and hurst,goodman,fitzpatrick and scott and sison and glaz . Based on simulation results, we discuss the performance of these methods in terms of empirical coverage probabilities and enclosed volume. None of the methods is uniformly better than all others, but the Goodman intervals control the empirical coverage probability with smaller volume than other methods when the sample size supports the large sample theory. If the expected cell counts are small and nearly equal across cells, we recommend the sison and glaz intervals.     

Nonparametric confidence intervals for Tmax in sequence-stratified crossover studies

Tmax is the time associated with the maximum serum or plasma drug concentration achieved following a dose. While Tmax is continuous in theory, it is usually discrete in practice because it is equated to a nominal sampling time in the noncompartmental pharmacokinetics approach. For a 2-treatment crossover design, a Hodges-Lehmann method exists for a confidence interval on treatment differences. For appropriately designed crossover studies with more than two treatments, a new median-scaling method is proposed to obtain estimates and confidence intervals for treatment effects. A simulation study was done comparing this new method with two previously described rank-based nonparametric methods, a stratified ranks method and a signed ranks method due to Ohrvik. The Normal theory, a nonparametric confidence interval approach without adjustment for periods, and a nonparametric bootstrap method were also compared. Results show that less dense sampling and period effects cause increases in confidence interval length. The Normal theory method can be liberal (i.e. less than nominal coverage) if there is a true treatment effect. The nonparametric methods tend to be conservative with regard to coverage probability and among them the median-scaling method is least conservative and has shortest confidence intervals. The stratified ranks method was the most conservative and had very long confidence intervals. The bootstrap method was generally less conservative than the median-scaling method, but it tended to have longer confidence intervals. Overall, the median-scaling method had the best combination of coverage and confidence interval length. All methods performed adequately with respect to bias.     

Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions

For interval estimation of a proportion, coverage probabilities tend to be too large for “exact” confidence intervals based on inverting the binomial test and too small for the interval based on inverting the Wald large-sample normal test (i.e., sample proportion ± z-score × estimated standard error). Wilson's suggestion of inverting the related score test with null rather than estimated standard error yields coverage probabilities close to nominal confidence levels, even for very small sample sizes. The 95% score interval has similar behavior as the adjusted Wald interval obtained after adding two “successes” and two “failures” to the sample. In elementary courses, with the score and adjusted Wald methods it is unnecessary to provide students with awkward sample size guidelines.     

Estimating kurtosis and confidence intervals for the variance under nonnormality

Exact confidence intervals for variances rely on normal distribution assumptions. Alternatively, large-sample confidence intervals for the variance can be attained if one estimates the kurtosis of the underlying distribution. The method used to estimate the kurtosis has a direct impact on the performance of the interval and thus the quality of statistical inferences. In this paper the author considers a number of kurtosis estimators combined with large-sample theory to construct approximate confidence intervals for the variance. In addition, a nonparametric bootstrap resampling procedure is used to build bootstrap confidence intervals for the variance. Simulated coverage probabilities using different confidence interval methods are computed for a variety of sample sizes and distributions. A modification to a conventional estimator of the kurtosis, in conjunction with adjustments to the mean and variance of the asymptotic distribution of a function of the sample variance, improves the resulting coverage values for leptokurtically distributed populations.     

Approximate confidence interval construction for risk difference under inverse sampling

For studies with dichotomous outcomes, inverse sampling (also known as negative binomial sampling) is often used when the subjects arrive sequentially, when the underlying response of interest is acute, and/or when the maximum likelihood estimators of some epidemiologic indices are undefined. Although exact unconditional inference has been shown to be appealing, its applicability and popularity is severely hindered by the notorious conservativeness due to the adoption of the maximization principle and by the tedious computing time due to the involvement of infinite summation. In this article, we demonstrate how these obstacles can be overcome by the application of the constrained maximum likelihood estimation and truncated approximation. The present work is motivated by confidence interval construction for the risk difference under inverse sampling. Wald-type and score-type confidence intervals based on inverting two one-sided and one two-sided tests are considered. Monte Carlo simulations are conducted to evaluate the performance of these confidence intervals with respect to empirical coverage probability, empirical confidence width, and empirical left and right non-coverage probabilities. Two examples from a maternal congenital heart disease study and a drug comparison study are used to demonstrate the proposed methodologies.     

Generalized confidence interval estimation for the mean of delta-lognormal distribution: an application to New Zealand trawl survey data

Highly skewed and non-negative data can often be modeled by the delta-lognormal distribution in fisheries research. However, the coverage probabilities of extant interval estimation procedures are less satisfactory in small sample sizes and highly skewed data. We propose a heuristic method of estimating confidence intervals for the mean of the delta-lognormal distribution. This heuristic method is an estimation based on asymptotic generalized pivotal quantity to construct generalized confidence interval for the mean of the delta-lognormal distribution. Simulation results show that the proposed interval estimation procedure yields satisfactory coverage probabilities, expected interval lengths and reasonable relative biases. Finally, the proposed method is employed in red cod densities data for a demonstration.     

Comparison of Interval Estimators of Pr(X < Y) in the Two-parameter Exponential Distribution

We consider confidence intervals for the stress–strength reliability Pr(X< Y) in the two-parameter exponential distribution. We have derived the Bayesian highest posterior density interval using non-informative prior distributions. We have compared its performance with the intervals based on the generalized pivot variable intervals in terms of their coverage probabilities and expected lengths. Our simulation study shows that the Bayesian interval performs better according to the criteria used, especially when the sample sizes are very small. An example is given.     

相关差别指标的区间估计方法比较

在公共疾病控制领域,重大稀有疾病的发病率非常低,符合逆抽样特征,量化分析重大稀有疾病的发病率并对其特点进行分析。为了研究在带有群内相关条件下的整群抽样问题,通过二项分布抽样对比流行病学中相关差别指标的六种渐近置信区间的构造方法研究,综合考虑实际覆盖率与区间长度对各种方法的优劣及适用情况做出对比分析。研究表明,Wald型置信区间与对数变换的置信区间对发病率的估计表现因参数而定,而Bootstrap类方法不稳定。本研究找出了不同区间估计方法的适用场合,应合理看待置信区间这种评估方法在流行病学中的实际应用。     

相关差别指标的区间估计方法比较

在公共疾病控制领域,重大稀有疾病的发病率非常低,符合逆抽样特征,量化分析重大稀有疾病的发病率并对其特点进行分析,为了研究在带有群内相关条件下的整群抽样问题,通过β-二项分布抽样对比流行病学中相关差别指标的六种渐近置信区间的构造方法,综合考虑实际覆盖率与区间长度对各种方法的优劣及适用情况并对比分析。研究表明,Wald型置信区间与对数变换的置信区间对发病率的估计表现因参数而定,而Bootstrap类方法不稳定。本研究找出了不同区间估计方法的适用场合,认为应合理看待置信区间这种评估方法在流行病学中的实际应用。     

Matching pseudocounts for interval estimation of binomial and Poisson parameters

ABSTRACT

For interval estimation of a binomial proportion and a Poisson mean, matching pseudocounts are derived, which give the one-sided Wald confidence intervals with second-order accuracy. The confidence intervals remove the bias of coverage probabilities given by the score confidence intervals. Partial poor behavior of the confidence intervals by the matching pseudocounts is corrected by hybrid methods using the score confidence interval depending on sample values.     

Bootstrap confidence intervals of generalized process capability index Cpyk for Lindley and power Lindley distributions

One of the indicators for evaluating the capability of a process is the process capability index. In this article, bootstrap confidence intervals of the generalized process capability index (GPCI) proposed by Maiti et al. are studied through simulation, when the underlying distributions are Lindley and Power Lindley distributions. The maximum likelihood method is used to estimate the parameters of the models. Three bootstrap confidence intervals namely, standard bootstrap (SB), percentile bootstrap (PB), and bias-corrected percentile bootstrap (BCPB) are considered for obtaining confidence intervals of GPCI. A Monte Carlo simulation has been used to investigate the estimated coverage probabilities and average width of the bootstrap confidence intervals. Simulation results show that the estimated coverage probabilities of the percentile bootstrap confidence interval and the bias-corrected percentile bootstrap confidence interval get closer to the nominal confidence level than those of the standard bootstrap confidence interval. Finally, three real datasets are analyzed for illustrative purposes.     

Evaluation of alternative confidence intervals to address non-inferiority through the stratified difference between proportions

The confidence interval (CI) for the difference between two proportions has been an important and active research topic, especially in the context of non-inferiority hypothesis testing. Issues concerning the Type 1 error rate, power, coverage rate and aberrations have been extensively studied for non-stratified cases. However, stratified confidence intervals are frequently used in non-inferiority trials and similar settings. In this paper, several methods for stratified confidence intervals for the difference between two proportions, including existing methods and novel extensions from unstratified CIs, are evaluated across different scenarios. When sparsity across the strata is not a concern, adding imputed observations to the stratification analysis can strengthen Type-1 error control without substantial loss of power. When sparseness of data is a concern, most of the evaluated methods fail to control Type-1 error; the modified stratified t-test CI is an exception. We recommend the modified stratified t-test CI as the most useful and flexible method across the respective scenarios; the modified stratified Wald CI may be useful in settings where sparsity is unlikely. These findings substantially contribute to the application of stratified CIs for non-inferiority testing of differences between two proportions.     

Conservative confidence intervals for the intraclass correlation coefficient for clustered binary data

Asymptotic approaches are traditionally used to calculate confidence intervals for intraclass correlation coefficient in a clustered binary study. When sample size is small to medium, or correlation or response rate is near the boundary, asymptotic intervals often do not have satisfactory performance with regard to coverage. We propose using the importance sampling method to construct the profile confidence limits for the intraclass correlation coefficient. Importance sampling is a simulation based approach to reduce the variance of the estimated parameter. Four existing asymptotic limits are used as statistical quantities for sample space ordering in the importance sampling method. Simulation studies are performed to evaluate the performance of the proposed accurate intervals with regard to coverage and interval width. Simulation results indicate that the accurate intervals based on the asymptotic limits by Fleiss and Cuzick generally have shorter width than others in many cases, while the accurate intervals based on Zou and Donner asymptotic limits outperform others when correlation and response rate are close to their boundaries.