Statistical inference of agreement coefficient between two raters with binary outcomes

Abstract

Scott’s pi and Cohen’s kappa are widely used for assessing the degree of agreement between two raters with binary outcomes. However, many authors have pointed out its paradoxical behavior, that comes from the dependence on the prevalence of a trait under study. To overcome the limitation, Gwet [Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology 61(1):29–48] proposed an alternative and more stable agreement coefficient referred to as the AC₁. In this article, we discuss a likelihood-based inference of the AC₁ in the case of two raters with binary outcomes. Construction of confidence intervals is mainly discussed. In addition, hypothesis testing, and sample size estimation are also presented.     

Minimum-volume confidence sets for normal linear regression models

In this article, we establish the minimum-volume confidence sets for normal linear regression models, extending the results in Zhang [Minimum volume confidence sets for parameters of normal distributions. Adv Stat Anal. 2017;101:309–320] on building the minimum-volume confidence sets for parameters of normal distributions. Compared with classical confidence sets, the proposed optimal confidence set is proved to have the smallest volume, for whatever confidence level, sample size and sample data.     

Estimation of infant mortality rates categorized by social class for an Australian population

"This paper reports a method of deriving simultaneous confidence intervals for [Australian] infant mortality rates based on a birth sample rather than the birth population. The large sample size employed enables the use of asymptotic multivariate techniques....[The authors find that] where the population distribution of a characteristic such as social class is not known, confidence intervals can be estimated for rates based on the distribution of this characteristic in a sample of that population."     

The monotone boundary property and the full coverage property of confidence intervals for a binomial proportion

The methodology for deriving the exact confidence coefficient of some confidence intervals for a binomial proportion is proposed in Wang [2007. Exact confidence coefficients of confidence intervals for a binomial proportion. Statist. Sinica 17, 361–368]. The methodology requires two conditions of confidence intervals: the monotone boundary property and the full coverage property. In this paper, we show that for some confidence intervals of a binomial proportion, the two properties hold for any sample size. Based on results presented in this paper, the procedure in Wang [2007. Exact confidence coefficients of confidence intervals for a binomial proportion. Statist. Sinica 17, 361–368] can be directly used to calculate the exact confidence coefficients of these confidence intervals for any fixed sample size.     

Construction of fixed width confidence intervals for a Bernoulli success probability using sequential sampling: a simulation study

This article considers the construction of level 1?α fixed width 2d confidence intervals for a Bernoulli success probability p, assuming no prior knowledge about p and so p can be anywhere in the interval [0, 1]. It is shown that some fixed width 2d confidence intervals that combine sequential sampling of Hall [Asymptotic theory of triple sampling for sequential estimation of a mean, Ann. Stat. 9 (1981), pp. 1229–1238] and fixed-sample-size confidence intervals of Agresti and Coull [Approximate is better than ‘exact’ for interval estimation of binomial proportions, Am. Stat. 52 (1998), pp. 119–126], Wilson [Probable inference, the law of succession, and statistical inference, J. Am. Stat. Assoc. 22 (1927), pp. 209–212] and Brown et al. [Interval estimation for binomial proportion (with discussion), Stat. Sci. 16 (2001), pp. 101–133] have close to 1?α confidence level. These sequential confidence intervals require a much smaller sample size than a fixed-sample-size confidence interval. For the coin jamming example considered, a fixed-sample-size confidence interval requires a sample size of 9457, while a sequential confidence interval requires a sample size that rarely exceeds 2042.     

Tests for assessment of agreement using probability criteria

For the assessment of agreement using probability criteria, we obtain an exact test, and for sample sizes exceeding 30, we give a bootstrap-t$t$ test that is remarkably accurate. We show that for assessing agreement, the total deviation index approach of Lin [2000. Total deviation index for measuring individual agreement with applications in laboratory performance and bioequivalence. Statist. Med. 19, 255–270] is not consistent and may not preserve its asymptotic nominal level, and that the coverage probability approach of Lin et al. [2002. Statistical methods in assessing agreement: models, issues and tools. J. Amer. Statist. Assoc. 97, 257–270] is overly conservative for moderate sample sizes. We also show that the nearly unbiased test of Wang and Hwang [2001. A nearly unbiased test for individual bioequivalence problems using probability criteria. J. Statist. Plann. Inference 99, 41–58] may be liberal for large sample sizes, and suggest a minor modification that gives numerically equivalent approximation to the exact test for sample sizes 30 or less. We present a simple and accurate sample size formula for planning studies on assessing agreement, and illustrate our methodology with a real data set from the literature.     

A MONTE CARLO COMPARISON OF VARIOUS ASYMPTOTIC APPROXIMATIONS TO THE DISTRIBUTION OF INSTRUMENTAL VARIABLES ESTIMATORS

We examine empirical relevance of three alternative asymptotic approximations to the distribution of instrumental variables estimators by Monte Carlo experiments. We find that conventional asymptotics provides a reasonable approximation to the actual distribution of instrumental variables estimators when the sample size is reasonably large. For most sample sizes, we find Bekker[11] asymptotics provides reasonably good approximation even when the first stage R² is very small. We conclude that reporting Bekker[11] confidence interval would suffice for most microeconometric (cross-sectional) applications, and the comparative advantage of Staiger and Stock[5] asymptotic approximation is in applications with sample sizes typical in macroeconometric (time series) applications.     

Sample size algorithm for randomized response model with dichotomized response

The sample size calculation plays an important role in many areas, particularly for applications in the biomedical and social sciences. Large-sample size is wasting of time and resources. Small-sample provides unreliable answer. In the literature, the aim of sample size calculation is to either detecting the difference among groups statistically or assessing the precision of estimate. Other than these two main goals of sample size determination, the objective of this article is to provide the sample size formulae for randomized/nonrandomized response models such that the estimates of sensitive probabilities falling inside the normal interval [0, 1] are guaranteed under a certain confidence. The sample size algorithm is introduced because of no closed form solution for sample size. A higher confidence probability, a greater sample size should be included into the study. Vice versa, larger sample sizes generally lead to increase the chance of the estimated probability falling in [0, 1]. An example is given to illustrate the use of the proposed algorithm.     

Interval estimation for the Pareto distribution based on the progressive Type II censored sample

For the complete sample and the right Type II censored sample, Chen [Joint confidence region for the parameters of Pareto distribution. Metrika 44 (1996), pp. 191–197] proposed the interval estimation of the parameter θ and the joint confidence region of the two parameters of Pareto distribution. This paper proposed two methods to construct the confidence region of the two parameters of the Pareto distribution for the progressive Type II censored sample. A simulation study comparing the performance of the two methods is done and concludes that Method 1 is superior to Method 2 by obtaining a smaller confidence area. The interval estimation of parameter ν is also given under progressive Type II censoring. In addition, the predictive intervals of the future observation and the ratio of the two future consecutive failure times based on the progressive Type II censored sample are also proposed. Finally, one example is given to illustrate all interval estimations in this paper.     

Bootstrap-based inferential improvements in beta autoregressive moving average model

We consider the issue of performing accurate small sample inference in beta autoregressive moving average model, which is useful for modeling and forecasting continuous variables that assume values in the interval (0,?1). The inferences based on conditional maximum likelihood estimation have good asymptotic properties, but their performances in small samples may be poor. This way, we propose bootstrap bias corrections of the point estimators and different bootstrap strategies for confidence interval improvements. Our Monte Carlo simulations show that finite sample inference based on bootstrap corrections is much more reliable than the usual inferences. We also presented an empirical application.     

A Monte Carlo simulation study of two-sided tolerance intervals in balanced one-way random effects model for non-normal errors

Recently, Ong and Mukerjee [Probability matching priors for two-sided tolerance intervals in balanced one-way and two-way nested random effects models. Statistics. 2011;45:403–411] developed two-sided Bayesian tolerance intervals, with approximate frequentist validity, for a future observation in balanced one-way and two-way nested random effects models. These were obtained using probability matching priors (PMP). On the other hand, Krishnamoorthy and Lian [Closed-form approximate tolerance intervals for some general linear models and comparison studies. J Stat Comput Simul. 2012;82:547–563] studied closed-form approximate tolerance intervals by the modified large-sample (MLS) approach. We compare the performances of these two approaches for normal as well as non-normal error distributions. Monte Carlo simulation methods are used to evaluate the resulting tolerance intervals with regard to achieved confidence levels and expected widths. It turns out that PMP tolerance intervals are less conservative for data with large number of classes and small number of observations per class and the MLS procedure is preferable for smaller sample sizes.     

Exact distribution of the MLEs of the parameters and of the quantiles of two-parameter exponential distribution under hybrid censoring

Epstein [Truncated life tests in the exponential case, Ann. Math. Statist. 25 (1954), pp. 555–564] introduced a hybrid censoring scheme (called Type-I hybrid censoring) and Chen and Bhattacharyya [Exact confidence bounds for an exponential parameter under hybrid censoring, Comm. Statist. Theory Methods 17 (1988), pp. 1857–1870] derived the exact distribution of the maximum-likelihood estimator (MLE) of the mean of a scaled exponential distribution based on a Type-I hybrid censored sample. Childs et al. [Exact likelihood inference based on Type-I and Type-II hybrid censored samples from the exponential distribution, Ann. Inst. Statist. Math. 55 (2003), pp. 319–330] provided an alternate simpler expression for this distribution, and also developed analogous results for another hybrid censoring scheme (called Type-II hybrid censoring). The purpose of this paper is to derive the exact bivariate distribution of the MLE of the parameter vector of a two-parameter exponential model based on hybrid censored samples. The marginal distributions are derived and exact confidence bounds for the parameters are obtained. The results are also used to derive the exact distribution of the MLE of the pth quantile, as well as the corresponding confidence bounds. These exact confidence intervals are then compared with parametric bootstrap confidence intervals in terms of coverage probabilities. Finally, we present some numerical examples to illustrate the methods of inference developed here.     

Weak convergence for the conditional distribution function in a Koziol–Green model under dependent censoring

In this paper we consider the conditional Koziol–Green model of Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] in which they generalized the Koziol–Green model of Veraverbeke and Cadarso Suárez [2000. Estimation of the conditional distribution in a conditional Koziol–Green model. Test 9, 97–122] by assuming that the association between a censoring time and a time until an event is described by a known Archimedean copula function. They got in this way, an informative censoring model with two different types of informative censoring. Braekers and Veraverbeke [2008. A conditional Koziol–Green model under dependent censoring. Statist. Probab. Lett., accepted for publication] derived in this model a non-parametric Koziol–Green estimator for the conditional distribution function of the time until an event, for which they showed the uniform consistency and the asymptotic normality. In this paper we extend their results and prove the weak convergence of the process associated to this estimator. Furthermore we show that the conditional Koziol–Green estimator is asymptotically more efficient in this model than the general copula-graphic estimator of Braekers and Veraverbeke [2005. A copula-graphic estimator for the conditional survival function under dependent censoring. Canad. J. Statist. 33, 429–447]. As last result, we construct an asymptotic confidence band for the conditional Koziol–Green estimator. Through a simulation study, we investigate the small sample properties of this asymptotic confidence band. Afterwards we apply this estimator and its confidence band on a practical data set.     

A class of confidence intervals for sequential phase II clinical trials with binary outcome

The phase II clinical trials often use the binary outcome. Thus, accessing the success rate of the treatment is a primary objective for the phase II clinical trials. Reporting confidence intervals is a common practice for clinical trials. Due to the group sequence design and relatively small sample size, many existing confidence intervals for phase II trials are much conservative. In this paper, we propose a class of confidence intervals for binary outcomes. We also provide a general theory to assess the coverage of confidence intervals for discrete distributions, and hence make recommendations for choosing the parameter in calculating the confidence interval. The proposed method is applied to Simon's [14] optimal two-stage design with numerical studies. The proposed method can be viewed as an alternative approach for the confidence interval for discrete distributions in general.     

Confidence interval estimation for a linear contrast in intraclass correlation coefficients under unequal family sizes for several populations

Confidence intervals [based on F-distribution and (Z) standard normal distribution] for a linear contrast in intraclass correlation coefficients under unequal family sizes for several populations based on several independent multinormal samples have been proposed. It has been found that the confidence interval based on F-distribution consistently and reliably produced better results in terms of shorter average length of the interval than the confidence interval based on standard normal distribution for various combinations of intraclass correlation coefficient values. The coverage probability of the interval based on F-distribution is competitive with the coverage probability of the interval based on standard normal distribution. The interval based on F-distribution can be used for both small sample and large sample situations. An example with real life data has been presented.     

Fixed-width confidence interval based on a minimum Hellinger distance estimator

In the context of discrete data, a sequential fixed-width confidence interval for an unknown parameter in a parametric model is constructed using a minimum Hellinger distance estimator (MHD) as the center of the interval. It is shown that our sequential procedure is asymptotically consistent and efficient, when the assumed parametric model is correct. These results, in addition to being exactly same as those obtained by Khan [1969, A general method of determining fixed-width confidence intervals. Ann. Math. Statist. 40, 704–709] and Yu [1989, On fixed-width confidence intervals associated with maximum likelihood estimation. J. Theoret. Probab. 2, 193–199] using a maximum likelihood estimator (MLE), offer an alternative which has several in-built robustness properties. Monte Carlo simulations show that the performance of our sequential procedure based on MHD, measured in terms of average sample size and the coverage probability, are as good as those based on MLE, when the assumed Poisson model is correct. However, when the samples come from a gross-error contaminated Poisson model, our numerical results show that the deviation from the Poisson model assumption severely affects the performance of the sequential procedure based on MLE, while the procedure based on MHD continues to perform well, thus exhibiting robustness of MHD against gross-error contaminations even for random sample sizes.     

Chebyshev's inequality for nonparametric testing with small N and α in microarray research

Summary.  Microarrays are a powerful new technology that allow for the measurement of the expression of thousands of genes simultaneously. Owing to relatively high costs, sample sizes tend to be quite small. If investigators apply a correction for multiple testing, a very small p -value will be required to declare significance. We use modifications to Chebyshev's inequality to develop a testing procedure that is nonparametric and yields p -values on the interval [0, 1]. We evaluate its properties via simulation and show that it both holds the type I error rate below nominal levels in almost all conditions and can yield p -values denoting significance even with very small sample sizes and stringent corrections for multiple testing.     

A NEW CALIBRATION METHOD OF CONSTRUCTING EMPIRICAL LIKELIHOOD-BASED CONFIDENCE INTERVALS FOR THE TAIL INDEX

Empirical likelihood has attracted much attention in the literature as a nonparametric method. A recent paper by Lu & Peng (2002) [Likelihood based confidence intervals for the tail index. Extremes 5, 337–352] applied this method to construct a confidence interval for the tail index of a heavy‐tailed distribution. It turns out that the empirical likelihood method, as well as other likelihood‐based methods, performs better than the normal approximation method in terms of coverage probability. However, when the sample size is small, the confidence interval computed using the χ² approximation has a serious undercoverage problem. Motivated by Tsao (2004) [A new method of calibration for the empirical loglikelihood ratio. Statist. Probab. Lett. 68, 305–314], this paper proposes a new method of calibration, which corrects the undercoverage problem.     

Multiple comparisons with a control for exponential location parameters under heteroscedasticity

In this paper, a new design-oriented two-stage two-sided simultaneous confidence intervals, for comparing several exponential populations with control population in terms of location parameters under heteroscedasticity, are proposed. If there is a prior information that the location parameter of k exponential populations are not less than the location parameter of control population, one-sided simultaneous confidence intervals provide more inferential sensitivity than two-sided simultaneous confidence intervals. But the two-sided simultaneous confidence intervals have advantages over the one-sided simultaneous confidence intervals as they provide both lower and upper bounds for the parameters of interest. The proposed design-oriented two-stage two-sided simultaneous confidence intervals provide the benefits of both the two-stage one-sided and two-sided simultaneous confidence intervals. When the additional sample at the second stage may not be available due to the experimental budget shortage or other factors in an experiment, one-stage two-sided confidence intervals are proposed, which combine the advantages of one-stage one-sided and two-sided simultaneous confidence intervals. The critical constants are obtained using the techniques given in Lam [9,10]. These critical constant are compared with the critical constants obtained by Bonferroni inequality techniques and found that critical constant obtained by Lam [9,10] are less conservative than critical constants computed from the Bonferroni inequality technique. Implementation of the proposed simultaneous confidence intervals is demonstrated by a numerical example.     

信心、货币政策与中国经济波动关系的统计检验

文章基于时变视角,依据行为经济学理论,构建了一个包含企业家信心、投资者信心、利率、货币增长率、经济增长率和通货膨胀率六变量的TVP-VAR模型,研究信心、货币政策与经济波动之间的时变特征。结果表明:企业家信心和投资者信心能够影响利率和货币增长率,即信心可以通过影响货币政策进而作用于宏观经济。货币增长率和利率能够影响投资者信心和企业家信心,进而可以通过信心影响宏观经济。从时变角度看,企业家信心一单位的正向冲击在整个样本区间内均会促进经济的增长;在短期内投资者信心和货币增长率对经济增长具有促进作用,但是在长期内货币增长率的提高会阻碍经济的增长。