Revisiting Beal's Confidence Intervals for the Difference of Two Binomial Proportions

Confidence interval construction for the difference of two independent binomial proportions is a well-known problem with a full panoply of proposed solutions. In this paper, we focus largely on the family of intervals proposed by Beal (1987 Beal , S. ( 1987 ). Asymptotic confidence intervals for the difference between two binomial parameters for use with small samples . Biometrics 43 : 941 – 950 . [CSA] [CROSSREF] [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). This family, which includes the Haldane and Jeffreys–Perks intervals as special cases, assumes a symmetric prior distribution for the population proportions p ₁ and p ₂. We propose new methods that allow the currently observed data to set the prior distribution by taking a parametric empirical-Bayes approach; in addition, we also provide an investigation of the new interval' behaviors in small-sample situations. Unlike other solutions, our intervals can be used adaptively for experiments conducted in multiple stages over time. We illustrate this notion using data from an Argentinean study involving the Mal Rio Cuarto virus and its transmission to susceptible maize crops.     

Generalized Point Estimation with Application to Small Response Estimation

Motivated by a number of drawbacks of classical methods of point estimation, we generalize the definitions of point estimation, and address such notions as unbiasedness and estimation under constraints. The utility of the extension is shown by deriving more reliable estimates for small coefficients of regression models, and for variance components and random effects of mixed models. The extension is in the spirit of generalized confidence intervals introduced by Weerahandi (1993 Weerahandi , S. ( 1993 ). Generalized confidence intervals . J. Amer. Statist. Assoc. 88 : 899 – 905 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and should encourage much needed further research in point estimation in unbalanced models, multi-variate models, non normal models, and nonlinear models.     

Repeated confidence intervals and prediction intervals using stochastic curtailment under fractional Brownian motion

ABSTRACT

Repeated confidence intervals (RCIs) and prediction intervals (PIs) can be used for the design and monitoring of group sequential trials. Stochastically curtailed tests (SCTs) under fractional Brownian motion (FBM) have been studied for the interim analysis of clinical trials (Zhang et al., 2015 Zhang, Q., Lai, D.J., Davis, B.R. (2015). Stochastically curtailed tests under fractional Brownian motion. Commun. Stat. Theory Methods. 44(5):1053–1064.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). In this article, we derive RCIs and PIs based on SCTs under FBM for one-sided derived tests (Jennison and Turnbull, 2000 Jennison, C., Turnbull, B.W. (2000). Group Sequential Methods with Applications to Clinical Trials. Boca Raton, London: Chapman and Hall. [Google Scholar]). Comparisons of RCI width and sample size requirement are made to those under Brownian motion (BM) and to those of Pocock and O'Brien-Fleming design types for various type I, type II error rates, and number of interim analyses. Interim data from Beta-Blocker Heart Attack Trial are used to illustrate how to design and monitor clinical trials using these RCIs and PIs under FBM. Results show that these one-sided derived tests based on SCTs have narrower final confidence intervals and require smaller sample sizes than those using classical group sequential designs. The Hurst parameter has more impact on the RCI width than on the sample size requirements for the proposed designs.     

A Confidence Interval and Test for the Mean of an Asymmetric Distribution

ABSTRACT

A confidence interval and test are obtained for the mean of an asymmetric distribution using a random sample of size n. The method is based on N. J. Johnson's (1978 Johnson , N. J. ( 1978 ). Modified, t tests and confidence intervals for asymmetrical populations. J. Amer. Statist. Assoc. 73 ( 363 ): 536 – 544 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) modified t-test, where terms of Cornish–Fisher expansions involving the third moment are used to adjust the conventional statistic to have more closely a Student's t-distribution with n ? 1 degrees of freedom. Johnson's (1978 Johnson , N. J. ( 1978 ). Modified, t tests and confidence intervals for asymmetrical populations. J. Amer. Statist. Assoc. 73 ( 363 ): 536 – 544 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) test cannot be inverted uniquely, so a corresponding confidence interval for the mean may be disjointed. However, an artificial term of small order can be added to make inversion of the test a uniquely defined operation, which prevents such disjointedness. The resulting one-sided and two-sided intervals perform better than others in the literature with skewed distributions, and have good performance with a normal distribution. The two-sided interval may be recommended for general use if the sample size is 10 or more and the nominal confidence coefficient is 95% or less, or if the sample size is 30 or more and the confidence coefficient is 99% or less.     

Interval Estimation by Frequentist Model Averaging

An important contribution to the literature on frequentist model averaging (FMA) is the work of Hjort and Claeskens (2003 Hjort , N. L. , Claeskens , G. ( 2003 ). Frequestist model average estimators . J. Amer. Statist. Assoc. 98 : 879 – 899 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), who developed an asymptotic theory for frequentist model averaging in parametric models based on a local mis-specification framework. They also proposed a simple method for constructing confidence intervals of the unknown parameters. This article shows that the confidence intervals based on the FMA estimator suggested by Hjort and Claeskens (2003 Hjort , N. L. , Claeskens , G. ( 2003 ). Frequestist model average estimators . J. Amer. Statist. Assoc. 98 : 879 – 899 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) are asymptotically equivalent to that obtained from the full model under both parametric and the varying-coefficient partially linear models. Thus, as long as interval estimation rather than point estimation is concerned, the confidence interval based on the full model already fulfills the objective and model averaging provides no additional useful information.     

A Study of Expansions of Posterior Distributions

Johnson (1970 Johnson , R. ( 1970 ). Asymptotic expansions associated with posterior distributions . Ann. Math. Statist. 41 : 851 – 864 .[Crossref] , [Google Scholar]) obtained expansions for marginal posterior distributions through Taylor expansions. Here, the posterior expansion is expressed in terms of the likelihood and the prior together with their derivatives. Recently, Weng (2010 Weng , R. C. ( 2010 ). A Bayesian Edgeworth expansion by Stein's Identity . Bayesian Anal. 5 ( 4 ): 741 – 764 .[Crossref], [Web of Science ®] , [Google Scholar]) used a version of Stein's identity to derive a Bayesian Edgeworth expansion, expressed by posterior moments. Since the pivots used in these two articles are the same, it is of interest to compare these two expansions.

We found that our O(t ^?1/2) term agrees with Johnson's arithmetically, but the O(t ^?1) term does not. The simulations confirmed this finding and revealed that our O(t ^?1) term gives better performance than Johnson's.     

Bayesian P-Values for Testing Independence in 2 × 2 Contingency Tables

This article considers Bayesian p-values for testing independence in 2 × 2 contingency tables with cell counts observed from the two independent binomial sampling scheme and the multinomial sampling scheme. From the frequentist perspective, Fisher's p-value (p _F ) is the most commonly used p-value but it can be conservative for small to moderate sample sizes. On the other hand, from the Bayesian perspective, Bayarri and Berger (2000 Bayarri , M. J. , Berger , J. O. ( 2000 ). P-values for composite null models (with discussion) . J. Amer. Statist. Assoc. 95 : 1127 – 1170 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) first proposed the partial posterior predictive p-value (p _PPOST ), which can avoid the double use of the data that occurs in another Bayesian p-value proposed by Guttman (1967 Guttman , I. ( 1967 ). The use of the concept of a future observation in goodness-of-fit problems . J. Roy. Statist. Soc. Ser. B 29 : 83 – 100 . [Google Scholar]) and Rubin (1984 Rubin , D. B. ( 1984 ). Bayesianly justifiable and relevant frequency calculations for the applied statistician . Ann. Statist. 12 : 1151 – 1172 .[Crossref], [Web of Science ®] , [Google Scholar]), called the posterior predictive p-value (p _POST ). The subjective and objective Bayesian p-values in terms of p _POST and p _PPOST are derived under the beta prior and the (noninformative) Jeffreys prior, respectively. Numerical comparisons among p _F , p _POST , and p _PPOST reveal that p _PPOST performs much better than p _F and p _POST for small to moderate sample sizes from the frequentist perspective.     

Shortest Expected Length Confidence Interval for the Power of the t-Test

Tarasińska (2005 Tarasińska , J. ( 2005 ). Confidence intervals for the power of student's t-test . Statistics & Probability Letters 73 ( 2 ): 125 – 130 .[Crossref], [Web of Science ®] , [Google Scholar]) considered a method to construct the shortest length confidence interval on the power of the t-test using a confidence interval for the population standard deviation in the non centrality parameter. Gilliland and Li (2008 Gilliland , D. , Li , M. ( 2008 ). A note on confidence intervals for the power of t-test . Statistics & Probability Letters 78 ( 5 ): 488 – 489 .[Crossref], [Web of Science ®] , [Google Scholar]) used simulations to show that this confidence interval has less than the nominal coverage, particularly in small samples. We propose to find the shortest expected length confidence interval for the power of the t-test by accounting for the variation in the sample standard deviation, and provide the necessary constants for its implementation for some selected sample and shift sizes. It is seen that the proposed interval is reasonably robust to the specification of the population standard deviation and maintains the nominal coverage.     

Empirical Likelihood Ratio for Linear Transformation Models with Doubly Censored Data

Double censoring arises when T represents an outcome variable that can only be accurately measured within a certain range, [L, U], where L and U are the left- and right-censoring variables, respectively. When L is always observed, we consider the empirical likelihood inference for linear transformation models, based on the martingale-type estimating equation proposed by Chen et al. (2002 Chen , K. , Jin , Z. , Ying , Z. ( 2002 ). Semiparametric analysis of transformation models with censored data . Biometrika 89 : 659 – 668 .[Crossref], [Web of Science ®] , [Google Scholar]). It is demonstrated that both the approach of Lu and Liang (2006 Lu , W. , Liang , Y. ( 2006 ). Empirical likelihood inference for linear transformation models . Journal of Multivariate Analysis 97 : 1586 – 1599 .[Crossref], [Web of Science ®] , [Google Scholar]) and that of Yu et al. (2011 Yu , W. , Sun , Y. , Zheng , M. ( 2011 ). Empirical likelihood method for linear transformation models . Annals of the Institute of Statistical Mathematics 63 : 331 – 346 .[Crossref], [Web of Science ®] , [Google Scholar]) can be extended to doubly censored data. Simulation studies are conducted to investigate the performance of the empirical likelihood ratio methods.     

Confidence Intervals for Linear Function of Variance Components in Two-Fold Nested Random Effects Model

In the article, we consider the unbalanced case of the two-way nested random effects model under partial balance. Using the method of generalized confidence intervals (GCIs) introduced in Weeranhandi (1993 Weeranhandi , S. ( 1993 ). Generalized confidence intervals . J. Amer. Statist. Assoc. 88 : 899 – 905 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar] 1995 Weeranhandi , S. ( 1995 ). Exact Statistical Methods for Data Analysis . New York : Springer-Verlag . [Google Scholar]), a new method is proposed for constructing confidence intervals on linear function of variance components. To compare the resulted intervals with the Modified Large Sample (MLS) intervals by Hernandez and Burdick (1993 Hernandez , R. P. , Burdick , R. K. ( 1993 ). Confidence intervals on the total variance in unbalanced two-fold nested designs . Biom. J. 35 : 515 – 522 .[Crossref] , [Google Scholar]), a simulation study is conducted. The results indicate that the proposed method performs better than the MLS method, especially for very unbalanced designs.     

Bayesian Robustness of the Positive False Discovery Rate

The positive false discovery rate was introduced by Storey (2003 Storey , J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. Ann. Statist. 31:2013–2035.[Crossref], [Web of Science ®] , [Google Scholar]) as an alternative to the family wise error rate for the case in which we are simultaneously testing a large amount of hypotheses. The positive false discovery rate has a very nice Bayesian interpretation (as it was shown by Storey, 2003 Storey , J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. Ann. Statist. 31:2013–2035.[Crossref], [Web of Science ®] , [Google Scholar]) and its robustness is analyzed. The emphasis is on the ε-contamination class (one of the most used classes of priors for Bayesian robustness) and it is shown that robustness is not obtained when the basic prior concentrates the probability on the null hypothesis.     

Exact Inference for the pth-Quantile and the Reliability of the Two-Parameter Exponential Distribution with Singly Type II Censoring: A Standard Approach

Starting from a standard pivot, exact inference for the pth-quantile and for the reliability of the two-parameter exponential distribution in case of singly Type II censored samples is developed in this article. Fernandez (2007 Fernandez , A. J. ( 2007 ). On calculating generalized confidence intervals for the two-parameter exponential reliability function . Statistics 41 : 129 – 135 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) first obtained some of the results proposed in this article, but, differently from what are proposed here, and developed his theory starting from a generalized pivot. An illustrative example shows that, with the expressions proposed in this article, it is also possible to overcome some shortcomings raising from the formulas by Fernandez (2007 Fernandez , A. J. ( 2007 ). On calculating generalized confidence intervals for the two-parameter exponential reliability function . Statistics 41 : 129 – 135 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). Finally, a new expression for the moments of the pivot is obtained.     

A Bayes Factor for Replications of ANOVA Results

ABSTRACT

With an increasing number of replication studies performed in psychological science, the question of how to evaluate the outcome of a replication attempt deserves careful consideration. Bayesian approaches allow to incorporate uncertainty and prior information into the analysis of the replication attempt by their design. The Replication Bayes factor, introduced by Verhagen and Wagenmakers (2014 Verhagen, J., and Wagenmakers, E.-J. (2014), “Bayesian Tests to Quantify the Result of a Replication Attempt,” Journal of Experimental Psychology: General, 143, 1457–1475. DOI: 10.1037/a0036731.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), provides quantitative, relative evidence in favor or against a successful replication. In previous work by Verhagen and Wagenmakers (2014 Verhagen, J., and Wagenmakers, E.-J. (2014), “Bayesian Tests to Quantify the Result of a Replication Attempt,” Journal of Experimental Psychology: General, 143, 1457–1475. DOI: 10.1037/a0036731.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), it was limited to the case of t-tests. In this article, the Replication Bayes factor is extended to F-tests in multigroup, fixed-effect ANOVA designs. Simulations and examples are presented to facilitate the understanding and to demonstrate the usefulness of this approach. Finally, the Replication Bayes factor is compared to other Bayesian and frequentist approaches and discussed in the context of replication attempts. R code to calculate Replication Bayes factors and to reproduce the examples in the article is available at https://osf.io/jv39h/.     

Subjective Bayesian Analysis of the Elliptical Model

For the multivariate elliptical model subjective Bayesian estimators of the location vector and some functions of the characteristic matrix with the normal-inverse Wishart and the normal-Wishart as prior, respectively, are derived. Fang and Li (1999 Fang, K.T., Li, R.Z. (1999). Bayesian statistical inference on elliptical matrix distributions. J. Multivariate Anal. 70: 66–85.[Crossref], [Web of Science ®] , [Google Scholar]) considered the elliptical model for Bayesian analysis for an objective prior structure. In addition, the newly developed results are applied to the multivariate normal- and t-distribution. A performance study is done to evaluate the normal-gamma and normal-inverse gamma distributions as suitable priors. A practical application for the posterior distributions of the multivariate t-distribution is included by means of Gibbs sampling and a Metropolis-Hastings algorithm.     

Bayesian Inference in Cointegrated I (2) Systems: A Generalization of the Triangular Model

This paper generalizes the cointegrating model of Phillips (1991 Phillips , P. C. B. ( 1991 ). Optimal inference in cointegrated systems . Econometrica 59 : 283 – 306 .[Crossref], [Web of Science ®] , [Google Scholar]) to allow for I (0), I (1) and I (2) processes. The model has a simple form that permits a wider range of I (2) processes than are usually considered, including a more flexible form of polynomial cointegration. Further, the specification relaxes restrictions identified by Phillips (1991 Phillips , P. C. B. ( 1991 ). Optimal inference in cointegrated systems . Econometrica 59 : 283 – 306 .[Crossref], [Web of Science ®] , [Google Scholar]) on the I (1) and I (2) cointegrating vectors and restrictions on how the stochastic trends enter the system. To date there has been little work on Bayesian I (2) analysis and so this paper attempts to address this gap in the literature. A method of Bayesian inference in potentially I (2) processes is presented with application to Australian money demand using a Jeffreys prior and a shrinkage prior.     

Expected Posterior Priors in Selecting the Largest Mean of the Exponential Distributions

In reliability theory or survival analysis, selecting the largest mean among many exponential distributions is an important issue. Such a problem can also be viewed as a model selection problem via the Bayesian approach. It is well known that Bayes factors under proper priors have been very successful in Bayesian model selection or testing problems. However, Bayes factors are typically invalid with respect to improper noninformative priors. Objective Bayesian criteria are thus desired. In this work, we consider to use the expected posterior priors originally proposed by Pérez and Berger (2002 Pérez , J. M. , Berger , J. ( 2002 ). Expected posterior prior distributions for model selection . Biometrika 89 : 491 – 512 .[Crossref], [Web of Science ®] , [Google Scholar]) to select the largest exponential mean. Specific expected posterior priors are derived in recursive formulas. Some simulation results are also given to illustrate the method.     

On Rates of Convergence for Posterior Distributions Under Misspecification

We extend the approach of Walker (2003 Walker , S. ( 2003 ). On sufficient conditions for Bayesian consistency . Biometrika 90 ( 2 ): 482 – 488 .[Crossref], [Web of Science ®] , [Google Scholar]); (2004 Walker , S. ( 2004 ). New approaches to Bayesian consistency . Ann. Statist. 32 ( 5 ): 2028 – 2043 .[Crossref], [Web of Science ®] , [Google Scholar]) to the case of misspecified models. A sufficient condition for establishing rates of convergence is given based on a key identity involving martingales, which does not require construction of tests. We also show roughly that the result obtained by using tests can also be obtained by our approach, which demonstrates the potential wider applicability of this method.     

Independent Quadratic Forms in 3-Variance-Component Models

This article addresses derivation and existence of quadratic forms that were suggested by Burch (2007 Burch , B. D. ( 2007 ). Generalized confidence intervals for proportions of total variance in mixed linear models . J. Statist. Plann. Infer. 137 : 2394 – 2404 .[Crossref], [Web of Science ®] , [Google Scholar]) for procedures for inference on variance components in mixed linear models in combination with generalized fiducial inference. A relatively simple algorithm leading to the required quadratic forms in a general 3-variance-component model is stated and designs for two-way ANOVA models without interactions that permit Burch's procedure are characterized. This complements developments in the original article by Burch.     

Nonparametric Interval Estimation in One-Way Random-Effects Models

The structural method provided by Hannig et al. (2006 Hannig , J. , Iyer , H. , Patterson , P. (2006). Fiducial generalized confidence intervals. J. Amer. Statist. Assoc. 101:254–269.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) has proved to be a useful tool for constructing confidence intervals. However, it is difficult to apply this method to nonparametric problems since the pivotal quantity required in using it exists only in some special parametric models. Based on an extended structural method, this article discusses nonparametric interval estimation for smooth functions of the variances in one-way random-effects models. We use the bootstrap distribution estimator of a statistic to construct an approximate pivotal equation, and prove that the confidence interval derived by the approximate pivotal equation has asymptotically correct coverage probability. Simulation results are presented and show that the normal fiducial interval is not robust against non normality and that the proposed confidence interval has better finite-sample behaviors than the naive interval based on normal approximation.     

Bayesian Alternatives to the F Test for Two Population Variances

Bayesian alternatives to the classical F test comparing two population variances are explored. Shoemaker (2003 Shoemaker , L. H. ( 2003 ). Fixing the F test for equal variances . The Amer. Statistician 57 : 105 – 114 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) suggested two adjustments to the F test due to it being very sensitive to the normal assumption of the two populations. A simulation study is performed to compare the Bayesian alternatives to the F test and Shoemaker's adjusted F tests as well as to the Levene/Brown–Forsythe and the squared rank nonparametric tests. The Bayesian alternatives assume a normal parent distribution and non informative priors and the conjugate prior for the variances; in addition, an exponential power distribution is considered as the parent distribution with a non informative prior for the variances. The latter looks to be very promising provided that a suitable value of a parameter which measures the extent of non normality is chosen.