PROBLEMS WITH BINOMIAL TWO-SIDED TESTS AND THE ASSOCIATED CONFIDENCE INTERVALS

Confidence intervals for parameters of distributions with discrete sample spaces will be less conservative (i.e. have smaller coverage probabilities that are closer to the nominal level) when defined by inverting a test that does not require equal probability in each tail. However, the P‐value obtained from such tests can exhibit undesirable properties, which in turn result in undesirable properties in the associated confidence intervals. We illustrate these difficulties using P‐values for binomial proportions and the difference between binomial proportions.     

SIMULATIONS AND DERIVED APPROXIMATIONS FOR THE MEANS AND STANDARD DEVIATIONS OF THE CHARACTERISTIC ROOTS OF A WISHART MATRIX

Monte Carlo simulations were done to estimate the means and standard deviations of the characteristic roots of a Wishart matrix which can be used in computing tests of hypotheses concerning multiplicative terms in balanced linear-bilinear (multiplicative) models for an m × n table of data. In this report we extend the previous results (Mandel, 1971; Cornelius, 1980) to r ≤ 199, c ≤ 149 or r ≤ 149, c ≤ 199, where r and c are row and column degrees of freedom, respectively, of the two-way array of residuals (with total degrees of freedom rc) after fitting the linear effects. For 187 combinations of r and c at intervals over this domain, we used 5000 simulations to estimate expectations and standard deviations of the Wishart roots. Using weighted linear regression variable selection techniques, symmetric functions of r and c were obtained for approximating the simulated means and standard deviations. Use of these approximating functions will avoid the need for reference to tables for input to computer programs which require these values for tests of significance of sequentially fitted terms in the analyses of balanced linear-bilinear models.     

Usual and Shortest Confidence Intervals on Odds Ratios from Logistic Regression

Based on the large-sample normal distribution of the sample log odds ratio and its asymptotic variance from maximum likelihood logistic regression, shortest 95% confidence intervals for the odds ratio are developed. Although the usual confidence interval on the odds ratio is unbiased, the shortest interval is not. That is, while covering the true odds ratio with the stated probability, the shortest interval covers some values below the true odds ratio with higher probability. The upper and lower limits of the shortest interval are shifted to the left of those of the usual interval, with greater shifts in the upper limits. With the log odds model γ + Xβ, in which X is binary, simulation studies showed that the approximate average percent difference in length is 7.4% for n (sample size) = 100, and 3.8% for n = 200. Precise estimates of the covering probabilities of the two types of intervals were obtained from simulation studies, and are compared graphically. For odds ratio estimates greater (less) than one, shortest intervals are more (less) likely to include one than are the usual intervals. The usual intervals are likelihood-based and the shortest intervals are not. The usual intervals have minimum expected length among the class of unbiased intervals. Shortest intervals do not provide important advantages over the usual intervals, which we recommend for practical use.     

Distribution-free confidence intervals for quantiles and tolerance intervals in terms of k-records

In this paper, we consider the problem of determining non-parametric confidence intervals for quantiles when available data are in the form of k-records. Distribution-free confidence intervals as well as lower and upper confidence limits are derived for fixed quantiles of an arbitrary unknown distribution based on k-records of an independent and identically distributed sequence from that distribution. The construction of tolerance intervals and limits based on k-records is also discussed. An exact expression for the confidence coefficient of these intervals are derived. Some tables are also provided to assist in choosing the appropriate k-records for the construction of these confidence intervals and tolerance intervals. Some simulation results are presented to point out some of the features and properties of these intervals. Finally, the data, representing the records of the amount of annual rainfall in inches recorded at Los Angeles Civic Center, are used to illustrate all the results developed in this paper and also to demonstrate the improvements that they provide on those based on either the usual records or the current records.     

Approximate Bayesianity of Frequentist Confidence Intervals for a Binomial Proportion

The well-known Wilson and Agresti–Coull confidence intervals for a binomial proportion p are centered around a Bayesian estimator. Using this as a starting point, similarities between frequentist confidence intervals for proportions and Bayesian credible intervals based on low-informative priors are studied using asymptotic expansions. A Bayesian motivation for a large class of frequentist confidence intervals is provided. It is shown that the likelihood ratio interval for p approximates a Bayesian credible interval based on Kerman’s neutral noninformative conjugate prior up to O(n^{? 1}) in the confidence bounds. For the significance level α ? 0.317, the Bayesian interval based on the Jeffreys’ prior is then shown to be a compromise between the likelihood ratio and Wilson intervals. Supplementary materials for this article are available online.     

Prediction intervals for the future record values from exponential distribution: comparative study

!n this paper we consider the predicf an problem of the future nth record value based an the first m (m < n) observed record values from one-parameter exponential distribution. We introduce four procedures for obtaining prediction intervals for the nth record value. The performance of the so obtained intervals is assessed through numerical and simulation studies. In these studies, we provide the means and standard errors of lower limits. upper limits and lengths of prediction intervals. Further, we check the validation of these intervals based on some point predictors.     

Prediction intervals for farima processes by bootstrap methods

In this paper we introduce a procedure to compute prediction intervals for FARIMA (p d q) processes, taking into account the variability due to model identification and parameter estimation. To this aim, a particular bootstrap technique is developed. The performance of the prediction intervals is then assessed and compared to that of stand­ard bootstrap percentile intervals. The methods are applied to the time series of Nile River annual minima.     

Stabilizing bootstrap‐t confidence intervals for small samples

A major use of the bootstrap methodology is in the construction of nonparametric confidence intervals. Although no consensus has yet been reached on the best way to proceed, theoretical and empirical evidence indicate that bootstra.‐t intervals provide a reasonable solution to this problem. However, when applied to small data sets, these intervals can be unusually wide and unstable. The author presents techniques for stabilizing bootstra.‐t intervals for small samples. His methods are motivated theoretically and investigated though simulations.     

βExpectation and β-content tolerance intervals for dependent observations

Methods of constructing exact tolerance intervals (β-expectation and β-content) for independent observations are well known. For the case of dependent observations, obtaining exact results is not possible. In this article we provide an approximate method of constructing β-expectation tolerance intervals via a Taylor series expansion. Examples of independent observations are considered to compare the intervals constructed with those obtained by the exact method. For the case of non-stationary type processes we have proposed a method of constructing approximate β-content tolerance intervals. Once again an example is given to illustrate the results.     

Some results on bootstrap prediction intervals

We investigate the construction of a BC_a-type bootstrap procedure for setting approximate prediction intervals for an efficient estimator θ_m of a scalar parameter θ, based on a future sample of size m. The results are also extended to nonparametric situations, which can be used to form bootstrap prediction intervals for a large class of statistics. These intervals are transformation-respecting and range-preserving. The asymptotic performance of our procedure is assessed by allowing both the past and future sample sizes to tend to infinity. The resulting intervals are then shown to be second-order correct and second-order accurate. These second-order properties are established in terms of min(m, n), and not the past sample size n alone.     

Nonparametric confidence intervals for quantiles and quantile intervals from inversely sampled record breaking data in a multi-sample plan

There are a number of situations in which an observation is retained only if it is a record value, which include studies in industrial quality control experiments, destructive stress testing, meteorology, hydrology, seismology, athletic events and mining. When the number of records is fixed in advance, the data are referred to as inversely sampled record-breaking data. In this paper, we study the problems of constructing the nonparametric confidence intervals for quantiles and quantile intervals of the parent distribution based on record data. For a single record-breaking sample, the confidence coefficients of the confidence intervals for the pth quantile cannot exceed p and 1?p, on the basis of upper and lower records, respectively; hence, replication is required. So, we develop the procedure based on k independent record-breaking samples. Various cases have been studied and in each case, the optimal k and the exact nonparametric confidence intervals are obtained, and exact expressions for the confidence coefficients of these confidence intervals are derived. Finally, the results are illustrated by numerical computations.     

MODELING AND ESTIMATING VARIANCES IN REGRESSION

ABSTRACT

It is well known that ignoring heteroscedasticity in regression analysis adversely affects the efficiency of estimation and renders the usual procedure for constructing prediction intervals inappropriate. In some applications, such as off-line quality control, knowledge of the variance function is also of considerable interest in its own right. Thus the modeling of variance constitutes an important part of regression analysis. A common practice in modeling variance is to assume that a certain function of the variance can be closely approximated by a function of a known parametric form. The logarithm link function is often used even if it does not fit the observed variation satisfactorily, as other alternatives may yield negative estimated variances. In this paper we propose a rich class of link functions for more flexible variance modeling which alleviates the major difficulty of negative variances. We suggest also an alternative analysis for heteroscedastic regression models that exploits the principle of “separation” discussed in Box (Signal-to-Noise Ratios, Performance Criteria and Transformation. Technometrics 1988, 30, 1–31). The proposed method does not require any distributional assumptions once an appropriate link function for modeling variance has been chosen. Unlike the analysis in Box (Signal-to-Noise Ratios, Performance Criteria and Transformation. Technometrics 1988, 30, 1–31), the estimated variances and their associated asymptotic variances are found in the original metric (although a transformation has been applied to achieve separation in a different scale), making interpretation of results considerably easier.     

Confidence intervals for the ratio of two variances

In this paper we consider confidence intervals for the ratio of two population variances. We propose a confidence interval for the ratio of two variances based on the t-statistic by deriving its Edgeworth expansion and considering Hall's and Johnson's transformations. Then, we consider the coverage accuracy of suggested intervals and intervals based on the F-statistic for some distributions.     

Convergence criteria for interval-valued inequality indices

In this paper we introduce an interval-valued inequality index for random intervals based on a convex function. We show that if this function does not grow faster than x ^p , then the inequality index is continuous on the space of random intervals with finite p-th moment. A bound for the distance between the inequality indices of two random intervals is also constructed. An example is presented to motivate and illustrate the developments in this paper.     

Small-sample intervals for regression

For the general linear regression model Y = Xη + e, we construct small-sample exponentially tilted empirical confidence intervals for a linear parameter 6 = a^Tη and for nonlinear functions of η. The coverage error for the intervals is O_p(1/n), as shown in Tingley and Field (1990). The technique, though sample-based, does not require bootstrap resampling. The first step is calculation of an estimate for η. We have used a Mallows estimate. The algorithm applies whenever η is estimated as the solution of a system of equations having expected value 0. We include calculations of the relative efficiency of the estimator (compared with the classical least-squares estimate). The intervals are compared with asymptotic intervals as found, for example, in Hampel et at. (1986). We demonstrate that the procedure gives sensible intervals for small samples.     

Coverage‐adjusted Confidence Intervals for a Binomial Proportion

We consider the classic problem of interval estimation of a proportion p based on binomial sampling. The ‘exact’ Clopper–Pearson confidence interval for p is known to be unnecessarily conservative. We propose coverage adjustments of the Clopper–Pearson interval that incorporate prior or posterior beliefs into the interval. Using heatmap‐type plots for comparing confidence intervals, we show that the coverage‐adjusted intervals have satisfying coverage and shorter expected lengths than competing intervals found in the literature.     

One and two sample confidence intervals for estimating the mean of skewed populations: an empirical comparative study

In this paper we consider and propose some confidence intervals for estimating the mean or difference of means of skewed populations. We extend the median t interval to the two sample problem. Further, we suggest using the bootstrap to find the critical points for use in the calculation of median t intervals. A simulation study has been made to compare the performance of the intervals and a real life example has been considered to illustrate the application of the methods.     

New bootstrap confidence intervals for means of positively skewed distributions

ABSTRACT

In this paper, we consider the problem of constructing non parametric confidence intervals for the mean of a positively skewed distribution. We suggest calibrated, smoothed bootstrap upper and lower percentile confidence intervals. For the theoretical properties, we show that the proposed one-sided confidence intervals have coverage probability α + O(n^{? 3/2}). This is an improvement upon the traditional bootstrap confidence intervals in terms of coverage probability. A version smoothed approach is also considered for constructing a two-sided confidence interval and its theoretical properties are also studied. A simulation study is performed to illustrate the performance of our confidence interval methods. We then apply the methods to a real data set.     

Comparing point and interval estimates in the bivariate <Emphasis Type="Italic">t</Emphasis>-copula model with application to financial data

The paper considers joint maximum likelihood (ML) and semiparametric (SP) estimation of copula parameters in a bivariate t-copula. Analytical expressions for the asymptotic covariance matrix involving integrals over special functions are derived, which can be evaluated numerically. These direct evaluations of the Fisher information matrix are compared to Hessian evaluations based on numerical differentiation in a simulation study showing a satisfactory performance of the computationally less demanding Hessian evaluations. Individual asymptotic confidence intervals for the t-copula parameters and the corresponding tail dependence coefficient are derived. For two financial datasets these confidence intervals are calculated using both direct evaluation of the Fisher information and numerical evaluation of the Hessian matrix. These confidence intervals are compared to parametric and nonparametric BCA bootstrap intervals based on ML and SP estimation, respectively, showing a preference for asymptotic confidence intervals based on numerical Hessian evaluations.     

Charting small sample characteristics of asymptotic confidence intervals for the binomial parameterp

Small sample properties of seven confidence intervals for the binomial parameterp (based on various normal approximations) and of the Clopper-Pearson interval are compared. Coverage probabilities and expected lower and upper limits of the intervals are graphically displayed as functions of the binomial parameterp for various sample sizes.