Analytical approximations for iterated bootstrap confidence intervals

Standard algorithms for the construction of iterated bootstrap confidence intervals are computationally very demanding, requiring nested levels of bootstrap resampling. We propose an alternative approach to constructing double bootstrap confidence intervals that involves replacing the inner level of resampling by an analytical approximation. This approximation is based on saddlepoint methods and a tail probability approximation of DiCiccio and Martin (1991). Our technique significantly reduces the computational expense of iterated bootstrap calculations. A formal algorithm for the construction of our approximate iterated bootstrap confidence intervals is presented, and some crucial practical issues arising in its implementation are discussed. Our procedure is illustrated in the case of constructing confidence intervals for ratios of means using both real and simulated data. We repeat an experiment of Schenker (1985) involving the construction of bootstrap confidence intervals for a variance and demonstrate that our technique makes feasible the construction of accurate bootstrap confidence intervals in that context. Finally, we investigate the use of our technique in a more complex setting, that of constructing confidence intervals for a correlation coefficient.     

Confidence intervals following Box-Cox transformation

What is the interpretation of a confidence interval following estimation of a Box-Cox transformation parameter λ? Several authors have argued that confidence intervals for linear model parameters ψ can be constructed as if λ. were known in advance, rather than estimated, provided the estimand is interpreted conditionally given $\hat \lambda$. If the estimand is defined as $\psi \left( {\hat \lambda } \right)$, a function of the estimated transformation, can the nominal confidence level be regarded as a conditional coverage probability given $\hat \lambda$, where the interval is random and the estimand is fixed? Or should it be regarded as an unconditional probability, where both the interval and the estimand are random? This article investigates these questions via large-n approximations, small- σ approximations, and simulations. It is shown that, when model assumptions are satisfied and n is large, the nominal confidence level closely approximates the conditional coverage probability. When n is small, this conditional approximation is still good for regression models with small error variance. The conditional approximation can be poor for regression models with moderate error variance and single-factor ANOVA models with small to moderate error variance. In these situations the nominal confidence level still provides a good approximation for the unconditional coverage probability. This suggests that, while the estimand may be interpreted conditionally, the confidence level should sometimes be interpreted unconditionally.     

Confidence and prediction intervals based on interpolated records

In several statistical problems, nonparametric confidence intervals for population quantiles can be constructed and their coverage probabilities can be computed exactly, but cannot in general be rendered equal to a pre-determined level. The same difficulty arises for coverage probabilities of nonparametric prediction intervals for future observations. One solution to this difficulty is to interpolate between intervals which have the closest coverage probability from above and below to the pre-determined level. In this paper, confidence intervals for population quantiles are constructed based on interpolated upper and lower records. Subsequently, prediction intervals are obtained for future upper records based on interpolated upper records. Additionally, we derive upper bounds for the coverage error of these confidence and prediction intervals. Finally, our results are applied to some real data sets. Also, a comparison via a simulation study is done with similar classical intervals obtained before.     

Estimation of a population size through capture-mark-recapture method: a comparison of various point and interval estimators

This article deals with the estimation of a fixed population size through capture-mark-recapture method that gives rise to hypergeometric distribution. There are a few well-known and popular point estimators available in the literature, but no good comprehensive comparison is available about their merits. Apart from the available estimators, an empirical Bayes (EB) estimator of the population size is proposed. We compare all the point estimators in terms of relative bias and relative mean squared error. Next, two new interval estimators – (a) an EB highest posterior distribution interval and (b) a frequentist interval estimator based on a parametric bootstrap method, are proposed. The comparison is then carried among the two proposed interval estimators and interval estimators derived from the currently available estimators in terms of coverage probability and average length (AL). Based on comprehensive numerical results, we rank and recommend the point estimators as well as interval estimators for practical use. Finally, a real-life data set for a green treefrog population is used as a demonstration for all the methods discussed.     

Parametric bootstrap inferences for the growth curve models with intraclass correlation structure

This paper presents parametric bootstrap (PB) approaches for hypothesis testing and interval estimation of the fixed effects and the variance component in the growth curve models with intraclass correlation structure. The PB pivot variables are proposed based on the sufficient statistics of the parameters. Some simulation results are presented to compare the performance of the proposed approaches with the generalized inferences. Our studies show that the PB approaches perform satisfactorily for various cell sizes and parameter configurations, and tends to outperform the generalized inferences with respect to the coverage probabilities and powers. The PB approaches not only have almost exact coverage probabilities and Type I error rates, but also have the shorter expected lengths and the higher powers. Furthermore, the PB procedure can be simply carried out by a few simulation steps. Finally, the proposed approaches are illustrated by using a real data example.     

The large sample coverage probability of confidence intervals in general regression models after a preliminary hypothesis test

We derive a computationally convenient formula for the large sample coverage probability of a confidence interval for a scalar parameter of interest following a preliminary hypothesis test that a specified vector parameter takes a given value in a general regression model. Previously, this large sample coverage probability could only be estimated by simulation. Our formula only requires the evaluation, by numerical integration, of either a double or a triple integral, irrespective of the dimension of this specified vector parameter. We illustrate the application of this formula to a confidence interval for the odds ratio of myocardial infarction when the exposure is recent oral contraceptive use, following a preliminary test where two specified interactions in a logistic regression model are zero. For this real‐life data, we compare this large sample coverage probability with the actual coverage probability of this confidence interval, obtained by simulation.     

On a class of m out of n bootstrap confidence intervals

It is widely known that bootstrap failure can often be remedied by using a technique known as the ' m out of n ' bootstrap, by which a smaller number, m say, of observations are resampled from the original sample of size n . In successful cases of the bootstrap, the m out of n bootstrap is often deemed unnecessary. We show that the problem of constructing nonparametric confidence intervals is an exceptional case. By considering a new class of m out of n bootstrap confidence limits, we develop a computationally efficient approach based on the double bootstrap to construct the optimal m out of n bootstrap intervals. We show that the optimal intervals have a coverage accuracy which is comparable with that of the classical double-bootstrap intervals, and we conduct a simulation study to examine their performance. The results are in general very encouraging. Alternative approaches which yield even higher order accuracy are also discussed.     

Importance resampling for the smoothed bootstrap

Alternative methods of estimating properties of unknown distributions include the bootstrap and the smoothed bootstrap. In the standard bootstrap setting, Johns (1988) introduced an importance resam¬pling procedure that results in more accurate approximation to the bootstrap estimate of a distribution function or a quantile. With a suitable “exponential tilting” similar to that used by Johns, we derived a smoothed version of importance resampling in the framework of the smoothed bootstrap. Smoothed importance resampling procedures were developed for the estimation of distribution functions of the Studentized mean, the Studentized variance, and the correlation coefficient. Implementation of these procedures are presented via simulation results which concentrate on the problem of estimation of distribution functions of the Studentized mean and Studentized variance for different sample sizes and various pre-specified smoothing bandwidths for the normal data; additional simulations were conducted for the estimation of quantiles of the distribution of the Studentized mean under an optimal smoothing bandwidth when the original data were simulated from three different parent populations: lognormal, t(3) and t(10). These results suggest that in cases where it is advantageous to use the smoothed bootstrap rather than the standard bootstrap, the amount of resampling necessary might be substantially reduced by the use of importance resampling methods and the efficiency gains depend on the bandwidth used in the kernel density estimation.     

Studentized bootstrap confidence intervals based on M-estimates

This article reviews and applies saddlepoint approximations to studentized confidence intervals based on robust M-estimates. The latter are known to be very accurate without needing standard theory assumptions. As examples, the classical studentized statistic, the studentized versions of Huber's M-estimate of location, of its initially MAD scaled version and of Huber's proposal 2 are considered. The aim is to know whether the studentized statistics yield robust confidence intervals with coverages close to nominal, with short intervals. The results of an extensive simulation study and the recommendations for practical use given in this article may fill gaps in the current literature and stimulate further discussion and research.     

Confidence intervals for a bounded mean in exponential families

Setting confidence bounds or intervals for a parameter in a restricted parameter space is an important issue in applications and is widely discussed in the recent literature. In this article, we focus on the distributions in the exponential families, and propose general forms of the truncated Pratt interval and rp interval for the means. We take the Poisson distribution as an example to illustrate the method and compare it with the other existing intervals. Besides possessing the merits from the theoretical inferences, the proposed intervals are also shown to be competitive approaches from simulation and real-data application studies.     

Test inversion bootstrap confidence intervals

In this paper we explore the theoretical and practical implications of using bootstrap test inversion to construct confidence intervals. In the presence of nuisance parameters, we show that the coverage error of such intervals is O ( n ^−1/2) which may be reduced to O ( n ⁻¹) if a Studentized statistic is used. We present three simulation studies and compare the performance of test inversion methods with established methods on the problem of estimating a confidence interval for the dose–response parameter in models of the Japanese atomic bomb survivors data.     

The performance of model averaged tail area confidence intervals

We investigate the exact coverage and expected length properties of the model averaged tail area (MATA) confidence interval proposed by Turek and Fletcher, CSDA, 2012, in the context of two nested, normal linear regression models. The simpler model is obtained by applying a single linear constraint on the regression parameter vector of the full model. For given length of response vector and nominal coverage of the MATA confidence interval, we consider all possible models of this type and all possible true parameter values, together with a wide class of design matrices and parameters of interest. Our results show that, while not ideal, MATA confidence intervals perform surprisingly well in our regression scenario, provided that we use the minimum weight within the class of weights that we consider on the simpler model.     

Prediction intervals for time series models with trend via sieve bootstrap

This paper discusses method for constructing the prediction intervals for time series model with trend using the sieve bootstrap procedure. Gasser–Müller type of kernel estimator is used for trend estimation and prediction. The boundary modification of the kernel is applied to control the edge effect and to construct the predictor of a trend.     

Confidence intervals for impulse responses under departures from normality

Monte Carlo evidence shows that in structural VAR models with fat-tailed or skewed innovations the coverage accuracy of impulse response confidence intervals may deterorate substantially compared to the same model with Gaussian innovations. Empirical evidance suggests that such departures from normality are quite plausible for economic time series. The simulation results suggest that applied researchers are best off using nonparametric bootstrap intervals for impulse responses, regardless of whether or not there is evidence of fat tails or skewness in the error distribution. Allowing for departures from normality is shown to considerably weaken the evidence of the delayed overshooting puzzle in Eichenbaum and Evans (1995).     

Confidence intervals for the mean of a normal distribution with restricted parameter space

For a normal distribution with known variance, the standard confidence interval of the location parameter is derived from the classical Neyman procedure. When the parameter space is known to be restricted, the standard confidence interval is arguably unsatisfactory. Recent articles have addressed this problem and proposed confidence intervals for the mean of a normal distribution where the parameter space is not less than zero. In this article, we propose a new confidence interval, rp interval, and derive the Bayesian credible interval and likelihood ratio interval for general restricted parameter space. We compare these intervals with the standard interval and the minimax interval. Simulation studies are undertaken to assess the performances of these confidence intervals.     

Improving the finite sample performance of autoregression estimators in dynamic factor models: A bootstrap approach

We investigate the finite sample properties of the estimator of a persistence parameter of an unobservable common factor when the factor is estimated by the principal components method. When the number of cross-sectional observations is not sufficiently large, relative to the number of time series observations, the autoregressive coefficient estimator of a positively autocorrelated factor is biased downward, and the bias becomes larger for a more persistent factor. Based on theoretical and simulation analyses, we show that bootstrap procedures are effective in reducing the bias, and bootstrap confidence intervals outperform naive asymptotic confidence intervals in terms of the coverage probability.     

Inferences on the common mean of several heterogeneous log-normal distributions

We consider the problem of making inferences on the common mean of several heterogeneous log-normal populations. We apply the parametric bootstrap (PB) approach and the method of variance estimate recovery (MOVER) to construct confidence intervals for the log-normal common mean. We then compare the performances of the proposed confidence intervals with the existing confidence intervals via an extensive simulation study. Simulation results show that our proposed MOVER and PB confidence intervals can be recommended generally for different sample sizes and number of populations.     

Confidence intervals for estimating the population signal-to-noise ratio: a simulation study

This paper considered several confidence intervals for estimating the population signal-to-noise ratio based on parametric, non-parametric and modified methods. A simulation study has been conducted to compare the performance of the interval estimators under both symmetric and skewed distributions. We reported coverage probability and average width of the interval estimators. Based on the simulation study, we observed that some of our proposed interval estimators are performing better in the sense of smaller width and coverage probability and have been recommended for the researchers.     

On the construction of nonparametric density function estimators using the bootstrap

The derivation of a new class of nonparametric density function estimators, the so-called bootstrap functional estimators (BFE's), is given. These estimators are shown to be strongly consistent under fairly nonrestrictive conditions. Some small-sample properties are discussed and a number of graphs are presented.