Non-parametric bootstrap recycling

The double bootstrap provides diagnostics for bootstrap calculations and, if need be, appropriate adjustments. The amount of computation involved is usually considerable, and recycling provides a less computer intensive alternative. Recycling consists of using repeatedly the same samples drawn from a recycling distribution G for estimation under each first-level bootstrap distribution, rather than independently repeating the simulation and estimation steps for each of these.Recycling is successful in parametric applications of the bootstrap, as demonstrated by M.A. Newton and C.J. Geyer (J. Amer. Statist. Assoc. 89: 905–912, 1994). We show that it is bound to fail in non-parametric bootstrap applications, and suggest a modification that makes the method work. The modification consists of smoothing the first-level bootstrap distributions, with the desired consequence that this removes the zero probabilities in the multinomial distributions that define them. We also discuss efficient choices of recycling distributions, both in terms of estimator efficiency and simulation efficiency.     

Irregularly observed time series – some asymptotics and the block bootstrap

We consider time series being observed at random time points. In addition to Parzen's classical modelling by amplitude modulating sequences, we state another modelling using an integer-valued sequence as the observation times. Limiting results are presented for the sample mean and are generalized to the class of functions of smooth means. Motivated by the complicated limiting behaviour, (moving) block bootstrap possibilities are investigated. Conditional on the used modelling for the irregular spacings, one is lead to different interpretations for the block length and hence bootstrap approaches. The block length either can be interpreted as the time (resulting in an observation string of fixed length containing a random number of observations) or as the number of observations (resulting in an observation string of variable length containing a fixed number of values). Both bootstrap approaches are shown to be asymptotically valid for the sample mean. Numerical examples and an application to real-world ozone data conclude the study.     

Mathematical proof of the third order accuracy of the speedy double bootstrap method

Abstract

In our previous research, we proposed a speedy double bootstrap method for assessing the reliability of statistical models with maximum log-likelihood criterion. It can provide 3rd order accurate probabilities. In this study, our focus switches to the mathematical proof. We propose an alternative proof of the third order accuracy in the context of the multivariate normal model. Our proof is based on tube formula differential geometric methodology and an Taylor series approach to the asymptotic analysis of the bootstrap method.     

The power of bootstrap based tests for parameters in cointegrating regressions

Several asymptotic procedures have been suggested for inference on cointegrating parameters. But the tests based on asymptotic theory have been found to have substantial size distortions. The present paper shows that the bootstrap method gives the proper test sizes and that the power of the bootstrap based tests is satisfactory.     

Obtaining prediction intervals for FARIMA processes using the sieve bootstrap

The sieve bootstrap (SB) prediction intervals for invertible autoregressive moving average (ARMA) processes are constructed using resamples of residuals obtained by fitting a finite degree autoregressive approximation to the time series. The advantage of this approach is that it does not require the knowledge of the orders, p and q, associated with the ARMA(p, q) model. Up until recently, the application of this method has been limited to ARMA processes whose autoregressive polynomials do not have fractional unit roots. The authors, in a 2012 publication, introduced a version of the SB suitable for fractionally integrated autoregressive moving average (FARIMA (p,d,q)) processes with 0<d<0.5 and established its asymptotic validity. Herein, we study the finite sample properties this new method and compare its performance against an older method introduced by Bisaglia and Grigoletto in 2001. The sieve bootstrap (SB) method is a numerically simpler alternative to the older method which requires the estimation of p, d, and q at every bootstrap step. Monte-Carlo simulation studies, carried out under the assumption of normal, mixture of normals, and exponential distributions for the innovations, show near nominal coverages for short-term and long-term SB prediction intervals under most situations. In addition, the sieve bootstrap method yields better coverage and narrower intervals compared to the Bisaglia–Grigoletto method in some situations, especially when the error distribution is a mixture of normals.     

New block bootstrap methods: Sufficient and/or ordered

In this study, we propose sufficient time series bootstrap methods that achieve better results than conventional non-overlapping block bootstrap, but with less computing time and lower standard errors of estimation. Also, we propose using a new technique using ordered bootstrapped blocks, to better preserve the dependency structure of the original data. The performance of the proposed methods are compared in a simulation study for MA(2) and AR(2) processes and in an example. The results show that our methods are good competitors that often exhibit improved performance over the conventional block methods.     

Tests for serial correlation in mean and variance of a sequence of time series objects

In this era of Big Data, large-scale data storage provides the motivation for statisticians to analyse new types of data. The proposed work concerns testing serial correlation in a sequence of sets of time series, here referred to as time series objects. An example is serial correlation of monthly stock returns when daily stock returns are observed. One could consider a representative or summarized value of each object to measure the serial correlation, but this approach would ignore information about the variation in the observed data. We develop Kolmogorov–Smirnov-type tests with the standard bootstrap and wild bootstrap Ljung–Box test statistics for serial correlation in mean and variance of time series objects, which take the variation within a time series object into account. We study the asymptotic property of the proposed tests and present their finite sample performance using simulated and real examples.     

Generalised regression estimation via the bootstrap

A generalised regression estimation procedure is proposed that can lead to much improved estimation of population characteristics, such as quantiles, variances and coefficients of variation. The method involves conditioning on the discrepancy between an estimate of an auxiliary parameter and its known population value. The key distributional assumption is joint asymptotic normality of the estimates of the target and auxiliary parameters. This assumption implies that the relationship between the estimated target and the estimated auxiliary parameters is approximately linear with coefficients determined by their asymptotic covariance matrix. The main contribution of this paper is the use of the bootstrap to estimate these coefficients, which avoids the need for parametric distributional assumptions. First‐order correct conditional confidence intervals based on asymptotic normality can be improved upon using quantiles of a conditional double bootstrap approximation to the distribution of the studentised target parameter estimate.     

Diagnostics for Autocorrelated Regression Models

This paper discusses the local influence approach to the linear regression model with AR(1) errors. Diagnostics for the autocorrelation models and for the autocorrelation coefficient only are proposed and developed respectively, when simultaneous perturbations of the response vector are allowed. Furthermore, the direction of maximum curvature of local influence analysis is shown to be exactly the same as that in Tsai & Wu (1992) when only the autocorrelation coefficient is of special interest.     

Robust bootstrap forecast densities for GARCH returns and volatilities

Bootstrap procedures are useful to obtain forecast densities for both returns and volatilities in the context of generalized autoregressive conditional heteroscedasticity models. In this paper, we analyse the effect of additive outliers on the finite sample properties of these bootstrap densities and show that, when obtained using maximum likelihood estimates of the parameters and standard filters for the volatilities, they are badly affected with dramatic consequences on the estimation of Value-at-Risk. We propose constructing bootstrap densities for returns and volatilities using a robust parameter estimator based on variance targeting implemented together with an adequate modification of the volatility filter. We show that the performance of the proposed procedure is adequate when compared with available robust alternatives. The results are illustrated with both simulated and real data.     

Comparison of bootstrap and generalized bootstrap methods for estimating high quantiles

The generalized bootstrap is a parametric bootstrap method in which the underlying distribution function is estimated by fitting a generalized lambda distribution to the observed data. In this study, the generalized bootstrap is compared with the traditional parametric and non-parametric bootstrap methods in estimating the quantiles at different levels, especially for high quantiles. The performances of the three methods are evaluated in terms of cover rate, average interval width and standard deviation of width of the 95% bootstrap confidence intervals. Simulation results showed that the generalized bootstrap has overall better performance than the non-parametric bootstrap in high quantile estimation.     

A simple bootstrap bandwidth selector for local polynomial fitting

A new, fully data-driven bandwidth selector with a double smoothing (DS) bias term and a data-driven variance estimator is developed following the bootstrap idea. The data-driven variance estimation does not involve any additional bandwidth selection. The proposed bandwidth selector convergences faster than a plug-in one due to the DS bias estimate, whereas the data-driven variance improves its finite sample performance clearly and makes it stable. Asymptotic results of the proposals are obtained. A comparative simulation study was done to show the overall gains and the gains obtained by improving either the bias term or the variance estimate, respectively. It is shown that the use of a good variance estimator is more important when the sample size is relatively small.     

Bootstrap approaches for estimation and confidence intervals of long memory processes

In this work, we investigate an alternative bootstrap approach based on a result of Ramsey [F.L. Ramsey, Characterization of the partial autocorrelation function, Ann. Statist. 2 (1974), pp. 1296–1301] and on the Durbin–Levinson algorithm to obtain a surrogate series from linear Gaussian processes with long range dependence. We compare this bootstrap method with other existing procedures in a wide Monte Carlo experiment by estimating, parametrically and semi-parametrically, the memory parameter d. We consider Gaussian and non-Gaussian processes to prove the robustness of the method to deviations from normality. The approach is also useful to estimate confidence intervals for the memory parameter d by improving the coverage level of the interval.     

A test for fractional cointegration using the sieve bootstrap

The concept of fractional cointegration (Cheung and Lai in J Bus Econ Stat 11:103–112, 1993) has been introduced to generalize traditional cointegration (Engle and Granger in Econometrica 55:251–276, 1987) to the long memory framework. In this work we propose a test for fractional cointegration with the sieve bootstrap and compare by simulations the performance of our proposal with other semiparametric methods existing in literature: the three steps technique of Marinucci and Robinson (J Econom 105:225–247, 2001) and the procedure to determine the fractional cointegration rank of Robinson and Yajima (J Econom 106:217–241, 2002).     

Importance resampling for the smoothed bootstrap

Alternative methods of estimating properties of unknown distributions include the bootstrap and the smoothed bootstrap. In the standard bootstrap setting, Johns (1988) introduced an importance resam¬pling procedure that results in more accurate approximation to the bootstrap estimate of a distribution function or a quantile. With a suitable “exponential tilting” similar to that used by Johns, we derived a smoothed version of importance resampling in the framework of the smoothed bootstrap. Smoothed importance resampling procedures were developed for the estimation of distribution functions of the Studentized mean, the Studentized variance, and the correlation coefficient. Implementation of these procedures are presented via simulation results which concentrate on the problem of estimation of distribution functions of the Studentized mean and Studentized variance for different sample sizes and various pre-specified smoothing bandwidths for the normal data; additional simulations were conducted for the estimation of quantiles of the distribution of the Studentized mean under an optimal smoothing bandwidth when the original data were simulated from three different parent populations: lognormal, t(3) and t(10). These results suggest that in cases where it is advantageous to use the smoothed bootstrap rather than the standard bootstrap, the amount of resampling necessary might be substantially reduced by the use of importance resampling methods and the efficiency gains depend on the bandwidth used in the kernel density estimation.     

Control variates and importance sampling for efficient bootstrap simulations

Importance sampling and control variates have been used as variance reduction techniques for estimating bootstrap tail quantiles and moments, respectively. We adapt each method to apply to both quantiles and moments, and combine the methods to obtain variance reductions by factors from 4 to 30 in simulation examples.We use two innovations in control variates—interpreting control variates as a re-weighting method, and the implementation of control variates using the saddlepoint; the combination requires only the linear saddlepoint but applies to general statistics, and produces estimates with accuracy of order n ^-1/2 B ^-1, where n is the sample size and B is the bootstrap sample size.We discuss two modifications to classical importance sampling—a weighted average estimate and a mixture design distribution. These modifications make importance sampling robust and allow moments to be estimated from the same bootstrap simulation used to estimate quantiles.     

The stationary bootstrap for the joint distribution of sum and maximum of stationary sequences

In this work, the stationary bootstrap procedure is used to estimate the joint distribution of sum and maximum of strictly stationary strong mixing sequences. Asymptotic validity is established for stationary bootstrapping of the joint distribution of sum and maximum.     

Test for the existence of finite moments via bootstrap

This paper develops a bootstrap hypothesis test for the existence of finite moments of a random variable, which is nonparametric and applicable to both independent and dependent data. The test is based on a property in bootstrap asymptotic theory, in which the m out of n bootstrap sample mean is asymptotically normal when the variance of the observations is finite. Consistency of the test is established. Monte Carlo simulations are conducted to illustrate the finite sample performance and compare it with alternative methods available in the literature. Applications to financial data are performed for illustration.