Bootstrap diagnostics and remedies

Bootstrap diagnostics are used to assess the reliability of bootstrap calculations and may suggest useful modified calculations when these are possible. Concern focuses on susceptibility to peculiarities in data, incorrectness of a resampling model, incorrect use of resampling simulation output, and inherent inaccuracy of the bootstrap approach. The last involves issues such as inconsistency of a bootstrap method, the order of correctness of a consistent bootstrap method, and approximate pivotality. The authors review here some of these problems, provide workable diagnostic methods where possible, and discuss fast and simple ways to effect the necessary computations.     

Approaching in Distribution with Applications to Resampling of Stochastic Processes

We introduce the notion of weak approaching and conditionally weak approaching sequences of random processes. This notion generalizes the conventional weak convergence, and has been proposed for real valued random variables in Belyaev (1995). Some of the standard tools for an investigation of the behaviour of weak approaching sequences of random elements in metric spaces are developed. The spaces of smoothed and right-continuous functions with left-hand limits are considered. This technique allows us to use the resampling approach for an evaluation of distributions of continuous functionals on realizations of sum of an increasing number of independent random processes. Two numerical examples are presented for such functionals as supremum and number of level crossings.     

On the Bootstrap and Monotone Likelihood in the Cox Proportional Hazards Regression Model

Recent literature has provided encouragement for using the bootstrap for inference on regression parameters in the Cox proportional hazards (PH) model. However, generating and performing the necessary partial likelihood computations on multitudinous bootstrap samples greatly increases the chances of incurring problems with monotone likelihood at some point in the analysis. The only symptom of monotone likelihood may be a failure to converge in the numerical maximization procedure, and so the problem might naively be dismissed by deleting the offending data set and replacing it with a new one. This strategy is shown to lead to potentially high selection biases in the subsequent summary statistics. This note discusses the importance of keeping track of these monotone likelihood cases and provides recommendations for their use in interpreting bootstrap findings, and for avoiding unwanted biases that may result from high rates of occurrence. In many cases, high monotone likelihood rates indicate that a more highly-specified model may be preferred. Special consideration is given to the problem of high monotone likelihood incidence in Monte Carlo studies of the bootstrap.     

On the bootstrap in cube root asymptotics

The authors study the application of the bootstrap to a class of estimators which converge at a nonstandard rate to a nonstandard distribution. They provide a theoretical framework to study its asymptotic behaviour. A simulation study shows that in the case of an estimator such as Chernoff's estimator of the mode, usually the basic bootstrap confidence intervals drastically undercover while the percentile bootstrap intervals overcover. This is a rare instance where basic and percentile confidence intervals, which have exactly the same length, behave in a very different way. In the case of Chernoff's estimator, if the distribution is symmetric, it is possible to bootstrap from a smooth symmetric estimator of the distribution for which the basic bootstrap confidence intervals will have the claimed coverage probability while the percentile bootstrap interval will have an asymptotic coverage of 1!     

Estimation of a finite population distribution function based on a linear model with unknown heteroscedastic errors

The authors consider a finite population ρ = {(Y_k, x_k), k = 1,…,N} conforming to a linear superpopulation model with unknown heteroscedastic errors, the variances of which are values of a smooth enough function of the auxiliary variable X for their nonparametric estimation. They describe a method of the Chambers‐Dunstan type for estimation of the distribution of {Y_k, k = 1,…, N} from a sample drawn from without replacement, and determine the asymptotic distribution of its estimation error. They also consider estimation of its mean squared error in particular cases, evaluating both the analytical estimator derived by “plugging‐in” the asymptotic variance, and a bootstrap approach that is also applicable to estimation of parameters other than mean squared error. These proposed methods are compared with some common competitors in simulation studies.     

Improved Sampling-Importance Resampling and Reduced Bias Importance Sampling

Abstract.  The sampling-importance resampling (SIR) algorithm aims at drawing a random sample from a target distribution π. First, a sample is drawn from a proposal distribution q , and then from this a smaller sample is drawn with sample probabilities proportional to the importance ratios π/ q . We propose here a simple adjustment of the sample probabilities and show that this gives faster convergence. The results indicate that our version converges better also for small sample sizes. The SIR algorithms are compared with the Metropolis–Hastings (MH) algorithm with independent proposals. Although MH converges asymptotically faster, the results indicate that our improved SIR version is better than MH for small sample sizes. We also establish a connection between the SIR algorithms and importance sampling with normalized weights. We show that the use of adjusted SIR sample probabilities as importance weights reduces the bias of the importance sampling estimate.     

On bootstrap confidence limits for possibly skew distributed statistics

Statistics for which confidence limits or tests are calculated by bootstrap techniques frequently have asymmetric distributions. Approaches based only on boot-strapped variance are inadequatein such cases. In a Mte. Carlo study with a markedly skew X²-distributed statistic an approach by Edgeworth expansions using bootstrapped estimates of variance and skewness of the statistic's distribution performed well with respect to size and power and is proposed for variaus applications.     

Parametric bootstrap inferences for panel data models

This article presents parametric bootstrap (PB) approaches for hypothesis testing and interval estimation for the regression coefficients and the variance components of panel data regression models with complete panels. The PB pivot variables are proposed based on sufficient statistics of the parameters. On the other hand, we also derive generalized inferences and improved generalized inferences for variance components in this article. Some simulation results are presented to compare the performance of the PB approaches with the generalized inferences. Our studies show that the PB approaches perform satisfactorily for various sample sizes and parameter configurations, and the performance of PB approaches is mostly the same as that of generalized inferences with respect to the expected lengths and powers. The PB inferences have almost exact coverage probabilities and Type I error rates. Furthermore, the PB procedure can be simply carried out by a few simulation steps, and the derivation is easier to understand and to be extended to the incomplete panels. Finally, the proposed approaches are illustrated by using a real data example.     

基于高维分步投影的多重分区聚类算法

基于数据分布密度划分的聚类算法是数据挖掘聚类算法中的主要方法之一。针对传统密度划分聚类算法存在运算复杂、运行效率不高等缺陷,设计出高维分步投影的多重分区聚类算法;以高维分布投影密度为依据,对数据集进行多重分区产生数据集的子簇空间,并进行子簇合并形成了理想的聚类结果;依据算法进行实验,结果证明该算法具有运算简单和运行效率高等优良性。