Saddlepoint-Based Bootstrap Inference for Quadratic Estimating Equations

Abstract.  We propose an easy to implement method for making small sample parametric inference about the root of an estimating equation expressible as a quadratic form in normal random variables. It is based on saddlepoint approximations to the distribution of the estimating equation whose unique root is a parameter's maximum likelihood estimator (MLE), while substituting conditional MLEs for the remaining (nuisance) parameters. Monotoncity of the estimating equation in its parameter argument enables us to relate these approximations to those for the estimator of interest. The proposed method is equivalent to a parametric bootstrap percentile approach where Monte Carlo simulation is replaced by saddlepoint approximation. It finds applications in many areas of statistics including, nonlinear regression, time series analysis, inference on ratios of regression parameters in linear models and calibration. We demonstrate the method in the context of some classical examples from nonlinear regression models and ratios of regression parameter problems. Simulation results for these show that the proposed method, apart from being generally easier to implement, yields confidence intervals with lengths and coverage probabilities that compare favourably with those obtained from several competing methods proposed in the literature over the past half-century.     

Estimating the number of clusters

Hartigan (1975) defines the number q of clusters in a d ‐variate statistical population as the number of connected components of the set {f > c}, where f denotes the underlying density function on R^d and c is a given constant. Some usual cluster algorithms treat q as an input which must be given in advance. The authors propose a method for estimating this parameter which is based on the computation of the number of connected components of an estimate of {f > c}. This set estimator is constructed as a union of balls with centres at an appropriate subsample which is selected via a nonparametric density estimator of f. The asymptotic behaviour of the proposed method is analyzed. A simulation study and an example with real data are also included.     

Modeling longitudinal count data with dropouts

This paper explores the utility of different approaches for modeling longitudinal count data with dropouts arising from a clinical study for the treatment of actinic keratosis lesions on the face and balding scalp. A feature of these data is that as the disease for subjects on the active arm improves their data show larger dispersion compared with those on the vehicle, exhibiting an over‐dispersion relative to the Poisson distribution. After fitting the marginal (or population averaged) model using the generalized estimating equation (GEE), we note that inferences from such a model might be biased as dropouts are treatment related. Then, we consider using a weighted GEE (WGEE) where each subject's contribution to the analysis is weighted inversely by the subject's probability of dropout. Based on the model findings, we argue that the WGEE might not address the concerns about the impact of dropouts on the efficacy findings when dropouts are treatment related. As an alternative, we consider likelihood‐based inference where random effects are added to the model to allow for heterogeneity across subjects. Finally, we consider a transition model where, unlike the previous approaches that model the log‐link function of the mean response, we model the subject's actual lesion counts. This model is an extension of the Poisson autoregressive model of order 1, where the autoregressive parameter is taken to be a function of treatment as well as other covariates to induce different dispersions and correlations for the two treatment arms. We conclude with a discussion about model selection. Published in 2009 by John Wiley & Sons, Ltd.     

Bootstrap procedures in a spatial-temporal model

Two bootstrap procedures are introduced into the hybrid of the backfitting algorithm and the Cochrane–Orcutt procedure in the estimation of a spatial-temporal model. The use of time blocks of consecutive observations in resampling steps proved to be optimal in terms of stability and efficiency of estimates. Between iterations, there were minimal changes in the empirical distributions of the parameter estimates associated with the covariate and temporal effects indicating convergence of the algorithm. Crop yield data are used to illustrate the proposed methods.

The simulation study indicated that prediction error from the fitted model (estimated from either Method 1 or Method 2) is very low. Also, the prediction error is relatively robust to the number of spatial units and the number of time points.     

Obtaining prediction intervals for FARIMA processes using the sieve bootstrap

The sieve bootstrap (SB) prediction intervals for invertible autoregressive moving average (ARMA) processes are constructed using resamples of residuals obtained by fitting a finite degree autoregressive approximation to the time series. The advantage of this approach is that it does not require the knowledge of the orders, p and q, associated with the ARMA(p, q) model. Up until recently, the application of this method has been limited to ARMA processes whose autoregressive polynomials do not have fractional unit roots. The authors, in a 2012 publication, introduced a version of the SB suitable for fractionally integrated autoregressive moving average (FARIMA (p,d,q)) processes with 0<d<0.5 and established its asymptotic validity. Herein, we study the finite sample properties this new method and compare its performance against an older method introduced by Bisaglia and Grigoletto in 2001. The sieve bootstrap (SB) method is a numerically simpler alternative to the older method which requires the estimation of p, d, and q at every bootstrap step. Monte-Carlo simulation studies, carried out under the assumption of normal, mixture of normals, and exponential distributions for the innovations, show near nominal coverages for short-term and long-term SB prediction intervals under most situations. In addition, the sieve bootstrap method yields better coverage and narrower intervals compared to the Bisaglia–Grigoletto method in some situations, especially when the error distribution is a mixture of normals.     

Recovery of inter-block information: extensions in a two variance component model

For a two variance component mixed linear model, it is shown that under suitable conditions there exists a nonlinear unbiased estimator that is better than a best linear unbiased estimator defined with respect to a given singular covariance matrix. It is also shown how this result applies to improving on intra-block estimators and on estimators like the unweighted means estimator in a random one-way model.     

Transformation and Smoothing in Sample Survey Data

Abstract. We consider model‐based prediction of a finite population total when a monotone transformation of the survey variable makes it appropriate to assume additive, homoscedastic errors. As the transformation to achieve this does not necessarily simultaneously produce an easily parameterized mean function, we assume only that the mean is a smooth function of the auxiliary variable and estimate it non‐parametrically. The back transformation of predictions obtained on the transformed scale introduces bias which we remove using smearing. We obtain an asymptotic expansion for the prediction error which shows that prediction bias is asymptotically negligible and the prediction mean‐squared error (MSE) using a non‐parametric model remains in the same order as when a parametric model is adopted. The expansion also shows the effect of smearing on the prediction MSE and can be used to compute the asymptotic prediction MSE. We propose a model‐based bootstrap estimate of the prediction MSE. The predictor produces competitive results in terms of bias and prediction MSE in a simulation study, and performs well on a population constructed from an Australian farm survey.     

Increasing the effectiveness of time-use survey with qualitative methods: The analysis of time–space interaction

Time-use surveys have been rich data sources in many countries for a long time. Turkey was among the countries that realized the potential of time-use surveys quite late and completed the first national survey in 2006. Despite its importance for a wide range of issues and applications, the first survey has flaws in design, which reduce its effectiveness and reliability. This is mostly due to disregarding cultural factors while tracking the methodology of European examples. This study aims to propose more appropriate methods of gathering time-use data in the Turkish context through a field survey in Ankara, the capital city. A mixed methodology that combines quantitative and qualitative methods effectively was applied and used to enrich data. The influence of space use was stressed and leisure activities were utilized to exemplify the use and benefits of mixed methods.     

Estimation of parameters of mixed failure time distribution

The problem of estimation of parameters of a mixture of degenerate and exponential distributions is considered. A new sampling scheme is proposed and the exact bias and the mean square error (MSE) of the maximum likelihood estimators of the parameters is derived. Moment estimators, their approximate biases and the MSE are obtained. Asymptotic distributions of the estimators are also obtained for both the cases.     

Heteroskedasticity-consistent interval estimators

The linear regression model is commonly used in applications. One of the assumptions made is that the error variances are constant across all observations. This assumption, known as homoskedasticity, is frequently violated in practice. A commonly used strategy is to estimate the regression parameters by ordinary least squares and to compute standard errors that deliver asymptotically valid inference under both homoskedasticity and heteroskedasticity of an unknown form. Several consistent standard errors have been proposed in the literature, and evaluated in numerical experiments based on their point estimation performance and on the finite sample behaviour of associated hypothesis tests. We build upon the existing literature by constructing heteroskedasticity-consistent interval estimators and numerically evaluating their finite sample performance. Different bootstrap interval estimators are also considered. The numerical results favour the HC4 interval estimator.