Simultaneous bootstrap for all three parameters in random coefficient autoregressive models

In this paper we consider autoregressive processes with random coefficients and develop bootstrap approaches that asymptotically work for the distribution of estimated autoregressive parameter as well as for the distribution of estimated variances of the innovation noise and the disturbance noise. We discuss how to obtain approximative residuals of the process and how to separate between the innovation and the disturbance noise in order to be able to extend the classical residual bootstrap for autoregressive processes to the situation considered in this paper. Thereafter, we propose a wild bootstrap procedure as a variation of the residual bootstrap that uses estimated densities of the innovation and the disturbance noise to generate bootstrap replicates of the data generating process. The consistency of the bootstrap approaches is established and their performance is illustrated by a simulation study.     

Empirical Bayes estimates for correlated hierarchical data with overdispersion

An extension of the generalized linear mixed model was constructed to simultaneously accommodate overdispersion and hierarchies present in longitudinal or clustered data. This so‐called combined model includes conjugate random effects at observation level for overdispersion and normal random effects at subject level to handle correlation, respectively. A variety of data types can be handled in this way, using different members of the exponential family. Both maximum likelihood and Bayesian estimation for covariate effects and variance components were proposed. The focus of this paper is the development of an estimation procedure for the two sets of random effects. These are necessary when making predictions for future responses or their associated probabilities. Such (empirical) Bayes estimates will also be helpful in model diagnosis, both when checking the fit of the model as well as when investigating outlying observations. The proposed procedure is applied to three datasets of different outcome types. Copyright © 2014 John Wiley & Sons, Ltd.     

Improving extreme quantile estimation via a folding procedure

In many applications (geosciences, insurance, etc.), the peaks-over-thresholds (POT) approach is one of the most widely used methodology for extreme quantile inference. It mainly consists of approximating the distribution of exceedances above a high threshold by a generalized Pareto distribution (GPD). The number of exceedances which is used in the POT inference is often quite small and this leads typically to a high volatility of the estimates. Inspired by perfect sampling techniques used in simulation studies, we define a folding procedure that connects the lower and upper parts of a distribution. A new extreme quantile estimator motivated by this theoretical folding scheme is proposed and studied. Although the asymptotic behaviour of our new estimate is the same as the classical (non-folded) one, our folding procedure reduces significantly the mean squared error of the extreme quantile estimates for small and moderate samples. This is illustrated in the simulation study. We also apply our method to an insurance dataset.     

Robust linear mixed models for Small Area Estimation

Hierarchical models are popular in many applied statistics fields including Small Area Estimation. One well known model employed in this particular field is the Fay–Herriot model, in which unobservable parameters are assumed to be Gaussian. In Hierarchical models assumptions about unobservable quantities are difficult to check. For a special case of the Fay–Herriot model, Sinharay and Stern [2003. Posterior predictive model checking in Hierarchical models. J. Statist. Plann. Inference 111, 209–221] showed that violations of the assumptions about the random effects are difficult to detect using posterior predictive checks. In this present paper we consider two extensions of the Fay–Herriot model in which the random effects are assumed to be distributed according to either an exponential power (EP) distribution or a skewed EP distribution. We aim to explore the robustness of the Fay–Herriot model for the estimation of individual area means as well as the empirical distribution function of their ‘ensemble’. Our findings, which are based on a simulation experiment, are largely consistent with those of Sinharay and Stern as far as the efficient estimation of individual small area parameters is concerned. However, when estimating the empirical distribution function of the ‘ensemble’ of small area parameters, results are more sensitive to the failure of distributional assumptions.     

Simultaneous estimation of Poisson means of the selected subset

Let _π1,_π2,…,_πp${\pi }_1,{\pi }_2,\dots ,{\pi }_p$ be p   independent Poisson populations with means _λ1,…,_λp${\lambda }_1,\dots ,{\lambda }_p$, respectively. Let {X₁,…,X_p} denote the set of observations, where X_i is from _πi${\pi }_i$. Suppose a subset of populations is selected using Gupta and Huang's (1975) selection rule which selects _πi${\pi }_i$ if and only if _Xi+1?_cX(1)$X_i+1?{\mathit{cX}}_{(1)}$, where X₍₁₎=max{X₁,…,X_p}, and 0<c<1$0<c<1$. In this paper, the simultaneous estimation of the Poisson means associated with the selected populations is considered for the k-normalized squared error loss function. It is shown that the natural estimator is positively biased. Also, a class of estimators that are better than the natural estimator is obtained by solving certain difference inequalities over the sample space. A class of estimators which dominate the UMVUE is also obtained. Monte carlo simulations are used to assess the percentage improvements and an application to a real-life example is also discussed.     

Smooth Residual Bootstrap for Empirical Processes of Non-parametric Regression Residuals

Abstract.  The aim of this paper is to prove the validity of smooth residual bootstrap versions of procedures that are based on the empirical process of residuals estimated from a non-parametric regression model. From this result, consistency of various model tests in non-parametric regression is deduced, such as goodness-of-fit tests for the regression and variance function, tests for equality of regression functions and tests concerning the error distribution.     

A comparison of robust alternatives to Hotelling’s T 2 control chart

Control charts are one of the widest used techniques in statistical process control. In Phase I, historical observations are analysed in order to construct a control chart. Because of the existence of multiple outliers that are undetected by control charts such as Hotelling’s T ² due to the masking effect, robust alternatives to Hotelling’s T ² have been developed based on minimum volume ellipsoid (MVE) estimators, minimum covariance determinant (MCD) estimators, reweighted MCD estimators or trimmed estimators. In this paper, we use a simulation study to analyse the performance of each alternative in various situations and offer guidance for the correct use of each estimator.     

Optimal domain estimation under summation restriction

The domain estimators that do not sum up to the population total (estimated or known) are considered. In order to achieve their additivity, the theory of the general restriction (GR)-estimator [Knottnerus P., 2003. Sample Survey Theory: Some Pythagorean Perspectives. Springer, New York] is used. The elaborated domain GR-estimators are optimal, they have the minimum variance in a class of estimators that satisfy summation restriction. Furthermore, their variances are smaller than the variances of the corresponding initial domain estimators. The variance/covariance formulae of the domain GR-estimators are explicitly given.The ratio estimators as representatives of the non-additive domain estimators are considered. Their design-based covariance matrix, being crucial for the GR-estimator, is presented. Its structure simplifies under certain assumptions on sampling design (and population model). The corresponding simpler forms of the domain GR-estimators are elaborated as well. The hypergeometric [Traat I., Ilves M., 2007. The hypergeometric sampling design, theory and practice. Acta Appl. Math. 97, 311–321] and the simple random sampling designs are considered in more detail. The results are illustrated in a simulation study where the optimal domain estimator displays its superiority among other meaningful domain estimators. It is noteworthy that due to the imposed restrictions also these other estimators, though not optimal, can be much more precise than the initial estimators.     

Regression modelling of the flows in an input–output table with accounting constraints

This paper details a method for estimating the unknown parameters of a regression model when the estimates of the dependent variable should be embedded in an input–output table with accounting constraints. Since in regression modelling the dependent variable is usually transformed either to achieve homoscedasticity of the residuals or for a better interpretation of the model, the estimating procedure becomes an optimization problem of an opportunely defined Lagrangian function with non-linear constraints. After detailing the algorithm and deriving the asymptotic distribution of the restricted estimator, the methodology is applied to estimate the flows of tourism within and between Italian regions with a gravity model. The procedure can be seen as an extension of Byron’s (J R Stat Soc Ser A 141:359–367, 1978) balancing method.     

Weighted analyses for cohort sampling designs

Weighted analysis methods are considered for cohort sampling designs that allow subsampling of both cases and non-cases, but with cases generally sampled more intensively. The methods fit into the general framework for the analysis of survey sampling designs considered by Lin (Biometrika 87:37–47, 2000). Details are given for applying the general methodology in this setting. In addition to considering proportional hazards regression, methods for evaluating the representativeness of the sample and for estimating event-free probabilities are given. In a small simulation study, the one-sample cumulative hazard estimator and its variance estimator were found to be nearly unbiased, but the true coverage probabilities of confidence intervals computed from these sometimes deviated significantly from the nominal levels. Methods for cross-validation and for bootstrap resampling, which take into account the dependencies in the sample, are also considered. An erratum to this article can be found at