Comments on the paper “Bias-adjustment and calibration of jackknife variance estimator in the presence of non-response”

Singh and Arnab (2010) presented a bias adjustment to the jackknife variance estimator of Rao and Sitter (1995) in the presence of non-response. In their paper, they obtained a second-order approximation of the bias of the Rao-Sitter variance estimator and then proposed a bias-adjusted estimator based on this approximation. To compare their proposed variance estimator to various other variance estimators, they performed a simulation study and showed that their variance estimator is superior to the Rao-Sitter variance estimator. In fact they showed that the Rao-Sitter variance estimator suffers from severe underestimation. These results contradict those in the literature, which indicate that the Rao-Sitter variance estimator suffers from a positive bias if the sampling fractions are not negligible; see Rao and Sitter (1995), Lee et al. (1995) and Haziza and Picard (2011). Because of this contradiction, we felt that a further investigation was warranted. In this paper, we attempt to recreate the results of Singh and Arnab (2010) and, in fact, show that their second order approximation to the bias of the Rao-Sitter variance estimator is incorrect and that their simulation results are also questionable.     

Determining the mean-variance relationship in generalized linear models—A parametric robust way

This article introduces a parametric robust way of determining the mean-variance relationship in the setting of generalized linear models. More specifically, the normal likelihood is properly amended to become asymptotically valid even if normality fails. Consequently, legitimate inference for the parametric relationship between mean and variance could be derived under model misspecification. More details are given to the scenario when the variance is proportional to an unknown power of the mean function. The efficacy of the novel technique is demonstrated via simulations and the analysis of two real data sets.     

A kernel smoothing method of adjusting for unit non‐response in sample surveys

Non‐response is a common problem in survey sampling and this phenomenon can only be ignored at the risk of invalidating inferences from a survey. In order to adjust for unit non‐response, the authors propose a weighting method in which kernel regression is used to estimate the response probabilities. They show that the adjusted estimator is consistent and they derive its asymptotic distribution. They also suggest a means of estimating its variance through a replication‐based technique. Furthermore, a Monte Carlo study allows them to illustrate the properties of the non‐response adjustment and its variance estimator.     

Model‐Based Non‐parametric Variance Estimation for Systematic Sampling

Abstract. Systematic sampling is frequently used in surveys, because of its ease of implementation and its design efficiency. An important drawback of systematic sampling, however, is that no direct estimator of the design variance is available. We describe a new estimator of the model‐based expectation of the design variance, under a non‐parametric model for the population. The non‐parametric model is sufficiently flexible that it can be expected to hold at least approximately in many situations with continuous auxiliary variables observed at the population level. We prove the model consistency of the estimator for both the anticipated variance and the design variance under a non‐parametric model with a univariate covariate. The broad applicability of the approach is demonstrated on a dataset from a forestry survey.     

Variance Estimation under Two‐Phase Sampling

We consider the variance estimation of the weighted likelihood estimator (WLE) under two‐phase stratified sampling without replacement. Asymptotic variance of the WLE in many semiparametric models contains unknown functions or does not have a closed form. The standard method of the inverse probability weighted (IPW) sample variances of an estimated influence function is then not available in these models. To address this issue, we develop the variance estimation procedure for the WLE in a general semiparametric model. The phase I variance is estimated by taking a numerical derivative of the IPW log likelihood. The phase II variance is estimated based on the bootstrap for a stratified sample in a finite population. Despite a theoretical difficulty of dependent observations due to sampling without replacement, we establish the (bootstrap) consistency of our estimators. Finite sample properties of our method are illustrated in a simulation study.     

A new approach for monitoring process variance

ABSTRACT

Control charts are effective tools for signal detection in both manufacturing processes and service processes. Much service data come from a process with variables having non-normal or unknown distributions. The commonly used Shewhart variable control charts, which depend heavily on the normality assumption, should not be properly used in such circumstances. In this paper, we propose a new variance chart based on a simple statistic to monitor process variance shifts. We explore the sampling properties of the new monitoring statistic and calculate the average run lengths (ARLs) of the proposed variance chart. Furthermore, an arcsine transformed exponentially weighted moving average (EWMA) chart is proposed because the ARLs of this modified chart are more intuitive and reasonable than those of the variance chart. We compare the out-of-control variance detection performance of the proposed variance chart with that of the non-parametric Mood variance (NP-M) chart with runs rules, developed by Zombade and Ghute [Nonparametric control chart for variability using runs rules. Experiment. 2014;24(4):1683–1691], and the nonparametric likelihood ratio-based distribution-free exponential weighted moving average (NLE) chart and the combination of traditional exponential weighted moving average (EWMA) mean and EWMA variance (CEW) control chart proposed by Zou and Tsung [Likelihood ratio-based distribution-free EWMA control charts. J Qual Technol. 2010;42(2):174–196] by considering cases in which the critical quality characteristic has a normal, a double exponential or a uniform distribution. Comparison results showed that the proposed chart performs better than the NP-M with runs rules, and the NLE and CEW control charts. A numerical example of service times with a right-skewed distribution from a service system of a bank branch in Taiwan is used to illustrate the application of the proposed variance chart and of the arcsine transformed EWMA chart and to compare them with three existing variance (or standard deviation) charts. The proposed charts show better detection performance than those three existing variance charts in monitoring and detecting shifts in the process variance.     

Sample size calculation for the one‐sample log‐rank test

In this paper, an exact variance of the one‐sample log‐rank test statistic is derived under the alternative hypothesis, and a sample size formula is proposed based on the derived exact variance. Simulation results showed that the proposed sample size formula provides adequate power to design a study to compare the survival of a single sample with that of a standard population. Copyright © 2014 John Wiley & Sons, Ltd.     

A simple bootstrap bandwidth selector for local polynomial fitting

A new, fully data-driven bandwidth selector with a double smoothing (DS) bias term and a data-driven variance estimator is developed following the bootstrap idea. The data-driven variance estimation does not involve any additional bandwidth selection. The proposed bandwidth selector convergences faster than a plug-in one due to the DS bias estimate, whereas the data-driven variance improves its finite sample performance clearly and makes it stable. Asymptotic results of the proposals are obtained. A comparative simulation study was done to show the overall gains and the gains obtained by improving either the bias term or the variance estimate, respectively. It is shown that the use of a good variance estimator is more important when the sample size is relatively small.     

A note on the estimation of pr{y<x} for truncation parameter distributions

In this note a relationship in the treatment of the lower and upper truncations considered in Beg (1980) is pointed out and the minimum variance unbiased estimator of P = Pr{Y<X) for the (upper) truncated exponential distribution is obtained.     

Diagnosing explainable heterogeneity of variance in random‐effects models

Data‐analytic tools for models other than the normal linear regression model are relatively rare. Here we develop plots and diagnostic statistics for nonconstant variance for the random‐effects model (REM). REMs for longitudinal data include both within‐ and between‐subject variances. A basic assumption is that the two variance terms are constant across subjects. However, we often find that these variances are functions of covariates, and the data set has what we call explainable heterogeneity, which needs to be allowed for in the model. We characterize several types of heterogeneity of variance in REMs and develop three diagnostic tests using the score statistic: one for each of the two variance terms, and the third for a form of multivariate nonconstant variance. For each test we present an adjusted residual plot which can identify cases that are unusually influential on the outcome of the test.     

A skew factor analysis model based on the normal mean–variance mixture of Birnbaum–Saunders distribution

This paper presents a robust extension of factor analysis model by assuming the multivariate normal mean–variance mixture of Birnbaum–Saunders distribution for the unobservable factors and errors. A computationally analytical EM-based algorithm is developed to find maximum likelihood estimates of the parameters. The asymptotic standard errors of parameter estimates are derived under an information-based paradigm. Numerical merits of the proposed methodology are illustrated using both simulated and real datasets.     

A Note of Wavelet Variance

This paper proposes a definition of wavelet variance in integral form and explores some properties of the variance. By this definition, a method of parameter estimation for long memory processes is established. An example of the estimation is discussed.     

Forecasting of some; transformed series

The delta method is proposed as a. retransformation approach for coramputing forecasts for a nonstationary process (Z$inf:t$einf t, = 1, 2, ...), A derived variance stabilizing transformation technique is also used to compute forecasts, The performance of the two methods is compared to other techniques. Numerical results show that forecasts based on the variance stabilizing transformation method (VSTM) can lead to forecasts with a lower mean square error (MSE) as compared to other transformation techniqnes.     

Control Variates for the Metropolis–Hastings Algorithm

Abstract.  We propose new control variates for variance reduction in estimation of mean values using the Metropolis–Hastings algorithm. Traditionally, states that are rejected in the Metropolis–Hastings algorithm are simply ignored, which intuitively seems to be a waste of information. We present a setting for construction of zero mean control variates for general target and proposal distributions and develop ideas for the standard Metropolis–Hastings and reversible jump algorithms. We give results for three simulation examples. We get best results for variates that are functions of the current state x and the proposal y , but we also consider variates that in addition are functions of the Metropolis–Hastings acceptance/rejection decision. The variance reduction achieved varies depending on the target distribution and proposal mechanisms used. In simulation experiments, we typically achieve relative variance reductions between 15% and 35%.     

Linear Regression With Nested Errors Using Probability‐Linked Data

Probabilistic matching of records is widely used to create linked data sets for use in health science, epidemiological, economic, demographic and sociological research. Clearly, this type of matching can lead to linkage errors, which in turn can lead to bias and increased variability when standard statistical estimation techniques are used with the linked data. In this paper we develop unbiased regression parameter estimates to be used when fitting a linear model with nested errors to probabilistically linked data. Since estimation of variance components is typically an important objective when fitting such a model, we also develop appropriate modifications to standard methods of variance components estimation in order to account for linkage error. In particular, we focus on three widely used methods of variance components estimation: analysis of variance, maximum likelihood and restricted maximum likelihood. Simulation results show that our estimators perform reasonably well when compared to standard estimation methods that ignore linkage errors.     

A note on variance estimation in the Cox proportional hazards model

The Cox proportional hazards model is widely used in clinical trials with time-to-event outcomes to compare an experimental treatment with the standard of care. At the design stage of a trial the number of events required to achieve a desired power needs to be determined, which is frequently based on estimating the variance of the maximum partial likelihood estimate of the regression parameter with a function of the number of events. Underestimating the variance at the design stage will lead to insufficiently powered studies, and overestimating the variance will lead to unnecessarily large trials. A simple approach to estimating the variance is introduced, which is compared with two widely adopted approaches in practice. Simulation results show that the proposed approach outperforms the standard ones and gives nearly unbiased estimates of the variance.     

Réduction de la variance dans les sondages en présence d'information auxiliarie: Une approache non paramétrique par splines de régression

The author considers the use of auxiliary information available at population level to improve the estimation of finite population totals. She introduces a new type of model‐assisted estimator based on nonparametric regression splines. The estimator is a weighted linear combination of the study variable with weights calibrated to the B‐splines known population totals. The author shows that the estimator is asymptotically design‐unbiased and consistent under conditions which do not require the superpopulation model to be correct. She proposes a design‐based variance approximation and shows that the anticipated variance is asymptotically equivalent to the Godambe‐Joshi lower bound. She also shows through simulations that the estimator has good properties.     

A novel quantification of information for longitudinal data analyzed by mixed‐effects modeling

Nonlinear mixed‐effects (NLME) modeling is one of the most powerful tools for analyzing longitudinal data especially under the sparse sampling design. The determinant of the Fisher information matrix is a commonly used global metric of the information that can be provided by the data under a given model. However, in clinical studies, it is also important to measure how much information the data provide for a certain parameter of interest under the assumed model, for example, the clearance in population pharmacokinetic models. This paper proposes a new, easy‐to‐interpret information metric, the “relative information” (RI), which is designed for specific parameters of a model and takes a value between 0% and 100%. We establish the relationship between interindividual variability for a specific parameter and the variance of the associated parameter estimator, demonstrating that, under a “perfect” experiment (eg, infinite samples or/and minimum experimental error), the RI and the variance of the model parameter estimator converge, respectively, to 100% and the ratio of the interindividual variability for that parameter and the number of subjects. Extensive simulation experiments and analyses of three real datasets show that our proposed RI metric can accurately characterize the information for parameters of interest for NLME models. The new information metric can be readily used to facilitate study designs and model diagnosis.     

A Bayesian approach to assessing population bioequivalence in a 2 ×2 crossover design

A Bayesian testing procedure is proposed for assessment of the bioequivalence in both mean and variance, which ensures population bioequivalence under the normality assumption. We derive the joint posterior distribution of the means and variances in a standard 2 ×2 crossover experimental design and propose a Bayesian testing procedure for bioequivalence based on a Markov chain Monte Carlo method. The proposed method is applied to a real data set.     

Empirical Likelihood Intervals for Conditional Value‐at‐Risk in Heteroscedastic Regression Models

Abstract. Non‐parametric regression models have been studied well including estimating the conditional mean function, the conditional variance function and the distribution function of errors. In addition, empirical likelihood methods have been proposed to construct confidence intervals for the conditional mean and variance. Motivated by applications in risk management, we propose an empirical likelihood method for constructing a confidence interval for the pth conditional value‐at‐risk based on the non‐parametric regression model. A simulation study shows the advantages of the proposed method.