Estimating and using propensity score in presence of missing background data: an application to assess the impact of childbearing on wellbeing

Propensity score methods are an increasingly popular technique for causal inference. To estimate propensity scores, we must model the distribution of the treatment indicator given a vector of covariates. Much work has been done in the case where the covariates are fully observed. Unfortunately, many large scale and complex surveys, such as longitudinal surveys, suffer from missing covariate values. In this paper, we compare three different approaches and their underlying assumptions of handling missing background data in the estimation and use of propensity scores: a complete-case analysis, a pattern-mixture model based approach developed by Rosenbaum and Rubin (J Am Stat Assoc79:516–524, 1984), and a multiple imputation approach. We apply these methods to assess the impact of childbearing events on individuals’ wellbeing in Indonesia, using a sample of women from the Indonesia Family Life Survey. I am grateful to all the participants at the project “Poverty Dynamics and Fertility in Developing Countries” for their support and encouragement. Special thanks are due to Fabrizia Mealli for her insightful suggestions and discussions. I also thank Jungho Kim, who is the main author of the STATA code to produce Indonesia consumption expenditure. Finally, I thank Arnstein Aassve, and Letizia Mencarini for help working with the data and their very useful discussions, and Alexia Fuernkranz-Prskawetz, and Henriette Engelhardt for detailed comments and suggestions which have improved the paper. Financial support from CNR-EFS and COFIN 2005 is gratefully acknowledged.     

Sensitivity analysis and related analyses: A review of some statistical techniques

This paper reviews five related types of analysis, namely (i) sensitivity or what-if analysis, (ii) uncertainty or risk analysis, (iii) screening, (iv) validation, and (v) optimization. The main questions are: when should which type of analysis be applied; which statistical techniques may then be used? This paper claims that the proper sequence to follow in the evaluation of simulation models is as follows. 1) Validation, in which the availability of data on the real system determines which type of statistical technique to use for validation. 2) Screening: in the simulation‘s pilot phase the really important inputs can be identified through a novel technique, called sequential bifurcation, which uses aggregation and sequential experimentation. 3) Sensitivity analysis: the really important inputs should be subjected to a more detailed analysis, which includes interactions between these inputs; relevant statistical techniques are design of experiments (DOE) and regression analysis. 4) Uncertainty analysis: the important environmental inputs may have values that are not precisely known, so the uncertainties of the model outputs that result from the uncertainties in these model inputs should be quantified; relevant techniques are the Monte Carlo method and Latin hypercube sampling. 5) Optimization: the policy variables should be controlled; a relevant technique is Response Surface Methodology (RSM), which combines DOE, regression analysis, and steepest-ascent hill-climbing. The recommended sequence implies that sensitivity analysis procede uncertainty analysis. Several case studies for each phase are briefly discussed in this paper.     

中国教育业的产业关联及中美比较分析

基于投入产出技术研究中国教育业的产业关联效应,并与美国进行对比分析。研究结果表明中国教育业与第二产业关联效应显著,而美国教育业与第三产业关联效应显著;中国教育业对国民经济的拉动和推动效应都不明显,美国教育业的拉动和推动效应比中国稍大;中美两国教育业的影响力系数都高于感应度系数,两国教育业对其上游产业拉动作用比其受到国民经济发展的推动作用要大。     

The sensitivity of estimates of the change in population behaviour to realistic changes in bias in repeated surveys

Summary.  The first British National Survey of Sexual Attitudes and Lifestyles (NATSAL) was conducted in 1990–1991 and the second in 1999–2001. When surveys are repeated, the changes in population parameters are of interest and are generally estimated from a comparison of the data between surveys. However, since all surveys may be subject to bias, such comparisons may partly reflect a change in bias. Typically limited external data are available to estimate the change in bias directly. However, one approach, which is often possible, is to define in each survey a sample of participants who are eligible for both surveys, and then to compare the reporting of selected events that occurred before the earlier survey time point. A difference in reporting suggests a change in overall survey bias between time points, although other explanations are possible. In NATSAL, changes in bias are likely to be similar for groups of sexual experiences. The grouping of experiences allows the information that is derived from the selected events to be incorporated into inference concerning population changes in other sexual experiences. We use generalized estimating equations, which incorporate weighting for differential probabilities of sampling and non-response in a relatively straightforward manner. The results, combined with estimates of the change in reporting, are used to derive minimum established population changes, based on NATSAL data. For some key population parameters, the change in reporting is seen to be consistent with a change in bias alone. Recommendations are made for the design of future surveys.     

On the effect of the number of quadrature points in a logistic random effects model: an example

Although generalized linear mixed models are recognized to be of major practical importance, it is also known that they can be computationally demanding. The problem is the evaluation of the integral in calculating the marginalized likelihood. The straightforward method is based on the Gauss–Hermite technique, based on Gaussian quadrature points. Another approach is provided by the class of penalized quasi-likelihood methods. It is commonly believed that the Gauss–Hermite method works relatively well in simple situations but fails in more complicated structures. However, we present here a strikingly simple example of a logistic random-intercepts model in the context of a longitudinal clinical trial where the method gives valid results only for a high number of quadrature points ( Q ). As a consequence, this result warns the practitioner to examine routinely the dependence of the results on Q . The adaptive Gaussian quadrature, as implemented in the new SAS procedure NLMIXED, offered the solution to our problem. However, even the adaptive version of Gaussian quadrature needs careful handling to ensure convergence.     

Assessing the bias due to non-coverage of residential movers in the German Microcensus Panel: an evaluation using data from the Socio-Economic Panel

The German Microcensus (MC) is a large scale rotating panel survey over three years. The MC is attractive for longitudinal analysis over the entire participation duration because of the mandatory participation and the very high case numbers (about 200000 respondents). However, as a consequence of the area sampling that is used for the MC, residential mobility is not covered and consequently statistical information at the new residence is lacking in the MC sample. This raises the question whether longitudinal analyses, like transitions between labour market states, are biased and how different methods perform that promise to reduce such a bias. Similar problems occur also for other national Labour Force Surveys (LFS) which are rotating panels and do not cover residential mobility, see Clarke and Tate (2002). Based on data of the German Socio-Economic Panel (SOEP), which covers residential mobility, we analysed the effects of missing data of residential movers by the estimation of labour force flows. By comparing the results from the complete SOEP sample and the results from the SOEP, restricted to the non-movers, we concluded that the non-coverage of the residential movers can not be ignored in Rubin’s sense. With respect to correction methods we analysed weighting by inverse mobility scores and log-linear models for partially observed contingency tables. Our results indicate that weighting by inverse mobility scores reduces the bias to about 60% whereas the official longitudinal weights obtained by calibration result in a bias reduction of about 80%. The estimation of log-linear models for non-ignorable non-response leads to very unstable results.     

Inference of a hidden spatial tessellation from multivariate data: application to the delineation of homogeneous regions in an agricultural field

Summary.  In a precision farming context, differentiated management decisions regarding fertilization, application of lime and other cultivation activities may require the subdivision of the field into homogeneous regions with respect to the soil variables of main agronomic significance. The paper develops an approach that is aimed at delineating homogeneous regions on the basis of measurements of a categorical and quantitative nature, namely soil type and resistivity measurements at different soil layers. We propose a Bayesian multivariate spatial model and embed it in a Markov chain Monte Carlo inference scheme. Implementation is discussed using real data from a 15-ha field. Although applied to soil data, this model could be relevant in areas of spatial modelling as diverse as epidemiology, ecology or meteorology.     

To split or not to split the US Ninth Circuit Court of Appeals: A simple statistical argument,counterargument, and critique

A statistical argument was presented quite recently, as an Op-Ed in The Los Angeles Times, purporting to conclude that the US Ninth Circuit Court of Appeals should be split. A corresponding statistical counterargument and critique are introduced in the present paper, by making use of some combinatorial formulas and by proposing an alternative empirical approach. In addition, with this issue of the Journal of Statistical Planning and Inference dedicated to Ted Anderson, I also include here comments on his contributions to both statistical inference about Markov chains and to statistical inference about latent classes.     

我国服务业发展与经济增长的因果关系研究——基于东、中、西部面板数据的实证研究

 摘　　要:本文运用面板单位根检验、协整检验以及误差修正模型等现代计量经济学方法，对我国东部地区、中部地区和西部地区的服务业与经济增长的关系进行实证研究 。     

On the recoding of continuous and bounded indexes to a binomial form: an application to quality-of-life scores

The statistical analysis of patient-reported outcomes (PROs) as endpoints has shown to be of great practical relevance. The resulting scores or indexes from the questionnaires used to measure PROs could be treated as continuous or ordinal. The goal of this study is to propose and evaluate a recoding process of the scores, so that they can be treated as binomial outcomes and, therefore, analyzed using logistic regression with random effects. The general methodology of recoding is based on the observable values of the scores. In order to obtain an optimal recoding, the evaluation of the recoding method is tested for different values of the parameters of the binomial distribution and different probability distributions of the random effects. We illustrate, evaluate and validate the proposed method of recoding with the Short Form-36 (SF-36) Survey and real data. The optimal recoding approach is very useful and flexible. Moreover, it has a natural interpretation, not only for ordinal scores, but also for questionnaires with many dimensions and different profiles, where a common method of analysis is desired, such as the SF-36.     

Incorporating scientific,ethical and economic considerations into the design of clinical trials in the pharmaceutical industry: a sequential approach

A flexible sequential approach to the design of clinical trials is discussed herein. This approach is based on a “confidence sequence” viewpoint instead of the rigid stopping and terminal decision rules in conventional sequential testing theory. By using an appropriate confidence sequence, one can always ensure a prescribed degree of scientific rigor (confidence) in establishing the drug to be effective. Moreover, one also has the option of terminating the trial early when there is already enough statistical evidence for concluding that the drug is effective, or when the drug shows uniorseen harmful effects, or when the data predict that there is little chance of arriving at a definitive conclusion in favor of the drug by the scheduled end of the trial. We discuss how these and other ethical and economic considerations can be readily incorporated into the stopping criteria of the trial.     

A Note on Breiman's Random Forest Data Mining Technique and Conventional Cox Modeling of Survival Statistics: The Case of the Phantom “Induct” Covariate in the Ohio State University Kidney Transplant Database

This note represents a portion of the research that has been conducted using the Ohio State University's large kidney transplant database. Our latest results into understanding the impact of covariates on renal graft success including the impact of drug therapy are discussed.

The major result here is that using both the Cox model and Breiman's Random Forest Data Mining techniques has helped to unravel the mystery of the “induct” immunosuppressant covariate slipping in and out of the list of important variables. We also make the interesting observation that the Random Forest method seems to mimic the clinician's (R.P.) understanding of the importance of variables.     

Comments on ‘Application of an adaptive design to a randomized phase II selection trial in gastric cancer: a report of the study design’ by Satoshi Morita and Junichi Sakamoto. Pharmaceutical Statistics

In this commentary, we show that the treatment selection probabilities in Morita and Sakamoto [1] could be different if safety information is considered. Copyright © 2012 John Wiley & Sons, Ltd.