Sensitivity,uncertainty, and decision analyses in the prioritization of research

The evaluation of hazards from complex, large scale, technologically advanced systems often requires the construction of computer implemented mathematical models. These models are used to evaluate the safety of the systems and to evaluate the consequences of modifications to the systems. These evaluations, however, are normally surrounded by significant uncertainties related to the uncertainty inherent in natural phenomena such as the weather and those related to uncertainties in the parameters and models used in the evaluation.

Another use of these models is to evaluate strategies for improving information used in the modeling process itself. While sensitivity analysis is useful in defining variables in the model that are important, uncertainty analysis provides a tool for assessing the importance of uncertainty about these variables. A third complementary technique, is decision analysis. It provides a methodology for explicitly evaluating and ranking potential improvements to the model. Its use in the development of information gathering strategies for a nuclear waste repository are discussed in this paper.     

Moment‐Independent Sensitivity Analysis Using Copula

In risk assessment, the moment‐independent sensitivity analysis (SA) technique for reducing the model uncertainty has attracted a great deal of attention from analysts and practitioners. It aims at measuring the relative importance of an individual input, or a set of inputs, in determining the uncertainty of model output by looking at the entire distribution range of model output. In this article, along the lines of Plischke et al., we point out that the original moment‐independent SA index (also called delta index) can also be interpreted as the dependence measure between model output and input variables, and introduce another moment‐independent SA index (called extended delta index) based on copula. Then, nonparametric methods for estimating the delta and extended delta indices are proposed. Both methods need only a set of samples to compute all the indices; thus, they conquer the problem of the “curse of dimensionality.” At last, an analytical test example, a risk assessment model, and the levelE model are employed for comparing the delta and the extended delta indices and testing the two calculation methods. Results show that the delta and the extended delta indices produce the same importance ranking in these three test examples. It is also shown that these two proposed calculation methods dramatically reduce the computational burden.     

煤矿瓦斯爆炸事故单危险源风险度量模型研究

本文研究了煤矿瓦斯爆炸事故危险源的分类,把危险源划分为人的不安全行为、机器设备不安全状态、环境不安全特征和管理缺陷四大类,并根据煤矿现场调查各类危险源的数据以及相应数学方法的特点,提出煤矿瓦斯爆炸事故人、机器设备(物)、环境、管理四类危险源的风险度量方法,在此基础上构建四类危险源的风险度量模型。研究表明,危险源的风险度量模型由风险发生的可能性、危险源重要度以及事故导致的损失构成;危险源风险发生的可能性,在具体应用中可以采用各类危险源的不可靠度、故障率等来衡量;危险源在事故中的重要度可以通过分析事故故障树种要素结构重要性获取。根据风险评价的结果,可以对危险源进行分级排序,从而为煤矿事故单危险源的控制提供依据。     

Improving Risk Management: From Lame Excuses to Principled Practice

The three classic pillars of risk analysis are risk assessment (how big is the risk and how sure can we be?), risk management (what shall we do about it?), and risk communication (what shall we say about it, to whom, when, and how?). We propose two complements as important parts of these three bases: risk attribution (who or what addressable conditions actually caused an accident or loss?) and learning from experience about risk reduction (what works, and how well?). Failures in complex systems usually evoke blame, often with insufficient attention to root causes of failure, including some aspects of the situation, design decisions, or social norms and culture. Focusing on blame, however, can inhibit effective learning, instead eliciting excuses to deflect attention and perceived culpability. Productive understanding of what went wrong, and how to do better, thus requires moving past recrimination and excuses. This article identifies common blame‐shifting “lame excuses” for poor risk management. These generally contribute little to effective improvements and may leave real risks and preventable causes unaddressed. We propose principles from risk and decision sciences and organizational design to improve results. These start with organizational leadership. More specifically, they include: deliberate testing and learning—especially from near‐misses and accident precursors; careful causal analysis of accidents; risk quantification; candid expression of uncertainties about costs and benefits of risk‐reduction options; optimization of tradeoffs between gathering additional information and immediate action; promotion of safety culture; and mindful allocation of people, responsibilities, and resources to reduce risks. We propose that these principles provide sound foundations for improving successful risk management.     

How to Evaluate Government Performance while Building a Rule of Law Government in China*

Building a law-based government is a central element of the comprehensive framework for promoting the rule of law in China, while using evaluation to catalyze growth is in line with the incentive principle of management studies. Since China started to implement reform and opening up over thirty years ago, rule of law development and organizational evaluation have gone through several stages, each with different characteristics. Efforts to build a law-based government have met with success, but what the country now has is essentially still goal-oriented assessment. At present, this suffers from the lack of a clear goal orientation or definition of functions, an imperfect technical system and unsound motivation mechanisms, not to mention the practical problems of each government department going its own way, duplicating evaluations or being left rudderless. Drawing on a combination of value rationality and instrumental rationality and using government performance evaluation to promote the building of a law-based government not only conforms to the spirit of the rule of law and value rationality in government performance, but also strengthens the role of evaluation as an instrument for organizational management. Therefore, we need to create new evaluation theories, expand public participation, introducing diversified evaluating entities, improve technical systems, strengthen institutional buildup, and foster a performance-based culture. In addition, replacing goal-oriented assessment with performance evaluation will help the emergence of a new discipline—the performance evaluation of rule of law government, thus promoting multidisciplinary efforts to integrate and create new public administration theories in China.     

Dyadic Analyses of Preschool‐aged Children's Friendships: Convergence and Differences between Friendship Classifications from Peer Sociometric Data and Teacher's Reports

Peer sociometrics and teachers' friendship reports were compared in 2179 preschool dyads. One hundred twenty of 306 reciprocated friend dyads from peer sociometric data were also identified as good friends by their classroom teachers, and 301 of 600 of non‐reciprocated dyads in peer data were named as friends by one or both classroom teachers (overall kappa = .16). Friendship classifications from both peer and teacher data had significant relations with variables relevant to peer interactions, social skills, peer acceptance, and teacher‐rated scales (six of seven tests significant for peer data; five of eight significant for teacher data). Multilevel analyses indicated that friendship status effects were not qualified by classroom‐level differences. Findings suggest that sociometric tasks can identify preschoolers' peer friendships and that the range of correlates may be broader in peer‐choice data than in teachers' friendship evaluations.     

Relations Between Alphabetized Name Order and Nomination Counts in Peer Nomination Measures

Peer nominations, a central method for measuring peer relationships in developmental research, typically involve asking children or adolescents to choose peers who fit various criteria from an alphabetized roster of classmates or grade‐mates. Although such measures have been used for decades, very little research has investigated the effects of alphabetical name order on the number of nominations received by peers. This study collected peer nominations for 20 items among 607 eighth grade participants in two schools. Regression analyses showed that earlier name order significantly predicted higher nomination counts for eight of the items, and explained over 5 percent of the variance in four affective variables (friendship, acceptance, acquaintanceship, and received liking). Across variables, name order effects were negatively correlated with internal reliability of nominations, implying that order effects may be related to the consensus of the peer group. Name order also had a minimal effect on inter‐correlations among a subset of variables. Implications and concrete recommendations for controlling and reducing name order effects in future research are discussed.     

Application of a QMRA Framework to Inform Selection of Drinking Water Interventions in the Developing Context

The aim of this study was to develop a modified quantitative microbial risk assessment (QMRA) framework that could be applied as a decision support tool to choose between alternative drinking water interventions in the developing context. The impact of different household water treatment (HWT) interventions on the overall incidence of diarrheal disease and disability adjusted life years (DALYs) was estimated, without relying on source water pathogen concentration as the starting point for the analysis. A framework was developed and a software tool constructed and then implemented for an illustrative case study for Nepal based on published scientific data. Coagulation combined with free chlorine disinfection provided the greatest estimated health gains in the short term; however, when long‐term compliance was incorporated into the calculations, the preferred intervention was porous ceramic filtration. The model demonstrates how the QMRA framework can be used to integrate evidence from different studies to inform management decisions, and in particular to prioritize the next best intervention with respect to estimated reduction in diarrheal incidence. This study only considered HWT interventions; it is recognized that a systematic consideration of sanitation, recreation, and drinking water pathways is important for effective management of waterborne transmission of pathogens, and the approach could be expanded to consider the broader water‐related context.     

Understanding Popularity and Relational Aggression in Adolescence: The Role of Social Dominance Orientation

This study investigated a potential moderator of the association between popularity and relational aggression: social dominance orientation (SDO), the degree to which an individual endorses the importance of social hierarchy. One hundred eighty‐five ninth graders completed a sociometric assessment of RA and popularity, and a self‐report SDO measure. SDO was positively associated with popularity for both boys and girls, and with RA for girls. Popularity and RA were positively correlated for both genders. Regression analyses showed that SDO moderated the association between popularity and RA for girls, but not for boys. Girls who were both popular and who were social dominance‐oriented were particularly high in peer‐nominated RA. SDO may provide a useful framework for understanding the role of popularity in adolescent peer groups.     

Identifying Changing Aviation Threat Environments Within an Adaptive Homeland Security Advisory System

A critical component of aviation security consists of screening passengers and baggage to protect airports and aircraft from terrorist threats. Advancements in screening device technology have increased the ability to detect these threats; however, specifying the operational configurations of these devices in response to changes in the threat environment can become difficult. This article proposes to use Fisher information as a statistical measure for detecting changes in the threat environment. The perceived risk of passengers, according to prescreening information and behavior analysis, is analyzed as the passengers sequentially enter the security checkpoint. The alarm responses from the devices used to detect threats are also analyzed to monitor significant changes in the frequency of threat items uncovered. The key results are that this information‐based measure can be used within the Homeland Security Advisory System to indicate changes in threat conditions in real time, and provide the flexibility of security screening detection devices to responsively and automatically adapt operational configurations to these changing threat conditions.