Variability and Uncertainty Meet Risk Management and Risk Communication

In the past decade, the use of probabilistic risk analysis techniques to quantitatively address variability and uncertainty in risks increased in popularity as recommended by the 1994 National Research Council that wrote Science and Judgment in Risk Assessment. Under the 1996 Food Quality Protection Act, for example, the U.S. EPA supported the development of tools that produce distributions of risk demonstrating the variability and/or uncertainty in the results. This paradigm shift away from the use of point estimates creates new challenges for risk managers, who now struggle with decisions about how to use distributions in decision making. The challenges for risk communication, however, have only been minimally explored. This presentation uses the case studies of variability in the risks of dying on the ground from a crashing airplane and from the deployment of motor vehicle airbags to demonstrate how better characterization of variability and uncertainty in the risk assessment lead to better risk communication. Analogies to food safety and environmental risks are also discussed. This presentation demonstrates that probabilistic risk assessment has an impact on both risk management and risk communication, and highlights remaining research issues associated with using improved sensitivity and uncertainty analyses in risk assessment.     

Risk Assessment Can Be a Game‐Changing Information Technology—But Too Often It Isn't

The printing press was a game‐changing information technology. Risk assessment could be also. At present, risk assessments are commonly used as one‐time decision aids: they provide justification for a particular decision, and afterwards usually sit on a shelf. However, when viewed as information technologies, their potential uses are much broader. Risk assessments: (1) are repositories of structured information and a medium for communication; (2) embody evaluative structures for setting priorities; (3) can preserve information over time and permit asynchronous communication, thus encouraging learning and adaptation; and (4) explicitly address uncertain futures. Moreover, because of their “what‐if” capabilities, risk assessments can serve as a platform for constructive discussion among parties that hold different values. The evolution of risk assessment in the nuclear industry shows how such attributes have been used to lower core‐melt risks substantially through improved templates for maintenance and more effective coordination with regulators (although risk assessment has been less commonly used in improving emergency‐response capabilities). The end result of this evolution in the nuclear industry has been the development of “living” risk assessments that are updated more or less in real time to answer even routine operational questions. Similar but untapped opportunities abound for the use of living risk assessments to reduce risks in small operational decisions as well as large policy decisions in other areas of hazard management. They can also help improve understanding of and communication about risks, and future risk assessment and management. Realization of these opportunities will require significant changes in incentives and active promotion by the risk analytic community.     

Incorporating Ethnographic Methods in Multidisciplinary Approaches to Risk Assessment and Communication: Cultural and Religious Uses of Mercury in Latino and Caribbean Communities

The potential risk from cultural and religious practices involving mercury in Latino and Caribbean communities raises central methodological and ethical questions for risk assessment and risk communication. Here, specific cultural practices unfamiliar to most risk professionals carry significant inherent risks in the eyes of those professionals but not necessarily in the eyes of practitioners. Practitioners' past experience and history as targets of religious suppression and anti-immigrant sentiment create a reluctance to engage with researchers or public health officials in risk assessment or preventive risk communication efforts. The potential for the risk--in this case mercury contamination in dwellings--to extend beyond the practicing community to future occupants adds to public health concern. Understanding the risks of these practices requires both an understanding of the cultural and political context, beliefs, and behaviors of mercury users and an understanding of the fate and transport of mercury in typical use scenarios. In this study, we employed ethnographic methods (interviews and participant observation) to understand beliefs and behavior about mercury use as well as quantitative modeling and measurement to estimate and assess potential exposures. This represents a new methodology tailored to situations in which traditional activities or observances that are integral components of cultural identity pose risks in and of themselves. Our findings indicate that there are different types of mercury use stemming from different cultural and religious traditions that result in different levels of exposure. Many of the mercury uses that can result in the highest exposures to mercury vapors have previously been attributed to the religious tradition of Santeria, but appear instead to have their roots outside of the religion.     

Some Limitations of Qualitative Risk Rating Systems

Qualitative systems for rating animal antimicrobial risks using ordered categorical labels such as “high,”“medium,” and “low” can potentially simplify risk assessment input requirements used to inform risk management decisions. But do they improve decisions? This article compares the results of qualitative and quantitative risk assessment systems and establishes some theoretical limitations on the extent to which they are compatible. In general, qualitative risk rating systems satisfying conditions found in real‐world rating systems and guidance documents and proposed as reasonable make two types of errors: (1) Reversed rankings, i.e., assigning higher qualitative risk ratings to situations that have lower quantitative risks; and (2) Uninformative ratings, e.g., frequently assigning the most severe qualitative risk label (such as “high”) to situations with arbitrarily small quantitative risks and assigning the same ratings to risks that differ by many orders of magnitude. Therefore, despite their appealing consensus‐building properties, flexibility, and appearance of thoughtful process in input requirements, qualitative rating systems as currently proposed often do not provide sufficient information to discriminate accurately between quantitatively small and quantitatively large risks. The value of information (VOI) that they provide for improving risk management decisions can be zero if most risks are small but a few are large, since qualitative ratings may then be unable to confidently distinguish the large risks from the small. These limitations suggest that it is important to continue to develop and apply practical quantitative risk assessment methods, since qualitative ones are often unreliable.     

Probabilistic Health Risk Assessment for Exposures to Estuary Sediments and Biota Contaminated with Polychlorinated Biphenyls, Polychlorinated Terphenyls and Other Toxic Substances

A Latin Hypercube probabilistic risk assessment methodology was employed in the assessment of health risks associated with exposures to contaminated sediment and biota in an estuary in the Tidewater region of Virginia. The primary contaminants were polychlorinated biphenyls (PCBs), polychlorinated terphenyls (PCTs), polynuclear aromatic hydrocarbons (PAHs), and metals released into the estuary from a storm sewer system. The exposure pathways associated with the highest contaminant intake and risks were dermal contact with contaminated sediment and ingestion of contaminated aquatic and terrestrial biota from the contaminated area. As expected, all of the output probability distributions of risk were highly skewed, and the ratios of the expected value (mean) to median risk estimates ranged from 1.4 to 14.8 for the various exposed populations. The 99th percentile risk estimates were as much as two orders of magnitude above the mean risk estimates. For the sediment exposure pathways, the stability of the median risk estimates was found to be much greater than the stability of the expected value risk estimates. The interrun variability in the median risk estimate was found to be +/-1.9% at 3000 iterations. The interrun stability of the mean risk estimates was found to be approximately equal to that of the 95th percentile estimates at any number of iterations. The variation in neither contaminant concentrations nor any other single input variable contributed disproportionately to the overall simulation variance. The inclusion or exclusion of spatial correlations among contaminant concentrations in the simulation model did not significantly effect either the magnitude or the variance of the simulation risk estimates for sediment exposures.     

Personal Values, Beliefs, and Ecological Risk Perception

A mail survey on ecological risk perception was administered in the summer of 2002 to a randomized sample of the lay public and to selected risk professionals at the U.S. Environmental Protection Agency (US EPA). The ranking of 24 ecological risk items, from global climate change to commercial fishing, reveals that the lay public is more concerned about low-probability, high-consequence risks whereas the risk professionals are more concerned about risks that pose long-term, ecosystem-level impacts. To test the explanatory power of the value-belief-norm (VBN) theory for risk perception, respondents were questioned about their personal values, spiritual beliefs, and worldviews. The most consistent predictors of the risk rankings are belief in the new ecological paradigm (NEP) and Schwartz's altruism. The NEP and Schwartz's altruism explain from 19% to 46% of the variance in the risk rankings. Religious beliefs account for less than 6% of the variance and do not show a consistent pattern in predicting risk perception although religious fundamentalists are generally less concerned about the risk items. While not exerting as strong an impact, social-structural variables do have some influence on risk perception. Ethnicities show no effect on the risk scales but the more educated and financially well-off are less concerned about the risk items. Political leanings have no direct influence on risk rankings, but indirectly affect rankings through the NEP. These results reveal that the VBN theory is a plausible explanation for the differences measured in the respondents' perception of ecological risk.     

Consideration of Background Exposures in the Management of Hazardous Waste Sites: A New Approach to Risk Assessment

The current approach to health risk assessment of toxic waste sites in the U.S. may lead to considerable expenditure of resources without any meaningful reduction in population exposure. Risk assessment methods used generally ignore background exposures and consider only incremental risk estimates for maximally exposed individuals. Such risk estimates do not address true public health risks to which background exposures also contribute. The purpose of this paper is to recommend a new approach to risk assessment and risk management concerning toxic waste sites. Under this new approach, which we have called public health risk assessment, chemical substances would be classified into a level of concern based on the potential health risks associated with typical national and regional background exposures. Site assessment would then be based on the level of concern for the particular pollutants involved and the potential contribution of site contaminants to typical background human exposures. While various problems can be foreseen with this approach, the key advantage is that resources would be allocated to reduce the most important sources of human exposure, and site remediation decisions could be simplified by focussing on exposure assessment rather than questionable risk extrapolations.     

“Know What to Do If You Encounter a Flash Flood”: Mental Models Analysis for Improving Flash Flood Risk Communication and Public Decision Making

Understanding how people view flash flood risks can help improve risk communication, ultimately improving outcomes. This article analyzes data from 26 mental models interviews about flash floods with members of the public in Boulder, Colorado, to understand their perspectives on flash flood risks and mitigation. The analysis includes a comparison between public and professional perspectives by referencing a companion mental models study of Boulder‐area professionals. A mental models approach can help to diagnose what people already know about flash flood risks and responses, as well as any critical gaps in their knowledge that might be addressed through improved risk communication. A few public interviewees mentioned most of the key concepts discussed by professionals as important for flash flood warning decision making. However, most interviewees exhibited some incomplete understandings and misconceptions about aspects of flash flood development and exposure, effects, or mitigation that may lead to ineffective warning decisions when a flash flood threatens. These include important misunderstandings about the rapid evolution of flash floods, the speed of water in flash floods, the locations and times that pose the greatest flash flood risk in Boulder, the value of situational awareness and environmental cues, and the most appropriate responses when a flash flood threatens. The findings point to recommendations for ways to improve risk communication, over the long term and when an event threatens, to help people quickly recognize and understand threats, obtain needed information, and make informed decisions in complex, rapidly evolving extreme weather events such as flash floods.     

Assessing Uncertainty in Simulation-Based Maritime Risk Assessment

Recent work in the assessment of risk in maritime transportation systems has used simulation-based probabilistic risk assessment techniques. In the Prince William Sound and Washington State Ferries risk assessments, the studies' recommendations were backed up by estimates of their impact made using such techniques and all recommendations were implemented. However, the level of uncertainty about these estimates was not available, leaving the decisionmakers unsure whether the evidence was sufficient to assess specific risks and benefits. The first step toward assessing the impact of uncertainty in maritime risk assessments is to model the uncertainty in the simulation models used. In this article, a study of the impact of proposed ferry service expansions in San Francisco Bay is used as a case study to demonstrate the use of Bayesian simulation techniques to propagate uncertainty throughout the analysis. The conclusions drawn in the original study are shown, in this case, to be robust to the inherent uncertainties. The main intellectual merit of this work is the development of Bayesian simulation technique to model uncertainty in the assessment of maritime risk. However, Bayesian simulations have been implemented only as theoretical demonstrations. Their use in a large, complex system may be considered state of the art in the field of computational sciences.     

The Risk of Groundling Fatalities from Unintentional Airplane Crashes

The crashes of four hijacked commercial planes on September 11, 2001, and the repeated televised images of the consequent collapse of the World Trade Center and one side of the Pentagon will inevitably change people's perceptions of the mortality risks to people on the ground from crashing airplanes. Goldstein and colleagues were the first to quantify the risk for Americans of being killed on the ground from a crashing airplane for unintentional events, providing average point estimates of 6 in a hundred million for annual risk and 4.2 in a million for lifetime risk. They noted that the lifetime risk result exceeded the commonly used risk management threshold of 1 in a million, and suggested that the risk to "groundlings" could be a useful risk communication tool because (a) it is a man-made risk (b) arising from economic activities (c) from which the victims derive no benefit and (d) exposure to which the victims cannot control. Their results have been used in risk communication. This analysis provides updated estimates of groundling fatality risks from unintentional crashes using more recent data and a geographical information system approach to modeling the population around airports. The results suggest that the average annual risk is now 1.2 in a hundred million and the lifetime risk is now 9 in ten million (below the risk management threshold). Analysis of the variability and uncertainty of this estimate, however, suggests that the exposure to groundling fatality risk varies by about a factor of approximately 100 in the spatial dimension of distance to an airport, with the risk declining rapidly outside the first 2 miles around an airport. We believe that the risk to groundlings from crashing airplanes is more useful in the context of risk communication when information about variability and uncertainty in the risk estimates is characterized, but we suspect that recent events will alter its utility in risk communication.     

Quantitative Estimates of Risk for Noncancer Endpoints

While quantitative estimates of risk have been a standard practice in cancer risk assessment for many years, no similar practice is evident in noncancer risk assessment. We use two recent examples involving methylmercury and arsenic to illustrate the negative impact of this discrepancy on risk communication and cost-benefit analysis. We argue for a more balanced treatment of cancer and noncancer risks and suggest an approach for reaching this goal.     

Consumer Phase Risk Assessment for Listeria monocytogenes in Deli Meats

The foodborne disease risk associated with the pathogen Listeria monocytogenes has been the subject of recent efforts in quantitative microbial risk assessment. Building upon one of these efforts undertaken jointly by the U.S. Food and Drug Administration and the U.S. Department of Agriculture (USDA), the purpose of this work was to expand on the consumer phase of the risk assessment to focus on handling practices in the home. One-dimensional Monte Carlo simulation was used to model variability in growth and cross-contamination of L. monocytogenes during food storage and preparation of deli meats. Simulations approximated that 0.3% of the servings were contaminated with >10(4) CFU/g of L. monocytogenes at the time of consumption. The estimated mean risk associated with the consumption of deli meats for the intermediate-age population was approximately 7 deaths per 10(11) servings. Food handling in homes increased the estimated mean mortality by 10(6)-fold. Of all the home food-handling practices modeled, inadequate storage, particularly refrigeration temperatures, provided the greatest contribution to increased risk. The impact of cross-contamination in the home was considerably less. Adherence to USDA Food Safety and Inspection Service recommendations for consumer handling of ready-to-eat foods substantially reduces the risk of listeriosis.     

Flash Flood Risks and Warning Decisions: A Mental Models Study of Forecasters,Public Officials,and Media Broadcasters in Boulder,Colorado

Timely warning communication and decision making are critical for reducing harm from flash flooding. To help understand and improve extreme weather risk communication and management, this study uses a mental models research approach to investigate the flash flood warning system and its risk decision context. Data were collected in the Boulder, Colorado area from mental models interviews with forecasters, public officials, and media broadcasters, who each make important interacting decisions in the warning system, and from a group modeling session with forecasters. Analysis of the data informed development of a decision‐focused model of the flash flood warning system that integrates the professionals’ perspectives. Comparative analysis of individual and group data with this model characterizes how these professionals conceptualize flash flood risks and associated uncertainty; create and disseminate flash flood warning information; and perceive how warning information is (and should be) used in their own and others’ decisions. The analysis indicates that warning system functioning would benefit from professionals developing a clearer, shared understanding of flash flood risks and the warning system, across their areas of expertise and job roles. Given the challenges in risk communication and decision making for complex, rapidly evolving hazards such as flash floods, another priority is development of improved warning content to help members of the public protect themselves when needed. Also important is professional communication with members of the public about allocation of responsibilities for managing flash flood risks, as well as improved system‐wide management of uncertainty in decisions.     

Improving Risk Communication

This paper explores reasons for difficulties in communicating risks among analysts, the laypublic, media, and regulators. Formulating risk communication problems as decisions involving objectives and alternatives helps to identify strategies for overcoming these difficulties. Several strategies are suggested to achieve risk communication objectives like improving public knowledge about risks and risk management, encouraging risk reduction behavior, understanding public values and concerns, and increasing trust and credibility.     

Characterizing Risk for Cumulative Risk Assessments

In assessing environmental health risks, the risk characterization step synthesizes information gathered in evaluating exposures to stressors together with dose–response relationships, characteristics of the exposed population, and external environmental conditions. This article summarizes key steps of a cumulative risk assessment (CRA) followed by a discussion of considerations for characterizing cumulative risks. Cumulative risk characterizations differ considerably from single chemical‐ or single source‐based risk characterization. CRAs typically focus on a specific population instead of a pollutant or pollutant source and should include an evaluation of all relevant sources contributing to the exposures in the population and other factors that influence dose–response relationships. Second, CRAs may include influential environmental and population‐specific conditions, involving multiple chemical and nonchemical stressors. Third, a CRA could examine multiple health effects, reflecting joint toxicity and the potential for toxicological interactions. Fourth, the complexities often necessitate simplifying methods, including judgment‐based and semi‐quantitative indices that collapse disparate data into numerical scores. Fifth, because of the higher dimensionality and potentially large number of interactions, information needed to quantify risk is typically incomplete, necessitating an uncertainty analysis. Three approaches that could be used for characterizing risks in a CRA are presented: the multiroute hazard index, stressor grouping by exposure and toxicity, and indices for screening multiple factors and conditions. Other key roles of the risk characterization in CRAs are also described, mainly the translational aspect of including a characterization summary for lay readers (in addition to the technical analysis), and placing the results in the context of the likely risk‐based decisions.     

Quantifying Uncertainty in a Risk Assessment Using Human Data

A call for risk assessment approaches that better characterize and quantify uncertainty has been made by the scientific and regulatory community. This paper responds to that call by demonstrating a distributional approach that draws upon human data to derive potency estimates and to identify and quantify important sources of uncertainty. The approach is rooted in the science of decision analysis and employs an influence diagram, a decision tree, probabilistic weights, and a distribution of point estimates of carcinogenic potency. Its results estimate the likelihood of different carcinogenic risks (potencies) for a chemical under a specific scenario. For this exercise, human data on formaldehyde were employed to demonstrate the approach. Sensitivity analyses were performed to determine the relative impact of specific levels and alternatives on the potency distribution. The resulting potency estimates are compared with the results of an exercise using animal data on formaldehyde. The paper demonstrates that distributional risk assessment is readily adapted to situations in which epidemiologic data serve as the basis for potency estimates. Strengths and weaknesses of the distributional approach are discussed. Areas for further application and research are recommended.     

Science and Decisions: Advancing Risk Assessment

At the request of the U.S. Environmental Protection Agency (EPA), the National Research Council (NRC) recently completed a major report, Science and Decisions: Advancing Risk Assessment, that is intended to strengthen the scientific basis, credibility, and effectiveness of risk assessment practices and subsequent risk management decisions. The report describes the challenges faced by risk assessment and the need to consider improvements in both the technical analyses of risk assessments (i.e., the development and use of scientific information to improve risk characterization) and the utility of risk assessments (i.e., making assessments more relevant and useful for risk management decisions). The report tackles a number of topics relating to improvements in the process, including the design and framing of risk assessments, uncertainty and variability characterization, selection and use of defaults, unification of cancer and noncancer dose‐response assessment, cumulative risk assessment, and the need to increase EPA's capacity to address these improvements. This article describes and summarizes the NRC report, with an eye toward its implications for risk assessment practices at EPA.     

Public participation in life cycle assessment and risk assessment: a shared need.

Life cycle assessment (LCA) and risk assessment are operationally different but share the common purpose of supporting decisions about reducing threats to human welfare. Both analysis methods also involve a complex mixture of science and value judgments reflecting epistemological as well as moral and esthetic values. The inability of risk assessment and LCA to be "value free" has been a source of considerable controversy in both communities. Recognition of the contingent and social nature of human interpretation of the risks and environmental impacts created by public and private decisions has led to an increased appreciation of the importance of involving interested and affected parties in risk characterization. Comparison of the value-based nature of LCA and risk assessment demonstrates the need for participation in LCA. Although the need for participation by affected parties in decision-making processes is gaining acceptance, there is little agreement as to how participation should be structured. Risk assessment and LCA have a shared need for research examining the design and analysis of participation processes appropriate to a given decision context. A proposed framework recommends participation strategies designed to enhance the effectiveness of policy-driven analyses such as risk assessment and LCA based on the level of trust that interested and affected parties have for other policy participants.     

Improving Health Risk Assessment as a Basis for Public Health Decisions in the 21st Century

One-fifth of the way through the 21st century, a commonality of factors with those of the last 50 years may offer the opportunity to address unfinished business and current challenges. The recommendations include: (1) Resisting the tendency to oversimplify scientific assessments by reliance on single disciplines in lieu of clear weight-of-evidence expressions, and on single quantitative point estimates of health protective values for policy decisions; (2) Improving the separation of science and judgment in risk assessment through the use of clear expressions of the range of judgments that bracket protective quantitative levels for public health protection; (3) Use of comparative risk to achieve the greatest gains in health and the environment; and (4) Where applicable, reversal of the risk assessment and risk management steps to facilitate timely and substantive improvements in public health and the environment. Lessons learned and improvements in the risk assessment process are applied to the unprecedented challenges of the 21st century such as, pandemics and climate change. The beneficial application of the risk assessment and risk management paradigm to ensure timely research with consistency and transparency of assessments is presented. Institutions with mandated stability and leadership roles at the national and international levels are essential to ensure timely interdisciplinary scientific assessment at the interface with public policy as a basis for organized policy decisions, to meet time sensitive goals, and to inform the public.