A Multicriteria Decision Analysis Model and Risk Assessment Framework for Carbon Capture and Storage

Multicriteria decision analysis (MCDA) has been applied to various energy problems to incorporate a variety of qualitative and quantitative criteria, usually spanning environmental, social, engineering, and economic fields. MCDA and associated methods such as life‐cycle assessments and cost‐benefit analysis can also include risk analysis to address uncertainties in criteria estimates. One technology now being assessed to help mitigate climate change is carbon capture and storage (CCS). CCS is a new process that captures CO₂ emissions from fossil‐fueled power plants and injects them into geological reservoirs for storage. It presents a unique challenge to decisionmakers (DMs) due to its technical complexity, range of environmental, social, and economic impacts, variety of stakeholders, and long time spans. The authors have developed a risk assessment model using a MCDA approach for CCS decisions such as selecting between CO₂ storage locations and choosing among different mitigation actions for reducing risks. The model includes uncertainty measures for several factors, utility curve representations of all variables, Monte Carlo simulation, and sensitivity analysis. This article uses a CCS scenario example to demonstrate the development and application of the model based on data derived from published articles and publicly available sources. The model allows high‐level DMs to better understand project risks and the tradeoffs inherent in modern, complex energy decisions.     

Fostering Innovation in Contaminated Sediments Management Through Multicriteria Technology Assessment and Public Participation

Management of contaminated sediments is problematic and costly. Several new technologies are under development that may in some cases reduce costs and environmental or ecological impacts. However, there are significant barriers to implementing new technologies, including the increased management complexity, the potential for introducing antagonistic or incommensurate objectives that are unfamiliar to stakeholders or regulators, and the difficulty of capturing private, commercial benefits from environmental improvements that may primarily benefit the public. This article identifies several innovative contaminated sediments technologies, discusses the difficulty of proving or quantifying the benefits of new technologies, and presents an agenda for research that would foster partnerships between scientific, government, and public communities of interest for the purpose of improving innovative technology assessment and environmental decision making.     

Multicriteria Decision Framework for Cybersecurity Risk Assessment and Management

Risk assessors and managers face many difficult challenges related to novel cyber systems. Among these challenges are the constantly changing nature of cyber systems caused by technical advances, their distribution across the physical, information, and sociocognitive domains, and the complex network structures often including thousands of nodes. Here, we review probabilistic and risk-based decision-making techniques applied to cyber systems and conclude that existing approaches typically do not address all components of the risk assessment triplet (threat, vulnerability, consequence) and lack the ability to integrate across multiple domains of cyber systems to provide guidance for enhancing cybersecurity. We present a decision-analysis-based approach that quantifies threat, vulnerability, and consequences through a set of criteria designed to assess the overall utility of cybersecurity management alternatives. The proposed framework bridges the gap between risk assessment and risk management, allowing an analyst to ensure a structured and transparent process of selecting risk management alternatives. The use of this technique is illustrated for a hypothetical, but realistic, case study exemplifying the process of evaluating and ranking five cybersecurity enhancement strategies. The approach presented does not necessarily eliminate biases and subjectivity necessary for selecting countermeasures, but provides justifiable methods for selecting risk management actions consistent with stakeholder and decisionmaker values and technical data.     

Uses and Misuses of Multicriteria Decision Analysis (MCDA) in Environmental Decision Making

We focus on a class of multicriteria methods that are commonly used in environmental decision making—those that employ the weighted linear average algorithm (and this includes the popular analytic hierarchy process (AHP)). While we do not doubt the potential benefits of using formal decision methods of this type, we draw attention to the consequences of not using them well. In particular, we highlight a property of these methods that should not be overlooked when they are applied in environmental and wider decision-making contexts: the final decision or ranking of options is dependent on the choice of performance scoring scales for the criteria when the criteria weights are held constant. We compare this "sensitivity" to a well-known criticism of the AHP, and we go on to describe the more general lesson when it comes to using weighted linear average methods—a lesson concerning the relationship between criteria weights and performance scoring scales.     

The Role of Decision Analysis in Risk Analysis: A Retrospective

In commemorating the 40th anniversary of Risk Analysis, this article takes a retrospective look at some of the ways in which decision analysis (as a “sibling field”) has contributed to the development both of the journal, and of risk analysis as a field. I begin with some early foundational papers from the first decade of the journal's history. I then review a number of papers that have applied decision analysis to risk problems over the years, including applications of related methods such as influence diagrams, multicriteria decision analysis, and risk matrices. The article then reviews some recent trends, from roughly the last five years, and concludes with observations about the parallel evolution of risk analysis and decision analysis over the decades—especially with regard to the importance of representing multiple stakeholder perspectives, and the importance of behavioral realism in decision models. Overall, the extensive literature surveyed here supports the view that the incorporation of decision-analytic perspectives has improved the practice of risk analysis.     

Use of Multicriteria Decision Analysis to Support Weight of Evidence Evaluation

Weight of evidence (WOE) methods are key components of ecological and human health risk assessments. Most WOE applications rely on the qualitative integration of diverse lines of evidence (LOE) representing impact on ecological receptors and humans. Recent calls for transparency in assessments and justifiability of management decisions are pushing the community to consider quantitative methods for integrated risk assessment and management. This article compares and contrasts the type of information required for application of individual WOE techniques and the outcomes that they provide in ecological risk assessment and proposes a multicriteria decision analysis (MCDA) framework for integrating individual LOE in support of management decisions. The use of quantitative WOE techniques is illustrated for a hypothetical but realistic case study of selecting remedial alternatives at a contaminated aquatic site. Use of formal MCDA does not necessarily eliminate biases and judgment calls necessary for selecting remedial alternatives, but allows for transparent evaluation and fusion of individual LOE. It also provides justifiable methods for selecting remedial alternatives consistent with stakeholder and decision‐maker values.     

Evaluation of Multicriteria Decision Analysis Algorithms in Food Safety: A Case Study on Emerging Zoonoses Prioritization

Decision making in food safety is a complex process that involves several criteria of different nature like the expected reduction in the number of illnesses, the potential economic or health-related cost, or even the environmental impact of a given policy or intervention. Several multicriteria decision analysis (MCDA) algorithms are currently used, mostly individually, in food safety to rank different options in a multifactorial environment. However, the selection of the MCDA algorithm is a decision problem on its own because different methods calculate different rankings. The aim of this study was to compare the impact of different uncertainty sources on the rankings of MCDA problems in the context of food safety. For that purpose, a previously published data set on emerging zoonoses in the Netherlands was used to compare different MCDA algorithms: MMOORA, TOPSIS, VIKOR, WASPAS, and ELECTRE III. The rankings were calculated with and without considering uncertainty (using fuzzy sets), to assess the importance of this factor. The rankings obtained differed between algorithms, emphasizing that the selection of the MCDA method had a relevant impact in the rankings. Furthermore, considering uncertainty in the ranking had a high influence on the results. Both factors were more relevant than the weights associated with each criterion in this case study. A hierarchical clustering method was suggested to aggregate results obtained by the different algorithms. This complementary step seems to be a promising way to decrease extreme difference among algorithms and could provide a strong added value in the decision-making process.     

An Integrated Approach to Oversight Assessment for Emerging Technologies

Analysis of oversight systems is often conducted from a single disciplinary perspective and by using a limited set of criteria for evaluation. In this article, we develop an approach that blends risk analysis, social science, public administration, legal, public policy, and ethical perspectives to develop a broad set of criteria for assessing oversight systems. Multiple methods, including historical analysis, expert elicitation, and behavioral consensus, were employed to develop multidisciplinary criteria for evaluating oversight of emerging technologies. Sixty‐six initial criteria were identified from extensive literature reviews and input from our Working Group. Criteria were placed in four categories reflecting the development, attributes, evolution, and outcomes of oversight systems. Expert elicitation, consensus methods, and multidisciplinary review of the literature were used to refine a condensed, operative set of criteria. Twenty‐eight criteria resulted spanning four categories: seven development criteria, 15 attribute criteria, five outcome criteria, and one evolution criterion. These criteria illuminate how oversight systems develop, operate, change, and affect society. We term our approach “integrated oversight assessment” and propose its use as a tool for analyzing relationships among features, outcomes, and tradeoffs of oversight systems. Comparisons among historical case studies of oversight using a consistent set of criteria should result in defensible and evidence‐supported lessons to guide the development of oversight systems for emerging technologies, such as nanotechnology.     

Assessing the Multidimensionality of Coastal Erosion Risks: Public Participation and Multicriteria Analysis in a Mediterranean Coastal System

The complex and multidimensional nature of coastal erosion risks makes it necessary to move away from single-perspective assessment and management methods that have conventionally predominated in coastal management. This article explores the suitability of participatory multicriteria analysis (MCA) for improving the integration of diverse expertises and values and enhancing the social-ecological robustness of the processes that lead to the definition of relevant policy options to deal with those risks. We test this approach in the Mediterranean coastal locality of Lido de Sète in France. Results show that the more adaptive alternatives such as "retreating the shoreline" were preferred by our selected stakeholders to those corresponding to "protecting the shoreline" and the business as usual proposals traditionally put forward by experts and policymakers on these matters. Participative MCA contributed to represent coastal multidimensionality, elicit and integrate different views and preferences, facilitated knowledge exchange, and allowed highlighting existing uncertainties.     

Advances on a Decision Analytic Approach to Exposure-Based Chemical Prioritization

The volume and variety of manufactured chemicals is increasing, although little is known about the risks associated with the frequency and extent of human exposure to most chemicals. The EPA and the recent signing of the Lautenberg Act have both signaled the need for high-throughput methods to characterize and screen chemicals based on exposure potential, such that more comprehensive toxicity research can be informed. Prior work of Mitchell et al. using multicriteria decision analysis tools to prioritize chemicals for further research is enhanced here, resulting in a high-level chemical prioritization tool for risk-based screening. Reliable exposure information is a key gap in currently available engineering analytics to support predictive environmental and health risk assessments. An elicitation with 32 experts informed relative prioritization of risks from chemical properties and human use factors, and the values for each chemical associated with each metric were approximated with data from EPA's CP_CAT database. Three different versions of the model were evaluated using distinct weight profiles, resulting in three different ranked chemical prioritizations with only a small degree of variation across weight profiles. Future work will aim to include greater input from human factors experts and better define qualitative metrics.     

A Social Decision Analysis of the Earthquake Safety Problem: The Case of Existing Los Angeles Buildings

In this paper we propose a framework for conducting a decision analysis for a societal problem such as earthquake safety. The application deals with the formulation and evaluation of alternative policies for the seismic safety problem faced by the city of Los Angeles with regard to its old masonry buildings. A social decision analysis compares the costs and benefits of the alternative policies from the viewpoints of the impacted constituents. The emphasis is on identifying acceptable policy that considers the interests of the impacted constituents and provides incentives for their cooperation. Alternatives ranging from strict regulation to free market are examined. In order to evaluate the trade-offs between additional cost and savings in lives, a direct willingness-to-pay and an economic approach, based on property value differential, are used. Recommendations range from strict regulation for the residential and critical buildings (schools, hospitals, fire stations, etc.) to simply informing the occupants (in the case of commercial and industrial buildings) of the risks involved.     

Decision Making Under Uncertainty—An Example for Seismic Risk Management

Decision-making techniques are used to select the "best" alternatives under multiple and often conflicting criteria. Multicriteria decision making (MCDM) necessitates to incorporate uncertainties in the decision-making process. The major thrust of this article is to extend the framework proposed by Yager^{( 1 )} for multiple decisionmakers and fuzzy utilities (payoffs). In addition, the concept of expert credibility factor is introduced. The proposed approach is demonstrated for an example of seismic risk management using a heuristic hierarchical structure. A step-by-step formulation of the proposed approach is illustrated using a hypothetical example and a three-story reinforced concrete building.     

A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept

Invasive species risk maps provide broad guidance on where to allocate resources for pest monitoring and regulation, but they often present individual risk components (such as climatic suitability, host abundance, or introduction potential) as independent entities. These independent risk components are integrated using various multicriteria analysis techniques that typically require prior knowledge of the risk components’ importance. Such information is often nonexistent for many invasive pests. This study proposes a new approach for building integrated risk maps using the principle of a multiattribute efficient frontier and analyzing the partial order of elements of a risk map as distributed in multidimensional criteria space. The integrated risks are estimated as subsequent multiattribute frontiers in dimensions of individual risk criteria. We demonstrate the approach with the example of Agrilus biguttatus Fabricius, a high‐risk pest that may threaten North American oak forests in the near future. Drawing on U.S. and Canadian data, we compare the performance of the multiattribute ranking against a multicriteria linear weighted averaging technique in the presence of uncertainties, using the concept of robustness from info‐gap decision theory. The results show major geographic hotspots where the consideration of tradeoffs between multiple risk components changes integrated risk rankings. Both methods delineate similar geographical regions of high and low risks. Overall, aggregation based on a delineation of multiattribute efficient frontiers can be a useful tool to prioritize risks for anticipated invasive pests, which usually have an extremely poor prior knowledge base.     

What to Do at Low Doses: A Bounding Approach for Economic Analysis

To quantify the health benefits of environmental policies, economists generally require estimates of the reduced probability of illness or death. For policies that reduce exposure to carcinogenic substances, these estimates traditionally have been obtained through the linear extrapolation of experimental dose-response data to low-exposure scenarios as described in the U.S. Environmental Protection Agency's Guidelines for Carcinogen Risk Assessment (1986). In response to evolving scientific knowledge, EPA proposed revisions to the guidelines in 1996. Under the proposed revisions, dose-response relationships would not be estimated for carcinogens thought to exhibit nonlinear modes of action. Such a change in cancer-risk assessment methods and outputs will likely have serious consequences for how benefit-cost analyses of policies aimed at reducing cancer risks are conducted. Any tendency for reduced quantification of effects in environmental risk assessments, such as those contemplated in the revisions to EPA's cancer-risk assessment guidelines, impedes the ability of economic analysts to respond to increasing calls for benefit-cost analysis. This article examines the implications for benefit-cost analysis of carcinogenic exposures of the proposed changes to the 1986 Guidelines and proposes an approach for bounding dose-response relationships when no biologically based models are available. In spite of the more limited quantitative information provided in a carcinogen risk assessment under the proposed revisions to the guidelines, we argue that reasonable bounds on dose-response relationships can be estimated for low-level exposures to nonlinear carcinogens. This approach yields estimates of reduced illness for use in a benefit-cost analysis while incorporating evidence of nonlinearities in the dose-response relationship. As an illustration, the bounding approach is applied to the case of chloroform exposure.     

A Dominance-Based Rough Set Approach for an Enhanced Assessment of Seasonal Influenza Risk

Accounting for about 290,000–650,000 deaths across the globe, seasonal influenza is estimated by the World Health Organization to be a major cause of mortality. Hence, there is a need for a reliable and robust epidemiological surveillance decision-making system to understand and combat this epidemic disease. In a previous study, the authors proposed a decision support system to fight against seasonal influenza. This system is composed of three subsystems: (i) modeling and simulation, (ii) data warehousing, and (iii) analysis. The analysis subsystem relies on spatial online analytical processing (S-OLAP) technology. Although the S-OLAP technology is useful in analyzing multidimensional spatial data sets, it cannot take into account the inherent multicriteria nature of seasonal influenza risk assessment by itself. Therefore, the objective of this article is to extend the existing decision support system by adding advanced multicriteria analysis capabilities for enhanced seasonal influenza risk assessment and monitoring. Bearing in mind the characteristics of the decision problem considered in this article, a well-known multicriteria classification method, the dominance-based rough set approach (DRSA), was selected to boost the existing decision support system. Combining the S-OLAP technology and the multicriteria classification method DRSA in the same decision support system will largely improve and extend the scope of analysis capabilities. The extended decision support system has been validated by its application to assess seasonal influenza risk in the northwest region of Algeria.     

Risk Ranking of Antimicrobial‐Resistant Hazards Found in Meat in Switzerland

Human exposure to bacteria resistant to antimicrobials and transfer of related genes is a complex issue and occurs, among other pathways, via meat consumption. In a context of limited resources, the prioritization of risk management activities is essential. Since the antimicrobial resistance (AMR) situation differs substantially between countries, prioritization should be country specific. The objective of this study was to develop a systematic and transparent framework to rank combinations of bacteria species resistant to selected antimicrobial classes found in meat, based on the risk they represent for public health in Switzerland. A risk assessment model from slaughter to consumption was developed following the Codex Alimentarius guidelines for risk analysis of foodborne AMR. Using data from the Swiss AMR monitoring program, 208 combinations of animal species/bacteria/antimicrobial classes were identified as relevant hazards. Exposure assessment and hazard characterization scores were developed and combined using multicriteria decision analysis. The effect of changing weights of scores was explored with sensitivity analysis. Attributing equal weights to each score, poultry‐associated combinations represented the highest risk. In particular, contamination with extended‐spectrum β‐lactamase/plasmidic AmpC‐producing Escherichia coli in poultry meat ranked high for both exposure and hazard characterization. Tetracycline‐ or macrolide‐resistant Enterococcus spp., as well as fluoroquinolone‐ or macrolide‐resistant Campylobacter jejuni , ranked among combinations with the highest risk. This study provides a basis for prioritizing future activities to mitigate the risk associated with foodborne AMR in Switzerland. A user‐friendly version of the model was provided to risk managers; it can easily be adjusted to the constantly evolving knowledge on AMR.     

Decision Analysis and Risk Management Decision Making: Issues and Methods

This paper provides an overview of decision analysis and its use in risk management decision making. The paper discusses the distinctive characteristics of decision analysis and compares these characteristics with those of its principal alternative—cost–benefit analysis. The paper also discusses each of the steps in a decision analysis and the strengths and limitations of the method.     

An Anticipatory Governance Approach to Carbon Nanotubes

Carbon nanotubes (CNTs) are novel materials with remarkable properties; possible beneficial applications include aircraft frames, hydrogen storage, environmental sensors, electrical transmission, and many more. At the same time, precise characterization of their potential toxicity remains elusive, in part because engineered nanostructures pose challenges to existing assays, predictive models, and dosimetry. While these obstacles are surmountable, their presence suggests that scientific uncertainty regarding the hazards of CNTs is likely to persist. Traditional U.S. policy approaches implicitly pose the question: “What level of evidence is necessary and sufficient to justify regulatory action?” In the case of CNTs, such a strategy of risk analysis is of limited immediate utility to both regulators essaying to carry out their mandates, and users of CNTs seeking to provide an appropriate level of protection to employees, customers, and other stakeholders. In contrast, the concept of anticipatory governance suggests an alternative research focus, that is: “Given the conflicted character of the data, how should relevant actors respond?” Adopting the latter theoretical framework, this article argues that currently available data support treating CNTs “as if” they are hazardous, while simultaneously highlighting some systemic uncertainties in many of the experiments carried out to date. Such a conclusion implies limiting exposure throughout product lifecycles, and also points to the possible applicability of various conceptual tools, such as life‐cycle and multicriteria decision analysis approaches, in choosing appropriate courses of action in the face of prolonged uncertainty.     

Cognitive and Motivational Biases in Decision and Risk Analysis

Behavioral decision research has demonstrated that judgments and decisions of ordinary people and experts are subject to numerous biases. Decision and risk analysis were designed to improve judgments and decisions and to overcome many of these biases. However, when eliciting model components and parameters from decisionmakers or experts, analysts often face the very biases they are trying to help overcome. When these inputs are biased they can seriously reduce the quality of the model and resulting analysis. Some of these biases are due to faulty cognitive processes; some are due to motivations for preferred analysis outcomes. This article identifies the cognitive and motivational biases that are relevant for decision and risk analysis because they can distort analysis inputs and are difficult to correct. We also review and provide guidance about the existing debiasing techniques to overcome these biases. In addition, we describe some biases that are less relevant because they can be corrected by using logic or decomposing the elicitation task. We conclude the article with an agenda for future research.     

Decision Analysis for Utilizing Hazardous Waste Site Assessments in Real Estate Acquisition

When a buyer needs to purchase commercial or industrial property, the decision of what real estate to purchase should be based on an assessment of the total costs of acquisition. In addition to the direct purchase cost, other possible costs include hazardous waste site assessment studies and clean up costs if the purchased site proves to be contaminated. This paper presents a decision analysis model for determining when and which type of hazardous waste assessment tests should be conducted and how the test output affects the choice of site. The model assumes there are two types of hazardous waste assessment, an historical use review (phase 1 test)and soil and water sampling (phase 2 test). Model inputs include the cost, sensitivity and specificity for each type of test, a site's purchase price, and a priori probability of contamination, along with the clean-up cost for a contaminated site. The analysis uses the results of a data survey of 17 environmental engineering firms in setting values on the model input requirements. The paper also reports on sensitivity analysis with the model for the purpose of providing decision-makers with explicit protocols for test utilization.