Comparative assessment of analytical approaches to quantify the risk for introduction of rare animal diseases: the example of avian influenza in Spain

Trade of animals and animal products imposes an uncertain and variable risk for exotic animal diseases introduction into importing countries. Risk analysis provides importing countries with an objective, transparent, and internationally accepted method for assessing that risk. Over the last decades, European Union countries have conducted probabilistic risk assessments quite frequently to quantify the risk for rare animal diseases introduction into their territories. Most probabilistic animal health risk assessments have been typically classified into one-level and multilevel binomial models. One-level models are more simple than multilevel models because they assume that animals or products originate from one single population. However, it is unknown whether such simplification may result in substantially different results compared to those obtained through the use of multilevel models. Here, data used on a probabilistic multilevel binomial model formulated to assess the risk for highly pathogenic avian influenza introduction into Spain were reanalyzed using a one-level binomial model and their outcomes were compared. An alternative ordinal model is also proposed here, which makes use of simpler assumptions and less information compared to those required by traditional one-level and multilevel approaches. Results suggest that, at least under certain circumstances, results of the one-level and ordinal approaches are similar to those obtained using multilevel models. Consequently, we argue that, when data are insufficient to run traditional probabilistic models, the ordinal approach presented here may be a suitable alternative to rank exporting countries in terms of the risk that they impose for the spread of rare animal diseases into disease-free countries.     

Spatial Stochastic Simulation Offers Potential as a Quantitative Method for Pest Risk Analysis

Pest risk analysis represents an emerging field of risk analysis that evaluates the potential risks of the introduction and establishment of plant pests into a new geographic location and then assesses the management options to reduce those potential risks. Development of new and adapted methodology is required to answer questions concerning pest risk analysis of exotic plant pests. This research describes a new method for predicting the potential establishment and spread of a plant pest into new areas using a case study, Ralstonia solanacearum, a bacterial disease of potato. This method combines current quantitative methodologies, stochastic simulation, and geographic information systems with knowledge of pest biology and environmental data to derive new information about pest establishment potential in a geographical region where a pest had not been introduced. This proposed method extends an existing methodology for matching pest characteristics with environmental conditions by modeling and simulating dissemination behavior of a pest organism. Issues related to integrating spatial variables into risk analysis models are further discussed in this article.     

Uncertainty in Comparative Risk Analysis for Threatened Australian Plant Species

Australian state and federal agencies use a broad range of methods for setting conservation priorities for species at risk. Some of these are based on rule sets developed by the International Union for the Conservation of Nature, while others use point scoring protocols to assess threat. All of them ignore uncertainty in the data. In this study, we assessed the conservation status of 29 threatened vascular plants from Tasmania and New South Wales using a variety of methods including point scoring and rule-based approaches. In addition, several methods for dealing with uncertainty in the data were applied to each of the priority-setting schemes. The results indicate that the choice of a protocol for setting priorities and the choice of the way in which uncertainty is treated may make important differences to the resulting assessments of risk. The choice among methods needs to be rationalized within the management context in which it is to be applied. These methods are not a substitute for more formal risk assessment.     

A Risk Analysis Approach to Prioritizing Epidemics: Ebola Virus Disease in West Africa as a Case Study

The 2014 Ebola virus disease (EVD) outbreak affected several countries worldwide, including six West African countries. It was the largest Ebola epidemic in the history and the first to affect multiple countries simultaneously. Significant national and international delay in response to the epidemic resulted in 28,652 cases and 11,325 deaths. The aim of this study was to develop a risk analysis framework to prioritize rapid response for situations of high risk. Based on findings from the literature, sociodemographic features of the affected countries, and documented epidemic data, a risk scoring framework using 18 criteria was developed. The framework includes measures of socioeconomics, health systems, geographical factors, cultural beliefs, and traditional practices. The three worst affected West African countries (Guinea, Sierra Leone, and Liberia) had the highest risk scores. The scores were much lower in developed countries that experienced Ebola compared to West African countries. A more complex risk analysis framework using 18 measures was compared with a simpler one with 10 measures, and both predicted risk equally well. A simple risk scoring system can incorporate measures of hazard and impact that may otherwise be neglected in prioritizing outbreak response. This framework can be used by public health personnel as a tool to prioritize outbreak investigation and flag outbreaks with potentially catastrophic outcomes for urgent response. Such a tool could mitigate costly delays in epidemic response.     

What's Wrong with Hazard‐Ranking Systems? An Expository Note

Two commonly recommended principles for allocating risk management resources to remediate uncertain hazards are: (1) select a subset to maximize risk-reduction benefits (e.g., maximize the von Neumann-Morgenstern expected utility of the selected risk-reducing activities), and (2) assign priorities to risk-reducing opportunities and then select activities from the top of the priority list down until no more can be afforded. When different activities create uncertain but correlated risk reductions, as is often the case in practice, then these principles are inconsistent: priority scoring and ranking fails to maximize risk-reduction benefits. Real-world risk priority scoring systems used in homeland security and terrorism risk assessment, environmental risk management, information system vulnerability rating, business risk matrices, and many other important applications do not exploit correlations among risk-reducing opportunities or optimally diversify risk-reducing investments. As a result, they generally make suboptimal risk management recommendations. Applying portfolio optimization methods instead of risk prioritization ranking, rating, or scoring methods can achieve greater risk-reduction value for resources spent.     

Establishment Risks for Invasive Species

This article presents a quantitative methodology for evaluating the probability of invasive pest species establishing persistent populations. The estimation of pest establishment relies on data and information describing the biology and ecology of the pest and its interactions with potential host species and the regional environment. This information is developed using a model construct borrowed from theoretical population ecology. The methodology for estimating the probability of pest establishment is part of an overall framework that explores the implications of reductions in pest invasions on subsequent establishment. The risk reduction framework integrates the engineering aspects of different technologies for reducing pest entry, the biology and ecology of pest species, the suitability of potentially susceptible hosts, and the quality of available habitats. The methodology for estimating the risk of establishment is presented using an example pest, the Asian longhorned beetle ( Anoplophora glabripennis ), which has been introduced into the United States via solid wood packing materials (SWPM) used in international commerce. Uncertainties inherent to the estimation of model parameters that determine the risk of establishment are defined, quantified, and propagated through the population model. Advantages and limitations of the proposed methodology are discussed along with recommendations to make the approach more useful in the management of risks posed by the establishment of pest populations.     

A Comparison of Three Methods for Calculating Confidence Intervals for the Benchmark Dose

Various methods exist to calculate confidence intervals for the benchmark dose in risk analysis. This study compares the performance of three such methods in fitting nonlinear dose-response models: the delta method, the likelihood-ratio method, and the bootstrap method. A data set from a developmental toxicity test with continuous, ordinal, and quantal dose-response data is used for the comparison of these methods. Nonlinear dose-response models, with various shapes, were fitted to these data. The results indicate that a few thousand runs are generally needed to get stable confidence limits when using the bootstrap method. Further, the bootstrap and the likelihood-ratio method were found to give fairly similar results. The delta method, however, resulted in some cases in different (usually narrower) intervals, and appears unreliable for nonlinear dose-response models. Since the bootstrap method is more time consuming than the likelihood-ratio method, the latter is more attractive for routine dose-response analysis. In the context of a probabilistic risk assessment the bootstrap method has the advantage that it directly links to Monte Carlo analysis.     

Probabilistic Modeling of the Fate of Listeria Monocytogenes in Diced Bacon During the Manufacturing Process

To assess the impact of the manufacturing process on the fate of Listeria monocytogenes, we built a generic probabilistic model intended to simulate the successive steps in the process. Contamination evolution was modeled in the appropriate units (breasts, dice, and then packaging units through the successive steps in the process). To calibrate the model, parameter values were estimated from industrial data, from the literature, and based on expert opinion. By means of simulations, the model was explored using a baseline calibration and alternative scenarios, in order to assess the impact of changes in the process and of accidental events. The results are reported as contamination distributions and as the probability that the product will be acceptable with regards to the European regulatory safety criterion. Our results are consistent with data provided by industrial partners and highlight that tumbling is a key step for the distribution of the contamination at the end of the process. Process chain models could provide an important added value for risk assessment models that basically consider only the outputs of the process in their risk mitigation strategies. Moreover, a model calibrated to correspond to a specific plant could be used to optimize surveillance.     

A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept

Invasive species risk maps provide broad guidance on where to allocate resources for pest monitoring and regulation, but they often present individual risk components (such as climatic suitability, host abundance, or introduction potential) as independent entities. These independent risk components are integrated using various multicriteria analysis techniques that typically require prior knowledge of the risk components’ importance. Such information is often nonexistent for many invasive pests. This study proposes a new approach for building integrated risk maps using the principle of a multiattribute efficient frontier and analyzing the partial order of elements of a risk map as distributed in multidimensional criteria space. The integrated risks are estimated as subsequent multiattribute frontiers in dimensions of individual risk criteria. We demonstrate the approach with the example of Agrilus biguttatus Fabricius, a high‐risk pest that may threaten North American oak forests in the near future. Drawing on U.S. and Canadian data, we compare the performance of the multiattribute ranking against a multicriteria linear weighted averaging technique in the presence of uncertainties, using the concept of robustness from info‐gap decision theory. The results show major geographic hotspots where the consideration of tradeoffs between multiple risk components changes integrated risk rankings. Both methods delineate similar geographical regions of high and low risks. Overall, aggregation based on a delineation of multiattribute efficient frontiers can be a useful tool to prioritize risks for anticipated invasive pests, which usually have an extremely poor prior knowledge base.     

Stochasticity in Physiologically Based Kinetics Models: Implications for Cancer Risk Assessment

In case of low-dose exposure to a substance, its concentration in cells is likely to be stochastic. Assessing the consequences of this stochasticity in toxicological risk assessment requires the coupling of macroscopic dynamics models describing whole-body kinetics with microscopic tools designed to simulate stochasticity. In this article, we propose an approach to approximate stochastic cell concentration of butadiene in the cells of diverse organs. We adapted the dynamics equations of a physiologically based pharmacokinetic (PBPK) model and used a stochastic simulator for the system of equations that we derived. We then coupled kinetics simulations with a deterministic hockey stick model of carcinogenicity. Stochasticity induced substantial modifications relative to dose-response curve, compared with the deterministic situation. In particular, there was nonlinearity in the response and the stochastic apparent threshold was lower than the deterministic one. The approach that we developed could easily be extended to other biological studies to assess the influence of stochasticity at macroscopic scale for compound dynamics at the cell level.     

Improving Risk-Based Decision Making for Terrorism Applications

How can we best allocate limited defensive resources to reduce terrorism risks? Dillon et al.'s Antiterrorism Risk-Based Decision Aid (ARDA) system provides a useful point of departure for addressing this crucial question by exhibiting a real-world system that calculates risk reduction scores for different portfolios of risk-reducing countermeasures and using them to rank-order different possible risk mitigation alternatives for Navy facilities. This comment points out some potential limitations of any scoring system that does not take into account risk externalities, interdependencies among threats, uncertainties that are correlated across targets, and attacker responses to alternative allocations of defensive resources. In at least some simple situations, allocations based on risk reduction scores and comparisons can inadvertently increase risks by providing intelligent attackers with valuable information, or they can fail to reduce risks as effectively as nonscoring, optimization-based approaches. These limitations of present scoring methods present exciting technical challenges and opportunities for risk analysts to develop improved methods for protecting facilities and infrastructure against terrorist threats.     

Individual differences in numerical representations of risk in health decision making: A fuzzy-trace theory approach

Fuzzy-trace theory predicts that decisionmakers process numerical information about risk at multiple levels in parallel: the simplest level, nominal (categorical some-none) gist, and at more fine-grained levels, involving relative comparison (ordinal less-more gist) and exact quantities (verbatim representations). However, little is known about how individual differences in these numerical representations relate to judgments and decisions, especially involving health tradeoffs and relative risks. To investigate these differences, we administered measures of categorical and ordinal gist representations of number, objective numeracy, and intelligence in two studies (Ns = 978 and 956). In both studies, categorical and ordinal gist representations of number predicted risk judgments and decisions beyond objective numeracy and intelligence. Participants with higher scores in categorical gist were more likely to choose options to avoid cancer recurrence risks; those who were higher in ordinal gist of numbers were more likely to discriminate relative risk of skin cancer; and those with higher scores in objective numeracy were more likely to choose options that were numerically superior overall in terms of relative risk of skin cancer and of genetic risks of breast cancer (e.g., lower numerical probability of cancer). Results support parallel-processing models that assume multiple representations of numerical information about risk, which vary in precision, and illustrate how individual differences in numerical representations are relevant to tradeoffs and risk comparisons in health decisions. These representations cannot be reduced to one another and explain psychological variations in risk processing that go beyond low versus high levels of objective numeracy.     

Categorical Regression Analysis of Acute Exposure to Tetrachloroethylene1

Exposure-response analysis of acute noncancer risks should consider both concentration (C) and duration (T) of exposure, as well as severity of response. Stratified categorical regression is a form of meta-analysis that addresses these needs by combining studies and analyzing response data expressed as ordinal severity categories. A generalized linear model for ordinal data was used to estimate the probability of response associated with exposure and severity category. Stratification of the regression model addresses systematic differences among studies by allowing one or more model parameters to vary across strata denned, for example, by species and sex. The ability to treat partial information addresses the difficulties in assigning consistent severity scores. Studies containing information on acute effects of tetrachloroethylene in rats, mice, and humans were analyzed. The mouse data were highly uncertain due to lack of data on effects of low concentrations and were excluded from the analysis. A model with species-specific concentration intercept terms for rat and human central nervous system data improved fit to the data compared with the base model (combined species). More complex models with strata denned by sex and species did not improve the fit. The stratified regression model allows human effect levels to be identified more confidently by basing the intercept on human data and the slope parameters on the combined data (on a C × T plot). This analysis provides an exposure–response function for acute exposures to tetrachloroethylene using categorical regression analysis.     

Will the Dismantlement of Early Retirement Schemes Increase Older Unemployment? A Competing‐risk Analysis for Belgium

On the basis of administrative data for Belgium, we estimate a competing‐risk model on transitions from employees aged 50 and older into unemployment, early and old‐age retirement while accounting for forward‐looking work disincentives. Our estimates are used to simulate a cut in early retirement benefits. Although this would enhance the financial sustainability of the social security system, our simulations predict a strong increase in unemployment among older blue‐collar workers in traditional industries. Members of private saving plans or occupational pension schemes and highly educated workers are predicted to move into the old‐age pension system.     

Probability Elicitation Under Severe Time Pressure: A Rank‐Based Method

Probability elicitation protocols are used to assess and incorporate subjective probabilities in risk and decision analysis. While most of these protocols use methods that have focused on the precision of the elicited probabilities, the speed of the elicitation process has often been neglected. However, speed is also important, particularly when experts need to examine a large number of events on a recurrent basis. Furthermore, most existing elicitation methods are numerical in nature, but there are various reasons why an expert would refuse to give such precise ratio‐scale estimates, even if highly numerate. This may occur, for instance, when there is lack of sufficient hard evidence, when assessing very uncertain events (such as emergent threats), or when dealing with politicized topics (such as terrorism or disease outbreaks). In this article, we adopt an ordinal ranking approach from multicriteria decision analysis to provide a fast and nonnumerical probability elicitation process. Probabilities are subsequently approximated from the ranking by an algorithm based on the principle of maximum entropy, a rule compatible with the ordinal information provided by the expert. The method can elicit probabilities for a wide range of different event types, including new ways of eliciting probabilities for stochastically independent events and low‐probability events. We use a Monte Carlo simulation to test the accuracy of the approximated probabilities and try the method in practice, applying it to a real‐world risk analysis recently conducted for DEFRA (the U.K. Department for the Environment, Farming and Rural Affairs): the prioritization of animal health threats.     

An integrated approach for water resources decision making under interactive and compound uncertainties

In recent years, the issue of water allocation among competing users has been of great concern for many countries due to increasing water demand from population growth and economic development. In water management systems, the inherent uncertainties and their potential interactions pose a significant challenge for water managers to identify optimal water-allocation schemes in a complex and uncertain environment. This paper thus proposes a methodology that incorporates optimization techniques and statistical experimental designs within a general framework to address the issues of uncertainty and risk as well as their correlations in a systematic manner. A water resources management problem is used to demonstrate the applicability of the proposed methodology. The results indicate that interval solutions can be generated for the objective function and decision variables, and a number of decision alternatives can be obtained under different policy scenarios. The solutions with different risk levels of constraint violation can help quantify the relationship between the economic objective and the system risk, which is meaningful for supporting risk management. The experimental data obtained from the Taguchi's orthogonal array design are useful for identifying the significant factors affecting the means of total net benefits. Then the findings from the mixed-level factorial experiment can help reveal the latent interactions between those significant factors at different levels and their effects on the modeling response.     

Robustness of Risk Maps and Survey Networks to Knowledge Gaps About a New Invasive Pest

In pest risk assessment it is frequently necessary to make management decisions regarding emerging threats under severe uncertainty. Although risk maps provide useful decision support for invasive alien species, they rarely address knowledge gaps associated with the underlying risk model or how they may change the risk estimates. Failure to recognize uncertainty leads to risk‐ignorant decisions and miscalculation of expected impacts as well as the costs required to minimize these impacts. Here we use the information gap concept to evaluate the robustness of risk maps to uncertainties in key assumptions about an invading organism. We generate risk maps with a spatial model of invasion that simulates potential entries of an invasive pest via international marine shipments, their spread through a landscape, and establishment on a susceptible host. In particular, we focus on the question of how much uncertainty in risk model assumptions can be tolerated before the risk map loses its value. We outline this approach with an example of a forest pest recently detected in North America, Sirex noctilio Fabricius. The results provide a spatial representation of the robustness of predictions of S. noctilio invasion risk to uncertainty and show major geographic hotspots where the consideration of uncertainty in model parameters may change management decisions about a new invasive pest. We then illustrate how the dependency between the extent of uncertainties and the degree of robustness of a risk map can be used to select a surveillance network design that is most robust to knowledge gaps about the pest.     

Regional Risk Assessment for Point Source Pollution Based on a Water Quality Model of the Taipu River,China

Point source pollution is one of the main threats to regional environmental health. Based on a water quality model, a methodology to assess the regional risk of point source pollution is proposed. The assessment procedure includes five parts: (1) identifying risk source units and estimating source emissions using Monte Carlo algorithms; (2) observing hydrological and water quality data of the assessed area, and evaluating the selected water quality model; (3) screening out the assessment endpoints and analyzing receptor vulnerability with the Choquet fuzzy integral algorithm; (4) using the water quality model introduced in the second step to predict pollutant concentrations for various source emission scenarios and analyzing hazards of risk sources; and finally, (5) using the source hazard values and receptor vulnerability scores to estimate overall regional risk. The proposed method, based on the Water Quality Analysis Simulation Program (WASP), was applied in the region of the Taipu River, which is in the Taihu Basin, China. Results of source hazard and receptor vulnerability analysis allowed us to describe aquatic ecological, human health, and socioeconomic risks individually, and also integrated risks in the Taipu region, from a series of risk curves. Risk contributions of sources to receptors were ranked, and the spatial distribution of risk levels was presented. By changing the input conditions, we were able to estimate risks for a range of scenarios. Thus, the proposed procedure may also be used by decisionmakers for long‐term dynamic risk prediction.     

A Risk Management Procedure for the Washington State Ferries

The state of Washington operates the largest passenger vessel ferry system in the United States. In part due to the introduction of high-speed ferries, the state of Washington established an independent blue-ribbon panel to assess the adequacy of requirements for passenger and crew safety aboard the Washington state ferries. On July 9, 1998, the Blue Ribbon Panel on Washington State Ferry Safety engaged a consultant team from The George Washington University and Rensselaer Polytechnic Institute/Le Moyne College to assess the adequacy of passenger and crew safety in the Washington state ferry (WSF) system, to evaluate the level of risk present in the WSF system, and to develop recommendations for prioritized risk reduction measures, which, once implemented, can improve the level of safety in the WSF system. The probability of ferry collisions in the WSF system was assessed using a dynamic simulation methodology that extends the scope of available data with expert judgment. The potential consequences of collisions were modeled in order to determine the requirements for onboard and external emergency response procedures and equipment. The methodology was used to evaluate potential risk reduction measures and to make detailed risk management recommendations to the blue-ribbon panel and the Washington State Transportation Commission.     

不完备判断信息情境下群组DEMATEL决策方法

为克服群组决策试行与评价实验室（DEMATEL）方法难以处理不完备专家判断信息问题，以及预先指定评价标度和群组信息集成规则不适应复杂决策环境的内在缺陷，本文基于群共识排序理论，提出一种能够有效处理不完备判断信息的群组DEMATEL决策方法。该方法的创新之处在于：第一，它能够以灵活的标度方式有效地反映群组专家的偏好判断表达。第二，它也能通过序列转换和共识度的引入较好地处理群组DEMATEL不完备判断信息。第三，它能够合理地反映决策结果因群共识水平不同而变化的复杂机理。实例验证结果表明，所提方法是切实可行的，能够有效解决实践中的决策问题。