Derivation of a Target Level of Lead in Soil at Residential Sites Corresponding to a De Minimis Contribution to Blood Lead Concentration1

Inability to define either a clear toxicologic threshold or a stochastic all-or-nothing (cancer-type) response model for the noncarcinogenic effects of lead (Pb) in young children has posed difficulties for derivation of risk-based target levels of Pb in residential soil. Approaches based on empirical relationships between Pb levels in blood (PbB) and Pb in soil suffer from inability to specify the numerous variables which mediate between these two quantities. Approaches based on achieving a toxicologically de minimis target PbB level (e.g., 10 μg/dl) are subject to large uncertainty in estimating the distribution of existing PbB levels in a specific exposed population and in estimating the relative contribution from nonsoil sources of Pb. The multisource contribution to the distribution of PbB makes this approach unsuited for determination of a target Pb level in a single medium. An alternative approach is presented based on achieving a de minimis contribution to PbB (ΔPbB) from soil. Contributions to Pb exposure from outdoor soil and indoor soil-derived dust (ISDD) are modeled and appropriate values are suggested for input parameters. This analysis predicts that chronic exposure of young children to 200 μg Pb/g (ppm) in residential soil will result in a ΔPbB of 2 μg Pb/dl blood. This concentration of Pb in soil may provide an appropriate target level for residential soil when other significant sources of Pb exposure are present. In other cases, this approach can be used to predict a soil concentration of Pb corresponding to an appropriate non-de minimisΔPbB.     

An Enforceable Indoor Air Quality Standard for Environmental Tobacco Smoke in the Workplace1

Environmental tobacco smoke (ETS)has recently been determined by U.S. environmental and occupational health authorities to be a human carcinogen. We develop a model which permits using atmospheric nicotine measurements to estimate nonsmokers’ETS lung cancer risks in individual workplaces for the first time. We estimate that during the 1980s, the U.S. nonsmoking adult population's median nicotine lung exposure (homes and workplaces combined)was 143 micrograms (μg)of nicotine daily, and that most-exposed adult nonsmokers inhaled 1430 μg/day. These exposure estimates are validated by pharmacokinetic modeling which yields the corresponding steady-state dose of the nicotine metabolite, cotinine. For U.S. adult nonsmokers of working age, we estimate median cotinine values of about 1.0 nanogram per milliliter (ng/ml)in plasma, and 6.2 ng/ml in urine; for most-exposed nonsmokers, we estimate cotinine concentrations of about 10 ng/ml in plasma and 62 ng/ml in urine. These values are consistent to within 15% of the cotinine values observed in contemporaneous clinical epidemiological studies. Corresponding median risk from ETS exposure in U.S. nonsmokers during the 1980s is estimated at about two lung cancer deaths (LCDs)per 1000 at risk, and for most-exposed nonsmokers, about two LCDs per 100. Risks abroad appear similar. Modeling of the lung cancer mortality risk from passive smoking suggests that de minimis [i.e., “acceptable” (10^-6)], risk occurs at an 8-hr time-weighted-average exposure concentration of 7.5 nanograms of ETS nicotine per cubic meter of workplace air for a working lifetime of 40 years. This model is based upon a linear exposure-response relationship validated by physical, clinical, and epidemiological data. From available data, it appears that workplaces without effective smoking policies considerably exceed this de minimis risk standard. For a substantial fraction of the 59 million nonsmoking workers in the U.S., current workplace exposure to ETS also appears to pose risks exceeding the de manifestos risk level above which carcinogens are strictly regulated by the federal government.     

Game Theory and Risk Analysis

Risk analysts often analyze adversarial risks from terrorists or other intelligent attackers without mentioning game theory. Why? One reason is that many adversarial situations—those that can be represented as attacker‐defender games, in which the defender first chooses an allocation of defensive resources to protect potential targets, and the attacker, knowing what the defender has done, then decides which targets to attack—can be modeled and analyzed successfully without using most of the concepts and terminology of game theory. However, risk analysis and game theory are also deeply complementary. Game‐theoretic analyses of conflicts require modeling the probable consequences of each choice of strategies by the players and assessing the expected utilities of these probable consequences. Decision and risk analysis methods are well suited to accomplish these tasks. Conversely, game‐theoretic formulations of attack‐defense conflicts (and other adversarial risks) can greatly improve upon some current risk analyses that attempt to model attacker decisions as random variables or uncertain attributes of targets (“threats”) and that seek to elicit their values from the defender's own experts. Game theory models that clarify the nature of the interacting decisions made by attackers and defenders and that distinguish clearly between strategic choices (decision nodes in a game tree) and random variables (chance nodes, not controlled by either attacker or defender) can produce more sensible and effective risk management recommendations for allocating defensive resources than current risk scoring models. Thus, risk analysis and game theory are (or should be) mutually reinforcing.     

A Decision Support Tool to Compare Waterborne and Foodborne Infection and/or Illness Risks Associated with Climate Change

Climate change may impact waterborne and foodborne infectious disease, but to what extent is uncertain. Estimating climate‐change‐associated relative infection risks from exposure to viruses, bacteria, or parasites in water or food is critical for guiding adaptation measures. We present a computational tool for strategic decision making that describes the behavior of pathogens using location‐specific input data under current and projected climate conditions. Pathogen‐pathway combinations are available for exposure to norovirus, Campylobacter, Cryptosporidium, and noncholera Vibrio species via drinking water, bathing water, oysters, or chicken fillets. Infection risk outcomes generated by the tool under current climate conditions correspond with those published in the literature. The tool demonstrates that increasing temperatures lead to increasing risks for infection with Campylobacter from consuming raw/undercooked chicken fillet and for Vibrio from water exposure. Increasing frequencies of drought generally lead to an elevated infection risk of exposure to persistent pathogens such as norovirus and Cryptosporidium, but decreasing risk of exposure to rapidly inactivating pathogens, like Campylobacter. The opposite is the case with increasing annual precipitation; an upsurge of heavy rainfall events leads to more peaks in infection risks in all cases. The interdisciplinary tool presented here can be used to guide climate change adaptation strategies focused on infectious diseases.     

Consumer Responses to Integrated Risk‐Benefit Information Associated with the Consumption of Food

The risk analysis of the health impact of foods is increasingly focused on integrated risk‐benefit assessment, which will also need to be communicated to consumers. It therefore becomes important to understand how consumers respond to integrated risk‐benefit information. Quality‐adjusted‐life‐years (QALYs) is one measure that can be used to assess the balance between risks and benefits associated with a particular food. The effectiveness of QALYs for communicating both positive and negative health effects associated with food consumption to consumers was examined, using a 3 × 2 experiment varying information about health changes in terms of QALYs associated with the consumption of fish (n = 325). The effect of this information on consumer perceptions of the usefulness of QALYs for describing health effects, on risk and benefit perceptions, attitudes, and intentions to consume fish was examined. Results demonstrated that consumers perceived QALYs as useful for communicating health effects associated with food consumption. QALYs communicated as a net effect were preferred for food products associated with negative net effects on health, while separate communication of both risks and benefits may be preferred for food products associated with positive or zero net health effects. Information about health changes in terms of QALYs facilitated informed decision making by consumers, as indicated by the impact on risk and benefit perceptions as intended by the information. The impact of this information on actual food consumption choices merits further investigation.     

Farmers’ Risk‐Based Decision Making Under Pervasive Uncertainty: Cognitive Thresholds and Hazy Hedging

Researchers in judgment and decision making have long debunked the idea that we are economically rational optimizers. However, problematic assumptions of rationality remain common in studies of agricultural economics and climate change adaptation, especially those that involve quantitative models. Recent movement toward more complex agent‐based modeling provides an opportunity to reconsider the empirical basis for farmer decision making. Here, we reconceptualize farmer decision making from the ground up, using an in situ mental models approach to analyze weather and climate risk management. We assess how large‐scale commercial grain farmers in South Africa (n = 90) coordinate decisions about weather, climate variability, and climate change with those around other environmental, agronomic, economic, political, and personal risks that they manage every day. Contrary to common simplifying assumptions, we show that these farmers tend to satisfice rather than optimize as they face intractable and multifaceted uncertainty; they make imperfect use of limited information; they are differently averse to different risks; they make decisions on multiple time horizons; they are cautious in responding to changing conditions; and their diverse risk perceptions contribute to important differences in individual behaviors. We find that they use two important nonoptimizing strategies, which we call cognitive thresholds and hazy hedging, to make practical decisions under pervasive uncertainty. These strategies, evident in farmers' simultaneous use of conservation agriculture and livestock to manage weather risks, are the messy in situ performance of naturalistic decision‐making techniques. These results may inform continued research on such behavioral tendencies in narrower lab‐ and modeling‐based studies.     

Online patient feedback as a safety valve: An automated language analysis of unnoticed and unresolved safety incidents

Safety reporting systems are widely used in healthcare to identify risks to patient safety. But, their effectiveness is undermined if staff do not notice or report incidents. Patients, however, might observe and report these overlooked incidents because they experience the consequences, are highly motivated, and independent of the organization. Online patient feedback may be especially valuable because it is a channel of reporting that allows patients to report without fear of consequence (e.g., anonymously). Harnessing this potential is challenging because online feedback is unstructured and lacks demonstrable validity and added value. Accordingly, we developed an automated language analysis method for measuring the likelihood of patient-reported safety incidents in online patient feedback. Feedback from patients and families (n = 146,685, words = 22,191,427, years = 2013–2019) about acute NHS trusts (hospital conglomerates; n = 134) in England were analyzed. The automated measure had good precision (0.69) and excellent recall (0.98) in identifying incidents; was independent of staff-reported incidents (r = −0.04 to 0.19); and was associated with hospital-level mortality rates (z = 3.87; p < 0.001). The identified safety incidents were often reported as unnoticed (89%) or unresolved (21%), suggesting that patients use online platforms to give visibility to safety concerns they believe have been missed or ignored. Online stakeholder feedback is akin to a safety valve; being independent and unconstrained it provides an outlet for reporting safety issues that may have been unnoticed or unresolved within formal channels.     

Overcoming Learning Aversion in Evaluating and Managing Uncertain Risks

Decision biases can distort cost‐benefit evaluations of uncertain risks, leading to risk management policy decisions with predictably high retrospective regret. We argue that well‐documented decision biases encourage learning aversion, or predictably suboptimal learning and premature decision making in the face of high uncertainty about the costs, risks, and benefits of proposed changes. Biases such as narrow framing, overconfidence, confirmation bias, optimism bias, ambiguity aversion, and hyperbolic discounting of the immediate costs and delayed benefits of learning, contribute to deficient individual and group learning, avoidance of information seeking, underestimation of the value of further information, and hence needlessly inaccurate risk‐cost‐benefit estimates and suboptimal risk management decisions. In practice, such biases can create predictable regret in selection of potential risk‐reducing regulations. Low‐regret learning strategies based on computational reinforcement learning models can potentially overcome some of these suboptimal decision processes by replacing aversion to uncertain probabilities with actions calculated to balance exploration (deliberate experimentation and uncertainty reduction) and exploitation (taking actions to maximize the sum of expected immediate reward, expected discounted future reward, and value of information). We discuss the proposed framework for understanding and overcoming learning aversion and for implementing low‐regret learning strategies using regulation of air pollutants with uncertain health effects as an example.     

An Approach for Balancing Health and Ecological Risks at Hazardous Waste Sites

Human health and ecological risks must be balanced at hazardous waste sites in order to ensure that remedial actions prevent unacceptable risks of either type. Actions that are designed to protect humans may fail to protect nonhuman populations and ecosystems or may damage ecosystems. However, there is no common scale of health and ecological risk that would allow comparisons to be performed. This paper presents an approach to addressing this problem based on classifying all risks (i.e., health and ecological risks due contaminants and remediation) as insignificant ( de minimis ), highly significant ( de manifestis ), or intermediate. For health risks the classification is based on standard criteria. However, in the absence of national guidance concerning the acceptability of ecological risks, new ecological criteria are proposed based on an analysis of regulatory precedents. Matrices and flow charts are presented to guide the use of these risk categories in remedial decision making. The assessment of mercury contamination of the East Fork Poplar Creek is presented as an example of the implementation of the approach.     

Ownership and Control in Closely‐held Family‐owned Firms: An Exploration of Strategic and Operational Control

Much of the existing research into the divorce of ownership and control either focuses on the propensity for the separation of decision functions or upon scrutinizing conceptions, gauges or the practicalities of organizational control in large corporations. Although far from equivocal, such research appears broadly to concur that where ownership is dispersed, de facto control is likely to be exerted by management and that where ownership is closely‐held, de facto as well as legal control is exerted by owners. This study examines this assumption through exploring the nature of control in a closely‐held family firm. In this regard, the focus of this study is not on consequences of divorced ownership and control but rather on exploring the contingencies where ownership and control diverge. This research reveals a case wherein a closely‐held family firm is strategically and operationally controlled by its managers. Case research leads to the development of a range of insights regarding the owner/family and the management characteristics that contribute to this scenario. The paper concludes with a series of implications and conclusions.     

THE TIMING OF LABOR TRANSFERS IN DUAL RESOURCE-CONSTRAINED SYSTEMS: “PUSH” VS. “PULL” RULES*

Altough the dual resource-constrained (DRC) system has been studied, the decision rule used to determine when workers are eligible for transfer largely has been ignored. Some earlier studies examined the impact of this rule [5] [12] [15] but did not include labor-transfer times in their models. Gunther [6] incorporated labour-transfer times into his model, but the model involved only one worker and two machines. No previous study has examined decision rules that initiate labor transfers based on labor needs (“pull” rules). Labor transfers always have been initiated based on lack of need (“push” rules). This study examines three “pull” variations of the “When” labor-assignment decision rule. It compares their performances to the performances of two “push” rules and a comparable machine-limited system. A nonparametric statistical test, Jonckheere's S statistic, is used to test for significance of the rankings of the rules: a robust parametric multiple-comparison statistical test, Tukey's B statistic, is used to test the differences. One “pull” and one “push” decision rule provide similar performances and top the rankings consistently. Decision rules for determining when labor should be transferred from one work area to another are valuable aids for managers. This especially is true for the ever-increasing number of managers operating in organizations that recognize the benefits of a cross-trained work force. Recently there has been much interest in cross-training workers, perhaps because one of the mechanisms used in just-in-time systems to handle unbalanced work loads is to have cross-trained workers who can be shifted as demand dictates [8]. If management is to take full advantage of a cross-trained work force, it need to know when to transfer workers.     

Evaluation of Legal Liability for Technological Risks in View of Requirements for Peaceful Coexistence and Progress

Legal liability for risk‐generating technological activities is evaluated in view of requirements that are necessary for peaceful human coexistence and progress in order to show possibilities for improvement. The requirements imply, given that political decision making about the activities proceeds on the basis of majority rule, that legal liability should be unconditional (absolute, strict) and unlimited (full). We analyze actual liability in international law for various risk‐generating technological activities, to conclude that nowhere is the standard of unconditional and unlimited liability fully met. Apart from that there are enormous differences. Although significant international liability legislation is in place for some risk‐generating technological activities, legislation is virtually absent for others. We discuss fundamental possibilities and limitations of liability and private insurance to secure credible and ethically sound risk assessment and risk management practices. The limitations stem from problems of establishing a causal link between an activity and a harm; compensating irreparable harm; financial warranty; moral hazard in insurance and in organizations; and discounting future damage to present value. As our requirements call for prior agreement among all who are subjected to the risks of an activity about the settlement of these difficult problems, precautionary ex ante regulation of risk‐generating activities may be a more attractive option, either combined with liability stipulations or not. However, if ex ante regulation is not based on the consent of all subjected to the risks, it remains that the basis of liability in the law should be unconditional and unlimited liability.     

AN EMPIRICAL EXAMINATION OF SOCIAL POWER IN TERMS OF DECISION THEORY1

The paper presents an extension of decision theory to the analysis of social power. The power of a person, A, over another person, B, is viewed in terms of the effect A has on B's decision. The analysis is based on the idea that B's decision regarding the performance of alternative behaviors is a function of 1) B's utility for the consequences of the behaviors and 2) B's subjective probabilities that the behaviors will lead to these consequences. In these terms, A's power over B lies in A's ability to mediate various consequences for B, contingent upon B's compliance or noncompliance. Subjects were asked to consider eight situations in which hypothetical individuals had to make a choice between two courses of action. In each situation another person (A) was attempting to induce the hypothetical individual (B) to choose one of the alternatives, while various situational factors were influencing B to choose the other alternative. The subjects were asked to consider B's utilities and subjective probabilities in each situation and to indicate whether or not B should comply with A and to make ratings of A's power. The decision theory analysis did well in predicting whether or not subjects would indicate that B should comply with A. Also, subjects generally were able to correctly specify whether A or the situational factors had more influence over B's decision. Finally, the subjects' ratings of A's power in the eight situations were highly related to the decision theoretic measure of power.     

Risk‐Based Decision Making for Reoccupation of Contaminated Areas Following a Wide‐Area Anthrax Release

This article presents an analysis of postattack response strategies to mitigate the risks of reoccupying contaminated areas following a release of Bacillus anthracis spores (the bacterium responsible for causing anthrax) in an urban setting. The analysis is based on a hypothetical attack scenario in which individuals are exposed to B. anthracis spores during an initial aerosol release and then placed on prophylactic antibiotics that successfully protect them against the initial aerosol exposure. The risk from reoccupying buildings contaminated with spores due to their reaerosolization and inhalation is then evaluated. The response options considered include: decontamination of the buildings, vaccination of individuals reoccupying the buildings, extended evacuation of individuals from the contaminated buildings, and combinations of these options. The study uses a decision tree to estimate the costs and benefits of alternative response strategies across a range of exposure risks. Results for best estimates of model inputs suggest that the most cost‐effective response for high‐risk scenarios (individual chance of infection exceeding 11%) consists of evacuation and building decontamination. For infection risks between 4% and 11%, the preferred option is to evacuate for a short period, vaccinate, and then reoccupy once the vaccine has taken effect. For risks between 0.003% and 4%, the preferred option is to vaccinate only. For risks below 0.003%, none of the mitigation actions have positive expected monetary benefits. A sensitivity analysis indicates that for high‐infection‐likelihood scenarios, vaccination is recommended in the case where decontamination efficacy is less than 99.99%.     

Improving Risk Management: From Lame Excuses to Principled Practice

The three classic pillars of risk analysis are risk assessment (how big is the risk and how sure can we be?), risk management (what shall we do about it?), and risk communication (what shall we say about it, to whom, when, and how?). We propose two complements as important parts of these three bases: risk attribution (who or what addressable conditions actually caused an accident or loss?) and learning from experience about risk reduction (what works, and how well?). Failures in complex systems usually evoke blame, often with insufficient attention to root causes of failure, including some aspects of the situation, design decisions, or social norms and culture. Focusing on blame, however, can inhibit effective learning, instead eliciting excuses to deflect attention and perceived culpability. Productive understanding of what went wrong, and how to do better, thus requires moving past recrimination and excuses. This article identifies common blame‐shifting “lame excuses” for poor risk management. These generally contribute little to effective improvements and may leave real risks and preventable causes unaddressed. We propose principles from risk and decision sciences and organizational design to improve results. These start with organizational leadership. More specifically, they include: deliberate testing and learning—especially from near‐misses and accident precursors; careful causal analysis of accidents; risk quantification; candid expression of uncertainties about costs and benefits of risk‐reduction options; optimization of tradeoffs between gathering additional information and immediate action; promotion of safety culture; and mindful allocation of people, responsibilities, and resources to reduce risks. We propose that these principles provide sound foundations for improving successful risk management.     

A Multifactorial Risk Prioritization Framework for Foodborne Pathogens

We develop a prioritization framework for foodborne risks that considers public health impact as well as three other factors (market impact, consumer risk acceptance and perception, and social sensitivity). Canadian case studies are presented for six pathogen‐food combinations: Campylobacter spp. in chicken; Salmonella spp. in chicken and spinach; Escherichia coli O157 in spinach and beef; and Listeria monocytogenes in ready‐to‐eat meats. Public health impact is measured by disability‐adjusted life years and the cost of illness. Market impact is quantified by the economic importance of the domestic market. Likert‐type scales are used to capture consumer perception and acceptance of risk and social sensitivity to impacts on vulnerable consumer groups and industries. Risk ranking is facilitated through the development of a knowledge database presented in the format of info cards and the use of multicriteria decision analysis (MCDA) to aggregate the four factors. Three scenarios representing different stakeholders illustrate the use of MCDA to arrive at rankings of pathogen‐food combinations that reflect different criteria weights. The framework provides a flexible instrument to support policymakers in complex risk prioritization decision making when different stakeholder groups are involved and when multiple pathogen‐food combinations are compared.     

Robustness of linear models in dynamic multivariate predictions

Linear aggregation models employing unit and equal weights have been shown to be superior to human decisions in a surprising range of decision situations. In addition, decisions based on these models have often been found to be superior to those based on linear regression models (LRMs). This general issue was explored for repetitive decisions in production planning. The problem considered differs in several aspects from the types of problems investigated previously: (1) the problem is dynamic rather than static; (2) a set (or vector) of interactive decisions dependent on previous decisions is required to be made, where a decision in stage t, the dependent variable, becomes an independent variable in stage t + 1; and (3) the criterion function is cost with a quadratic loss function (rather than the correlation measure of R²). Moreover, since repetitive decisions were involved, the parameters of the models were estimated using past human decisions. These were used to predict specific values of the decision variables (rather than rank order), which in turn were employed recursively to predict values of the decision variables at subsequent stages. While decisions from equal weighting rules were found to be superior to human decisions and not greatly inferior to decisions from linear regression models, decisions from unit weighting rules performed poorly. The rationale for such performance is discussed, indicating that previous theoretical and empirical research on linear weighting models is not generally applicable to dynamic, multivariate interactive decisions problems with lagged variables.     

Risk of Antibiotic-Resistant Staphylococcus aureus Dispersion from Hog Farms: A Critical Review

The World Health Organization has declared antibiotic resistance “one of the biggest threats to global health.” Mounting evidence suggests that antibiotic use in industrial-scale hog farming is contributing to the spread of antibiotic-resistant Staphylococcus aureus. To capture available evidence on these risks, we searched peer-reviewed studies published before June 2017 and conducted a meta-analysis of these studies’ estimates of the prevalence of swine-associated, antibiotic-resistant S. aureus in animals, humans, and the environment. The 166 relevant studies revealed consistent evidence of livestock-associated methicillin-resistant S. aureus (MRSA) in hog herds (55.3%) raised with antibiotics. MRSA prevalence was also substantial in slaughterhouse pigs (30.4%), industrial hog operation workers (24.4%), and veterinarians (16.8%). The prevalence of swine-associated, multidrug-resistant S. aureus (MDRSA)—with resistance to three or more antibiotics—is not as well documented. Nonetheless, sufficient studies were available to estimate MDRSA pooled prevalence in conventional hog operation workers (15.0%), workers’ household members (13.0%), and community members (5.37%). Evidence also suggests that antibiotic-resistant S. aureus can be present in air, soil, water, and household surface samples gathered in or near high-intensity hog operations. An important caveat is that prevalence estimates for humans reflect colonization, not active infection, and the health risks of colonization remain poorly understood. In addition, these pooled results may not represent risks in specific locations, due to wide geographic variation. Nonetheless, these results underscore the need for additional preventive action to stem the spread of antibiotic-resistant pathogens from livestock operations and a streamlined reporting system to track this risk.     

Effect of Climate Change on the Concentration and Associated Risks of Vibrio Spp. in Dutch Recreational Waters

Currently, the number of reported cases of recreational‐ water‐related Vibrio illness in the Netherlands is low. However, a notable higher incidence of Vibrio infections has been observed in warm summers. In the future, such warm summers are expected to occur more often, resulting in enhanced water temperatures favoring Vibrio growth. Quantitative information on the increase in concentration of Vibrio spp. in recreational water under climate change scenarios is lacking. In this study, data on occurrence of Vibrio spp. at six different bathing sites in the Netherlands (2009–2012) were used to derive an empirical formula to predict the Vibrio concentration as a function of temperature, salinity, and pH. This formula was used to predict the effects of increased temperatures in climate change scenarios on Vibrio concentrations. For Vibrio parahaemolyticus, changes in illness risks associated with the changed concentrations were calculated as well. For an average temperature increase of 3.7 °C, these illness risks were calculated to be two to three times higher than in the current situation. Current illness risks were, varying per location, on average between 10^?4 and 10^?2 per person for an entire summer. In situations where water temperatures reached maximum values, illness risks are estimated to be up to 10^?2 and 10^?1. If such extreme situations occur more often during future summers, increased numbers of ill bathers or bathing‐water‐related illness outbreaks may be expected.     

Context‐Specific,Scenario‐Based Risk Scales

Reacting to an emergency requires quick decisions under stressful and dynamic conditions. To react effectively, responders need to know the right actions to take given the risks posed by the emergency. While existing research on risk scales focuses primarily on decision making in static environments with known risks, these scales may be inappropriate for conditions where the decision maker's time and mental resources are limited and may be infeasible if the actual risk probabilities are unknown. In this article, we propose a method to develop context‐specific, scenario‐based risk scales designed for emergency response training. Emergency scenarios are used as scale points, reducing our dependence on known probabilities; these are drawn from the targeted emergency context, reducing the mental resources required to interpret the scale. The scale is developed by asking trainers/trainees to rank order a range of risk scenarios and then aggregating these orderings using a Kemeny ranking. We propose measures to assess this aggregated scale's internal consistency, reliability, and validity, and we discuss how to use the scale effectively. We demonstrate our process by developing a risk scale for subsurface coal mine emergencies and test the reliability of the scale by repeating the process, with some methodological variations, several months later.