Psychometric analysis of the UK Health and Safety Executive's Management Standards work-related stress Indicator Tool

Abstract

Numerous tools have been developed that attempt to measure work-related stress and working conditions, but few practical instruments in the literature have been found to have a reliable psychometric factor structure. In the UK, the Health and Safety Executive (HSE) Management Standards (MS) Indicator Tool is increasingly used by organizations to monitor working conditions that can lead to stress. In Health and Safety Executive (2004), a factor analysis was conducted demonstrating the reliability of the scales. However, the authors acknowledged that direct reassessment of the same factor structure was impossible as the questionnaire was split into two separate modules for data collection. Furthermore, the tool is designed to enable comparisons between as well as within organizations to take place, yet reliability has only previously been tested at the individual level. The current study is the first to examine the factor structure of the HSE MS Indicator Tool using organizational-level data. Data collected from 39 UK organizations (N=26,382) was used to perform a first-order Confirmatory Factor Analysis (CFA) on the original 35-item seven-factor measurement scale. The results showed an acceptable fit to the data for the instrument. A second-order CFA was also performed to test if the Indicator Tool contains a higher order uni-dimensional measure of work-related stress. These findings also revealed an acceptable fit to the data, suggesting that it may be possible to derive a single measure of work-related stress. Normative data comprising tables of percentiles from the organizational data are provided to enable employers to compare their organizational averages against national benchmarks.     

Application of Bayesian Networks in Quantitative Risk Assessment of Subsea Blowout Preventer Operations

This article proposes a methodology for the application of Bayesian networks in conducting quantitative risk assessment of operations in offshore oil and gas industry. The method involves translating a flow chart of operations into the Bayesian network directly. The proposed methodology consists of five steps. First, the flow chart is translated into a Bayesian network. Second, the influencing factors of the network nodes are classified. Third, the Bayesian network for each factor is established. Fourth, the entire Bayesian network model is established. Lastly, the Bayesian network model is analyzed. Subsequently, five categories of influencing factors, namely, human, hardware, software, mechanical, and hydraulic, are modeled and then added to the main Bayesian network. The methodology is demonstrated through the evaluation of a case study that shows the probability of failure on demand in closing subsea ram blowout preventer operations. The results show that mechanical and hydraulic factors have the most important effects on operation safety. Software and hardware factors have almost no influence, whereas human factors are in between. The results of the sensitivity analysis agree with the findings of the quantitative analysis. The three‐axiom‐based analysis partially validates the correctness and rationality of the proposed Bayesian network model.     

Catastrophe Risk Models for Evaluating Disaster Risk Reduction Investments in Developing Countries

Major natural disasters in recent years have had high human and economic costs, and triggered record high postdisaster relief from governments and international donors. Given the current economic situation worldwide, selecting the most effective disaster risk reduction (DRR) measures is critical. This is especially the case for low‐ and middle‐income countries, which have suffered disproportionally more economic and human losses from disasters. This article discusses a methodology that makes use of advanced probabilistic catastrophe models to estimate benefits of DRR measures. We apply such newly developed models to generate estimates for hurricane risk on residential structures on the island of St. Lucia, and earthquake risk on residential structures in Istanbul, Turkey, as two illustrative case studies. The costs and economic benefits for selected risk reduction measures are estimated taking account of hazard, exposure, and vulnerability. We conclude by emphasizing the advantages and challenges of catastrophe model‐based cost‐benefit analyses for DRR in developing countries.     

Decision Making in Child Protective Services: A Risky Business?

Child Protective Services (CPS) in the United States has received a torrent of criticism from politicians, the media, child advocate groups, and the general public for a perceived propensity to make decisions that are detrimental to children and families. This perception has resulted in numerous lawsuits and court takeovers of CPS in 35 states, and calls for profound restructuring in other states. A widely prescribed remedy for decision errors and faulty judgments is an improvement of risk assessment strategies that enhance hazard evaluation through an improved understanding of threat potentials and exposure likelihoods. We examine the reliability and validity problems that continue to plague current CPS risk assessment and discuss actions that can be taken in the field, including the use of receiver operating characteristic (ROC) curve technology to improve the predictive validity of risk assessment strategies.     

The Risk Perception Paradox—Implications for Governance and Communication of Natural Hazards

This article reviews the main insights from selected literature on risk perception, particularly in connection with natural hazards. It includes numerous case studies on perception and social behavior dealing with floods, droughts, earthquakes, volcano eruptions, wild fires, and landslides. The review reveals that personal experience of a natural hazard and trust—or lack of trust—in authorities and experts have the most substantial impact on risk perception. Cultural and individual factors such as media coverage, age, gender, education, income, social status, and others do not play such an important role but act as mediators or amplifiers of the main causal connections between experience, trust, perception, and preparedness to take protective actions. When analyzing the factors of experience and trust on risk perception and on the likeliness of individuals to take preparedness action, the review found that a risk perception paradox exists in that it is assumed that high risk perception will lead to personal preparedness and, in the next step, to risk mitigation behavior. However, this is not necessarily true. In fact, the opposite can occur if individuals with high risk perception still choose not to personally prepare themselves in the face of a natural hazard. Therefore, based on the results of the review, this article offers three explanations suggesting why this paradox might occur. These findings have implications for future risk governance and communication as well as for the willingness of individuals to invest in risk preparedness or risk mitigation actions.     

New Data,Strategies, and Insights for Listeria monocytogenes Dose‐Response Models: Summary of an Interagency Workshop, 2011

Listeria monocytogenes is a leading cause of hospitalization, fetal loss, and death due to foodborne illnesses in the United States. A quantitative assessment of the relative risk of listeriosis associated with the consumption of 23 selected categories of ready‐to‐eat foods, published by the U.S. Department of Health and Human Services and the U.S. Department of Agriculture in 2003, has been instrumental in identifying the food products and practices that pose the greatest listeriosis risk and has guided the evaluation of potential intervention strategies. Dose‐response models, which quantify the relationship between an exposure dose and the probability of adverse health outcomes, were essential components of the risk assessment. However, because of data gaps and limitations in the available data and modeling approaches, considerable uncertainty existed. Since publication of the risk assessment, new data have become available for modeling L. monocytogenes dose‐response. At the same time, recent advances in the understanding of L. monocytogenes pathophysiology and strain diversity have warranted a critical reevaluation of the published dose‐response models. To discuss strategies for modeling L. monocytogenes dose‐response, the Interagency Risk Assessment Consortium (IRAC) and the Joint Institute for Food Safety and Applied Nutrition (JIFSAN) held a scientific workshop in 2011 (details available at http://foodrisk.org/irac/events/ ). The main findings of the workshop and the most current and relevant data identified during the workshop are summarized and presented in the context of L. monocytogenes dose‐response. This article also discusses new insights on dose‐response modeling for L. monocytogenes and research opportunities to meet future needs.     

A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept

Invasive species risk maps provide broad guidance on where to allocate resources for pest monitoring and regulation, but they often present individual risk components (such as climatic suitability, host abundance, or introduction potential) as independent entities. These independent risk components are integrated using various multicriteria analysis techniques that typically require prior knowledge of the risk components’ importance. Such information is often nonexistent for many invasive pests. This study proposes a new approach for building integrated risk maps using the principle of a multiattribute efficient frontier and analyzing the partial order of elements of a risk map as distributed in multidimensional criteria space. The integrated risks are estimated as subsequent multiattribute frontiers in dimensions of individual risk criteria. We demonstrate the approach with the example of Agrilus biguttatus Fabricius, a high‐risk pest that may threaten North American oak forests in the near future. Drawing on U.S. and Canadian data, we compare the performance of the multiattribute ranking against a multicriteria linear weighted averaging technique in the presence of uncertainties, using the concept of robustness from info‐gap decision theory. The results show major geographic hotspots where the consideration of tradeoffs between multiple risk components changes integrated risk rankings. Both methods delineate similar geographical regions of high and low risks. Overall, aggregation based on a delineation of multiattribute efficient frontiers can be a useful tool to prioritize risks for anticipated invasive pests, which usually have an extremely poor prior knowledge base.     

An Empirical Approach to Sufficient Similarity: Combining Exposure Data and Mixtures Toxicology Data

When assessing risks posed by environmental chemical mixtures, whole mixture approaches are preferred to component approaches. When toxicological data on whole mixtures as they occur in the environment are not available, Environmental Protection Agency guidance states that toxicity data from a mixture considered “sufficiently similar” to the environmental mixture can serve as a surrogate. We propose a novel method to examine whether mixtures are sufficiently similar, when exposure data and mixture toxicity study data from at least one representative mixture are available. We define sufficient similarity using equivalence testing methodology comparing the distance between benchmark dose estimates for mixtures in both data‐rich and data‐poor cases. We construct a “similar mixtures risk indicator”(SMRI) (analogous to the hazard index) on sufficiently similar mixtures linking exposure data with mixtures toxicology data. The methods are illustrated using pyrethroid mixtures occurrence data collected in child care centers (CCC) and dose‐response data examining acute neurobehavioral effects of pyrethroid mixtures in rats. Our method shows that the mixtures from 90% of the CCCs were sufficiently similar to the dose‐response study mixture. Using exposure estimates for a hypothetical child, the 95th percentile of the (weighted) SMRI for these sufficiently similar mixtures was 0.20 (i.e., where SMRI <1, less concern; >1, more concern).     

Health Risk Characterization of Chlorpyrifos Using Epidemiological Dose‐Response Data and Probabilistic Techniques: A Case Study with Rice Farmers in Vietnam

Various methods for risk characterization have been developed using probabilistic approaches. Data on Vietnamese farmers are available for the comparison of outcomes for risk characterization using different probabilistic methods. This article addresses the health risk characterization of chlorpyrifos using epidemiological dose‐response data and probabilistic techniques obtained from a case study with rice farmers in Vietnam. Urine samples were collected from farmers and analyzed for trichloropyridinol (TCP), which was converted into absorbed daily dose of chlorpyrifos. Adverse health response doses due to chlorpyrifos exposure were collected from epidemiological studies to develop dose‐adverse health response relationships. The health risk of chlorpyrifos was quantified using hazard quotient (HQ), Monte Carlo simulation (MCS), and overall risk probability (ORP) methods. With baseline (prior to pesticide spraying) and lifetime exposure levels (over a lifetime of pesticide spraying events), the HQ ranged from 0.06 to 7.1. The MCS method indicated less than 0.05% of the population would be affected while the ORP method indicated that less than 1.5% of the population would be adversely affected. With postapplication exposure levels, the HQ ranged from 1 to 32.5. The risk calculated by the MCS method was that 29% of the population would be affected, and the risk calculated by ORP method was 33%. The MCS and ORP methods have advantages in risk characterization due to use of the full distribution of data exposure as well as dose response, whereas HQ methods only used the exposure data distribution. These evaluations indicated that single‐event spraying is likely to have adverse effects on Vietnamese rice farmers.     

Psychometric and Demographic Predictors of the Perceived Risk of Terrorist Threats and the Willingness to Pay for Terrorism Risk Management Programs

A 2009 national telephone survey of 924 U.S. adults assessed perceptions of terrorism and homeland security issues. Respondents rated severity of effects, level of understanding, number affected, and likelihood of four terrorist threats: poisoned water supply; explosion of a small nuclear device in a major U.S. city; an airplane attack similar to 9/11; and explosion of a bomb in a building, train, subway, or highway. Respondents rated perceived risk and willingness to pay (WTP) for dealing with each threat. Demographic, attitudinal, and party affiliation data were collected. Respondents rated bomb as highest in perceived risk but gave the highest WTP ratings to nuclear device. For both perceived risk and WTP, psychometric variables were far stronger predictors than were demographic ones. OLS regression analyses using both types of variables to predict perceived risk found only two significant demographic predictors for any threat—Democrat (a negative predictor for bomb) and white male (a significant positive predictor for airline attack). In contrast, among psychometric variables, severity, number affected, and likelihood were predictors of all four threats and level of understanding was a predictor for one. For WTP, education was a negative predictor for three threats; no other demographic variables were significant predictors for any threat. Among psychometric variables, perceived risk and number affected were positive predictors of WTP for all four threats; severity and likelihood were predictors for three; level of understanding was a significant predictor for two.