Exploring the Utility of Preference Assessments in Organizational Behavior Management

The present study compared two variations of stimulus preference assessments: a survey in which direct service employees ranked their preferences for a variety of items, and a multiple stimulus preference assessment without replacement (MSWO), in which textual stimuli were used to represent the actual items. Results obtained for four participants revealed identical preference hierarchies across each type of stimulus preference assessment for one participant, with three participants demonstrating variations in their preference hierarchies during the MSWO when compared with the ranking survey.     

An Examination of Generalized-Conditioned Reinforcers in Stimulus Preference Assessments

Generalized-conditioned reinforcers (GCRs) are advocated for by practitioners when possible because of their ability to function as reinforcers across a wide array of motivative operations. In organizational behavior management 2 common GCRs are praise and money. Although many studies have demonstrated their usefulness, no prior study has compared relative preferences for GCRs (specifically money) and other potentially reinforcing items. A total of 24 direct care employees from a group home setting completed assessments for potential reinforcers. All participants in the current study identified items other than money as high-preference items, suggesting that some items may serve as alternatives to money in terms of preference.     

The Effects of Progressively Thinning High-Preference Item Delivery on Responding in Employees

The use of mixed-preference reinforcer delivery (i.e., the random delivery of a set of items with varying degrees of preference for each individual) with employees has been found to produce moderate levels of responding in an analog setting; however, mixed reinforcer delivery may not conform to the recommendations made by some popular writers in organizational behavior management. The current investigation used a progressively thinning high-preference stimulus delivery procedure to investigate the use of mixed reinforcer delivery with 5 employees. Results indicated that most participants did not reliably complete work when the percent chance of earning a high-preference item dropped below 100%. These results do not support the use of varied reinforcers in applied settings.     

An Initial Assessment of Effective Preference Assessment Intervals Among Employees

Previous research has shown that employee preferences for tangible items may change significantly from one month to the next. Although a 1-month interval may be too long to wait between preference assessment administrations, no guidelines exist with regard to how often to assess employee preference. This study examined changes in preference as measured by two different preference assessments across four different time intervals. We measured preference stability by assessing changes in designations of high- and low-preference items from one assessment to the next. Only the 1-week interval indicated no changes in item designation from high preference to low preference or low preference to high preference. These data suggest that if tangibles are used, preferences may need to be assessed over time.     

Temporal (In)Stability of Employee Preferences for Rewards

This study examined the temporal stability of employee preferences for rewards over seven monthly evaluations. Participants completed a ranking stimulus preference assessment monthly, and the latter six monthly assessments were compared to the initial assessment. Correlations of preferences from month to month ranged from r = ?.89 to .99. Contrary to the stationarity axiom of rational choice economic theory, but consistent with a behavioral economic perspective, preferences for rewards changed across time for all participants and sometimes even reversed for some. This temporal instability suggests that organizations implementing incentive programs using preference assessments should periodically re-evaluate employee reward preferences and not assume temporal constancy of preferences.     

Ecological Risk Assessment,Prediction, and Assessing Risk Predictions

Ecological risk assessment embodied in an adaptive management framework is becoming the global standard approach for formally assessing and managing the ecological risks of technology and development. Ensuring the continual improvement of ecological risk assessment approaches is partly achieved through the dissemination of not only the types of risk assessment approaches used, but also their efficacy. While there is an increasing body of literature describing the results of general comparisons between alternate risk assessment methods and models, there is a paucity of literature that post hoc assesses the performance of specific predictions based on an assessment of risk and the effectiveness of the particular model used to predict the risk. This is especially the case where risk assessments have been used to grant consent or approval for the construction of major infrastructure projects. While postconstruction environmental monitoring is increasingly commonplace, it is not common for a postconstruction assessment of the accuracy and performance of the ecological risk assessment and underpinning model to be undertaken. Without this “assessment of the assessment,” it is difficult for other practitioners to gain insight into the performance of the approach and models used and therefore, as argued here, this limits the rate of improvement of risk assessment approaches.     

Managing Employee Compliance with Information Security Policies: The Critical Role of Top Management and Organizational Culture*

We develop an individual behavioral model that integrates the role of top management and organizational culture into the theory of planned behavior in an attempt to better understand how top management can influence security compliance behavior of employees. Using survey data and structural equation modeling, we test hypotheses on the relationships among top management participation, organizational culture, and key determinants of employee compliance with information security policies. We find that top management participation in information security initiatives has significant direct and indirect influences on employees’ attitudes towards, subjective norm of, and perceived behavioral control over compliance with information security policies. We also find that the top management participation strongly influences organizational culture which in turn impacts employees’ attitudes towards and perceived behavioral control over compliance with information security policies. Furthermore, we find that the effects of top management participation and organizational culture on employee behavioral intentions are fully mediated by employee cognitive beliefs about compliance with information security policies. Our findings extend information security research literature by showing how top management can play a proactive role in shaping employee compliance behavior in addition to the deterrence oriented remedies advocated in the extant literature. Our findings also refine the theories about the role of organizational culture in shaping employee compliance behavior. Significant theoretical and practical implications of these findings are discussed.     

Ensuring the Quality of Occupational Safety Risk Assessment

In work environments, the main aim of occupational safety risk assessment (OSRA) is to improve the safety level of an installation or site by either preventing accidents and injuries or minimizing their consequences. To this end, it is of paramount importance to identify all sources of hazards and assess their potential to cause problems in the respective context. If the OSRA process is inadequate and/or not applied effectively, it results in an ineffective safety prevention program and inefficient use of resources. An appropriate OSRA is an essential component of the occupational safety risk management process in industries. In this article, we performed a survey to elicit the relative importance for identified OSRA tasks to enable an in‐depth evaluation of the quality of risk assessments related to occupational safety aspects on industrial sites. The survey involved defining a questionnaire with the most important elements (tasks) for OSRA quality assessment, which was then presented to safety experts in the mining, electrical power production, transportation, and petrochemical industries. With this work, we expect to contribute to the main question of OSRA in industries: “What constitutes a good occupational safety risk assessment?” The results obtained from the questionnaire showed that experts agree with the proposed OSRA process decomposition in steps and tasks (taxonomy) and also with the importance of assigning weights to obtain knowledge about OSRA task relevance. The knowledge gained will enable us, in the near future, to build a framework to evaluate OSRA quality for industrial sites.     

Risk Assessment Can Be a Game‐Changing Information Technology—But Too Often It Isn't

The printing press was a game‐changing information technology. Risk assessment could be also. At present, risk assessments are commonly used as one‐time decision aids: they provide justification for a particular decision, and afterwards usually sit on a shelf. However, when viewed as information technologies, their potential uses are much broader. Risk assessments: (1) are repositories of structured information and a medium for communication; (2) embody evaluative structures for setting priorities; (3) can preserve information over time and permit asynchronous communication, thus encouraging learning and adaptation; and (4) explicitly address uncertain futures. Moreover, because of their “what‐if” capabilities, risk assessments can serve as a platform for constructive discussion among parties that hold different values. The evolution of risk assessment in the nuclear industry shows how such attributes have been used to lower core‐melt risks substantially through improved templates for maintenance and more effective coordination with regulators (although risk assessment has been less commonly used in improving emergency‐response capabilities). The end result of this evolution in the nuclear industry has been the development of “living” risk assessments that are updated more or less in real time to answer even routine operational questions. Similar but untapped opportunities abound for the use of living risk assessments to reduce risks in small operational decisions as well as large policy decisions in other areas of hazard management. They can also help improve understanding of and communication about risks, and future risk assessment and management. Realization of these opportunities will require significant changes in incentives and active promotion by the risk analytic community.     

A Risk Assessment Framework for Assessing Metallic Nanomaterials of Environmental Concern: Aquatic Exposure and Behavior

Nanomaterials are finding application in many different environmentally relevant products and processes due to enhanced catalytic, antimicrobial, and oxidative properties of materials at this scale. As the market share of nano‐functionalized products increases, so too does the potential for environmental exposure and contamination. This study presents some exposure ranking methods that consider potential metallic nanomaterial surface water exposure and fate, due to nano‐functionalized products, through a number of exposure pathways. These methods take into account the limited and disparate data currently available for metallic nanomaterials and apply variability and uncertainty principles, together with qualitative risk assessment principles, to develop a scientific ranking. Three exposure scenarios with three different nanomaterials were considered to demonstrate these assessment methods: photo‐catalytic exterior paint (nano‐scale TiO₂), antimicrobial food packaging (nano‐scale Ag), and particulate‐reducing diesel fuel additives (nano‐scale CeO₂). Data and hypotheses from literature relating to metallic nanomaterial aquatic behavior (including the behavior of materials that may relate to nanomaterials in aquatic environments, e.g., metals, pesticides, surfactants) were used together with commercial nanomaterial characteristics and Irish natural aquatic environment characteristics to rank the potential concentrations, transport, and persistence behaviors within subjective categories. These methods, and the applied scenarios, reveal where data critical to estimating exposure and risk are lacking. As research into the behavior of metallic nanomaterials in different environments emerges, the influence of material and environmental characteristics on nanomaterial behavior within these exposure‐ and risk‐ranking methods may be redefined on a quantitative basis.     

Historical Relationship Between Performance Assessment for Radioactive Waste Disposal and Other Types of Risk Assessment

This article describes the evolution of the process for assessing the hazards of a geologic disposal system for radioactive waste and, similarly, nuclear power reactors, and the relationship of this process with other assessments of risk, particularly assessments of hazards from manufactured carcinogenic chemicals during use and disposal. This perspective reviews the common history of scientific concepts for risk assessment developed until the 1950s. Computational tools and techniques developed in the late 1950s and early 1960s to analyze the reliability of nuclear weapon delivery systems were adopted in the early 1970s for probabilistic risk assessment of nuclear power reactors, a technology for which behavior was unknown. In turn, these analyses became an important foundation for performance assessment of nuclear waste disposal in the late 1970s. The evaluation of risk to human health and the environment from chemical hazards is built on methods for assessing the dose response of radionuclides in the 1950s. Despite a shared background, however, societal events, often in the form of legislation, have affected the development path for risk assessment for human health, producing dissimilarities between these risk assessments and those for nuclear facilities. An important difference is the regulator's interest in accounting for uncertainty.     

Notes from an Introspective Behaviorist

Abstract

Based on the three-contingency model of performance management, I make the following argument: (1) Often, we fail to behave as we should because the natural contingencies supporting appropriate behavior are ineffective; the natural contingencies involve outcomes for each individual response that are either too small, though of cumulative significance, or outcomes that are too improbable. The delay of the outcome is essentially irrelevant. The psychodynamic model of the cognitive motivational theorists provides a poor explanation for why we fail to behave as we should. (2) The performance-management contingencies in organizational behavior management (OBM) must usually involve deadline-induced aversive control, even when they are based on powerful reinforcers. Furthermore, such performance management succeeds only to the extent that the person's behavioral history, “Jewish mother,” has inculcated an appropriate value system. Wiegand and Geller's critique of the necessity of the use of aversive control fails to take into account the necessity of deadlines and the difference between instrumental and hedonic reinforcers; furthermore, it greatly over values the power of intrinsic reinforcement contingencies in OBM.     

No longer a solo practice: how physician leaders lead

The authors conducted a national study to determine the factors associated with the success of physician leaders. They utilized the Leadership Practices Inventory (LPI) and a demographic survey followed by individual interviews with respondents. Data analysis revealed several implications for the selection, training, management, and career development of physician leaders. The results suggest that: Physician leadership training should have a strong focus on the "human side" of management, including negotiation, organizational "politics," conflict resolution, team building, and motivation. Data management and finance should be a focus represented in the curriculum. Mentoring relationships should be developed as an aspiring physician leader pursues a career shift. Self assessment, including an analysis of style, strengths, best potential organizational fit, and specific areas of strength and weakness should be an integral part of the development of an aspiring physician leader. Screening mechanisms to ascertain a physician's motivation to move toward a full-time leadership role should be developed to ensure appropriate intent. To facilitate this implication, more effective assessment tools need to be developed.     

Science and Decisions: Advancing Risk Assessment

At the request of the U.S. Environmental Protection Agency (EPA), the National Research Council (NRC) recently completed a major report, Science and Decisions: Advancing Risk Assessment, that is intended to strengthen the scientific basis, credibility, and effectiveness of risk assessment practices and subsequent risk management decisions. The report describes the challenges faced by risk assessment and the need to consider improvements in both the technical analyses of risk assessments (i.e., the development and use of scientific information to improve risk characterization) and the utility of risk assessments (i.e., making assessments more relevant and useful for risk management decisions). The report tackles a number of topics relating to improvements in the process, including the design and framing of risk assessments, uncertainty and variability characterization, selection and use of defaults, unification of cancer and noncancer dose‐response assessment, cumulative risk assessment, and the need to increase EPA's capacity to address these improvements. This article describes and summarizes the NRC report, with an eye toward its implications for risk assessment practices at EPA.     

Engaging with Comparative Risk Appraisals: Public Views on Policy Priorities for Environmental Risk Governance

Communicating the rationale for allocating resources to manage policy priorities and their risks is challenging. Here, we demonstrate that environmental risks have diverse attributes and locales in their effects that may drive disproportionate responses among citizens. When 2,065 survey participants deployed summary information and their own understanding to assess 12 policy‐level environmental risks singularly, their assessment differed from a prior expert assessment. However, participants provided rankings similar to those of experts when these same 12 risks were considered as a group, allowing comparison between the different risks. Following this, when individuals were shown the prior expert assessment of this portfolio, they expressed a moderate level of confidence with the combined expert analysis. These are important findings for the comprehension of policy risks that may be subject to augmentation by climate change, their representation alongside other threats within national risk assessments, and interpretations of agency for public risk management by citizens and others.     

Integrated Analysis: Combining Risk and Economic Assessments While Preserving the Separation of Powers

This article presents a process for an integrated policy analysis that combines risk assessment and benefit-cost analysis. This concept, which explicitly combines the two types of related analyses, seems to contradict the long-accepted risk analysis paradigm of separating risk assessment and risk management since benefit-cost analysis is generally considered to be a part of risk management. Yet that separation has become a problem because benefit-cost analysis uses risk assessment results as a starting point and considerable debate over the last several years focused on the incompatibility of the use of upper bounds or "safe" point estimates in many risk assessments with benefit-cost analysis. The problem with these risk assessments is that they ignore probabilistic information. As advanced probabilistic techniques for risk assessment emerge and economic analysts receive distributions of risks instead of point estimates, the artificial separation between risk analysts and the economic/decision analysts complicates the overall analysis. In addition, recent developments in countervailing risk theory suggest that combining the risk and benefit-cost analyses is required to fully understand the complexity of choices and tradeoffs faced by the decisionmaker. This article also argues that the separation of analysis and management is important, but that benefit-cost analysis has been wrongly classified into the risk management category and that the analytical effort associated with understanding the economic impacts of risk reduction actions need to be part of a broader risk assessment process.     

'Management Standards' and work-related stress in the UK: policy background and science

In the late 1990s, the Health and Safety Commission, as the lead authority in the UK responsible for Health and Safety at Work, conducted an extensive consultation exercise to elicit views about how work-related stress should be tackled. The Commission subsequently decided that regulation was not justified and opted for an approach with four strands. One of these was to work with stakeholders to develop clear, agreed standards of good management practice. This paper describes and discusses the rationale behind a standards-based approach that is essentially based on a method of controlling hazards. The Management Standards approach uses a taxonomy of six stressors that has evolved out of extensive research carried out on behalf of the UK's Health and Safety Executive (HSE) and in conjunction with stakeholders, and a three-phase risk assessment methodology. Further developmental work on the standards (which are to be subjected to public consultation) and associated measurement tools is described in a companion paper in this issue of Work & Stress (Cousins, Mackay, Clarke, Kelly, Kelly, & McCaig, 2004). The emphasis is on prevention towards reducing stress in the UK working population. We review current thinking on models of work stress, consider evidence linking workplace psychosocial factors and various health and organizational outcomes, and examine the effectiveness of organizational interventions. We argue that the literature supports an approach that aims to move organizational states (represented by the current situation) to more desirable ones (represented by the six Management Standards), and that this is an effective 'population' based approach to tackling workplace stress and promoting individual and organizational health.     

A Preliminary Laboratory Evaluation: Effects of Consequence Quality and Ratio-Schedule Arrangements on Staff Performance

ABSTRACT

Supplementary, contingent pay arrangements can result in improved employee productivity and increased job satisfaction. We examined the effects of four stimulus delivery arrangements on performance in a computer-based task in a simulated work context. Three participants entered hypothetical client data onto a Microsoft Excel® invoice and earned gift-cards for task completion according to the following conditions: (a) fixed-ratio/high-preference stimuli (FR/HiP), (b) variable-ratio/high-preference stimuli (VR/HiP), (c) fixed-ratio/varied stimuli (FR/Var), and (d) variable-ratio/varied stimuli (VR/Var). For two of three participants varied reinforcers produced similar levels of responding to high-preference stimuli regardless of schedule type, whereas varied reinforcers did not support responding for the third participant. All participants preferred working under conditions of access to high-preference reinforcers. Results are discussed in light of creating efficient performance improvement plans in organizational settings.     

Rethinking Risk Assessment for Public Utility Safety Regulation

To aid in their safety oversight of large‐scale, potentially dangerous energy and water infrastructure and transportation systems, public utility regulatory agencies increasingly seek to use formal risk assessment models. Yet some of the approaches to risk assessment used by utilities and their regulators may be less useful for this purpose than is supposed. These approaches often do not reflect the current state of the art in risk assessment strategy and methodology. This essay explores why utilities and regulatory agencies might embrace risk assessment techniques that do not sufficiently assess organizational and managerial factors as drivers of risk, nor that adequately represent important uncertainties surrounding risk calculations. Further, it describes why, in the special legal, political, and administrative world of the typical public utility regulator, strategies to identify and mitigate formally specified risks might actually diverge from the regulatory promotion of “safety.” Some improvements are suggested that can be made in risk assessment approaches to support more fully the safety oversight objectives of public regulatory agencies, with examples from “high‐reliability organizations” (HROs) that have successfully merged the management of safety with the management of risk. Finally, given the limitations of their current risk assessments and the lessons from HROs, four specific assurances are suggested that regulatory agencies should seek for themselves and the public as objectives in their safety oversight of public utilities.     

Evidence maps: communicating risk assessments in societal controversies: the case of engineered nanoparticles

The transparent and fair characterization of scientific evidence for reporting the results of a hazard assessment is a demanding task. In this article, we present an approach for characterizing evidence--the evidence map approach. The theoretical starting point is to view evidence characterization as a form of argumentation. Thus, evidence maps are designed to depict the evidence base, the pro and con arguments, and the remaining uncertainties, which together lead experts to their conclusions when summarizing and evaluating the scientific evidence about a potential hazard. To illustrate its use, the evidence maps approach is applied to characterizing the health-relevant effects of engineered nanoparticles. Empirical data from an online survey suggests that the use of evidence maps improves the reporting of hazard assessments. Nonexperts prefer to receive the information included in an evidence map in order to come to an informed judgment. Furthermore, the benefits and limitations of evidence maps are discussed in the light of recent literature on risk communication. Finally, the article underlines the need for further research in order to increase quality of evidence reporting.