Evaluating organizational-level work stress interventions: Beyond traditional methods

Abstract

Since the early 1990s, there has been a growing literature on organizational-level interventions for work-related stress, and associated calls for such interventions to be evaluated. At the same time, doubts have been expressed about the adequacy of traditional scientific research methods in applied psychology (the natural science paradigm) in providing an effective framework for such evaluations. This paper considers some of the philosophical and methodological issues raised by evaluation research in relation to organizational-level interventions for work-related stress. Four key issues are discussed: the concept of a study being “fit for purpose” in relation to research designs and the nature of acceptable evidence; the issue of control of research conditions in real-world studies; the need to evaluate process as well as outcome, including the interrelated nature of process and outcome; and the interpretation of imperfect evidence sets. The starting point of this paper is the reality of organizational life, which is complex and continually changing. Its main objective is not to offer an alternative to a scientific approach but to argue for a more broadly conceived and eclectic framework for evaluation that acknowledges the limitations of the traditional approach. It espouses an approach that is reflective of the reality of organizational life and in which the methods used for evaluating an intervention are fit for purpose. The paper concludes by offering an outline framework for this broader approach to the evaluation of interventions.     

Performer-Level Systems Analysis

Abstract

A review of the Journal of Organizational Behavior Management(1992-2001) was conducted to determine how “systemic” the applied behavioral interventions were. Criteria for the term “systemic” in an organizational behavior context were derived from Rummler and Brache's (1995) Human Performance System (HPS). Six dependent measures derived from Rummler and Brache's HPS were used to evaluate the systemic nature of the interventions. The dependent variables were classified into one of three mutually exclusive categories: whether the variable was modified, discussed but not modified, or absent. The classification of variables was used to determine the degree to which an intervention was “systemic.” Results indicated that considerations of systemic factors were often modified and rarely merely discussed. A majority of the studies examined dealt with 2, 3, or 4 of the 6 systemic variables evaluated.     

Routines Revisited: Exploring the Capabilities and Practice Perspectives

Organizational routines, repetitive patterns of interdependent organizational actions, have been investigated through the lens of capabilities, rooted in organizational economics, and the lens of practice, grounded in organization theory. The former approach emphasizes the “what” or “why,” while the latter emphasizes the “how.” In this review, we summarize both of these literatures and explore recent empirical studies in each stream, identifying common themes. In particular, we compare and contrast how each perspective incorporates the effects of individual actors, tacit knowledge, ambidexterity, and context specificity. We find that the two streams of work have distinct trajectories and strengths, but elements of each can be complementary to developing a more holistic understanding of organizational routines.     

Desired Risk: Broadening the Social Amplification of Risk Framework1

Recently Kasperson et al.⁽⁶⁾ have proposed a conceptual framework, “The Social Amplification of Risk,” as a beginning step in developing a comprehensive theory of public experience of risk. A central goal of their effort is to systematically link technical assessments of risk with the growing findings from social scientific research. A key and growing domain of public risk experience is “desired” risk, but this is virtually neglected in the framework. This paper evaluates the scope of the “Social Amplification of Risk Framework,” asking whether it is applicable to desired risks, such as risk recreation (hang gliding, mountain climbing, and so forth). The analysis is supportive of the framework's applicability to the domain of desired risk.     

The Use of Anthropomorphizing as a Tool for Generating Organizational Theories

Abstract

Despite admonishments that anthropomorphizing represents a serious error in scientific thinking, this review shows that anthropomorphizing has been a critically important tool for developing influential theories in organization studies. Analyzing the literatures related to organizational identity and organizational knowledge reveals how organization theorists build on their rich and highly accessible understanding of humans (i.e. the self and others) to (1) make guesses and sense of organizational anomalies, (2) articulate theoretical mechanisms to build stronger theories, and (3) create plausible stories that facilitate sensegiving. Our review shows how some theorists by using particular approaches were able to use anthropomorphizing to generate new organizational theories, yet anthropomorphizing does not always lead to such salutary outcomes. Anthropomorphizing is less likely to enhance theorizing in organization studies when the theorist does not sufficiently doubt their guesses about organizational phenomena, fails to develop stronger explanations of the “how” and “why” of the theory thereby only partially exploring the social mechanisms underlying the proposed relationships, and fails in their attempts to tell the theory's “story”. We conclude with a discussion of the conditions under which anthropomorphizing is more or less effective.     

Effectiveness of FISK,an Invasiveness Screening Tool for Non‐Native Freshwater Fishes,to Perform Risk Identification Assessments in the Iberian Peninsula

Risk assessments are crucial for identifying and mitigating impacts from biological invasions. The Fish Invasiveness Scoring Kit (FISK) is a risk identification (screening) tool for freshwater fishes consisting of two subject areas: biogeography/history and biology/ecology. According to the outcomes, species can be classified under particular risk categories. The aim of this study was to apply FISK to the Iberian Peninsula, a Mediterranean climate region highly important for freshwater fish conservation due to a high level of endemism. In total, 89 fish species were assessed by three independent assessors. Results from receiver operating characteristic analysis showed that FISK can discriminate reliably between noninvasive and invasive fishes for Iberia, with a threshold of 20.25, similar to those obtained in several regions around the world. Based on mean scores, no species was categorized as “low risk,” 50 species as “medium risk,” 17 as “moderately high risk,” 11 as “high risk,” and 11 as “very high risk.” The highest scoring species was goldfish Carassius auratus. Mean certainty in response was above the category “mostly certain,” ranging from tinfoil barb Barbonymus schwanenfeldii with the lowest certainty to eastern mosquitofish Gambusia holbrooki with the highest level. Pair‐wise comparison showed significant differences between one assessor and the other two on mean certainty, with these two assessors showing a high coincidence rate for the species categorization. Overall, the results suggest that FISK is a useful and viable tool for assessing risks posed by non‐native fish in the Iberian Peninsula and contributes to a “watch list” in this region.     

Evaluating organizational-level work stress interventions: Beyond traditional methods

Since the early 1990s, there has been a growing literature on organizational-level interventions for work-related stress, and associated calls for such interventions to be evaluated. At the same time, doubts have been expressed about the adequacy of traditional scientific research methods in applied psychology (the natural science paradigm) in providing an effective framework for such evaluations. This paper considers some of the philosophical and methodological issues raised by evaluation research in relation to organizational-level interventions for work-related stress. Four key issues are discussed: the concept of a study being “fit for purpose” in relation to research designs and the nature of acceptable evidence; the issue of control of research conditions in real-world studies; the need to evaluate process as well as outcome, including the interrelated nature of process and outcome; and the interpretation of imperfect evidence sets. The starting point of this paper is the reality of organizational life, which is complex and continually changing. Its main objective is not to offer an alternative to a scientific approach but to argue for a more broadly conceived and eclectic framework for evaluation that acknowledges the limitations of the traditional approach. It espouses an approach that is reflective of the reality of organizational life and in which the methods used for evaluating an intervention are fit for purpose. The paper concludes by offering an outline framework for this broader approach to the evaluation of interventions.     

Interventions for musculoskeletal disorders in computer-intense office work: A framework for evaluation

Workplace interventions for work-related musculoskeletal disorders (WMSDs) are usually multifaceted. These interventions tend to deal with multiple work organizational and physical risk factors and have components occurring at different organizational levels. The organizations are often changing, with shifting initiatives and priorities. Evaluation of such interventions poses challenges in documentation of implementation, reduction in exposures, and assessment of improved health outcomes. We describe a means-outcomes framework for evaluating field interventions that includes strategies, activities, objectives and metrics for outcomes using quantitative and qualitative methods. We demonstrate application of the framework to our work with a large newspaper, which builds on existing laboratory, aetiological and best practice evidence to improve musculoskeletal health. The newspaper had adopted several organizational strategies aimed at improving financial performance, including restructuring into teams, a major set of moves/renovations and introduction of new software. Concomitant WMSD-related organizational strategies include an ergonomics policy, human resources activities, promotion of team work, changes in environment and equipment specifications and development of information systems. We have found the framework useful for focusing the purpose of data collection and ensuring coverage of important components. At the same time, it provides sufficient flexibility to respond to the changing process of implementation.     

History in Organization and Management Theory: More Than Meets the Eye

Abstract

There has been a growing debate about the role of history in management research with several authors making suggestions on how to bring the two (back) together and others even highlighting the need for a “historic turn”. What we argue in this paper is that, while history was indeed sidelined by the scientization of management since the late 1950s, it started to make a comeback from the 1980s onwards and is increasingly employed in a number of research programs. We stress that the crucial question for management scholars engaging with history (or wanting to do so) is how it relates to theory. First of all, we present a systematic overview of the way history has been used—both at the micro (organizational) and macro-levels of analysis—distinguishing between what we refer to as “history to theory” and “history in theory”. In the former, we consider those research programs, such as (neo-)institutionalism, where history serves as evidence to develop, modify or test theories. In the case of “history in theory” we identify research programs where history or the past are part of the theoretical model itself as a driver or moderator, with “imprinting” as a prime example. Second, we also identify a growing number of studies that go further by displaying what we call “historical cognizance” in the sense of incorporating period effects or historical contingencies into their theorizing efforts. Finally, drawing on our broad overview, we make more specific suggestions for increasing the visibility and influence of history in organization and management theory.     

Reviewing performance: an analysis of the structure and functions of performance management reviews

This article proposes an analytical framework for conceptualising performance management reviews (PMRs). Drawing on multiple literatures, the article applies Pettigrew et al.'s (Pettigrew, A., Whipp R., and Rosenfield R., 1989. Competitiveness and the management of strategic change processes. In: A. Francis, and P.K.M. Tharakan, eds. The competitiveness of European industry: country policies and company strategies. London: Routledge) framework to develop our understanding of the context, process and content of PMR. The process elements of PMRs are the levers for managerial intervention as they determine the immediate outcome of PMR. They accomplish this task by acting on the content elements, transforming the subject of PMR into specific outcomes. The scope of the intervention, however, is constrained by factors in the organisation's context. This framework sheds light on various functions of PMRs, most notably strategy implementation.     

Evaluation of an intervention programme based on empowerment for eldercare nursing staff

Abstract

This study evaluated the impact of an intervention programme at individual, worksite, and organizational level, for eldercare nursing staff at 12 eldercare units. The project aimed at empowering auxiliary nurses and nursing assistants, thus promoting good working conditions, health and well-being of eldercare staff, and improving their evaluation of the quality of nursing care. Questionnaire responses from the nursing staff (n=200) before and after an 18-month intervention programme evaluated the effects using ANOVA, repeated measures for the statistical analyses. Although the improvements were limited, the intervention seemed to impact on work conditions and on the perceived quality of nursing rather than on the health and well-being of staff. Work at nursing homes or at home-care was shown to modify the outcome due to different needs and priorities for work unit improvements. Staff turnover and multiple reorganizations are discussed as inhibiting factors for performance as well as for the evaluation of workplace interventions. The sharing of power between occupational groups or organizational levels must be carefully considered. The study emphasizes the importance of involving the middle management in early project planning and decisions.     

4 The Physical Environment in Organizations

Abstract

We review empirical research on the physical environment in professional, organizational work settings (i.e., offices, meeting rooms, and design work spaces) from the past several decades. This research reveals no common elements of the physical environment (e.g., enclosures and barriers in work spaces, adjustable work arrangements, personalized work spaces, and ambient surroundings) that are consistently and exclusively associated with desired outcomes in these work settings. Instead, these elements are routinely associated with both desired and undesired outcomes. Based on these findings, we suggest that understanding the role of physical environments in organizations requires an understanding of common trade-offs in organizational life. Further, we suggest that the prevalence of such trade-offs is grounded in tensions that are inherent to the functions that physical environments serve (i.e., aesthetic, instrumental, and symbolic functions). We provide an outline of these tensions and trade-offs in relation to common elements of the physical environment, and suggest that researchers consider these tensions and trade-offs in their future research.     

In sickness and in health: An exploration of spousal support and occupational similarity

Abstract

While many studies of interventions have focused on their content and immediate effects, less research has focused on the processes that may explain these effects. The purpose of this study was to show how process evaluation can be used to interpret the results of an intervention study in four industrial canteens in Denmark. Two canteens acted as intervention groups and two as comparison groups. Effects were measured by surveys before and after interventions, and observations and interviews were conducted to provide an in-depth understanding of processes. Analyses were conducted based on the responses from 118 employees. Results showed, contrary to expectations, improvements in working conditions and well-being in one intervention group and in one comparison group, whereas no improvements were found in the two remaining groups. Data from the process evaluation enabled a meaningful interpretation of these results, raising the possibility programme failure rather than theory failure, and thereby constituting an example of how process evaluation can shed light over the factors that may influence outcomes in controlled intervention studies.     

Three Lenses on Occupations and Professions in Organizations: Becoming,Doing, and Relating

Management and organizational scholarship is overdue for a reappraisal of occupations and professions as well as a critical review of past and current work on the topic. Indeed, the field has largely failed to keep pace with the rising salience of occupational and professional (as opposed to organizational) dynamics in work life. Moreover, not only is there a dearth of studies that explicitly take occupational or professional categories into account, but there is also an absence of a shared analytical framework for understanding what occupations and professions entail. Our goal is therefore two-fold: first, to offer guidance to scholars less familiar with this terrain who encounter occupational or professional dynamics in their own inquiries and, second, to introduce a three-part framework for conceptualizing occupations and professions to help guide future inquiries. We suggest that occupations and professions can be understood through lenses of “becoming”, “doing”, and “relating”. We develop this framework as we review past literature and discuss the implications of each approach for future research and, more broadly, for the field of management and organizational theory.     

Risky Business: Perceived Behavior of Local Scientists and Community Support for Their Research

Attracting new technologies to a region can mean significant economic growth, so understanding why some communities may not favor becoming “the next Silicon Valley” merits consideration. This study investigates the relationship among the perceived behavior of local scientists and community members' attitudes toward their research. Drawing on theories from organizational justice, it hypothesizes that when local residents consider scientists as more just in their behavior, they will also have more favorable attitudes toward the scientists and their research. Just, in this sense, refers to whether scientists are perceived as fair in terms of outcomes, procedures, interpersonal treatment, and explanations in their dealings with the community. Favorable attitudes are measured in terms of concern about new technologies and satisfaction with research. Data were collected via a mail survey of residents in two upstate New York counties (N= 1,306) that host substantial technology research facilities. Controlling for demographics, media use, basic science knowledge, and technology awareness, the results show that distributive justice (i.e., fairness of outcomes) had a consistent, negative relationship with technology concern. In comparison, all four justice variables were positively related with research satisfaction. The findings suggest that the perceived behavior of local scientists may indeed impact community support for their research.     

Estimating Health Risks from Natural Hazards Using Risk Assessment and Epidemiology

Risk assessment is the process of estimating the likelihood that an adverse effect may result from exposure to a specific health hazard. The process traditionally involves hazard identification, dose-response assessment, exposure assessment, and risk characterization to answer “How many excess cases of disease A will occur in a population of size B due to exposure to agent C at dose level D?” For natural hazards, however, we modify the risk assessment paradigm to answer “How many excess cases of outcome Y will occur in a population of size B due to natural hazard event E of severity D?” Using a modified version involving hazard identification, risk factor characterization, exposure characterization, and risk characterization, we demonstrate that epidemiologic modeling and measures of risk can quantify the risks from natural hazard events. We further extend the paradigm to address mitigation, the equivalent of risk management, to answer “What is the risk for outcome Y in the presence of prevention intervention X relative to the risk for Y in the absence of X?” We use the preventable fraction to estimate the efficacy of mitigation, or reduction in adverse health outcomes as a result of a prevention strategy under ideal circumstances, and further estimate the effectiveness of mitigation, or reduction in adverse health outcomes under typical community-based settings. By relating socioeconomic costs of mitigation to measures of risk, we illustrate that prevention effectiveness is useful for developing cost-effective risk management options.     

Notes from an Introspective Behaviorist

Abstract

Based on the three-contingency model of performance management, I make the following argument: (1) Often, we fail to behave as we should because the natural contingencies supporting appropriate behavior are ineffective; the natural contingencies involve outcomes for each individual response that are either too small, though of cumulative significance, or outcomes that are too improbable. The delay of the outcome is essentially irrelevant. The psychodynamic model of the cognitive motivational theorists provides a poor explanation for why we fail to behave as we should. (2) The performance-management contingencies in organizational behavior management (OBM) must usually involve deadline-induced aversive control, even when they are based on powerful reinforcers. Furthermore, such performance management succeeds only to the extent that the person's behavioral history, “Jewish mother,” has inculcated an appropriate value system. Wiegand and Geller's critique of the necessity of the use of aversive control fails to take into account the necessity of deadlines and the difference between instrumental and hedonic reinforcers; furthermore, it greatly over values the power of intrinsic reinforcement contingencies in OBM.     

A process evaluation of individual and organizational occupational stress and health interventions

There is reason to believe that many health and stress interventions fail due to inattention to the effects of intervention implementation processes, but evaluations of these processes are found only rarely in the literature. The objective of the present study was to explore the issue of obstacles to implementation that may occur when stress and health interventions are introduced in work organizations. The study was conducted as a process evaluation of seven different individual and organizational interventions. Interviews were conducted in 22 post offices, 12 organizational units (such as care homes and local administrative units) of a Norwegian municipality, and in 10 shops in a shopping mall. The interviews took place before and after the interventions. The following key process factors were identified: (1) the ability to learn from failure and to motivate participants; (2) multi-level participation and negotiation, and differences in organizational perception; (3) insight into tacit and informal organizational behaviour; (4) clarification of roles and responsibilities, especially the role of middle management; and (5) competing projects and reorganization. For improved studies of interventions in the future we recommend that qualitative and quantitative methods be combined, that researchers build more on natural interventions that occur naturally within the organization, and that a pilot study be undertaken in order to investigate the cultural maturity of the organization.     

Retaining the Productive Employee: The Role of Personality

Abstract

Prior meta-analyses and quantitative reviews have examined the construct-related true-score correlations by personality in predicting important organizational outcomes or have focused on relatively specific, practical problems generally associated with using personality tests in selection. However, there lacks a theoretical integration of major theories developed in the literature. In this review, we propose an integrative research paradigm for personality research by identifying key mediating and moderating mechanisms explaining why, how and when personality traits predict employee work effectiveness. Based on the compatibility principle, we develop a theoretical model to reconceptualize the effect of the five-factor model (FFM) on broadly defined work effectiveness outcomes. We contend researchers have not exploited the breadth of the FFM bandwidth and thus have underestimated the predictive power of personality. In support of our new propositions, we systematically review the almost overwhelming literature by focusing on retaining productive employees, in order to contribute theoretically by identifying a few key generalizable findings and to improve managerial efficiency by uncovering possible “best practices”.     

All Things Great and Small: Organizational Size,Boundaries of the Firm,and a Changing Environment

Abstract

Research findings have established a relationship between organizational size and a substantial set of organizational outcomes, resulting in size's distinction as “perhaps the most powerful explanatory organizational covariate in strategic analysis”. We draw on the theory of the firm to provide a theory-driven definition of firm size and as a framework to organize the diverse research on firm size. We examine studies over the last 20 plus years since the last review of research on organizational size that have expanded our understanding of the advantages and disadvantages of larger firms, the environmental factors that have changed the merits of firms relative to markets, the managerial bias to pursue growth, and the most recent findings on the performance implications of organizational size. In doing so, the review provides extensions to our understanding of the theory of the firm, by integrating contingency theory, the resource-based theory of the firm, leadership theories, and the knowledge-based view of the firm. In addition, based on an extensive review of the measurement methodologies for the most common control variable employed by strategy scholars, this review outlines a rich and robust set of opportunities for future research to explore the nature of organizational size and its effects.