Organizational interventions: A research-based framework for the evaluation of both process and effects

Abstract

Organizational interventions are often recommended when organizations want to improve employee psychological health and well-being. Research, however, has revealed inconsistent results and reviewers have called for research on why interventions either bring about desired change or fail to do so. Answering the “how” and “why” of intervention outcomes requires a close examination of the elements that hinder or facilitate desired outcomes, thus moving beyond evaluation of only the overall effects. In this paper, we present an evaluation framework based on recent intervention research and process-oriented organization theory. The framework offers suggestions for which elements to include when evaluating organizational interventions. Within the framework, elements crucial to intervention evaluation are grouped into four overarching categories that we argue are crucial to evaluation over the five phases of an intervention programme. These categories are: the organizational “actors”; the mental models of those actors; the context of the intervention; and intervention design and process. Evaluation during the process as well as of the overall effects, as recommended by this framework, should throw light on what works for whom, why, how and under which circumstances.     

Global product development projects: measuring performance and monitoring the risks

Abstract

This article investigates the development and application of key performance indicators for global product development. Two in-depth, longitudinal case studies with multinational Danish manufacturing companies were conducted, and highlight how key performance indicators, typically used for collocated, cross-functional product development, do not provide the predictive insight required to avoid the additional risks encountered in the global product development environment. Grounded in the case study results and building on established methodologies in performance measurement literature, a framework was developed and validated in two additional Danish companies to support project managers to develop: preventive indicators, which support the avoidance of identified risks, and outcome indicators, which support the measurement towards the attainment of project objectives. The study is unique as it is one of the very few longitudinal studies of engineering design activities in a global context, providing the in-depth contextual understanding towards key risks and their influence on performance; an important step to support researchers and practitioners with the development of preventive measures.     

Purchasing performance management systems: an empirical investigation

This article aims at further developing the purchasing performance management systems (PPMSs) body of knowledge, assuming the wider perspective of the adoption process rather than key performance indicators (KPIs) only. In particular, the research questions are focused on understanding what are the most adopted indicators, what are the key elements characterising the implementation process and what are the differences among different organisational levels and different purchasing categories. The literature provides a framework for classifying purchasing KPIs, identifying the implementation process and the PPMS architecture, thus supporting the empirical research protocol. Nine case studies of large multinationals belonging to different industries are conducted. Empirical evidence shows that companies are still adopting mainly an external perspective, by focusing on performance measurement efforts on suppliers. Widely adopted indicators mainly measure cost, time and quality. However, the purchasing department has acquired an important role within the organisation and new performance indicators have been created; flexibility, innovation and sustainability are becoming increasingly important.     

Receptivity to Change in a General Medical Practice

In this paper, Pettigrew, Ferlie and McKee's concepts of receptive and non receptive contexts for change are examined using data from an evaluation study of a general medical practice implementing a Personal Medical Services Pilot between 1998 and 2001. Four questions concerning the applicability, associatedness, temporality and dynamism of the eight factors Pettigrew et al. identified as constitutive of receptivity are used in the analysis, which extends the original model through an operationalization yielding 21 ‘focal questions’. Although the process of change at the fieldwork site was stalled, the receptivity model is shown to have been a useful tool in identifying the factors blocking change. The analysis shows that when the eight factors are conceptualized in terms of the strength, direction and continuity of their influence, the receptivity metaphor provides a distinctive tool for the analysis of change. The paper concludes that further refinement of the model could provide a basis for the derivation of change management typologies.     

The Social Construction of Planning Systems: A Strategic-Relational Institutionalist Approach

Abstract

This article reflects on a theoretical framework for the analysis of planning systems based on an institutionalist planning theory broadened with Jessop's strategic-relational approach. The aim is to explore the concept of the planning system with an actor—structure perspective so as to underline possible research consequences for analyses and comparisons of planning systems. The article highlights the interactions of actors and social institutional elements, clarifying the strategic-relational nature of a planning system and the dialectical process at the basis of its changes and evolutions.     

Science and Decisions: Advancing Risk Assessment

At the request of the U.S. Environmental Protection Agency (EPA), the National Research Council (NRC) recently completed a major report, Science and Decisions: Advancing Risk Assessment, that is intended to strengthen the scientific basis, credibility, and effectiveness of risk assessment practices and subsequent risk management decisions. The report describes the challenges faced by risk assessment and the need to consider improvements in both the technical analyses of risk assessments (i.e., the development and use of scientific information to improve risk characterization) and the utility of risk assessments (i.e., making assessments more relevant and useful for risk management decisions). The report tackles a number of topics relating to improvements in the process, including the design and framing of risk assessments, uncertainty and variability characterization, selection and use of defaults, unification of cancer and noncancer dose‐response assessment, cumulative risk assessment, and the need to increase EPA's capacity to address these improvements. This article describes and summarizes the NRC report, with an eye toward its implications for risk assessment practices at EPA.     

Using vulnerability performance indicators to attain food supply chain robustness

High effectiveness and leanness of modern supply chains (SCs) increase their vulnerability, i.e. susceptibility to disturbances reflected in non-robust SC performances. Both the SC management literature and SC professionals indicate the need for the development of SC vulnerability assessment tools. In this article, a new method for vulnerability assessment, the VULA method, is presented. The VULA method helps to identify how much a company would underperform on a specific Key Performance Indicator in the case of a disturbance, how often this would happen and how long it would last. It ultimately informs the decision about whether process redesign is appropriate and what kind of redesign strategies should be used in order to increase the SC's robustness. The applicability of the VULA method is demonstrated in the context of a meat SC using discrete-event simulation to conduct the performance analysis.     

Shared Leadership in Commercial Organizations: A Systematic Review of Definitions,Theoretical Frameworks and Organizational Outcomes

The importance of context has been well established in studies of leadership (Bryman, A. and Stephens, M. (1996). The importance of context: qualitative research and the study of leadership. Leadership Quarterly, 7, pp. 353–371; Pettigrew, A. and Whipp, R. (1991). Managing Change for Competitive Success. Oxford: Blackwell). However, recent reviews of shared leadership have tended to merge findings across commercial and non‐commercial settings, disregarding contextual differences in these distinctive domains. Acknowledging that the challenges of leadership may vary in different organizational contexts, this paper argues that a focused review of shared leadership in commercial organizations (COs) is needed. The authors thus systematically review findings from over twenty years of empirical research on the practice of shared leadership in commercial organizations, critically reviewing definitions, theoretical dispositions and measurement approaches adopted in the field, before evaluating the impact of shared leadership on performance in this context. Findings from commercial and non‐ commercial organizations are then compared, highlighting significant differences in the conceptualization of shared leadership in these distinct settings. Contributing to theory in this field, a framework is developed, mapping the landscape of current research in commercial contexts, revealing critical gaps in our present understanding of shared leadership processes. Consequently, a model summarizing a proposed research agenda for future studies is provided, highlighting the need for such research to focus on the interactions of individuals as they share in the leadership of their team.     

Quality management and performance: a comparison between the UK and Turkey

Purpose: The aim of this article is to detail the correlation between quality management, specifically its tools and critical success factors, and performance in terms of primary operational and secondary organisational performances.

Design/methodology/approach: Survey data from the UK and Turkey were analysed using exploratory factor analyses, structural equation modelling and regression analysis.

Findings: The results show that quality management has a significant and positive impact on both primary and secondary performances; that Turkish and UK attitudes to quality management are similar; and that quality management is widely practised in manufacturing and service industries but has more statistical emphasis in the manufacturing sector. The main challenge for making quality management practice more effective lies in an appropriate balanced use of the different sorts of the tools and critical success factors.

Originality/value: This study takes a novel approach by: (i) exploring the relationship between primary operational and secondary organisational performances, (ii) using service and manufacturing data and (iii) making a cross-country comparison between the UK (a developed economy) and Turkey (a developing economy).

Limitations: Detailed contrast provided between only two countries.     

Navigating the Life Cycle of Trust in Developing Economies: One‐size Solutions Do Not Fit All

Trust is critical to the development and maintenance of collaborative and cohesive relationships in societies, broadly, and in organizations, specifically. At the same time, trust is highly dependent on the social context in which it occurs. Unfortunately, existing research involving trust remains somewhat limited to a particular set of developed economies, providing a window to explore a culture's stage of economic development as a key contextual determinant of trust within organizations. In this article, we review the state of the scholarship on trust and identify those qualities of trust that are common in organizations at similar stages of economic development, referred to as its etic aspects. We then also distinguish those elements of trust that are, to the contrary, culturally specific or emic in nature. We structure our discussion around the “life cycle of trust” (i.e., the creation, maintenance, and postfracture repair of trust) and consider unique factors in its application to developing economies. In doing so, we ground our examination in expository examples through field experience in Haiti. We conclude with the proposal of a framework for future research oriented toward the resolution of remaining theoretical and empirical queries as they relate to trust in developing economies.     

Relational Leadership Theory: Exploring the social processes of leadership and organizing

Relational leadership is a relatively new term in the leadership literature, and because of this, its meaning is open to interpretation. In the present article I describe two perspectives of relational leadership: an entity perspective that focuses on identifying attributes of individuals as they engage in interpersonal relationships, and a relational perspective that views leadership as a process of social construction through which certain understandings of leadership come about and are given privileged ontology. These approaches can be complementary, but their implications for study and practice are quite different. After reviewing leadership research relative to these two perspectives I offer Relational Leadership Theory (RLT) as an overarching framework for the study of leadership as a social influence process through which emergent coordination (e.g., evolving social order) and change (e.g., new approaches, values, attitudes, behaviors, ideologies) are constructed and produced. This framework addresses relationships both as an outcome of investigation (e.g., How are leadership relationships produced?) and a context for action (e.g., How do relational dynamics contribute to structuring?). RLT draws from both entity and relational ontologies and methodologies to more fully explore the relational dynamics of leadership and organizing.     

Effects of Process and Human Performance Improvement Strategies

Abstract

Organizational performance is a function of many variables, two of which are work process factors and human performance factors. Our study compared the effects of changing a work process versus human performance improvement techniques and the combined effects of combing both techniques. A 2 (manual vs. electronic process) X 2 (with vs. without behavioral intervention) between-subjects design with stratified random assignment was employed. Forty-eight participants performed a word processing task where their minutes-in-possession and error rate were recorded. Results revealed a main effect for process type and a main effect for behavioral intervention. The largest effects were observed with the context of a combined intervention. The implications of using a combined approach and topics for future researchers are discussed.     

Integrating risk and performance management in quality management systems for the development of complex bespoke systems (CBSs)

Abstract

Risk and performance management are at the core of complex bespoke systems (CBSs). CBSs are developed to customer–specified requirements in terms of structure, functionality and conformance. This article examines how risk and performance management are integrated as essential systems in the successful development of projects across multi-organizational functions in complex bespoke system (CBS) organizations. The article argues for the development of a quality management system that consists of two sub-processes: quality control and quality development. Using three case studies from engineering companies, we provide evidence and insights of the way change control, quality development and quality performance are developed in innovating business solutions.     

Customization: Impact on Product and Process Performance

Manufacturing capability has often been viewed to be a major obstacle in achieving higher levels of customization. Companies follow various strategies ranging from equipment selection to order process management to cope with the challenges of increased customization. We examined how the customization process affects product performance and conformance in the context of a design‐to‐order (DTO) manufacturer of industrial components. Our competing risk hazard function model incorporates two thresholds, which we define as mismatch and manufacturing thresholds. Product performance was adversely affected when the degree of customization exceeded the mismatch threshold. Likewise, product conformance eroded when the degree of customization exceeded the manufacturing threshold. Relative sizes of the two thresholds have management implications for the subsequent investments to improve customization capabilities. Our research developed a rigorous framework to address two key questions relevant to the implementation of product customization: (1) what degrees of customization to offer, and (2) how to customize the product design process.     

Performer-Level Systems Analysis

Abstract

A review of the Journal of Organizational Behavior Management(1992-2001) was conducted to determine how “systemic” the applied behavioral interventions were. Criteria for the term “systemic” in an organizational behavior context were derived from Rummler and Brache's (1995) Human Performance System (HPS). Six dependent measures derived from Rummler and Brache's HPS were used to evaluate the systemic nature of the interventions. The dependent variables were classified into one of three mutually exclusive categories: whether the variable was modified, discussed but not modified, or absent. The classification of variables was used to determine the degree to which an intervention was “systemic.” Results indicated that considerations of systemic factors were often modified and rarely merely discussed. A majority of the studies examined dealt with 2, 3, or 4 of the 6 systemic variables evaluated.     

Green supply chain performance measurement using the analytic hierarchy process: a comparative analysis of manufacturing organisations

The main purpose of this research is to develop and deploy an analytical framework for measuring the environmental performance of manufacturing supply chains. This work's theoretical bases combine and reconcile three major areas: supply chain management, environmental management and performance measurement. Researchers have suggested many empirical criteria for green supply chain (GSC) performance measurement and proposed both qualitative and quantitative frameworks. However, these are mainly operational in nature and specific to the focal company. This research develops an innovative GSC performance measurement framework by integrating supply chain processes (supplier relationship management, internal supply chain management and customer relationship management) with organisational decision levels (both strategic and operational). Environmental planning, environmental auditing, management commitment, environmental performance, economic performance and operational performance are the key level constructs. The proposed framework is then applied to three selected manufacturing organisations in the UK. Their GSC performance is measured and benchmarked by using the analytic hierarchy process (AHP), a multiple-attribute decision-making technique. The AHP-based framework offers an effective way to measure and benchmark organisations’ GSC performance. This study has both theoretical and practical implications. Theoretically it contributes holistic constructs for designing a GSC and managing it for sustainability; and practically it helps industry practitioners to measure and improve the environmental performance of their supply chain.     

Strategic Appraisal of Environmental Risks: A Contrast Between the United Kingdom's Stern Review on the Economics of Climate Change and its Committee on Radioactive Waste Management

In this article, we compare two high‐profile strategic policy reviews undertaken for the U.K. government on environmental risks: radioactive waste management and climate change. These reviews took very different forms, both in terms of analytic approach and deliberation strategy. The Stern Review on the Economics of Climate Change was largely an exercise in expert modeling, building, within a cost‐benefit framework, an argument for immediate reductions in carbon emissions. The Committee on Radioactive Waste Management, on the other hand, followed a much more explicitly deliberative and participative process, using multicriteria decision analysis to bring together scientific evidence and stakeholder and public values. In this article, we ask why the two reviews were different, and whether the differences are justified. We conclude that the differences were mainly due to political context, rather than the underpinning science, and as a consequence that, while in our view “fit for purpose,” they would both have been stronger had they been less different. Stern's grappling with ethical issues could have been strengthened by a greater degree of public and stakeholder engagement, and the Committee on Radioactive Waste Management's handling of issues of uncertainty could have been strengthened by the explicitly probabilistic framework of Stern.     

An Empirical Model for Managing Quality in the Electronics Industry

Much of the empirical research in the past two decades has suggested that quality management (QM) is context dependent. This research develops an empirical QM model in a technology‐based sector—electronics manufacturing. Based on quantitative and qualitative investigations of 225 electronics firms in Hong Kong and the Pearl River Delta (PRD) region of China, a path analytic model is developed. The empirical model shows that a typical quality management system (QMS) in the electronics industry is composed of four major modules, namely leadership, cultural elements, operational support systems, and process management. These modules create a series of chain effects on organizational performance, rather than acting as parallel elements with an equal impact. By quantifying their effects on organizational performance and comparing the model to others in the literature, we identify those QM constructs that are context dependent. In electronics manufacturing, process management and customer focus are more important than other elements (e.g., cultural factors) for garnering business results. This study contributes to contingency theory and research by identifying the key constructs and their relationships in a competitive, volatile, and technology‐based industry with complex supply networks.     

The Role of Operational Capabilities in Enhancing New Venture Survival: A Longitudinal Study

We investigate relationships between operational capabilities and new venture survival. On the basis of operations management and entrepreneurship literature, we develop a contingency framework of operational capabilities especially appropriate at different life phases of a new venture's evolution. We expect that in the first years of a new venture's life, entrepreneurs should emphasize high inventory turnover to preserve working capital, support customer responsiveness, and aid firm adaptability. As new ventures grow, entrepreneurs should emphasize internal working capital generation via larger gross margins to support production ramp‐up. Later, new venture entrepreneurs should emphasize employee productivity to buttress sustainable volume production. We analyze a 6‐year longitudinal sample of 812 Swedish manufacturing new ventures using a gamma frailty‐based Cox regression. The findings show that specific operational capabilities, while always supporting new venture survival, have exceptional influence in specific new venture life phases. The three hypotheses are confirmed, suggesting that higher inventory turnover, gross margin, and employee productivity further increase new venture survival likelihoods, respectively, in the venture's start‐up, growth, and stability phases. This suggests a phased‐capabilities approach to new venture survival. This study contributes to operations management and entrepreneurship theory and practice, and sets a foundation for future research on operations strategy for new ventures.