Development and Measurement Validity of a Task-Technology Fit Instrument for User Evaluations of Information System

Although many researchers have raised concerns about the lack of theoretical underpinnings for the user evaluation construct and the lack of measurement validity for specific instruments measuring it, the construct is still widely used in IS research. This paper reports on the development and measurement validity of a diagnostic tool used in recently published research to evaluate an organization's overall information systems and services. A distinctive feature of this instrument is that it is conceptually based on the task-technology fit theory in which the correspondence between information systems functionality and task requirements leads to positive user evaluations, and positive performance impacts. Specifically, the instrument development was guided by a task model of managerial decision making using recorded organizational information. This model suggested the different information systems functionalities required by users for that task, which then serve as the basis for a “task-technology fit” (TTF) instrument. The instrument thus measures the degree to which an organization's information systems and services meet the information needs of its managers. An extensive test of the measurement validity of the instrument is conducted using a sample of 357 users in 10 companies. It is found to have excellent reliability and discriminant validity for 12 dimensions of TTF, and also exhibits strong predictive validity. Finally, the instrument is compared to two other well-known user evaluation instruments. Though no single instrument can meet all needs, the instrument presented here should be considered an attractive option for researchers and practitioners seeking to measure the effectiveness of organizational information systems.     

Information Systems Adaptation and the Successful Implementation of Advanced Manufacturing Technologies*

Few plants have initial success with advanced manufacturing technologies (AMTs), and adaptations are commonly required after installing new technologies. We especially know little about the outcomes of adaptations that manufacturers regularly employ in the context of AMTs. Sociotechnical theory and the technology literature suggest that AMTs commonly require four types of adaptations including those to process technologies, human resources, operational structures, and information systems. This study investigates which of these four adaptations and their interactions lead to improved operational performance. Data were collected on 104 plants that implemented a single type of manufacturing AMT. Findings indicate that information systems (IS) adaptation during the course of AMT implementation was the most important action. Surprisingly, human resource and process technology adaptations were linked to lower performance, and no interactions had any clear effects. The results also show that practitioners underestimated the relevance of IS adaptations during contemporary or “second-generation” AMT implementation projects and overemphasized the need for shop floor changes.     

基于自组织理论的信息系统演化研究

本文依据系统科学的自组织理论,从演化的视角重新审视企业信息系统实施过程,分析信息系统自组织演化所必须具备的条件、演化的动力及规律。为了达到信息系统的成功实施,必须实现两点:一是创造形成信息系统耗散结构的条件,形成一个“活”的系统;二是要推动信息系统由被组织向自组织方式演化的转变。     

Examining the Impact of Pre‐Implementation Expectations on Post‐Implementation Use of Enterprise Systems: A Longitudinal Study

This article builds upon the technology acceptance model and theories of technology sensemaking to explore pre‐enterprise system adoption expectations and post‐enterprise system adoption outcomes in a longitudinal setting. Building on the exploitation and exploration paradigm, we propose that task productivity and task innovation expectations are the key drivers of users’ pre‐adoption enterprise system usage intention. Further, we argue that the enterprise system facilitates generation of a common knowledge base that may encourage a more integrated organizational culture and promote shared understanding among employees. Considering the distinction between mandatory and voluntary contexts, we propose that user acceptance of the enterprise system at the pre‐ and post‐adoption stages will mediate these relationships in a mandatory context. The results show that the influence of pre‐adoption expectations regarding task productivity and task innovation on intention to use an enterprise system is mediated by user acceptance of the enterprise system. Intention to use an enterprise system is positively related to actual use. At the post‐adoption stage, the influence of actual use on shared understanding is mediated by user acceptance of an enterprise system and enterprise system use has a direct negative impact on task efficiency in the initial period after implementation. Overall, the results highlight that user acceptance at both pre‐ and post‐adoption stages are critical factors when usage is mandatory. These findings suggest a number of important implications for research and for managerial action.     

中国信息系统（IS）研究现状和国际比较

系统分析了中国信息系统(IS)研究的现状,从参考学科、研究题目、研究方法和分析层次4个方面,分析了1999-2003年间发表在18种中国代表性学术期刊上的IS论文,并与西方IS研究进行了比较.研究发现中国IS研究:1)从多个学科中获得理论基础,没有单一的参考学科;2)研究题目集中在组织类问题和系统/软件类问题;3)研究方法以非实证方法为主,实证方法应用很少;4)分析层次集中在组织层和系统层,对小组/团队层和个体层问题少有研究.与西方相比,中国的IS研究在理论基础、研究重点和研究方法上具有自己的特点,也有需要进一步完善的地方.     

The Impact of Information System Personnel Skill Discrepancies on Stakeholder Satisfaction

System development efforts depend to a large degree upon how well information systems (IS) managers, IS specialists, and IS users work together in a project team structure. Yet, these individuals frequently work under different perceptions about matters of importance to development, management, and success. This paper introduces a framework for examining IS specialists' skill requirements from a multiple‐stakeholder perspective. Derived from discrepancy theory, the framework concedes that different stakeholders hold a variable set of expectations for IS personnel skill levels as well as a perception of skills held by IS personnel. We examine differences in expectation and performance expressed by each group and describe the impact of the discrepancy on user satisfaction, career satisfaction of IS specialists, and on job performance evaluations by IS managers. Results confirm that a discrepancy between an IS specialist's expectations of skill and their perceived skill self‐proficiency impacts career satisfaction. Similar relations hold for IS managers and users. Since different stakeholders may hold different perceptions, satisfaction of all parties becomes problematic unless a common frame of reference can be determined.     

Confirmatory Factor Analysis of the End‐User Computing Satisfaction Instrument: Replication within an ERP Domain*

Over the past decade, organizations have made significant investments in enterprise resource planning (ERP) systems. The realization of benefits from these investments depends on supporting effective use of information technology (IT) and satisfying IT users. User satisfaction with information systems is one of the most important determinants of the success of those systems. Drawing upon a sample of 407 end users of ERP systems and working within the framework of confirmatory factor analysis (CFA), this study examines the structure and dimensionality, and reliability and validity of the end‐user computing satisfaction (EUCS) instrument posited by Doll and Torkzadeh (1988) . In response to Klenke's (1992) motion to cross‐validate management information system (MIS) instruments and to retest the end user computing satisfaction instrument using new data, this study's results, consistent with previous findings, confirm that the EUCS instrument maintains its psychometric stability when applied to users of enterprise resource planning application software. Implications of these results for practice and research are provided.     

An Integrative Framework of the Information Systems Development Process*

Despite more than 25 years of research on the processes and outcomes of information systems development in organizations, deficiencies exist in our knowledge about the effective management of complex systems development processes. Although individual studies have generated a wealth of findings, there is a need for a cumulative framework that facilitates interpretation of what has been learned and what needs to be learned about the process of information systems development. This paper reviews prior research on ISD processes and identifies the different types of contributions that have been made to our growing knowledge. More important, it generates a cumulative framework for understanding the process of ISD that could provide a valuable template for future research and practice.     

Managerial Influences on Intraorganizational Information Technology Use: A Principal-Agent Model

Our current understanding of information technology (IT) usage does not explain why and how managers can influence organizational members to use a new IT. Drawing on principal-agent research, this paper develops and tests a model of intraorganizational IT usage that addresses this important issue. Managerial incentives and control are examined as important components of managerial influences, which are linked to IT usage via a principal-agent model (PAM). Seven research hypotheses are generated from this model and empirically tested using a laboratory experiment. Results of the study indicate that managers can promote IT usage within organizations by designing appropriate incentives and control structures such as monitoring and multiple-period contracts. However, the effectiveness of these structures will depend on potential users' ability to distinguish between various forms of incentives and control.     

复杂产品系统企业集成解决方案业务转型动因实证研究

在当今这个服务经济时代,复杂产品系统企业开展集成解决方案的业务转型,为客户提供集成解决方案业务,已经成为企业获取竞争优势的有效方法。在文献资料和国内企业调研访谈的基础上,初步提出14项复杂产品系统企业开展集成解决方案业务转型的动力因素。通过对问卷收集的数据进行实证研究,验证和提取出外部环境、客户需求、服务经济效益、以期获取竞争优势、企业供给5个关键动力因素,并对实证研究结果进行分析讨论。