Development and Measurement Validity of a Task-Technology Fit Instrument for User Evaluations of Information System

Although many researchers have raised concerns about the lack of theoretical underpinnings for the user evaluation construct and the lack of measurement validity for specific instruments measuring it, the construct is still widely used in IS research. This paper reports on the development and measurement validity of a diagnostic tool used in recently published research to evaluate an organization's overall information systems and services. A distinctive feature of this instrument is that it is conceptually based on the task-technology fit theory in which the correspondence between information systems functionality and task requirements leads to positive user evaluations, and positive performance impacts. Specifically, the instrument development was guided by a task model of managerial decision making using recorded organizational information. This model suggested the different information systems functionalities required by users for that task, which then serve as the basis for a “task-technology fit” (TTF) instrument. The instrument thus measures the degree to which an organization's information systems and services meet the information needs of its managers. An extensive test of the measurement validity of the instrument is conducted using a sample of 357 users in 10 companies. It is found to have excellent reliability and discriminant validity for 12 dimensions of TTF, and also exhibits strong predictive validity. Finally, the instrument is compared to two other well-known user evaluation instruments. Though no single instrument can meet all needs, the instrument presented here should be considered an attractive option for researchers and practitioners seeking to measure the effectiveness of organizational information systems.     

The Relationship Between Information System Planning Sophistication and Information System Success: An Empirical Assessment*

Literature on information systems (IS) planning implicitly assumes that a sophisticated IS planning process leads to greater IS success. This paper questions the exclusive reliance on this traditional belief. Instead, because IS planning requires significant organizational resources, prior IS success is essential to convince top management of the importance of IS planning sophistication. Therefore, IS success may influence IS planning sophistication. Several theoretical arguments are advanced in support of this explanation. Data from a survey of 236 academic institutions are used to empirically assess the two alternative directions of the relationship between IS planning sophistication and IS success. Four structural models including the alternative causal directions are evaluated. Two of these models are supported. Together, they imply that for a high level of IS planning sophistication, either the previous ISs should have been successful or the organization should possess advanced information technology capabilities. Thus, empirical results suggest that the explanation presented here (i.e., IS success facilitates IS planning sophistication) provides an equally good alternative to the more traditional explanation (i.e., IS planning sophistication facilitates IS success).     

Critical Success Factors for Strategic Alliances in the Information Technology Industry: An Empirical Study*

Intense competition in the marketplace is forcing organizations to examine different ways by which they could enhance or retain their competitive edge. Strategic alliance is one such option through which an organization can leverage its resources to emerge as an effective competitor. Such alliances are burgeoning in the information technology industry, which is characterized by rapid change and short innovation cycles. Successful management of alliances has proved to be very elusive for the most part, and there is a lack of theoretical and empirical work in this area. Literature on critical factors was synthesized, and then a parsimonious set of critical factors was identified using a combination of interview and survey methodologies. Our study has implications for both practice and future research.     

Computer Simulation Success: On the Use of the End-User Computing Satisfaction Instrument: A Comment

This comment is part of a comprehensive study to develop a contingency model of simulation success. The current study focuses on the psychometric stability of the end-user computing satisfaction (EUCS) instrument by Doll and Torkzadeh (1988) when applied to users of computer simulation. Using a survey of 411 users, the researchers provide evidence that the EUCS instrument is a valid and reliable measure of computer simulation success. Given this evidence, managers and simulation software product developers can confidently apply the instrument in the investigation of competing tools, features, and technologies.     

Information Systems Adaptation and the Successful Implementation of Advanced Manufacturing Technologies*

Few plants have initial success with advanced manufacturing technologies (AMTs), and adaptations are commonly required after installing new technologies. We especially know little about the outcomes of adaptations that manufacturers regularly employ in the context of AMTs. Sociotechnical theory and the technology literature suggest that AMTs commonly require four types of adaptations including those to process technologies, human resources, operational structures, and information systems. This study investigates which of these four adaptations and their interactions lead to improved operational performance. Data were collected on 104 plants that implemented a single type of manufacturing AMT. Findings indicate that information systems (IS) adaptation during the course of AMT implementation was the most important action. Surprisingly, human resource and process technology adaptations were linked to lower performance, and no interactions had any clear effects. The results also show that practitioners underestimated the relevance of IS adaptations during contemporary or “second-generation” AMT implementation projects and overemphasized the need for shop floor changes.     

An Exploratory Analysis of the Value of the Skills of IT Personnel: Their Relationship to IS Infrastructure and Competitive Advantage

Determining and assessing the requisite skills of information technology (IT) personnel have become critical as the value of IT has risen in modern organizations. In addition to technical skills traditionally expected of IT personnel, softer skills like managerial, business, and interpersonal skills have been increasingly cited in previous studies as mandatory for these employees. This paper uses a typology of IT personnel skills—technology management skills, business functional skills, interpersonal skills, and technical skills—and investigates their relationships to two information systems (IS) success variables, IS infrastructure flexibility and the competitive advantage provided by IS. The study investigates these relationships using the perceptions of chief information officers (CIOs) from mostly Fortune 2000 companies. The contributions of this study are: IT personnel skills do affect IS success, technical skills are viewed as the most important skill set in affecting IS infrastructure flexibility and competitive advantage, and modularity is viewed as more valuable to competitive advantage than integration. Several explanations are offered for the lack of positive relationships between the softer IT personnel skills and the dimensions of IS success used in this study.     

Toward an Understanding of the Behavioral Intention to Use an Information System

Organizational investment in information systems is often large and risky given the variety of information requirements placed on systems today. To make more informed decisions and to meet the challenge of developing systems that satisfy these demands, system developers need to achieve a better understanding of factors that ultimately lead to system usage. To enhance this understanding, we posit a holistic framework to examine several constructs suggested in the literature that lead to the behavioral intention to use an information system. Our framework includes situational involvement, intrinsic involvement, argument for change, perceived usefulness, ease of use, prior usage, and attitude constructs. We extend the Davis, Bagozzi, and Warshaw Technology Acceptance Model (TAM), which is founded on the Theory of Reasoned Action. A diverse sample from industry is used to test our model. Structural equation modeling is used to examine the entire pattern of intercorrelations among the constructs and to test related propositions. A hierarchical structure is used to compare the explanatory ability of TAM with our extension. Our model explains a large portion of the covariance among the constructs that lead to a user's behavioral intention to use an information system and compares favorably with TAM. The results indicate that (1) the direct effect of situational involvement on behavioral intention as well as attitude is significant in the negative direction, (2) attitude seems to play a mediating role, and (3) intrinsic involvement plays a significant role in shaping perceptions. Finally, we conclude that the user involvement construct needs to be separated into its psychological as well as its participative components for developers to understand its impact on the systems development process.     

Linking IT Applications with Manufacturing Strategy: An Intelligent Decision Support System Approach

Research has indicated the importance of matching Information Technology (IT) applications or manufacturing systems with the competitive strategy of a company. Selection of the right type of IT application is, however, a challenging task. When a company with a given dominant process structure emphasizes two or more competitive priorities, such as quality, product flexibility, etc., an unaided manager faces a complex decision problem in choosing from alternative IT applications available in the areas of product design through distribution. In this paper, we develop an Intelligent Decision Support System (IDSS) to assist managers with assessment of the relative importance of competitive priorities in their organization, evaluation of the fit between the competitive priorities and their dominant process structure, and identification of the IT applications that are consistent with both the competitive priorities and the process structure. The IDSS is comprised of an interactive user interface, a knowledge database, a decision model, and a Knowledge-Based System (KBS) that was developed using the 1st Class KBS shell. Validation of the system illustrates that its performance is as good as the human expert, and it has the potential to facilitate effective and swift decision making in the selection of appropriate IT applications that best match an organization's manufacturing strategy. The choice and use of the right type of IT application should provide a company with a competitive edge.     

Tandem Configuration Automated Guided Vehicle Systems: A Comparative Study*

Automated guided vehicle (AGV) systems provide the flexibility and integration required for flexible manufacturing systems. Previous AGV system studies have attempted to reduce the controlling complexities commonly encountered in these systems. However, this has not been accomplished without additional resources (e.g., automated guided vehicles) and lower system flexibility. The primary objective of this study is to compare the performance of AGV system configurations that reduce controlling and modification complexities (i.e., tandem configurations) to traditional AGV system configuration. Three AGV system configurations were tested under 16 experimental conditions. Performance metrics considered were AGV utilization, mean flowtime, mean tardiness, and percent tardy. The results of this study extend the findings of the previous studies in demonstrating the viability of tandem configurations, in that the tandem configurations match the performance of traditional configuration across all performance metrics, without sacrificing ease of control and system flexibility. Finally, the cost tradeoffs inherent in selecting a particular configuration are discussed.     

Strategic Information Systems Planning: Planning System Dimensions,Internal Coalignment,and Implications for Planning Effectiveness

Improving strategic information systems planning (SISP) remains a critical concern of both practitioners and academics. To date, a rather large number of studies have examined or proposed analytical techniques, frameworks, and tools for developing strategic plans. As a direct consequence of this emphasis, methodologies have often become the basis for characterizing the entire process of SISP within the information systems literature. Recent theoretical work suggests that such characterizations are unnecessarily narrow and that planning activities within organizations can be more accurately conceptualized as systems of behaviors, agendas, or process dimensions. Working within this contemporary theoretical perspective, the findings of this study suggest that SISP can be operationalized along distinct dimensions of comprehensiveness (extent of solution search), formalization (rules and procedures to guide activities), focus (creativity or control), flow (top down, bottom up), participation (number and variety of planners), and consistency (frequency of planning cycles). Similar to previous theoretical work and case studies, higher order factor modeling of these dimensions suggests that planning systems that exhibit aspects of rationality (high comprehensiveness, high formalization, control focus, top-down flow), and adaptation (high participation, high consistency) are positively associated with planning effectiveness.     

The Role of Innovation Characteristics and Perceived Voluntariness in the Acceptance of Information Technologies

The often paradoxical relationship between investment in information technology and gains in productivity has recently been attributed to a lack of user acceptance of information technology innovations. Diverse streams of research have attempted to explain and predict user acceptance of new information technologies. A common theme underlying these various research streams is the inclusion of the perceived characteristics of an innovation as key independent variables. Furthermore, prior research has utilized different outcomes to represent user acceptance behavior. In this paper we focus on individual's perceptions about the characteristics of the target technology as explanatory and predictive variables for acceptance behavior, and present an empirical study examining the effects of these perceptions on two frequently used outcomes in the context of the innovation represented by the World Wide Web. The two outcomes examined are initial use of an innovation and intentions to continue such use in the future, that is, to routinize technology use. Two research questions motivated and guided the study. First, are the perceptions that predict initial use the same as those that predict future use intentions? Our results confirm, as hypothesized by prior research, that innovation characteristics do explain acceptance behavior. The results further reveal that the specific characteristics that are relevant for each acceptance outcome are different. The second research question asks if perceived voluntariness plays a role in technology acceptance. Results show that external pressure has an impact on adopters' acceptance behavior. Theoretical and practical implications that follow are presented.     

Linking Objectives to Actions: A Decision Support Approach Based on Cause–Effect Linkages

The process of translating objectives into actions is a difficult task. This difficulty is due to the wide range of possibilities and the lack of structured information. Managers must take into account relevant information and generate a range of options before a decision is reached. So far, little is available to guide managers in translating a set of objectives into actions. This paper presents a three‐stage action‐planning process to address this gap. The process, supported by a software tool, takes managers through the stages of model building, action generation, and action evaluation and selection. A case study illustrates the application of the process. The paper concludes by discussing the implication of this work for managers and academics.     

Managing the International Strategic Sourcing Process as a Market-Driven Organizational Learning System*

This study examines the effects of market-driven organizational learning on a select set of strategic sourcing outcomes involving the sourcing function of a Fortune 500 multinational corporation. The focus is on the dyadic activities and relationships between the domestic and international strategic business units (SBUs) and the corporate buying center. The hypothesized relationships are tested on the overall sample and based on a two-by-two matrix framework defined by international versus domestic settings and frequent versus infrequent sourcing scenarios. Based on a sample of 179 domestic and 167 international SBUs, the results suggest that market-driven organizational learning in the strategic sourcing units influences customer satisfaction, relationship commitment, and cycle time of the sourcing process. However, while the set of learning orientations appears to be strategically robust across the four quadrant scenarios (moderator settings), the sourcing situations differ somewhat in the specific tactical learning orientations preferred.     

Decision Making in an Automated Environment: The Effects of Anonymity and Proximity with a Group Decision Support System*

Recent advances in information systems technology have made it possible to support the work of interacting groups using networked personal computers. A laboratory experiment was conducted using a group decision support system to evaluate effects of anonymity and proximity on group process in automated group problem solving. Twenty groups of four persons each performed an idea-generating task using an interactive electronic brainstorming program. This experiment's main findings were: (1) Group members working anonymously and apart generated more comments. (2) Working in the same room increased satisfaction. (3) Highest levels of perceived system effectiveness were reported under anonymity.     

The Significance of Information Systems Research on Emerging Technologies: Seven Information Technologies that Promise to Improve Managerial Effectiveness*

Emerging information technologies are those excitingly novel advances that decision makers are just beginning to notice. These emerging products or processes may have been invented some time ago, but are only now beginning to reveal practical applications. This paper examines this collection of seven studies exploring emerging technologies, classifying them so the context of their results can be related to other emerging technologies. Once the research is classified and the contribution and managerial significance of the research is identified, it becomes apparent that certain barriers exist, holding back the technology from wider use and appreciation. Common obstacles include resistance to, or difficulty with, using the technology; uncertainty concerning the value of the technology; and the complexities involved with implementation. This paper concludes with recommendations for future research aimed at breaking down the barriers in order to move from the technological emergence phase to the technological sublime phase in which decision makers and other end users understand the technology, realize and appreciate its value, and put the technology to its best use.     

Confirmatory Factor Analysis of the End‐User Computing Satisfaction Instrument: Replication within an ERP Domain*

Over the past decade, organizations have made significant investments in enterprise resource planning (ERP) systems. The realization of benefits from these investments depends on supporting effective use of information technology (IT) and satisfying IT users. User satisfaction with information systems is one of the most important determinants of the success of those systems. Drawing upon a sample of 407 end users of ERP systems and working within the framework of confirmatory factor analysis (CFA), this study examines the structure and dimensionality, and reliability and validity of the end‐user computing satisfaction (EUCS) instrument posited by Doll and Torkzadeh (1988) . In response to Klenke's (1992) motion to cross‐validate management information system (MIS) instruments and to retest the end user computing satisfaction instrument using new data, this study's results, consistent with previous findings, confirm that the EUCS instrument maintains its psychometric stability when applied to users of enterprise resource planning application software. Implications of these results for practice and research are provided.     

Virtual Teams versus Face-to-Face Teams: An Exploratory Study of a Web-based Conference System*

Many organizations are forming “virtual teams” of geographically distributed knowledge workers to collaborate on a variety of workplace tasks. But how effective are these virtual teams compared to traditional face-to-face groups? Do they create similar teamwork and is information exchanged as effectively? An exploratory study of a World Wide Web-based asynchronous computer conference system known as Meeting Web™ is presented and discussed. It was found that teams using this computer-mediated communication system (CMCS) could not outperform traditional (face-to-face) teams under otherwise comparable circumstances. Further, relational links among team members were found to be a significant contributor to the effectiveness of information exchange. Though virtual and face-to-face teams exhibit similar levels of communication effectiveness, face-to-face team members report higher levels of satisfaction. Therefore, the paper presents steps that can be taken to improve the interaction experience of virtual teams. Finally, guidelines for creating and managing virtual teams are suggested, based on the findings of this research and other authoritative sources.     

Influencing a Supplier Using Delivery Windows: Its Effect on the Variance of Flow Time and On-Time Delivery

A critical outcome that buyers seek is the timely delivery of the products they purchase from suppliers. Delivery windows have been proposed as a means to achieve this goal. This paper proposes a relatively simple model that shows that delivery windows do not always improve delivery timeliness. The effect of buyer-specified delivery windows on the supplier's flow-time variance, inventory, expected tardiness, and probability of on-time delivery is analyzed. The analysis shows that although using delivery windows may result in the supplier's preferred action being a reduction in the variance of flow time, actual delivery timeliness may not improve. On-time delivery performance is analyzed for linear and hyperbolic variance cost functions. The results indicate that when the cost of maintaining lower variances grows exponentially, variance reduction does not lead to more timely deliveries.