Some Cautions on the Measurement of User Information Satisfaction*

User information satisfaction (UIS) is important because of its potential effects on MIS department goals, quality of user work life, and extent of voluntary usage of systems. Reliable measurement of UIS is important for providing evaluative information for both researchers and practitioners. This study used 92 managers and executives as subjects to compare the test/retest reliability of a widely used, 13-scale UIS instrument together with four summary questions under experimental and control conditions. The summary questions behaved more reliably than the detailed questions for all groups, perhaps because of problems with scale units and origins and with item heterogeneity. This suggests that researchers need more reliable measures of UIS and that practitioners need to exercise caution when collecting and interpreting UIS scores.     

Test-Retest Reliability of User Information Satisfaction: A Comment on Galletta and Lederer's Paper

Galletta and Lederer [10] concluded that the short-form measure of user information satisfaction (UIS) lacks sufficient test-retest reliability. We question the validity of this conclusion since the method used by the authors for assessing test-retest reliability is not grounded in classical reliability theory. Analysis of their data suggests that the UIS instrument has adequate test-retest reliability.     

ORGANIZATIONAL CONTEXT,USER INVOLVEMENT,AND THE USEFULNESS OF INFORMATION SYSTEMS*

This study investigates organizational factors related to user involvement in information system development and perceived system usefulness. Using a sample of 118 usermanagers in 34 companies, the results show that user involvement in design and implementation is related positively to users' perceptions of system usefulness. However, organizational factors were not found to be related significantly to user involvement, as had been originally hypothesized. Rather, organizational factors either had a direct relationship with perceived usefulness or moderated the relationship between involvement and usefulness. Two factors reflecting an MIS department's maturity (size and age) were found to reduce users' perceptions of system usefulness. Also, users at higher levels and those making more structured decisions found their systems more useful, although the user's level was found to moderate perceptions of system usefulness during the design stage. Three other organizational factors (level of MIS manager, MIS department scope, and decentralization of authority) also were found to have moderating effects.     

Information Systems Management Issues: Reporting and Relevance*

Reports of key information systems issues have been published over the last two decades in many journals. Leading IS journals (e.g., MIS Quarterly, Information & Management, among others) have published key IS management issue reports every three or four years over the last 15 years, and will probably continue to provide such reports in the future. Although these reports claim to provide decisional guidance to practitioners, researchers, consultants, etc., the authors in their experience have noted concerns about their usefulness. While not questioning the validity of the methods and analysis conducted in these studies, we address two important questions in this article: the manner of reporting of the key issue results (which might be misleading), and the relevance of the results (are they providing what they intended to?). We hope that our discussion will provide new perspectives in making resource allocation decisions to both readers and authors of key issue articles.     

Integrating the Content and Process of Strategic MIS Planning with Competitive Strategy*

This paper presents a framework that links strategic MIS planning and business strategy and relates it to competitive advantage and company performance. To achieve this objective, the paper first delineates the dimensions of strategic MIS planning, focusing on both content and process issues. The notion of fit within dimensions, between sets of dimensions (process and content), and between MIS planning and competitive strategy is also introduced. Next, employing the Miles-Snow typology of business strategy, the paper posits normative differences in the dimensions of strategic MIS planning along different business (or competitive) strategies. The implications of our study for both decision makers and scholars are discussed. Propositions that tie competitive strategy, strategic MIS planning, and company financial performance are then presented. The paper concludes by providing direction for future research.     

Measuring user attitudes in MIS research: a review

Management information system (MIS) user attitude measurement and research has been motivated by two distinct perspectives, termed the implementation perspective and the information perspective. A survey of the most significant work based on these perspectives is presented. The consensus of this work is that MIS attitudes are related to MIS use, broadly speaking. However, the usage-relevant components of user attitudes are as yet not well understood. More refined attitude concepts and measures are needed. One such concept, that of a user's channel disposition, is advanced as part of a suggested research direction.     

A Congruence Construct of User Involvement

The MIS literature has devoted considerable attention to the relationship between user involvement and MIS success; unfortunately, this research has produced conflicting results. Recent research on a discrepancy model of user involvement has provided a framework for reconciling studies showing positive, negative, or no impact of involvement on user satisfaction. In this discrepancy model, individual differences between perceived and desired levels of involvement define three conditional states or frames of reference that govern the relationship between involvement and end-user satisfaction. The discrepancy model indicates that studies of user involvement need to control for individual differences by dividing respondents into three groups corresponding to these conditional states. Building upon the discrepancy concept, this paper presents a congruence construct of user involvement (i.e., a measure of involvement “relative” to an individual's desire to get involved) as an alternative way of modeling this contingency relationship. The reliability and validity of the involvement congruence construct are assessed. Perceived and congruence constructs of involvement are compared as predictors of end-user computing satisfaction. The results suggest that involvement congruence is a better predictor than perceived involvement and may offer theoretical as well as empirical advantages over the use of component measures. Furthermore, the congruence method of modeling the discrepancy effect has research design advantages (i.e., it does not require dividing respondents by frame of reference).     

The Information Problems in Organizations: A Research Model for the Value of Information and Information Systems*

Growing recognition of the need for better management information system (MIS) theory and practice centers around problems with identifying the value of information and information systems in organizations. This paper addresses this issue by showing that existing theory in organizational economics and industrial organization directly relates to information problems in organizations (their nature, and their effects in terms of organization structure and performance). The paper categorizes these problems and associated theories into four distinct classes and shows that MIS research and practice can be mapped to information problems of each type. Because the economic theory pertinent to specific information problems includes the nature of the organizational response to information constraints, it also provides insight into the nature of the improvement to be realized if information constraints can be overcome. These improvements can then be interpreted as the value of the associated information systems which suggests using the resultant classification scheme to map between information problems and system value. The paper shows that this methodology provides a more appropriate level of focus than either traditional normative or business value methods, especially because many improvements have structural as well as performance consequences.     

Planning Implications of the Information Systems Strategic Grid: An Empirical Investigation

In recent years, information systems (IS) planning has come to represent a key IS management tool to practitioners and researchers. Concurrently, there has been increasing recognition by organizations that their IS can be viewed as a strategic resource. This research is an attempt to explore the relationship between these two aspects of IS. It analyzes, in an empirical setting, the contingent nature of some IS planning-related variables in the context of the strategic relevance of an organization's IS. The basis for the empirical test is the IS strategic grid framework developed by Cash, McFarlan, McKenney, and Vitale [6]. A questionnaire survey method is employed to elicit information on the strategic orientation of IS and IS planning issues within respondent organizations. The difference in emphasis on various planning aspects in organizations with different IS environments is analyzed. Results of the analysis indicate that there is empirical support for the strategic grid framework and that there are differences in planning aspects among organizations, depending on their location in the grid. The implications of these findings for IS and IS planning are then discussed.     

The Effects of Group Attitudes Toward Alternative GDSS Designs on the Decision-making Performance of Computer-Supported Groups*

Empirical investigations of the effects of group decision support systems (GDSS) accord relatively little attention to the role of attitudes developed by groups toward the GDSS. This study draws upon the theory of social influence to examine the role played by group attitudes in mediating the impact of GDSS designs on group decision-making performance. We found that, in addition to capabilities of GDSS designs, group attitudes toward GDSS were influential in affecting group decision-making performance. The managerial implications of the study are: (1) effective GDSS designs for supporting groups in equivocal decision-making contexts should include structures for communication and consensus support and (2) attempts should be made to enhance user attitudes toward the GDSS through design features of the GDSS, training, and facilitation of positive social influences within the group. The study also provides encouraging evidence about the value of social theories, such as the social influence model and the adaptive structuration theory, in investigating GDSS effects. Further, this study illustrates the value of the partial least squares (PLS) analysis method for testing holistic structural models of GDSS effects.     

The Career Advancement Prospects of Managers and Professionals: Are MIS Employees Unique?

The present study examined the career advancement prospects of MIS and non-MIS employees, as well as the relationships of career advancement prospects with job performance evaluations, job satisfaction, career satisfaction, and organizational commitment for MIS and non-MIS professionals and managers. Participants included 134 MIS professionals and managers and 397 non-MIS professionals and managers of a large communications company. The results provided no evidence that MIS employees experience more restricted career advancement prospects than non-MIS employees. In addition, job performance evaluations generally had positive effects on career advancement prospects; career advancement prospects had a number of positive effects on job satisfaction, career satisfaction, and organizational commitment; and job satisfaction and career satisfaction had positive effects on organizational commitment. These findings are related to prior research, suggestions for future research are offered, and implications for the management of MIS employees are identified.     

Confirmatory Factor Analysis of the End‐User Computing Satisfaction Instrument: Replication within an ERP Domain*

Over the past decade, organizations have made significant investments in enterprise resource planning (ERP) systems. The realization of benefits from these investments depends on supporting effective use of information technology (IT) and satisfying IT users. User satisfaction with information systems is one of the most important determinants of the success of those systems. Drawing upon a sample of 407 end users of ERP systems and working within the framework of confirmatory factor analysis (CFA), this study examines the structure and dimensionality, and reliability and validity of the end‐user computing satisfaction (EUCS) instrument posited by Doll and Torkzadeh (1988) . In response to Klenke's (1992) motion to cross‐validate management information system (MIS) instruments and to retest the end user computing satisfaction instrument using new data, this study's results, consistent with previous findings, confirm that the EUCS instrument maintains its psychometric stability when applied to users of enterprise resource planning application software. Implications of these results for practice and research are provided.     

INFORMATION CHANNEL DISPOSITION AND USE*

The use of information channels by individuals in organizations is substantially discretionary. Although much studied, variation in patterns of discretionary use has yet to be explained adequately in terms of an accepted integrative theory validated across varieties of channel types and organizational settings. In a step toward the development of such a theory, the present paper proposes a basic channel-disposition model that relates an individual's attitude or disposition toward a channel to his/her actual use of the channel in the context of information and channel supply-and-demand structures in the organization. An exploratory study of the dispositions of 186 users of ten management information system (MIS) reports in four organizational settings provides limited evidence in support of the model proposed.     

META-DESIGN CONSIDERATIONS IN DEVELOPING MODEL MANAGEMENT SYSTEMS*

This paper examines cognitive considerations in developing model management systems (MMSs). First, two approaches to MMS design are reviewed briefly: one based on database theory and one based on knowledge-representation techniques. Then three major cognitive issues—human limitations, information storage and retrieval, and problem-solving strategies—and their implications for MMS design are discussed. Evidence indicates that automatic modeling, which generates more complicated models by integrating existing models automatically, is a critical function of model management systems. In order to discuss issues pertinent to automatic modeling, a graph-based framework for integrating models is introduced. The framework captures some aspects of the processes by which human beings develop models as route selections on a network of all possible alternatives. Based on this framework, three issues are investigated: (1) What are proper criteria for evaluating a model formulated by an MMS? (2) If more than one criterion is chosen for evaluation, how can evaluations on each of the criteria be combined to get an overall evaluation of the model? (3) When should a model be evaluated? Finally, examples are presented to illustrate various modeling strategies.     

The Design of a Knowledge-Based Decision Support System to Support the Information Analyst in Determining Requirements

Decision support system (DSS) researchers and designers continue to look for unstructured organizational tasks where there is a critical need for intelligent computer-based support. One such decision task is information requirements determination. Requirements determination is recognized as the most crucial phase of the systems development life cycle. Unfortunately, most methodologies and CASE tools focus only on how to specify the requirements once they are determined. There is very little computer support for the process of determining requirements. This paper discusses the conceptual design and development of a knowledge-based DSS to support information analysts in the critical decision task of determining requirements for the design of effective information systems. The expert modeling support system has the expertise to assist the analyst in studying the organization as a whole and in modeling the system under study in the context of the overall organization's goals and needs. The focus of the paper is on the problems associated with building the knowledge base component of the intelligent decision support system. A prototype implementation of the system is described.     

Construct Measurement in Information Systems Research: An Illustration in Strategic Systems

This study seeks to highlight construct measurement issues in information systems (IS) research. It describes the normative process of construct measurement and identifies the difficult problems involved in measurement and some ways in which these difficulties may be overcome. An illustrative construct-operationalization study in the area of strategic systems outlines how the normative guidelines may be applied to IS. Some specific recommendations for IS include developing a preliminary model of the construct even if there is little previous measurement research, devoting greater attention to predictive validity because a lack of theories in IS precludes the examination of nomological validity, verifying the assumptions underlying the computation of an overall index, and examining the measurement properties of the index.     

A Note on SERVQUAL Reliability and Validity in Information System Service Quality Measurement

Today's information system function includes a large service component. Recent research has examined the SERVQUAL instrument as a possible measure to assist managers and researchers in evaluating service quality. To further examine the appropriateness of the SERVQUAL measure, a large industry sample serves to verify the anticipated structure of the instrument. In addition, a high correlation with a common measure of user satisfaction indicates that the SERVQUAL metric may indeed represent accurate views of user perception. As such, the SERVQUAL instrument can serve as a useful indicator for information system managers attempting to identify areas of needed service improvement and to researchers seeking a success measure of information system services.     

THE STRUCTURE OF EXECUTIVE INFORMATION SYSTEMS: AN EXPLORATORY ANALYSIS

This paper reports on a study which attempted to identify the structure of executive information systems and evaluate their relationship to decision making. The study centered on answering the question: “Where and how do senior executives get their decision-making information?” The data, provided by five senior executives, were gathered by a variety of means which included personal interviews, questionnaires, and logs of the executives' incoming-information transactions for a two-week period. Our findings support beliefs that senior executives receive much information from the environment, that informal systems play a role equal to that of formal systems, and that computers do not provide much information directly to an executive. The study also found that internal information is important and that preferred sources and media vary with different decision roles. The authors suggest that the scope of MIS and DSS be broadened to match those information networks managers actually rely on in daily practice.     

Development and Measurement Validity of a Task-Technology Fit Instrument for User Evaluations of Information System

Although many researchers have raised concerns about the lack of theoretical underpinnings for the user evaluation construct and the lack of measurement validity for specific instruments measuring it, the construct is still widely used in IS research. This paper reports on the development and measurement validity of a diagnostic tool used in recently published research to evaluate an organization's overall information systems and services. A distinctive feature of this instrument is that it is conceptually based on the task-technology fit theory in which the correspondence between information systems functionality and task requirements leads to positive user evaluations, and positive performance impacts. Specifically, the instrument development was guided by a task model of managerial decision making using recorded organizational information. This model suggested the different information systems functionalities required by users for that task, which then serve as the basis for a “task-technology fit” (TTF) instrument. The instrument thus measures the degree to which an organization's information systems and services meet the information needs of its managers. An extensive test of the measurement validity of the instrument is conducted using a sample of 357 users in 10 companies. It is found to have excellent reliability and discriminant validity for 12 dimensions of TTF, and also exhibits strong predictive validity. Finally, the instrument is compared to two other well-known user evaluation instruments. Though no single instrument can meet all needs, the instrument presented here should be considered an attractive option for researchers and practitioners seeking to measure the effectiveness of organizational information systems.