Test-Retest Reliability of the End-User Computing Satisfaction Instrument

The development of reliable and valid measures of user-information satisfaction is becoming increasingly important to both practitioners and researchers. Measures of reliability include internal consistency and stability. Recent research has raised concerns about the stability of user information satisfaction measures. Using the test-retest correlation method, this article assesses short- and long-range stability of a 12-item scale for measuring end-user computing satisfaction. It examines the stability of individual items and subscales as well as the 12-item instrument. The results suggest that the instrument is internally consistent and stable.     

Test-Retest Reliability of User Information Satisfaction: A Comment on Galletta and Lederer's Paper

Galletta and Lederer [10] concluded that the short-form measure of user information satisfaction (UIS) lacks sufficient test-retest reliability. We question the validity of this conclusion since the method used by the authors for assessing test-retest reliability is not grounded in classical reliability theory. Analysis of their data suggests that the UIS instrument has adequate test-retest reliability.     

Developing Measures for Assessing the Organizational Impact of Information Technology: A Comment on Mahmood and Soon's Paper

In a recent study, Mahmood and Soon [26] identified and operationalized a set of variables that can be potentially impacted by information technology. The lack of factor analysis to verify the dimensionality of different variables is a notable omission in the study. This paper describes and employs the limited-information factor analysis approach and the minimum average partial criterion for testing the unidimensionality of different variables in the Mahmood and Soon study. While reconfirming the construct validity of eight variables, our results question the unidimensionality of two original variables. Further testimony is provided in favor of our results by citing previous research studies.     

PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION*

The perceived usefulness of information is an important construct for the design of management information systems. Yet an examination of existing measures of perceived usefulness shows that the instruments developed have not been validated nor has their reliability been verified. In this paper a new instrument for measuring two dimensions of perceived usefulness is developed. The results of an empirical study designed to test the reliability and construct validity of this instrument in a capital-budgeting setting are presented.     

Computer Simulation Success: On the Use of the End-User Computing Satisfaction Instrument: A Comment

This comment is part of a comprehensive study to develop a contingency model of simulation success. The current study focuses on the psychometric stability of the end-user computing satisfaction (EUCS) instrument by Doll and Torkzadeh (1988) when applied to users of computer simulation. Using a survey of 411 users, the researchers provide evidence that the EUCS instrument is a valid and reliable measure of computer simulation success. Given this evidence, managers and simulation software product developers can confidently apply the instrument in the investigation of competing tools, features, and technologies.     

The Effects of Group Attitudes Toward Alternative GDSS Designs on the Decision-making Performance of Computer-Supported Groups*

Empirical investigations of the effects of group decision support systems (GDSS) accord relatively little attention to the role of attitudes developed by groups toward the GDSS. This study draws upon the theory of social influence to examine the role played by group attitudes in mediating the impact of GDSS designs on group decision-making performance. We found that, in addition to capabilities of GDSS designs, group attitudes toward GDSS were influential in affecting group decision-making performance. The managerial implications of the study are: (1) effective GDSS designs for supporting groups in equivocal decision-making contexts should include structures for communication and consensus support and (2) attempts should be made to enhance user attitudes toward the GDSS through design features of the GDSS, training, and facilitation of positive social influences within the group. The study also provides encouraging evidence about the value of social theories, such as the social influence model and the adaptive structuration theory, in investigating GDSS effects. Further, this study illustrates the value of the partial least squares (PLS) analysis method for testing holistic structural models of GDSS effects.     

The Development of a Measure for End-User Computing Support

Various studies have argued and concluded that the most effective method of promotingend-user computing (EUC) in an organization consists of providing extensive end-user support. This paper describes the development of an instrument to measure EUC support A search of the EUC literature was conducted to identify items to include in the instrument. Theinstrument was validated by administering it in the form of a questionnaire to end-users in more man a hundred information centers across the United States. A factor analysis conducted on the data obtained from this survey yielded 12 factors of EUC support. Three factors were subsequently dropped from the instrument. The remaining factors were successfully tested for internal consistency. The instrument was tested for, and found to possess, convergent and discriminant validity. The instrument exhibited nomological validity. The resulting instrument, consisting of 42 items and 9 factors, is presented as a reliable, valid, and useful device for assessing the level of EUC support.     

Toward Development of the End User Computing Construct in a University Setting*

The authors identify and define the end user computing (EUC) construct and operationalize the construct through development of a valid, reliable measure called the EUC activities scale. This scale is designed to distinguish specific, discrete computer activities performed on the job. The research analyzes the validity and reliability of the instrument based on data obtained from 776 university employees who participated in the initial, exploratory application. Exploratory factor analysis of the scale resulted in five factors. In order of increasing complexity of job-related computer activities, these factors are: beginning EUC activities, intermediate EUC activities, advanced EUC activities, EUC facilitation activities, and EUC infrastructure activities. The factor analysis, reliabilities, and known-groups analysis provide support for the construct validity of the instrument when used in a university setting. Suggestions are provided for further use of the scale in business environments to increase generalizability, refine the instrument, and help establish a coherent theoretical basis for further research in EUC.     

A Study of the Impact of an Integrated Information Technology on the Time Utilization of Information Workers

This paper examines the impact of the implementation of an integrated information technology (IIT) on the time utilization of information workers as mediated by the content of the information work performed. The IIT in this study is a system of personal computers linked together in a network for sharing computing, data, and communication resources. The subjects of the study were two groups of information workers in an academic field setting. One group consisted of knowledge workers whose chief activity was to advise and counsel students. The other group represented lower level information workers who provided support service to an academic department. A two-dimensional framework was used to classify each of the activities an information worker performs relative to its importance and programmability within the context of the information work. Using work sampling methodology, it was determined that the IIT was associated with the knowledge workers' reallocation of work time to important yet relatively unstructured tasks. The lower level information workers became more efficient in performing highly structured skill-based activities. However, there was no statistically significant improvement in the effectiveness of the work completed as perceived by the clients of both groups of information workers. The results suggest that when an IIT is implemented, the manner in which newly available time is utilized depends on the nature of the information work performed by the users.     

Some Cautions on the Measurement of User Information Satisfaction*

User information satisfaction (UIS) is important because of its potential effects on MIS department goals, quality of user work life, and extent of voluntary usage of systems. Reliable measurement of UIS is important for providing evaluative information for both researchers and practitioners. This study used 92 managers and executives as subjects to compare the test/retest reliability of a widely used, 13-scale UIS instrument together with four summary questions under experimental and control conditions. The summary questions behaved more reliably than the detailed questions for all groups, perhaps because of problems with scale units and origins and with item heterogeneity. This suggests that researchers need more reliable measures of UIS and that practitioners need to exercise caution when collecting and interpreting UIS scores.     

Combining Neural Networks and Statistical Predictions to Solve the Classification Problem in Discriminant Analysis*

A number of recent studies have compared the performance of neural networks (NNs) to a variety of statistical techniques for the classification problem in discriminant analysis. The empirical results of these comparative studies indicate that while NNs often outperform the more traditional statistical approaches to classification, this is not always the case. Thus, decision makers interested in solving classification problems are left in a quandary as to what tool to use on a particular data set. We present a new approach to solving classification problems by combining the predictions of a well-known statistical tool with those of an NN to create composite predictions that are more accurate than either of the individual techniques used in isolation.     

On the Generality of the PERT Average Time Formula

It is well known that the PERT average time formula approximation is related to the Beta distribution assumption. In this note, it is shown that if the formula is modified to use the median instead of the mode, then it becomes a good approximation regardless of distribution assumptions. Applications of the formula beyond project management are highlighted.     

Discretionary Use of Computers: An Empirically Derived Explanatory Model*

This study identifies variables that explain variations in computer use. Factor analysis of data gathered from 422 business administration faculty reveal eight themes among the independent variables. Seven of these factors significantly discriminate among non, minimal, and high users. These results suggest an empirical model for future studies and provide policy insights for decision makers seeking to stimulate computer usage. Additionally, the study shows that there is much commonality between the previously separate organizational innovation and information systems implementation streams. It also demonstrates that motivation theory may be a valid framework within which to study computer use.     

Cognitive Fit: A Theory-Based Analysis of the Graphs Versus Tables Literature*

A considerable amount of research has been conducted over a long period of time into the effects of graphical and tabular representations on decision-making performance. To date, however, the literature appears to have arrived at few conclusions with regard to the performance of the two representations. This paper addresses these issues by presenting a theory, based on information processing theory, to explain under what circumstances one representation outperforms the other. The fundamental aspects of the theory are: (1) although graphical and tabular representations may contain the same information, they present that information in fundamentally different ways; graphical representations emphasize spatial information, while tables emphasize symbolic information; (2) tasks can be divided into two types, spatial and symbolic, based on the type of information that facilitates their solution; (3) performance on a task will be enhanced when there is a cognitive fit (match) between the information emphasized in the representation type and that required by the task type; that is, when graphs support spatial tasks and when tables support symbolic tasks; (4) the processes or strategies problem solvers use are the crucial elements of cognitive fit since they provide the link between representation and task; the processes identified here are perceptual and analytical; (5) so long as there is a complete fit of representation, processes, and task type, each representation will lead to both quicker and more accurate problem solving. The theory is validated by its success in explaining the results of published studies that examine the performance of graphical and tabular representations in decision making.     

A Note on SERVQUAL Reliability and Validity in Information System Service Quality Measurement

Today's information system function includes a large service component. Recent research has examined the SERVQUAL instrument as a possible measure to assist managers and researchers in evaluating service quality. To further examine the appropriateness of the SERVQUAL measure, a large industry sample serves to verify the anticipated structure of the instrument. In addition, a high correlation with a common measure of user satisfaction indicates that the SERVQUAL metric may indeed represent accurate views of user perception. As such, the SERVQUAL instrument can serve as a useful indicator for information system managers attempting to identify areas of needed service improvement and to researchers seeking a success measure of information system services.     

A NOTE ON THE RELATIONSHIPS AMONG FINENESS,GARBLING, AND SUFFICIENCY FOR THE COMPARISON OF INFORMATION SYSTEMS*

Choice among competing information systems is an important problem for both the providers and users of information. When the attributes of the decision makers and decision problems for which information is produced are unknown or heterogeneous, it is difficult to choose among alternative information sources. Three criteria for such comparisons of information systems are available in the theory of information economics. These criteria may be distinguished by the differing restrictions that they impose on the generality of the studies in which they are used. This note explicates the relationships among these criteria and discusses the various limitations that they impose on generality.     

Task-Structure Relationship of Information Systems Development Subunit: A Congruence Perspective*

Several studies have examined the influence of organizational context (e.g., organization size, environment, strategy) on information systems (IS) performance/success. But very few studies have examined IS structure, and those studies have focused on a particular element of IS structure (e.g., decentralization). Thus, the multidimensional structural configuration of IS as an organizational subunit has escaped research attention. Further, the nature of the task to be performed by the IS subunit as a contextual factor has been virtually ignored in the IS research literature. In this paper, we first develop a congruence model for the task-structure relationship in an information systems development (ISD) subunit setting. Then we test this model as a multivariate relationship followed by subordinate bivariate analyses. Analysis of data from 41 hospitals’ ISD subunits reveals that a congruence relationship between task context and the structure of an ISD subunit is present. Our findings also show that an exclusive association exists between uncertainty in the task environment and the decision-making structure. Likewise, the association between equivocality of task content and the control structure of the ISD subunit is also exclusive. Implications of these findings for decision makers and researchers are discussed.     

Confirmatory Factor Analysis of the End‐User Computing Satisfaction Instrument: Replication within an ERP Domain*

Over the past decade, organizations have made significant investments in enterprise resource planning (ERP) systems. The realization of benefits from these investments depends on supporting effective use of information technology (IT) and satisfying IT users. User satisfaction with information systems is one of the most important determinants of the success of those systems. Drawing upon a sample of 407 end users of ERP systems and working within the framework of confirmatory factor analysis (CFA), this study examines the structure and dimensionality, and reliability and validity of the end‐user computing satisfaction (EUCS) instrument posited by Doll and Torkzadeh (1988) . In response to Klenke's (1992) motion to cross‐validate management information system (MIS) instruments and to retest the end user computing satisfaction instrument using new data, this study's results, consistent with previous findings, confirm that the EUCS instrument maintains its psychometric stability when applied to users of enterprise resource planning application software. Implications of these results for practice and research are provided.     

The Effectiveness of Graphical Presentation for Information Extraction: A Cumulative Experimental Approach*

Three laboratory experiments were conducted to assess the relative strengths and weaknesses of bar, symbol, and line graphs for performing a variety of elementary information extraction tasks using two dependent variables, time and accuracy. The findings indicate that the degree of support provided by a particular graph format for a particular data extraction task depends on the matching of format and task in terms of their anchoring characteristics. Anchoring, in this context, refers to the phenomenon that specific and diverse parts of a graph are segmented by the reader to act as salient and relevant cues, or anchors, when different classes of information are to be extracted from the graph. A data extraction task has high x-value (y-value) anchoring if the x-axis (y-axis) component is represented in the question as either a given value or an unknown value. Conversely, a task has low x-value (y-value) anchoring if the x-axis (y-axis) component is not represented in the question as either a given value or as an unknown value. Data extraction accuracy was not significantly affected by presentation format. Bars provided the best time performance for data extraction tasks having high anchoring on both axes but were not appropriate for tasks having low anchoring on either the y axis or both the x and y axes. Line graphs tended to be worse in terms of time performance for tasks having high anchoring on both axes although they were as fast or better than other representations for tasks having low anchoring on both axes. Symbol plots appeared to possess anchoring characteristics associated with both bars and line graphs. Symbols (as with bars) tended to produce a time performance superior to that of line graphs for tasks having high anchoring on both axes; and (as with line graphs) symbols allowed faster results than bar graphs for tasks having low anchoring on either the y axis or both the x and y axes.     

Integrating the Content and Process of Strategic MIS Planning with Competitive Strategy*

This paper presents a framework that links strategic MIS planning and business strategy and relates it to competitive advantage and company performance. To achieve this objective, the paper first delineates the dimensions of strategic MIS planning, focusing on both content and process issues. The notion of fit within dimensions, between sets of dimensions (process and content), and between MIS planning and competitive strategy is also introduced. Next, employing the Miles-Snow typology of business strategy, the paper posits normative differences in the dimensions of strategic MIS planning along different business (or competitive) strategies. The implications of our study for both decision makers and scholars are discussed. Propositions that tie competitive strategy, strategic MIS planning, and company financial performance are then presented. The paper concludes by providing direction for future research.