Confirmatory factor analysis and factorial invariance of the impact of information technology instrument

Organizations increasingly evaluate information technology in terms of its impact on the individual and his/her work. Academics have shown increased attention to developing measures of technology success in terms of impact on work. One of these efforts produced an instrument that measures how extensively information technology applications impact task productivity, task innovation, customer satisfaction, and management control. These constructs reflect perceived usefulness of information technology application for work. This paper reports on confirmatory analysis and factorial invariance tests of the impact of information technology instrument. The recommended four-factor instrument contains 12 items, seems to be factorially invariant across two samples from the US and Mexico and across two managerial levels, and has high reliability and validity.     

Development and Measurement Validity of a Task-Technology Fit Instrument for User Evaluations of Information System

Although many researchers have raised concerns about the lack of theoretical underpinnings for the user evaluation construct and the lack of measurement validity for specific instruments measuring it, the construct is still widely used in IS research. This paper reports on the development and measurement validity of a diagnostic tool used in recently published research to evaluate an organization's overall information systems and services. A distinctive feature of this instrument is that it is conceptually based on the task-technology fit theory in which the correspondence between information systems functionality and task requirements leads to positive user evaluations, and positive performance impacts. Specifically, the instrument development was guided by a task model of managerial decision making using recorded organizational information. This model suggested the different information systems functionalities required by users for that task, which then serve as the basis for a “task-technology fit” (TTF) instrument. The instrument thus measures the degree to which an organization's information systems and services meet the information needs of its managers. An extensive test of the measurement validity of the instrument is conducted using a sample of 357 users in 10 companies. It is found to have excellent reliability and discriminant validity for 12 dimensions of TTF, and also exhibits strong predictive validity. Finally, the instrument is compared to two other well-known user evaluation instruments. Though no single instrument can meet all needs, the instrument presented here should be considered an attractive option for researchers and practitioners seeking to measure the effectiveness of organizational information systems.     

Using Davis's Perceived Usefulness and Ease-of-use Instruments for Decision Making: A Confirmatory and Multigroup Invariance Analysis

As key components of Davis's technology acceptance model (TAM), the perceived usefulness and perceived ease-of-use instruments are widely accepted among the MIS research community as tools for evaluating information system applications and predicting usage. Despite this wide acceptance, a series of incremental cross-validation studies have produced conflicting and equivocal results that do not provide guidance for researchers or practitioners who might use the TAM for decision making. Using a sample of 902 “initial exposure” responses, this research conducts: (1) a confirmatory factor analysis to assess the validity and reliability of the original instruments proposed by Davis, and (2) a multigroup invariance analysis to assess the equivalence of these instruments across subgroups based on type of application, experience with computing, and gender. In contrast to the mixed results of prior cross-validation efforts, the results of this confirmatory study provide strong support for the validity and reliability of Davis's sixitem perceived usefulness and six-item ease-of-use instruments. The multigroup invariance analysis suggests the usefulness and ease-of-use instruments have invariant true scores across most, but not all, subgroups. With notable exemptions for word processing applications and users with no prior computing experience, this research provides evidence that the item-factor loadings (true scores) are invariant across spread sheet, database, and graphic applications. The implications of the results for managerial decision making are discussed.     

Cautions on the Use of the SERVQUAL Measure to Assess the Quality of Information Systems Services

The SERVQUAL questionnaire (Parasuraman, Zeithaml, & Berry, 1988) is one of the preeminent instruments for measuring the quality of services as perceived by the customer. In a recent Decision Sciences article, Kettinger and Lee (1995) suggested the use of a modified SERVQUAL instrument to assess the quality of the services supplied by an information services provider. However, a number of problems with the SERVQUAL instrument are discussed in the literature. This article provides an illustrative example utilizing data collected from 138 executive and information systems professional customers of a multibillion dollar information services provider in order to examine the validity and reliability of Kettinger and Lee's (1995) modified SERVQUAL instrument. Results of analyses do not confirm the findings of Kettinger and Lee. Moreover, it appears that the use of difference scores in calculating SERVQUAL contributes to problems with the reliability, discriminant validity, convergent validity, and predictive validity of the measure. These findings suggest that caution should be exercised in the use of SERVQUAL scores and that further work is needed in the development of measures for assessing the quality of information services.     

Determinants and Consequences of Perceived Complexity in Human-Computer Interaction*

A number of recently published studies on human-computer interface variables report contradictory results. A lack of underlying theory may be the cause. This study investigates the usefulness of employing an intermediate variable–perceived complexity–in examining the impact of two information system (IS) variables on performance: the mode of presentation, which has been extensively studied; and the number of windows, which has scarcely been studied. The study demonstrates the usefulness of understanding the role of perceived complexity in human-computer interaction. The specific results support past findings with regard to graphs vs. tables and reveal new findings on the role of windows. Most interesting is the interaction between the two IS variables. The use of more windows is significantly more beneficial for tabular, rather than graphical, presentation. The realization that perceived complexity is affected by task complexity and by IS variables has important implications for the design of flexible information systems. These implications are discussed.     

基于TAM的移动证券消费者信任实证研究

电子商务环境下的消费者信任研究比较多,但是移动商务环境下消费者对交易型服务的信任研究相对较少。基于技术接受模型,以移动证券业务为研究对象,构建移动商务环境下的消费者信任模型,分析感知的易用性、感知的有用性、感知的安全、信息质量、便利性和信任倾向对移动证券信任的影响以及移动证券的信任、感知的易用性和感知的有用性对消费者使用意愿的作用。通过问卷调查,收集224份有效问卷,采用SPSS和PLS-Graph软件进行统计分析。实证结果表明,感知的有用性、感知的安全、信任倾向和信息质量正向影响消费者对移动证券的信任,感知的易用性和便利性对移动证券的信任没有显著影响,信任是消费者对移动证券产生使用动机的关键要素。最后,对移动证券的服务提供商提出对策建议并指出进一步研究的方向。     

Social Networking and Individual Perceptions: Examining Predictors of Participation

Social networking is a process and practice that draws people and organizations together in an electronic medium. This article explores social interaction-based theories to suggest a social networking participation model that may help organizations understand acceptance or rejection of participation. Responses from 191 public administrators were analyzed using structural equation modeling (SEM), focusing on relationships between participation and five constructs: perceived usefulness, perceived ease of use, perceived improvement potential (PIP), intra-organizational trust, and type of use. The study found favorable model fit statistics that support positive correlations between the latent variables examined and participation in social networking activities. The results demonstrate the potential of the survey instrument to serve as an adoption and participation model to predict and promote social networking activities as they relate to perceived performance improvement.     

ORGANIZATIONAL CONTEXT,USER INVOLVEMENT,AND THE USEFULNESS OF INFORMATION SYSTEMS*

This study investigates organizational factors related to user involvement in information system development and perceived system usefulness. Using a sample of 118 usermanagers in 34 companies, the results show that user involvement in design and implementation is related positively to users' perceptions of system usefulness. However, organizational factors were not found to be related significantly to user involvement, as had been originally hypothesized. Rather, organizational factors either had a direct relationship with perceived usefulness or moderated the relationship between involvement and usefulness. Two factors reflecting an MIS department's maturity (size and age) were found to reduce users' perceptions of system usefulness. Also, users at higher levels and those making more structured decisions found their systems more useful, although the user's level was found to moderate perceptions of system usefulness during the design stage. Three other organizational factors (level of MIS manager, MIS department scope, and decentralization of authority) also were found to have moderating effects.     

Modelling the factors that influence the acceptance of digital technologies in e-government services in the UAE: a PLS-SEM Approach

Abstract

The digital technologies such as Internet play a crucial role in the management of operations of organisations in both public and private sectors. Such technologies support the implementation of effective digital business strategies. By reviewing the extant literature, this paper aims to identify factors that influence the intention to use digital technologies in order to develop a theoretical model which is then tested empirically using the PLS-SEM approach. While many studies have focused solely on the importance of social influence, perceived usefulness, perceived ease of use, awareness, perceived trust in technology, perceived trust in government, perceived cost and perceived risk, this article brings them together to explain their linkage, and quantifies the relationship. This study is the first empirical attempt to explore the factors influence e-government services adoption in the UAE. Most specifically, this article emphasises the role of social influence, perceived ease to use and perceived trust in technology as the important determinants of the intention to digital technology adoption. The paper expands the traditional discussion by incorporating six variables in a model that acts as facilitator or barrier in the intention to use digital technologies. This article helps practitioners to understand of which factors should be given emphasis in enhancing the intention to use digital technologies. The model developed in this paper is not only a response to the need to understand what causes the variation in the intention to use digital technologies from the operation management perspective, it is also a response to practitioner needs to use an appropriate construct to ensure the effective operation and use of the digital technologies in e-government services. The paper will help to identify the key issues surrounding the digital technologies adoption that may lead the successful operations of e-government.     

The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973 ) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.     

Toward Development of the End User Computing Construct in a University Setting*

The authors identify and define the end user computing (EUC) construct and operationalize the construct through development of a valid, reliable measure called the EUC activities scale. This scale is designed to distinguish specific, discrete computer activities performed on the job. The research analyzes the validity and reliability of the instrument based on data obtained from 776 university employees who participated in the initial, exploratory application. Exploratory factor analysis of the scale resulted in five factors. In order of increasing complexity of job-related computer activities, these factors are: beginning EUC activities, intermediate EUC activities, advanced EUC activities, EUC facilitation activities, and EUC infrastructure activities. The factor analysis, reliabilities, and known-groups analysis provide support for the construct validity of the instrument when used in a university setting. Suggestions are provided for further use of the scale in business environments to increase generalizability, refine the instrument, and help establish a coherent theoretical basis for further research in EUC.     

The effects of self-efficacy on computer usage

This paper examines the effect of self-efficacy, belief in one's capabilities of using a computer in the accomplishment of specific tasks, on computer usage. It introduces an extended technology acceptance model (TAM) that explicitly incorporates self-efficacy and its determinants (experience and organizational support) as factors affecting computer anxiety, perceived ease of use, perceived usefulness and the use of computer technology. A survey of 450 microcomputer users in Finland found strong support for the conceptual model. In accordance with TAM, perceived usefulness had a strong direct effect on usage, while perceived ease of use had indirect effect on usage through perceived usefulness. Self-efficacy had both direct and indirect effects on usage, demonstrating its importance in the decision to use computer technology. It also had a strong direct effect on perceived ease of use, but only an indirect effect on perceived usefulness through perceived ease of use. Computer experience was found to have a strong positive direct effect on self-efficacy, perceived ease of use, perceived usefulness and usage. Organizational support and computer anxiety had only indirect effects on usage, mainly through perceived usefulness. Implications of these findings are discussed for researchers and practitioners.     

Test-Retest Reliability of User Information Satisfaction: A Comment on Galletta and Lederer's Paper

Galletta and Lederer [10] concluded that the short-form measure of user information satisfaction (UIS) lacks sufficient test-retest reliability. We question the validity of this conclusion since the method used by the authors for assessing test-retest reliability is not grounded in classical reliability theory. Analysis of their data suggests that the UIS instrument has adequate test-retest reliability.     

Toward an Understanding of the Behavioral Intention to Use an Information System

Organizational investment in information systems is often large and risky given the variety of information requirements placed on systems today. To make more informed decisions and to meet the challenge of developing systems that satisfy these demands, system developers need to achieve a better understanding of factors that ultimately lead to system usage. To enhance this understanding, we posit a holistic framework to examine several constructs suggested in the literature that lead to the behavioral intention to use an information system. Our framework includes situational involvement, intrinsic involvement, argument for change, perceived usefulness, ease of use, prior usage, and attitude constructs. We extend the Davis, Bagozzi, and Warshaw Technology Acceptance Model (TAM), which is founded on the Theory of Reasoned Action. A diverse sample from industry is used to test our model. Structural equation modeling is used to examine the entire pattern of intercorrelations among the constructs and to test related propositions. A hierarchical structure is used to compare the explanatory ability of TAM with our extension. Our model explains a large portion of the covariance among the constructs that lead to a user's behavioral intention to use an information system and compares favorably with TAM. The results indicate that (1) the direct effect of situational involvement on behavioral intention as well as attitude is significant in the negative direction, (2) attitude seems to play a mediating role, and (3) intrinsic involvement plays a significant role in shaping perceptions. Finally, we conclude that the user involvement construct needs to be separated into its psychological as well as its participative components for developers to understand its impact on the systems development process.     

Acceptance of automation manufacturing technology in China: an examination of perceived norm and organizational efficacy

Abstract

With a shift to more automation technology, social acceptance of technology plays an important role in the manufacturing sector. To what extent this occurs, and affects the adoption of technology, has been less researched, but is important in deciding how such technology is introduced, and the nature of the shift from labour-intensive manufacturing to automation. This research applies the revised technology acceptance model (TAM) to examine the impact of social and individual antecedents on the acceptance of automation manufacturing technology. Survey data are collected from 258 Chinese manufacturers. Results suggest that perceived norms significantly affect organizational intention to use automation manufacturing technology both directly and via perceived usefulness; organizational efficacy explains the intention to use via mediating effect of perceived usefulness and perceived ease of use. This research is one of the first extending and applying TAM from individuals to organizations.     

Führungsstile – Evaluation einer Nebenaufgabe im Development Center

To asses six different leadership styles we employed a questionnaire during the development center in a manufacturing firm. Analysing the questionnaire indicates its reliability, scalability, economy, usefulness and fairness. An explorative factor analysis supports the factorial validity. A content analysis provides evidence that the transformational leadership style is perceived as the most positive and the authoritarian leadership style as the most negative one. Furthermore, we found transformational leadership style positively correlated with an aggregated measure for the competence extraversion.     

A FRAMEWORK AND MEASUREMENT INSTRUMENT FOR JUST-IN-TIME MANUFACTURING

While Just-in-Time (JIT) manufacturing has emerged as one of the major tools to enhance manufacturing competitiveness, no attempt has been made to develop a reliable and valid measurement instrument for empirical research in JIT. Without such an instrument, generalization beyond the immediate sample is difficult or misleading. We have proposed a JIT framework and developed a valid and reliable instrument with 16 summated scales for dimensions that capture essential aspects of JIT useful in assessing its impact in manufacturing environments. In addition, we discuss in detail the interactive nature of JIT practice. And, we propose a step-by-step approach to reliability and validity testing. Four JIT practices (equipment layout, pull system support, supplier quality level, and Kanban) are identified as major contributing factors to JIT performance.     

Reliability evaluation of a multicast over coded packet networks

Network coding is a generalization of conventional routing methods that allows a network node to code information flows before forwarding them. While it has been theoretically proved that network coding can achieve maximum network throughput, theoretical results usually do not consider the stochastic nature in information processing and transmission, especially when the capacity of each arc becomes stochastic due to failure, attacks, or maintenance. Hence, the reliability measurement of network coding becomes an important issue to evaluate the performance of the network under various system settings. In this paper, we present analytical expressions to measure the reliability of multicast communications in coded networks, where network coding is most promising. We define the probability that a multicast rate can be transmitted through a coded packet network under a total transmission cost constraint as the reliability metric. To do this, we first introduce an exact mathematical formulation to construct multicast connections over coded packet networks under a limited transmission cost. We then propose an algorithm based on minimal paths to calculate the reliability measurement of multicast connections and analyze the complexity of the algorithm. Our results show that the reliability of multicast routing with network coding improved significantly compared to the case of multicast routing without network coding.     

A Congruence Construct of User Involvement

The MIS literature has devoted considerable attention to the relationship between user involvement and MIS success; unfortunately, this research has produced conflicting results. Recent research on a discrepancy model of user involvement has provided a framework for reconciling studies showing positive, negative, or no impact of involvement on user satisfaction. In this discrepancy model, individual differences between perceived and desired levels of involvement define three conditional states or frames of reference that govern the relationship between involvement and end-user satisfaction. The discrepancy model indicates that studies of user involvement need to control for individual differences by dividing respondents into three groups corresponding to these conditional states. Building upon the discrepancy concept, this paper presents a congruence construct of user involvement (i.e., a measure of involvement “relative” to an individual's desire to get involved) as an alternative way of modeling this contingency relationship. The reliability and validity of the involvement congruence construct are assessed. Perceived and congruence constructs of involvement are compared as predictors of end-user computing satisfaction. The results suggest that involvement congruence is a better predictor than perceived involvement and may offer theoretical as well as empirical advantages over the use of component measures. Furthermore, the congruence method of modeling the discrepancy effect has research design advantages (i.e., it does not require dividing respondents by frame of reference).     

On the Repeated Test-Retest Reliability of the End-User Computing Satisfaction Instrument: A Comment*

This comment extends the test-retest reliability of the end-user computing satisfaction (EUCS) instrument by Torkzadeh and Doll [10]. Whereas Torkzadeh and Doll [10] reportedstability for two hour and two week EUCS test-retest reliability, we investigate the test-retest reliability of the EUCS instrument at two points in time, separated by a two yearinterval. We assess the end user computing satisfaction of personal computer, as well as mainframe, administrative end users in a large public organization. The results of the repeated test-retest using differing application platforms add further support for the reliability of the EUCS measure and highlight some areas of concern for managers of information systems.