The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973 ) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.     

A Simulation of Partial Information Use in Decision Making: Implications for DSS Design

Information matrices are often the output produced by a decision support system. These matrices are a common method for expressing a decision situation under different decision-making scenarios. The decisions involved in designing a decision support system to generate the information matrix are important and involve several cost and benefit components. A designer needs guidance in making effective design decisions in this context. Such guidance can be provided by considering the relationships among specific design decisions, costs, and benefits. The general objective of this study is to provide a comprehensive framework for this purpose. This study is the first to develop and present a comprehensive cost-benefit framework for evaluating design decisions for a variety of scenarios. The specific objective of this research is to provide guidance regarding the number of available information dimensions to incorporate in a computer-based decision aid. Simulation experiments are conducted with a completely specified model based on the cost-benefit framework (including needed assumptions) to evaluate how many information dimensions to include for a specific information matrix size to achieve a balance between information use costs and decision quality. Based upon extensive simulation analyses for a hypothetical decision maker, the practical guideline found for designers is to include only the top half of the relevant information dimensions in any specific decision support system. Over a large number of repeating choice decisions, the savings in cognitive effort and information gathering costs clearly offset relatively minor losses in decision quality.     

Effects of Information Sequence and Irrelevant Distractor Information When Using a Computer‐based Decision Aid*

Computer‐based decision aids are intended to support and improve human judgments. Frequently, the largest portion of the design effort is devoted to the technical aspects of the system; behavioral aspects are often overlooked. As a result, the decision aid may be ineffective. An experiment was conducted to examine the effects of two information structure variables that theoretically affect judgments: information sequence and irrelevant distractor information. Auditor subjects made continuing existence judgments for client‐banks after interacting with one of four alternative decision aids. The decision aids are modifications of a system developed by an international CPA firm. Judgments were predicted to be more accurate when: (1) diagnostic information is presented late rather than early in the information sequence and (2) when no irrelevant distractor information is presented. Further, judgment confidence was predicted to be unrelated to either information sequence or irrelevant distractor information. The experimental data support all three predictions.     

The Effects of Interruptions,Task Complexity,and Information Presentation on Computer‐Supported Decision‐Making Performance

Interruptions are a frequent occurrence in the work life of most decision makers. This paper investigated the influence of interruptions on different types of decision‐making tasks and the ability of information presentation formats, an aspect of information systems design, to alleviate them. Results from the experimental study indicate that interruptions facilitate performance on simple tasks, while inhibiting performance on more complex tasks. Interruptions also influenced the relationship between information presentation format and the type of task performed: spatial presentation formats were able to mitigate the effects of interruptions while symbolic formats were not. The paper presents a broad conceptualization of interruptions and interprets the ramifications of the experimental findings within this conceptualization to develop a program for future research.     

The Influence of Task Interruption on Individual Decision Making: An Information Overload Perspective

Interruptions are a common aspect of the work environment of most organizations. Yet little is known about how interruptions and their characteristics, such as frequency of occurrence, influence decision-making performance of individuals. Consequently, this paper reports the results of two experiments investigating the influence of interruptions on individual decision making. Interruptions were found to improve decision-making performance on simple tasks and to lower performance on complex tasks. For complex tasks, the frequency of interruptions and the dissimilarity of content between the primary and interruption tasks was found to exacerbate this effect. The implications of these results for future research and practice are discussed.     

Decision Making in an Automated Environment: The Effects of Anonymity and Proximity with a Group Decision Support System*

Recent advances in information systems technology have made it possible to support the work of interacting groups using networked personal computers. A laboratory experiment was conducted using a group decision support system to evaluate effects of anonymity and proximity on group process in automated group problem solving. Twenty groups of four persons each performed an idea-generating task using an interactive electronic brainstorming program. This experiment's main findings were: (1) Group members working anonymously and apart generated more comments. (2) Working in the same room increased satisfaction. (3) Highest levels of perceived system effectiveness were reported under anonymity.     

Animation in User Interfaces Designed for Decision Support Systems: The Effects of Image Abstraction,Transition, and Interactivity on Decision Quality*

This paper develops the idea of animation in user interfaces designed for decision support systems (DSS), proposes a framework to investigate the efficacy of animation in these interfaces, and reports on a study that examined the effects of properties of animation specified by the framework. Based on a review of selected background literature, principal properties affecting the efficacy of animation in user interfaces designed for DSS are identified and the effects on decision quality of three of these properties are hypothesized. To evaluate these hypotheses, data was collected in a laboratory experiment involving two different tasks. The results for both tasks indicate that animation in user interfaces designed for DSS should employ parallel as opposed to sequential navigation interactivity techniques. The decision quality of subjects that used a parallel navigation technique was significantly greater than that of those that used a sequential navigation interactivity technique. The results regarding the efficacy of image abstraction and transition effects varied by task. For one task, decision quality was significantly greater for subjects that used realistic as opposed to abstract images, but decision quality did not vary by transition effect. For the other task, decision quality was significantly greater for subjects that used gradual as compared to abrupt transition, but image abstraction had no effect on decision quality.     

The Value of Supplier Information to Improve Management of a Retailer's Inventory

The distribution of lead time demand is essential for determining reorder points in inventory systems. Usually, the distribution of lead time demand is approximated directly. However, in some cases it may be worthwhile to take the demand per unit time and lead time into account, particularly when specific information is available. This paper deals with the situation where a supplier, who produces on order in fixed production cycles, provides information on the status of the coming production run. The retailer can use this information to gain insight into the lead-time process. A fixed order (s_vQ) strategy is presented, with a set of reorder points s_v depending on the time t until the first possible delivery, which is determined by the information of the supplier. A Markov model that analyzes a given (s_vQ) strategy is used to quantify the value of the information provided by the supplier. Some numerical examples show that the approach may lead to considerable cost savings compared to the traditional approach that uses only one single reorder point, based on a two-moments approximation. Using this numerical insight, the pros and cons of a more frequent exchange of information between retailers and suppliers can be balanced.     

The Effects of Temporal Placement of Feedback on Performance With and Without Goals

ABSTRACT

This report from the field evaluated the effects of temporal placement of feedback, and presence or absence of stated goals, on employee skill acquisition in the context of an organization-wide training. Four conditions were examined: feedback before performance with goals, feedback before performance without goals, feedback after performance with goals, and feedback after performance without goals. The results of this study found no statistically significant difference in performance across the four conditions.     

An Empirical Investigation into Factors Relating to the Adoption of Executive Information Systems: An Analysis of EIS for Collaboration and Decision Support*

This study focuses on the organizational adoption of Executive Information Systems (EIS). A distinction is made between two related, complementary EIS capabilities—EIS for collaboration support (EIS_c) and EIS for decision support (EIS_d). EIS_c is relatively standardized and replicable, while EIS_d has to be developed in situ given the specific characteristics of the user and task. The adoption process is conceptualized as an initial transition from a state of nonadoption to adoption (adoption status) and subsequent internal propagation of the technology (adoption level). Data collected from a national survey are used to test hypotheses between identified contextual variables and the adoption status and adoption level of EIS_c and EIS_d. Adopters and nonadopters of both EIS_c and EIS_d do not differ in their organization size, suggesting that the traditional paradigm of “EIS as a technology for large firms” is no longer true. Environmental uncertainty is found to promote the transition from a state of nonadoption to adoption of both EIS_c and EIS_d while continuing to catalyze the internal propagation of EIS_d. While no differences are observed in IS department size between adopters and nonadopters of EIS_c, our results suggest that larger IS departments provide the resource base to explore the less standardized of the two capabilities, EIS_d. IS support is also found to be critical for the subsequent internal propagation of EIS_d. Furthermore, the adoption level of both EIS_c and EIS_d are found to be promoted by top management support. Implications of these results are discussed for the organizational adoption of EIS.     

A Framework for Measuring the Importance of Variables with Applications to Management Research and Decision Models*

In many disciplines, including various management science fields, researchers have shown interest in assigning relative importance weights to a set of explanatory variables in multivariable statistical analysis. This paper provides a synthesis of the relative importance measures scattered in the statistics, psychometrics, and management science literature. These measures are computed by averaging the partial contributions of each variable over all orderings of the explanatory variables. We define an Analysis of Importance (ANIMP) framework that reflects two desirable properties for the relative importance measures discussed in the literature: additive separability and order independence. We also provide a formal justification and generalization of the “averaging over all orderings” procedure based on the Maximum Entropy Principle. We then examine the question of relative importance in management research within the framework of the “contingency theory of organizational design” and provide an example of the use of relative importance measures in an actual management decision situation. Contrasts are drawn between the consequences of use of statistical significance, which is an inappropriate indicator of relative importance and the results of the appropriate ANIMP measures.     

Participation in Strategic Decision Making: The Role of Organizational Predisposition and Issue Interpretation*

Each time managers are faced with a strategic decision they decide how to decide. Specifically, they make choices about who has necessary information and, therefore, who needs to participate in the decision. Such responses to strategic issues are believed to be affected by the way in which decision makers interpret issues. However, organizations develop habitual responses to issues and may be predisposed because of their attention to rules and routines, or because of past performance, to respond to strategic issues in certain ways regardless of how issues are interpreted. We examined the direct and indirect effects of predisposition (rule orientation and past financial performance) and interpretation of strategic issues on the participation of internal stakeholder groups in strategic decision making. Executives in 52 organizations indicated that rule orientation and performance are directly linked to participation in strategic decision making, and that interpretation and rule orientation are directly linked to each other. Implications for managers include the notion that any effort to improve decision-making effectiveness by shaping how organizational members frame and interpret issues will be constrained by the organization's existing routines as well as its past performance.     

Mexican and Swedish Managers' Perceptions of the Impact of EIS on Organizational Intelligence,Decision Making,and Structure*

Although information technologies in business organizations around the world may be very similar, the meanings conveyed through the technologies may be dependent on managerial values and national culture. Cultural differences need to be understood before information technology developed for organizations in one country can be effectively implemented in organizations in another country. Drawing on survey responses from managers using Executive Information Systems (EIS) across many organizations in Mexico, Sweden, and the United States, the current study examined whether cultural differences influence perceptions of the relationship between Executive Information Systems' use and various outcomes related to decision-making behaviors and processes. The study found significant differences, predicted by cultural factors, in the impact of EIS use on senior management decision making. The findings confirm the notion that IT is used by executives to reinforce the decision-making behaviors valued in their culture.     

The Effects of Task Clarification and Group Graphic Feedback on Early Punch-In Times

Task clarification in the form of workplace policy guidelines coupled with weekly graphic feedback of group punch-in times on the staff clock were presented to waitstaff, cooks, cash register clerks, dishwashers, buffet attendants, and hourly assistant managers in a restaurant sub-franchise. Clocking in early dropped from 130 min during baseline to 62 min per week during intervention. A 1-week return to baseline resulted in 189 min of clocking in early by restaurant personnel. The use of task clarification and group feedback reduced company expenses without reductions in job satisfaction or increased stress.     

Seeing Is Believing: The Transitory Influence of Reputation Information on E‐Commerce Trust and Decision Making

This research examines the transitory influence of reputation information on consumer decision making regarding an e‐vendor. Using social judgment theory to explain how reputation information's effect on perceptions may be fleeting, we specifically examined how user trusting beliefs related to an e‐vendor change after a simple exposure to the Web site. A total of 369 college students participated in an experiment that found that reputation information was initially strongly related to trusting beliefs regarding the e‐vendor, but a brief nonpurchase‐related exposure to the e‐vendor's Web site—that is, direct experience—reduced reputation's effects significantly. This research provides insights into why reputation information may be more important in certain circumstances than in others and enhances our understanding of how consumer decision making is affected by different purchasing contexts. This research also has implications on the design and use of trust‐building technologies.     

任务绩效与情境绩效二因素绩效模型的验证

本研究采用验证性因素分析的方法在中国文化背景下检验了任务绩效与情境绩效在结构上的差异,结果表明,任务绩效和情境绩效在结构上是可以区分开的,二者具有不同的构面(construct domain),从而支持了任务绩效与情境绩效二因素绩效模型。同时,通过回归分析的方法发现,任务绩效可以预测员工的提升可能性和离职意向,情境绩效的工作奉献维度可以预测员工的提升可能性。作者最后探讨了本研究的局限及对未来研究的展望。     

The Positive Effects of Easy Goals on Decision Quality and Risk Propensity in an MCPLP Task

In this study the potential performance benefits of easy goals were examined within the multiple cue probability learning paradigm (MCPLP). Specifically, the effects of varying levels of goal difficulty on performance and risk propensity (used to define a form of commitment) were investigated. With few exceptions, previous studies demonstrated support for difficult goals. In this study, contrary to the majority of past evidence, as goals became easier decision quality significantly improved. Moreover, risk propensity increased with easier goals and, as suggested by a post-hoc analysis, had more direct impact on decision makers’ behaviors than goal levels. Goal-related behavior in complex MCPLP tasks appears to significantly differ from the majority of goal evidence in other types of research due to the tendency for subjects to view complex task properties in the same context as goal levels.     

The Significance of Information Systems Research on Emerging Technologies: Seven Information Technologies that Promise to Improve Managerial Effectiveness*

Emerging information technologies are those excitingly novel advances that decision makers are just beginning to notice. These emerging products or processes may have been invented some time ago, but are only now beginning to reveal practical applications. This paper examines this collection of seven studies exploring emerging technologies, classifying them so the context of their results can be related to other emerging technologies. Once the research is classified and the contribution and managerial significance of the research is identified, it becomes apparent that certain barriers exist, holding back the technology from wider use and appreciation. Common obstacles include resistance to, or difficulty with, using the technology; uncertainty concerning the value of the technology; and the complexities involved with implementation. This paper concludes with recommendations for future research aimed at breaking down the barriers in order to move from the technological emergence phase to the technological sublime phase in which decision makers and other end users understand the technology, realize and appreciate its value, and put the technology to its best use.     

The Effects of Information Overload on Software Project Risk Assessment*

Managers are responsible for providing effective information technology governance of the software development process. Ineffective governance leads to serious resource misallocations and negative consequences concerning Sarbanes‐Oxley compliance. In order for managers to make informed decisions about software development projects, they often need more information than is available through normal information channels, that is, they need an in‐depth review of the at‐risk project. Such in‐depth reviews, however, are costly. Hence, accurate identification of at‐risk projects for in‐depth review is critical to management's ability to govern. This research considers how two factors, information load and time pressure, affect the quality of the project‐selection process. We examine quality by observing the decision strategies involved and then relating these strategies to subsequent decision making. An experiment was conducted with experienced information systems auditors using a combination of policy‐capturing and computerized process‐tracing techniques. The participants in our study cope with information overload by accelerating their decision‐making process and adopting noncompensatory decision processes. Contrary to prior research, our process‐tracing analysis suggests that participants rarely filter information, thus implying that decision makers are unable to process all the information. Coping by resorting to noncompensatory strategies did not decrease decision quality unless combined with accelerated information processing. Participants also increase their weight on the software project risk factors that they repeatedly access and that they view for longer periods of time. The theoretical contributions and practical implications regarding what actions managers can take to reduce the negative impact of information overload are discussed.