The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973 ) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.     

PREFERENCE MAPPING OF PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEMS DESIGN

In a recent issue of this journal, Watkins [13] presented an approach for discovery of decision-maker perceptions of the complexity (dimensionality) of information items that might be supplied by a decision support system. Through use of multidimensional scaling and cluster analysis, relatively homogeneous groups of decision makers, sharing common perceptions of various information items, were formed. This prior research was referred to as a first step in suggesting that information reports could be tailored to groups of decision makers classified on the basis of common perceptions of information. The current research extends the prior study by evaluating decision maker preferences for information in a variety of decision-making scenarios in relation to the previously identified perceptions of the information. Based on the results of the study, conclusions are made which suggest that the tailoring of information to groups of decision makers should be based on both perceptions and preferences for information. Even so, it is demonstrated that the decision tasks have an impact on the preferences for information which may affect the attempt to tailor information to groups of decision makers.     

DECISION SUPPORT SYSTEMS FOR ILL-STRUCTURED PROBLEMS: AN EMPIRICAL STUDY

Decision support systems (DSSs) are more complex than most other traditional decision-aid systems. For what types of problems are they more effective, and what design characteristics make them more effective? The laboratory experiment reported here examined the effect of three design characteristics of these systems in the context of decision makers faced with ill-structured problems. The characteristics were presence or absence of decision-aid heuristics, degree of interaction between the user and the system, and whether or not the system was computerized. The dependent variables were (1) quality of user performance, (2) user productivity of ideas, (3) user confidence in the quality of his/her performance, (4) user satisfaction with the decision aid or support system, (5) changes in user attitude toward the problem addressed, and (6) changes in user attitude toward computers. Use of heuristics and increased interaction had positive effects on decision quality, user productivity, and attitude toward computers; they had negative effects on user confidence, satisfaction, and attitude toward the problem addressed. Whether or not the system was computerized did not have a significant effect on any dependent variable. The findings concerning negative effects, in particular, suggest the need for research on the design of heuristics for addressing ill-structured problems—heuristics that will deliver the positive but not the negative effects observed in this study. The findings also suggest the need for research on how to benefit from computers in the context of solving ill-structured problems.     

A multi-stakeholder view of social media as a supporting tool in higher education: An educator–student perspective

Social media in higher education is becoming increasingly important both in courses' delivery and assessment. This research explores the adoption of social media as a supporting tool in undergraduate (UG) education using both educators' and students' perspectives. The first study involves a survey of 205 educators who reported their views on the importance and use of social media within their management courses. The second study consists of four focus groups, which provides insights into students' perspectives and attitudes toward the use of social media by their educators in higher education. Results show that both educators and students acknowledge the importance of incorporating social media in delivery and assessment of courses and highlight its positive impact on students' deep learning experience and engagement, as well as their enhancement of collaborative and organizational skills. However, faculty is advised to keep a balance in terms of relevance of social media use, control, and usage level of social media platforms.     

Development and teaching a computer-assisted course in production planning

Abstract. Course development and student activities are described for a successful computer-assisted senior level course in production planning. Development was guided by the view that students must (1) understand the elements being integrated, (2) understand the problems that are being resolved through integration, and (3) participate in the integration activity. Production planning is treated as a hierarchy of individual decision situations which are to be integrated. Each decision is assisted by a software-based technique. A menu program and a common database were developed to allow a student to become the 'integrator' by directing the information flow among the individual decision situations. The paper describes the development tasks, the course elements, and student activities which provide guidelines for others developing similar courses.     

Risk,Ambiguity, and Decision Choice: Some Additional Evidence*

This paper extends prior research by jointly assessing the roles of risk attitude and tolerance for ambiguity in predicting choice. An experiment examined the effects of these variables on decisions made in four different scenarios. The four scenarios (treatment combinations) were generated by manipulating risk and ambiguity into two levels (high and low). The context was defined in terms of a sample size selection problem. The second issue explored was the effect of attitudes toward risk and ambiguity on decision confidence. The results indicate that (1) both risk attitude and ambiguity intolerance determined choice behavior, (2) the roles of these individual attitudes depend on the levels of the two treatment variables of risk and ambiguity, (3) the presence of ambiguity accentuates the perception of risk in individual subjects, and (4) decision makers who are less risk averse, and have more tolerance for ambiguity, display greater confidence in their choice. The paper discusses some of the managerial implications of the results.     

A Public Transportation Decision‐Making Model within a Metropolitan Area

Understanding the decision‐making factors associated with public transportation is essential in strategic development of public transportation to improve acceptance and utilization of mass transit systems. This research analyzes factors affecting attitudes toward public transportation and the choice of transportation mode by investigating the public transportation decision‐making process of working professionals using a survey methodology. The objectives of this research are to model the transportation decision‐making process of public transportation users in a metropolitan area and to determine key factors that affect the public transportation choices made by potential public transportation users. This study contributes to the literature by developing and testing an integrated theoretical framework for modeling an individual's public transportation decision‐making process using four independent variables: Perceived Public Transportation Security, Knowledge, Price, and Convenience. We develop the proposed theoretical framework based upon the extant literature and tested it using partial least squares structural equation modeling (PLS‐SEM). Based on the Theory of Reasoned Action, the Theory of Planned Behavior, and utility theory, we develop the factors and refine associated items using confirmatory factor analysis.     

Structuring Conflict in Individual,Face-to-Face,and Computer-Mediated Group Decision Making: Carping Versus Objective Devil's Advocacy*

Researchers and practitioners have long been interested in the effects of cognitive conflict techniques on individual and group decision making. One widely used and studied technique, devil's advocacy (DA), has been found to enhance decision-making performance for both individuals and groups. Devil's advocacy begins with a recommended decision, followed by a critique of the decision that questions its assumptions. Researchers have not yet examined the effects of the objectivity of the devil's advocacy comments in computer-mediated environments. This paper reports the results of a laboratory experiment that focused on this question by comparing the effects of an objective, nonemotional DA to an emotional, “carping” DA within individuals and groups using either computer-mediated or face-to-face communication. In a manner consistent with prior research, both DA treatments were operationalized through the use of paper-based consulting reports. The results suggest that individuals and computer-mediated groups develop and consider more solution alternatives than face-to-face groups, and that subjects given the objective DA treatment produce higher quality decisions than those given the carping DA treatment. Face-to-face groups in the carping DA treatment considered the fewest alternative solutions in their decision-making process, reached the lowest solution quality, yet reached decision consensus in the fewest voting rounds. The practical implications of the results suggest that questioning statements made by a devil's advocate should be objective, regardless of group communication condition. Carping devil's advocacy appears to stifle group decision outcomes when groups are using face-to-face communication.     

Generating Explanations for Goal-Based Decision Making*

As information systems make the transition from decision support to decision making, there will be a concomitant need for the programs to explain or justify their actions. Without such explanations, humans will not readily cede authority to a machine. This paper describes an automated decision-making program, VOTE, which generates natural language explanations for its decisions in both English and French. The program domain is Congressional roll call voting. VOTE simulates voting decisions of specific members of the United States House of Representatives on given bills. VOTE's natural language generation facility is also used by the underlying databases to interpret the knowledge representations. These underlying knowledge representations are described and applications of this decision making model to the general business domains of strategic planning, investment, and marketing are suggested.     

Integrating Analysis and Communication Skills into the Decision Science Curriculum*

The teaching of decision sciences presupposes that careful attention is directed toward improving students' critical thinking and analytical skills. This paper presents an approach to teaching quantitative methods classes that focuses on developing student skills in the areas of analytical and critical thinking through written and oral communication. The approach requires very little additional instructor preparation time and does not require the instructor to make major changes in either the content or organization of the course. While the instructor's investment is minimal, the benefits to the students appear to be substantial.     

EFFECTS OF CONFLICTING ANALYSES ON MANAGERIAL DECISION MAKING: A LABORATORY EXPERIMENT

Researchers in a variety of disciplines have recommended the use of multiple conflicting data analyses to improve managerial decision making through the challenging of assumptions. This study deals with the effects of single data analyses and conflicting analyses on managers' solutions to a case analysis task. Results showed that managers who received conflicting analyses produced solutions with higher expected profits than those who received single analyses. Implications for the use of analytic decision aids are noted.     

Decisional Conflict and User Acceptance of Multicriteria Decision-Making Aids*

Despite the development of increasingly sophisticated and refined multicriteria decision-making (MCDM) methods, an examination of the experimental evidence indicates that users most often prefer relatively unsophisticated methods. In this paper, we synthesize theories and empirical findings from the psychology of judgment and choice to provide a new theoretical explanation for such user preferences. Our argument centers on the assertion that the MCDM method preferred by decision makers is a function of the degree to which the method tends to introduce decisional conflict. The model we develop relates response mode, decision strategy, and the salience of decisional conflict to user preferences among decision aids. We then show that the model is consistent with empirical results in MCDM studies. Next, the role of decisional conflict in problem formulation aids is briefly discussed. Finally, we outline future research needed to thoroughly test the theoretical mechanisms we have proposed.     

Education DEVELOPMENT AND VALIDATION OF A TOOL FOR ASSIGNING STUDENTS TO GROUPS FOR CLASS PROJECTS*

Group project work is an integral part of many university courses. Assigning students to project groups can be difficult because of the students' diverse backgrounds. Many instructors therefore decide not to assign group projects. This paper develops and validates an instrument that assigns both experienced and inexperienced students to different project groups, thereby creating a balanced, fair environment. The instrument is checked for reliability and validity and then is used to assign students to different project groups. Based on group performance, the end-of-the-semester results also are provided. Path analysis is used to test a causal model. Conclusions and implications for future research are presented.     

An Experimental Study of the Effectiveness of Three Debiasing Techniques*

Subjective probability distributions constitute an important part of the input to decision analysis and other decision aids. The long list of persistent biases associated with human judgments under uncertainy [16] suggests, however, that these biases can be translated into the elicited probabilities which, in turn, may be reflected in the output of the decision aids, potentially leading to biased decisions. This experiment studies the effectiveness of three debiasing techniques in elicitation of subjective probability distributions. It is hypothesized that the Socratic procedure [18] and the devil's advocate approach [6] [7] [31] [32] [33] [34] will increase subjective uncertainty and thus help assessors overcome a persistent bias called “overconfidence.” Mental encoding of the frequency of the observed instances into prespecified intervals, however, is expected to decrease subjective uncertainty and to help assessors better capture, mentally, the location and skewness of the observed distribution. The assessors' ratings of uncertainty confirm these hypotheses related to subjective uncertainty but three other measures based on the dispersion of the elicited subjective probability distributions do not. Possible explanations are discussed. An intriguing explanation is that debiasing may affect what some have called “second order” uncertainty. While uncertainty ratings may include this second component, the measures based on the elicited distributions relate only to “first order” uncertainty.     

DEVIL'S ADVOCACY AND DIALECTICAL INQUIRY EFFECTS ON PREDICTION PERFORMANCE: TASK INVOLVEMENT AS A MEDIATING VARIABLE

Critics of previous laboratory experiments comparing devil's advocacy (DA) to dialectical inquiry (DI) have suggested that these experiments produced misleading results because (1) they used subjects who had low levels of task involvement and (2) the DI treatment used was confusing to subjects and required further explanation to be useful. The present study examines the effects of four inquiry methods—expert (E), DA, DI, and DI with explanatory statement (DI+)—on subjects' performance at a financial prediction task. Results show that DA, DI, and DI + were superior to E when the state of the world differed significantly from assumptions underlying the expert's plan. For subjects with high task involvement, DI and DI + were more effective than E and DA. The results support some of the criticisms of previous laboratory research and suggest that future research on these decision aids should include task involvement as a factor.     

Risk Attitude,Ambiguity Intolerance and Decision Making: An Exploratory Investigation*

Although recent research has identified attitudes towards ambiguity and risk to be important determinants of choice behavior [8] [18], no prior work jointly assessed the roles of both attitudes. We conducted a laboratory experiment using a real decision scenario and conducted exploratory analyses of the relationship between attitudes towards risk and ambiguity and the decision taken by the subjects. The results support the prediction that attitudes towards both risk and ambiguity affect choice behavior. Our exploratory analyses indicate interesting avenues for future research, including an examination of the decision process itself.     

COGNITIVE STYLE AND THE USEFULNESS OF INFORMATION*

The desirability of a merger/acquisition alternative depends in part on the perceptions of the decision maker. What sources of information are “useful” to the decision maker & Does the set of useful information remain constant for all decision makers; if not, do individuals using similar information sets have similar information processing characteristics? Do these sets vary as feedback is obtained during the decision process? To answer these questions, graduate students participated in a modified Delphi experiment, and the resulting data were analyzed by the two-way aligned-ranks nonparametric test. These test results affirm that in a merger/acquisition scenario, decision makers with different cognitive styles prefer different sets of information and these sets vary dynamically as feedback is incorporated in the decision-making process. Furthermore, information that contains worker and community welfare considerations is identified as “useful” five times more frequently by decision makers with a “feeling” cognitive style than those with a “thinking” style.     

Does shared and differentiated transformational leadership predict followers' working conditions and well-being?

Transformational leadership has been widely researched and is associated with followers' performance, attitudes, and subjective well-being at the individual level. Less research has focused on transformational leadership as a group phenomenon. In a survey study (425 followers and 56 leaders), we examined how group-level and differentiated transformational leadership shape followers' perceptions of their working conditions and individual subjective well-being. There was stronger evidence that differentiated transformational leadership's relationships with indicators of well-being was mediated by perceptions of working conditions, in that 10 out of 20 tests for mediation using differentiated transformational leadership were significant, compared to just three out of 20 for group-level transformational leadership. The results suggest that transformational leadership needs to be studied as a group phenomenon considering how group-level perceptions may impact on followers' well-being and that leaders need to realize that there is an “I” in groups and addition to a “we” in groups.     

Patterns of Information Source Use Across Industrial Purchase Situations*

An empirical taxonomy of industrial customers' information source use is developed based on a survey of 636 industrial customers across a wide range of different purchase situations. The taxonomy reveals five distinct information source mixes. Each mix consists of the combination of individual information sources used in a purchase situation. The five information source mixes are related to select underlying characteristics of purchase situations. The results indicate that the multivariate dimensions of purchase involvement, purchase complexity, and multiple influence are all significantly related to customers' choice of an information source mix. Implications of the taxonomy for marketing management and research are discussed.