Data and Model Management in a Generalized MCDM-DSS*

Drawing upon the choice models developed in the multiple criteria decision making (MCDM) area, this paper proposes an architecture for designing an intelligent decision support system (DSS) that is intended to aid in making choices among multiple alternatives along multiple dimensions. It argues that effective support can be provided to the decision maker when the knowledge-based DSS is capable of dynamically selecting choice models appropriate to the domain and context of a particular problem being specified by the decision maker, and of properly applying them to the problem solution. Development of a prototype intended to partially represent application of the architecture is described. The paper concludes with suggestions for research extensions.     

Integrating Neural Networks and Semi-Markov Processes for Automated Knowledge Acquisition: An Application to Real-time Scheduling*

Recently, artificial neural networks (ANN) have gained attention as a promising modeling tool for building intelligent systems. A number of applications have been reported in areas varying from pattern recognition to bankruptcy prediction. In this paper, we present a creative methodology that integrates computer simulation, semi-Markov optimization, and ANN techniques for automated knowledge acquisition in real-time scheduling. The integrated approach focuses on the synergy between operations research and ANN in eliciting human knowledge, filtering inconsistent data, and building competent models capable of performing at the expert level. The new approach includes three main components. First, computer simulation is used to collect expert decisions. This step allows expert knowledge to be obtained in a non-intrusive way and minimizes the difficulties involved in interviewing experts, constructing repertory grids, or using other similar structures required for manual knowledge acquisition. The data collected from computer simulation are then optimized using a semi-Markov decision model to remove data redundancies, inconsistencies, and errors. Finally, the optimized data are used to build ANN-based expert systems. The integrated approach is evaluated by comparing it with the human expert and using ANN alone in the domain of real-time scheduling. The results indicate that ANN-based systems perform worse than human experts from whom the data were collected, but the integrated approach outperforms human experts and ANN models alone.     

Decision Making in an Automated Environment: The Effects of Anonymity and Proximity with a Group Decision Support System*

Recent advances in information systems technology have made it possible to support the work of interacting groups using networked personal computers. A laboratory experiment was conducted using a group decision support system to evaluate effects of anonymity and proximity on group process in automated group problem solving. Twenty groups of four persons each performed an idea-generating task using an interactive electronic brainstorming program. This experiment's main findings were: (1) Group members working anonymously and apart generated more comments. (2) Working in the same room increased satisfaction. (3) Highest levels of perceived system effectiveness were reported under anonymity.     

The Effects of Memory Structure on Using Rule-Based Expert Systems for Training: A Framework and an Empirical Test*

One justification for eliciting and representing the judgment strategy of an expert in a rule-based expert system (RBES) is to facilitate knowledge transfer to individuals with less expertise. However, prior research suggests complexities and potential problems when using RBESs for training. In this paper, a conceptual framework of user learning from RBESs is presented. It is proposed that learning may be ineffective when the problem representation of the RBES is inconsistent with the user's mental representation of the task-domain knowledge. An experiment was conducted to examine the effects of consistency (inconsistency) between the problem-solving strategy of RBESs and individuals' memory structures. Groups of subjects whose memory structure either matched or did not match two RBESs' problem-solving strategies were examined using an internal control evaluation task. The results suggest that learning was facilitated only for groups with congruence between the RBES's problem-solving strategy and a subject's memory structure.     

A Computerized Approach to Decision Process Tracing for Decision Support System Design*

We propose the use of computerized process tracing (CPT) tools as an appropriate approach for monitoring the information acquisition and evaluation phase of specific decision processes. CPT tools are unobtrusive and seem particularly relevant for evaluating certain decision tasks that may be supported by decision support systems (DSS). CPT tools can be an important component of DSS development. An information systems research taxonomy developed by previous researchers [29] [36] is used to position research work involving the methodology of CPT. Using a critique suggested by Libby [28], CPT tools are evaluated and compared to alternative process tracing tools. A brief empirical example using CPT is provided, and future uses relative to DSS are suggested. The appendix includes an example of a specific CPT tool.     

Strategic Assessment Model (SAM): A Multiple Criteria Decision Support System for Evaluation of Strategic Alternatives*

The evaluation of strategic alternatives is a particularly difficult task. This difficulty is due to the complexities inherent in the evaluation process and the lack of structured information. The evaluation process must consider a multitude of relevant information from both the internal and external environments of the organization. Various analytical and normative models have helped decision makers utilize large volumes of information in strategic evaluation; however, most of these models have some limitations. We present a multiple criteria decision support system, called strategic assessment model (SAM), that addresses some of the limitations inherent in the existing models. SAM captures the decision maker's beliefs through a series of sequential, rational, and analytical processes. The environmental forces—decomposed into internal, task, general opportunities, and threats—are used along with the analytic hierarchy process (AHP), subjective probabilities, the entropy concept, and utility theory to enhance the decision maker's intuition in evaluating a set of strategic alternatives.     

Combining Neural Networks and Statistical Predictions to Solve the Classification Problem in Discriminant Analysis*

A number of recent studies have compared the performance of neural networks (NNs) to a variety of statistical techniques for the classification problem in discriminant analysis. The empirical results of these comparative studies indicate that while NNs often outperform the more traditional statistical approaches to classification, this is not always the case. Thus, decision makers interested in solving classification problems are left in a quandary as to what tool to use on a particular data set. We present a new approach to solving classification problems by combining the predictions of a well-known statistical tool with those of an NN to create composite predictions that are more accurate than either of the individual techniques used in isolation.     

An Empirical Investigation of the Effects of Decision Aids on Problem-Solving Processes*

Despite the growing number of investigations examining decision support systems (DSS), relatively few empirical studies have evaluated the effects of DSS on problem-solving processes. This study uses protocol analysis to investigate the impact of a specific decision aid on problem-solving processes in a semi-structured problem. Results indicate that decision aids influence the problem-solving processes of decision makers. The effect of a decision aid is found to be contingent on familiarity with the decision aid, task familiarity, and the interaction of these two factors. Suggestions for incorporating interaction effects and problem-solving processes into future examinations are proposed.     

An Empirical Investigation of Information Search Strategies with Implications for Decision Support System Design

Understanding how people search through and combine information before making decisions is an important concern in the study of decision making and in the design of decision support systems (DSS). The purpose of this study is to examine DSS search strategies in relation to the body of empirical research on information load. Prior research is examined in relation to basic empirically-testable hypotheses and compared to the results of this study as a way of validating the procedures used here. The transfer of information load empirical research to a DSS scenario is confirmed statistically. Then, results of an analysis of information search patterns under DSS conditions are described. Finally, implications for DSS design are discussed in terms of possible search support mechanisms for specific search strategies.     

Toward Computerizing a Causal Modeling Approach to Strategic Problem Framing*

This paper proposes an object-oriented approach to the development of interactive software for the purpose of managerial problem solving. A prototype is being developed using CSM causal mapping to represent each manager's perceptions of the relationships between key variables of a firm's strategic situation. This paper suggests the design of GDSS that would enable a group of managers to discuss, learn from each other, and possibly develop consensus about decisions or their causes. Issues involving future development are discussed.     

Subordinate Participation in Audit Budgeting Decisions: A Comparison of Decisions Influenced by Organizational Factors to Decisions Conforming with the Vroom-Jago Model*

This study examines the role of subordinate participation in the effectiveness of audit hours budget decisions in accounting firms. The study compares decisions influenced by organizational factors (such as organizational policies or the preferences of the superior) to decisions that conform to the Vroom-Jago (VJ) model. Our results indicate that actual level of participation used in budget decisions appears to be based primarily on perceived preferences of superiors and participation styles available under the circumstancesof the individual audit. However, results also indicate that decisions consistent with the Vroom-Jago model are characterized by higher decision quality and increased subordinatedevelopment. Since managers are apparently reluctant to use decision styles that conflictwith organizational factors, accounting firms may wish to gather information regarding the attributes of the decision context and use the VJ model to establish their available decision styles and determine the preferences of superiors. Doing so has the advantage of considering decision-specific attributes while enhancing the probability of manager compliance with a desired decision style.     

Automating Knowledge Acquisition and Refinement for Decision Support: A Connectionist Inductive Inference Model*

An important application of expert systems technology is to provide support for nonstructured decision making. Usually, nonstructured decision making is characterized by heavy reliance on heuristic knowledge, which is very difficult to articulate or document, and therefore traditional knowledge acquisition approaches are not very successful. The quality and effectiveness of an expert system supporting unstructured decision making is affected when traditional knowledge acquisition approaches are used. To alleviate this problem a model is proposed that combines inductive inference and neural network computing, and an example is presented that illustrates the potential of this model in unstructured decision support.     

COMPUTER GRAPHICS AS DECISION AIDS: DIRECTIONS FOR RESEARCH*

Computer-generated graphics are becoming increasingly available to decision makers. Despite claims on the part of vendors that the use of graphics will improve decision speed and quality over traditional methods of data display, the available evidence is far from supportive. Initial studies show graphics to be no more effective in communicating information than tables. Correct interpretation of graphical displays appears to require training, which most users lack. Furthermore, there is evidence that those features that make a graph visually attractive—such as color, design complexity, and realism—may actually detract from accurate comprehension. This paper summarizes the literature dealing with the human use of graphics, develops several propositions based on persistent trends in the literature, and suggests directions for future research.     

The Effectiveness of Graphical Presentation for Information Extraction: A Cumulative Experimental Approach*

Three laboratory experiments were conducted to assess the relative strengths and weaknesses of bar, symbol, and line graphs for performing a variety of elementary information extraction tasks using two dependent variables, time and accuracy. The findings indicate that the degree of support provided by a particular graph format for a particular data extraction task depends on the matching of format and task in terms of their anchoring characteristics. Anchoring, in this context, refers to the phenomenon that specific and diverse parts of a graph are segmented by the reader to act as salient and relevant cues, or anchors, when different classes of information are to be extracted from the graph. A data extraction task has high x-value (y-value) anchoring if the x-axis (y-axis) component is represented in the question as either a given value or an unknown value. Conversely, a task has low x-value (y-value) anchoring if the x-axis (y-axis) component is not represented in the question as either a given value or as an unknown value. Data extraction accuracy was not significantly affected by presentation format. Bars provided the best time performance for data extraction tasks having high anchoring on both axes but were not appropriate for tasks having low anchoring on either the y axis or both the x and y axes. Line graphs tended to be worse in terms of time performance for tasks having high anchoring on both axes although they were as fast or better than other representations for tasks having low anchoring on both axes. Symbol plots appeared to possess anchoring characteristics associated with both bars and line graphs. Symbols (as with bars) tended to produce a time performance superior to that of line graphs for tasks having high anchoring on both axes; and (as with line graphs) symbols allowed faster results than bar graphs for tasks having low anchoring on either the y axis or both the x and y axes.     

Decisional Conflict and User Acceptance of Multicriteria Decision-Making Aids*

Despite the development of increasingly sophisticated and refined multicriteria decision-making (MCDM) methods, an examination of the experimental evidence indicates that users most often prefer relatively unsophisticated methods. In this paper, we synthesize theories and empirical findings from the psychology of judgment and choice to provide a new theoretical explanation for such user preferences. Our argument centers on the assertion that the MCDM method preferred by decision makers is a function of the degree to which the method tends to introduce decisional conflict. The model we develop relates response mode, decision strategy, and the salience of decisional conflict to user preferences among decision aids. We then show that the model is consistent with empirical results in MCDM studies. Next, the role of decisional conflict in problem formulation aids is briefly discussed. Finally, we outline future research needed to thoroughly test the theoretical mechanisms we have proposed.     

Decision Processes for Developing Strategic Applications of Information Systems: A Contingency Approach*

Strategic applications of information systems (IS) are considered by IS researchers to be determined by contextual factors such as environmental uncertainty, and influenced by attributes of the processes preceding them, such as planning and top management support. For better management of the process leading to these applications, it is essential to understand the relationship between process attributes and contextual factors. Utilizing a contingency approach, this article takes a step toward such an understanding. Based on successful strategic IS applications from 81 large companies, it examines the relationship between the context of these applications and the decision-making process leading to them. The results indicate that the external environment is related to whether a rational or political decision-making process is used. The IS function seems to influence the use of the decision process implied by IS researchers, one in which the top management champions the strategic application, while the IS managers contribute by conducting in-depth analysis. However, the organization structure was not related to any decision process attribute. The implications of these findings for future research and practice are also discussed.     

Decision Making,Scaling, and Number Crunching

The purpose of this note is to comment on the artificiality of using known scales of measurement (or conveniently improvised numbers) to make decisions. In particular, the pitfalls of trying to please the decision maker and of using normalization as a number crunching tool are discussed. Finally, an example is given to show what is needed to develop a workable and theoretically sound theory for multi-criteria decisions and to show that the analytic hierarchy process (AHP) meets these demands.