PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEM DESIGN

Top-level decision making in business organizations is characterized by high degrees of uncertainty, incomplete information, and conflicting objectives. To support top-level decision making effectively, decision support systems (DSSs) have been proposed. Information supplied by a DSS must be selective in that not all possible information sets may be feasibly or economically represented in the data base. This study suggests that discovery of perceptual complexity (dimensionality) of information items, and the subsequent categorization of decision makers having the same perceptions of those information items, is a first step in the ultimate design of an effective DSS. Through the use of multidimensional scaling in a field setting, this study shows the feasibility of creating relatively homogeneous groups of decision makers according to the content and number of dimensions associated with various information items. Further results of the research suggest that information can be tailored to classes of users, which has cost-benefit implications as well as the potential to improve the quality of the resultant decisions.     

An Empirical Investigation of Information Search Strategies with Implications for Decision Support System Design

Understanding how people search through and combine information before making decisions is an important concern in the study of decision making and in the design of decision support systems (DSS). The purpose of this study is to examine DSS search strategies in relation to the body of empirical research on information load. Prior research is examined in relation to basic empirically-testable hypotheses and compared to the results of this study as a way of validating the procedures used here. The transfer of information load empirical research to a DSS scenario is confirmed statistically. Then, results of an analysis of information search patterns under DSS conditions are described. Finally, implications for DSS design are discussed in terms of possible search support mechanisms for specific search strategies.     

The Effects of Task Information and Outcome Feedback on Individuals' Insight into Their Decision Models

When making business decisions, people generally receive some form of guidance. Often, this guidance might be in the form of instructions about which inputs to the decision are most important. Alternatively, it might be outcome feedback concerning the appropriateness of their decisions. When people receive guidance in making difficult judgments, it is important that they do not confuse this guidance with insight into their own decision models. This study examined whether people confuse their actual decision model with task information and outcome feedback. Subjects predicted the likelihood that various hypothetical companies would experience financial distress and then reported the decision models they believed they had used. Their reported models were compared with their actual models as estimated by a regression of the subjects' predictions on the inputs to their decisions. In a 2times2 factorial design, some subjects were provided with task information regarding the relative importance of each input to their decisions while others were not. Some subjects were provided with outcome feedback regarding the quality of their decisions while others were not. The subjects tended to confuse the task information and outcome feedback with their actual decision models. Implications for the results are discussed.     

The Development Manager's Advisory System: A Knowledge-Based DSS Tool for Project Assessment*

This research investigates whether the knowledge-based decision support system (KBDSS) paradigm provides the necessary supporting structure and developmental framework for product development evaluation. To address the research questions posed in this study, it is necessary to develop and implement KBDSS's at specific decision points along the product development cycle. This paper describes the design, development, and implementation of a KBDSS to support a product development manager's decision concerning full-scale development of a new product. From the systems design perspective, this paper addresses the integration and innovative use of a variety of techniques for knowledge acquisition, modeling, and processing. The approach utilized obtains the benefits of normative modeling as well as the flexibility and developmental advantages of knowledge-based systems. Since its implementation, the system has been successfully used by a development manager to support his recommendation for an ongoing project. His complete satisfaction with this system served as the impetus for the design and development of a multi-expert system which was implemented at the strategic level.     

PROJECT IPMA: APPLYING DECISION SUPPORT SYSTEM DESIGN PRINCIPLES TO BUILDING EXPERT-BASED SYSTEMS*

There currently is no widely accepted design framework for building expert systems. Knowledge engineers describe the process in terms of a set of heuristics or as a series of phases. Most paradigms are based on post-development reflections. This paper explores an expert-based system constructed using decision support system design techniques. An actual system in experimental use at the Department of Entomology, Oregon State University, was designed using the approach presented. The system, Integrated Pest Management Assistant (IPMA), will be used by extension agents to help orchard owners make decisions regarding pear tree pest infestations and to offer remedial strategies for eradicating potentially destructive insects.     

A Framework for the Analysis of Error in Conjunctive,Multi-Criteria,Satisficing Decision Processes*

This paper examines the impact of certain types of error on ad hoc, unstructured decision making that incorporates a satisficing strategy in a multi-criteria context using the conjunctive rule. The impacts of error in evaluation and of error in minimal or satisficing levels are systematically modelled for each of the decision criteria. Error functions, analytical expressions, and procedures are developed to obtain information such as the likelihood of correct decision making in the presence of evaluation and minimal criteria level error. These are applied to a specific research design, which is then analyzed. This highlights certain features of decision making in a satisficing context, such as the importance of keeping the number of decision criteria to a minimum. The results yield various insights, some of which confirm information obtained from previous analyses. A major advantage of the framework presented is that it can provide quantitative measurements which support ideas previously couched in qualitative terms only. Although the framework is applied in the context of decision making that uses the conjunctive rule in the case of multiple criteria, other satisficing strategies can be accommodated as well.     

Decision Making for Risk Management: A Comparison of Graphical Methods for Presenting Quantitative Uncertainty

Previous research has shown that people err when making decisions aided by probability information. Surprisingly, there has been little exploration into the accuracy of decisions made based on many commonly used probabilistic display methods. Two experiments examined the ability of a comprehensive set of such methods to effectively communicate critical information to a decision maker and influence confidence in decision making. The second experiment investigated the performance of these methods under time pressure, a situational factor known to exacerbate judgmental errors. Ten commonly used graphical display methods were randomly assigned to participants. Across eight scenarios in which a probabilistic outcome was described, participants were asked questions regarding graph interpretation (e.g., mean) and made behavioral choices (i.e., act; do not act) based on the provided information indicated that decision‐maker accuracy differed by graphical method; error bars and boxplots led to greatest mean estimation and behavioral choice accuracy whereas complementary cumulative probability distribution functions were associated with the highest probability estimation accuracy. Under time pressure, participant performance decreased when making behavioral choices.     

MULTIPLE-CRITERIA DECISION MAKING INCLUDING QUALITATIVE FACTORS: THE POST-MODEL ANALYSIS APPROACH

As a method of solving multiple-criteria decision making problems with a single quantitative objective and multiple qualitative objectives, the post-model analysis (PMA) approach is proposed. The essence of PMA is to support the trade-offs between a quantitative objective and multiple qualitative objectives so that the decision maker can find a perceived most preferred nondominated solution. To this end, the optimal solution of a quantitative model is found first, without regard for qualitative factors. The solution is then evaluated in terms of qualitative objectives. When the initial quantitatively optimal solution is adjusted to allow improvement of qualitative goals, opportunity costs of achieving qualitative goals are incurred. In this process, an expert system and/or graphical display can be used. PMA therefore provides a way to incorporate quantitative models into knowledge-based expert systems.     

Generating Explanations for Goal-Based Decision Making*

As information systems make the transition from decision support to decision making, there will be a concomitant need for the programs to explain or justify their actions. Without such explanations, humans will not readily cede authority to a machine. This paper describes an automated decision-making program, VOTE, which generates natural language explanations for its decisions in both English and French. The program domain is Congressional roll call voting. VOTE simulates voting decisions of specific members of the United States House of Representatives on given bills. VOTE's natural language generation facility is also used by the underlying databases to interpret the knowledge representations. These underlying knowledge representations are described and applications of this decision making model to the general business domains of strategic planning, investment, and marketing are suggested.     

PREFERENCE MAPPING OF PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEMS DESIGN

In a recent issue of this journal, Watkins [13] presented an approach for discovery of decision-maker perceptions of the complexity (dimensionality) of information items that might be supplied by a decision support system. Through use of multidimensional scaling and cluster analysis, relatively homogeneous groups of decision makers, sharing common perceptions of various information items, were formed. This prior research was referred to as a first step in suggesting that information reports could be tailored to groups of decision makers classified on the basis of common perceptions of information. The current research extends the prior study by evaluating decision maker preferences for information in a variety of decision-making scenarios in relation to the previously identified perceptions of the information. Based on the results of the study, conclusions are made which suggest that the tailoring of information to groups of decision makers should be based on both perceptions and preferences for information. Even so, it is demonstrated that the decision tasks have an impact on the preferences for information which may affect the attempt to tailor information to groups of decision makers.     

DESIGNING INSPECTION STRATEGIES FOR UNCERTAIN ENVIRONMENTS

This paper considers the problems of designing inspection strategies for production systems terms in the presence of environmental uncertainty. The framework for determining information priorities to support inspection system planning is presented in the contaxt of a generic production system that encompasses the characteristics of many real-world serial production systems. The impact on the design decision of five key variables is considered: quality of producton processes, quality of inspection procedures, penalty cost for undetected defective units, relative cost of improving process vs. inspection, and shape of the cost functions for process and inspection enhancement. The framework for analysis involves varying factors over two or three orders of magnitude to determine optimal inspection strategies across a wide range of environments These results are used to compare design decisions made in the presence of environmental uncertainty using expected-opportunity-cost and minimization-of-maximum-opportunity-cost approaches. Design strategies are identified for situations ranging from complete lack of knowledge about the environment through increasing levels of information. Information-gathering priorities are established, and the impact on the design decision of this additional information is assayed.     

Data and Model Management in a Generalized MCDM-DSS*

Drawing upon the choice models developed in the multiple criteria decision making (MCDM) area, this paper proposes an architecture for designing an intelligent decision support system (DSS) that is intended to aid in making choices among multiple alternatives along multiple dimensions. It argues that effective support can be provided to the decision maker when the knowledge-based DSS is capable of dynamically selecting choice models appropriate to the domain and context of a particular problem being specified by the decision maker, and of properly applying them to the problem solution. Development of a prototype intended to partially represent application of the architecture is described. The paper concludes with suggestions for research extensions.     

TWO DESIGN PRINCIPLES FOR KNOWLEDGE-BASED SYSTEMS*

This paper discusses two principles that have become increasingly important in the design of knowledge-based systems: domain-specific knowledge used to support opportunistic reasoning and hierarchical organization structure used to control and coordinate problem-solving activity. We propose a design framework that embodies these two principles and describe how this framework has been used to develop a knowledge-based job-shop scheduling system. This system, called OPIS 0, has undergone limited testing in an experimental environment modeled after an actual job shop. Its performance has been very good compared to ISIS and to the more traditional approach of constructing a schedule by dispatching jobs using the COVERT priority rule. The resulting design also shows potential for use in a decision support role.     

The Effectiveness of Decisional Guidance: An Empirical Evaluation

Decisional guidance is defined as how a decision support system (DSS) influences its users as they structure and execute the decision‐making process. It is assumed that decisional guidance has profound effects on decision making, but these effects are understudied and empirically unproven. This paper describes an empirical, laboratory‐experiment‐based evaluation of the effectiveness of deliberate decisional guidance and its four types. We developed and used a comprehensive model consisting of four evaluation criteria: decision quality, user satisfaction, user learning, and decision‐making efficiency. On these criteria, we compared decisional guidance versus no guidance, informative versus suggestive decisional guidance, and predefined versus dynamic decisional guidance. We found that deliberate decisional guidance was more effective on all four criteria; suggestive guidance was more effective in improving decision quality and user satisfaction, and informative guidance was more effective in user learning about the problem domain, whereas dynamic guidance was more effective than predefined guidance in improving decision quality and user learning; and both suggestive guidance and dynamic guidance reduced the decision time.     

Organizational Computing as a Facilitator of Operational and Managerial Decision Making: An Exploratory Study of Managers' Perceptions*

Much of the current knowledge pertaining to information technology (IT) and decision making is based on decades old technologies that revolved around a central computing function and application-specific systems. The purpose of this research is to examine the IT decision-making relationship within the emerging organizational computing (OC) environment permeated by spontaneous utilization of both application-and nonapplication-specific computing and communication technologies. Specifically, this study seeks to explore managers' perceptions of the emerging OC environment as a facilitator of their decision-making activities. To achieve a higher level of clarity than previous works, a two-dimensional research framework is developed with the IT dimension consisting of computing and communication, and the decision-making dimension differentiated between operational and managerial decisions. A survey instrument was constructed that measured the computing and communication dimensions of information technology use and their perceived effects upon operational and managerial decisions. The major findings of the study confirmed that managers recognize the value of general, nonapplication-specific information technologies in decision making, and that this recognition is highly associated with how intensively these information technologies are used. Additionally, it was found that the two dimensions of IT differ in their relationships to decision making, and that IT usage relates to managerial decisions differently than operational decisions. These study findings have significant implication for practice and research, especially in the context of information resource management in which the primary purpose of the IS function is the delivery of general information service to users rather than the development of specific IS applications.     

CAPACITY AND PRODUCTION DECISIONS IN STOCHASTIC MANUFACTURING SYSTEMS: AN ASYMPTOTIC OPTIMAL HIERARCHICAL APPROACH

We present a new paradigm of hierarchical decision making in production planning and capacity expansion problems under uncertainty. We show that under reasonable assumptions, the strategic level management can base the capacity decision on aggregated information from the shopfloor, and the operational level management, given this decision, can derive a production plan for the system, without too large a loss in optimality when compared to simultaneous determination of optimal capacity and production decisions. The results are obtained via an asymptotic analysis of a manufacturing system with convex costs, constant demand, and with machines subject to random breakdown and repair. The decision variables are purchase time of a new machine at a given fixed cost and production plans before and after the purchase. The objective is to minimize the discounted costs of investment, production, inventories, and backlogs. If the rate of change in machine states such as up and down is assumed to be much larger than the rate of discounting costs, one obtains a simpler limiting problem in which the random capacity is replaced by its mean. We develop methods for constructing asymptotically optimal decisions for the original problem from the optimal decisions for the limiting problem. We obtain error estimates for these constructed decisions.     

MANAGING PRODUCT VARIETY: AN INTEGRATIVE REVIEW AND RESEARCH DIRECTIONS

Variety management has emerged as a crucial dimension of successful business practice. In this paper, I first provide a framework for managerial decisions about variety. Variety‐creation decisions determine the amount, type, and timing of end‐product variety, while variety‐implementation decisions focus on the design and operation of internal processes and a supply chain to support a firm's variety‐creation strategy. I organize variety‐related decisions into four key decision themes in variety creation: 1) dimensions of variety, 2) product architecture, 3) degree of customization, and 4) timing; and three key decision themes in variety implementation: 1) process capabilities, 2) points of variegation, and 3) day‐to‐day decisions. I describe each theme and review the relevant literature on each theme, with a focus on research that provides insight to problems faced in practice. Finally, I identify untapped avenues for future research that would be of value to the practicing manager, paying special attention to interdependencies among decision themes.     

Feedback in DSS as a Source of Control: Experiments with the Timing of Feedback

Well-designed feedback can improve decision making but to date there has been no comprehensive study of feedback in decision support systems (DSS) that could guide developers in its design. This work examines the opportunities and means to enhance cognitive control in decision making by providing appropriate feedback with DSS. It concentrates on the timing of feedback, which has been shown to affect the use of feedback and also demonstrates the potential advantages of using information technology over and above manual decision environments. Two experiments test the effects of controlling the timing of cognitive feedback on the user's cognitive control. The first tests the effect of timing one source of cognitive feedback, and the second tests the effect of timing two sources of feedback. The findings suggest that the design of feedback should become a routine part of the development of DSS.     

The Design of a Knowledge-Based Decision Support System to Support the Information Analyst in Determining Requirements

Decision support system (DSS) researchers and designers continue to look for unstructured organizational tasks where there is a critical need for intelligent computer-based support. One such decision task is information requirements determination. Requirements determination is recognized as the most crucial phase of the systems development life cycle. Unfortunately, most methodologies and CASE tools focus only on how to specify the requirements once they are determined. There is very little computer support for the process of determining requirements. This paper discusses the conceptual design and development of a knowledge-based DSS to support information analysts in the critical decision task of determining requirements for the design of effective information systems. The expert modeling support system has the expertise to assist the analyst in studying the organization as a whole and in modeling the system under study in the context of the overall organization's goals and needs. The focus of the paper is on the problems associated with building the knowledge base component of the intelligent decision support system. A prototype implementation of the system is described.