A Consistency Test for AHP Decision Makers

Saaty's analytic hierarchy process assessed attribute importance by soliciting decision makers' (DM) importance ratios to compute weights. Saaty suggested a decision rule for accepting DM judgments based on a consistency measure derived from the DM's importance ratios. This paper investigates the distribution of random inconsistency and decision rule implications. Stricter consistency requirements for three- and four-attribute criteria matrices are suggested.     

The Development Manager's Advisory System: A Knowledge-Based DSS Tool for Project Assessment*

This research investigates whether the knowledge-based decision support system (KBDSS) paradigm provides the necessary supporting structure and developmental framework for product development evaluation. To address the research questions posed in this study, it is necessary to develop and implement KBDSS's at specific decision points along the product development cycle. This paper describes the design, development, and implementation of a KBDSS to support a product development manager's decision concerning full-scale development of a new product. From the systems design perspective, this paper addresses the integration and innovative use of a variety of techniques for knowledge acquisition, modeling, and processing. The approach utilized obtains the benefits of normative modeling as well as the flexibility and developmental advantages of knowledge-based systems. Since its implementation, the system has been successfully used by a development manager to support his recommendation for an ongoing project. His complete satisfaction with this system served as the impetus for the design and development of a multi-expert system which was implemented at the strategic level.     

The Internal Validity of the Trade-Off Method of Conjoint Analysis

The discovery of consumers' preferences for multiattribute products/services has recently become possible with the development of conjoint measurement techniques. Conjoint analysis uses an individual's preference ranking or rating of some deliberately manipulated constructs of a concept to determine his/her numerically valued preferences for levels of those attributes that comprise the concept. Generally speaking, there are two methods of data collection for conjoint analysis: the full profile and the trade-off methods. This paper calls into question the internal validity of the preferences obtained via the trade-off method. An empirical analysis, which is based on the subjects' preferences for selecting a hospital, clearly shows that the estimates derived from the trade-off method may not reflect consumers' true preferences.     

Production System Development for Expert Systems Using a Recursive Partitioning Induction Approach: An Application to Mortgage,Commercial, and Consumer Lending

The concepts of expert systems and decision support systems have received considerable attention recently. While systems have been proposed for various problem areas in business, difficulties still exist in the knowledge acquisition phase of development. This paper presents a recursive partitioning analysis (RPA) approach to knowledge acquisition. The RPA production system approach was applied to data sets representing the mortgage, commercial, and consumer lending problems. Comparison of the classification rates across these problems to the results of a generalized inductive inference production system (Quinlan's ID3 algorithm) and across the mortgage and commercial lending problems to traditional statistical modeling approaches indicated that the RPA approach provided superior results while using fewer variables.     

Knowledge Representation and Reasoning in a Real-Time Operational Control System: The Shipboard Piloting Expert System (SPES)*

This paper describes a knowledge representation approach and reasoning implementation in a real-time knowledge-based control system (KBCS) for navigating ships in restricted waters. This shipboard piloting expert system (SPES) is being developed as an intelligent node in Sperry Marine's ExxBridge integrated ship's bridge system (IBS) for Exxon Shipping Company tankers. The SPES is intended to provide decision support to ships' navigation officers while piloting large vessels in restricted waters, and to reduce the information overload under which they labor, by incorporating local, transit-specific, and shiphandling knowledge, and by providing requisite decision support in a timely fashion. As such, the system provides decision support to (1) senior ships' pilots training junior pilots; (2) ships' masters training junior deck officers in the essentials of good piloting and shiphandling; and (3) watchstanding deck officers utilizing the system's on-line reminder and assist capabilities, or off-line simulation and contingency planning functionality.     

Strategic Assessment Model (SAM): A Multiple Criteria Decision Support System for Evaluation of Strategic Alternatives*

The evaluation of strategic alternatives is a particularly difficult task. This difficulty is due to the complexities inherent in the evaluation process and the lack of structured information. The evaluation process must consider a multitude of relevant information from both the internal and external environments of the organization. Various analytical and normative models have helped decision makers utilize large volumes of information in strategic evaluation; however, most of these models have some limitations. We present a multiple criteria decision support system, called strategic assessment model (SAM), that addresses some of the limitations inherent in the existing models. SAM captures the decision maker's beliefs through a series of sequential, rational, and analytical processes. The environmental forces—decomposed into internal, task, general opportunities, and threats—are used along with the analytic hierarchy process (AHP), subjective probabilities, the entropy concept, and utility theory to enhance the decision maker's intuition in evaluating a set of strategic alternatives.     

Some Extensions of Domain Criteria in Decision Making under Uncertainty*

This paper examines some approaches to decision problems under uncertainty. Starr's [29] domain criterion is presented and modified to take into account different philosophies concerning the desirability of winning versus the importance of avoiding losses. The concept of expected value of distribution information is defined and its computation is illustrated with a numerical example. Target values are then introduced into the model and a parametric procedure is used to maximize the chances of achieving a certain level of the given objective. Finally, we show how the concepts developed in this paper might provide further insight into some decision situations reported in the literature.     

Decision Making in an Automated Environment: The Effects of Anonymity and Proximity with a Group Decision Support System*

Recent advances in information systems technology have made it possible to support the work of interacting groups using networked personal computers. A laboratory experiment was conducted using a group decision support system to evaluate effects of anonymity and proximity on group process in automated group problem solving. Twenty groups of four persons each performed an idea-generating task using an interactive electronic brainstorming program. This experiment's main findings were: (1) Group members working anonymously and apart generated more comments. (2) Working in the same room increased satisfaction. (3) Highest levels of perceived system effectiveness were reported under anonymity.     

ASSESSMENT OF MULTIATTRIBUTED MEASURABLE VALUE AND UTILITY FUNCTIONS VIA MATHEMATICAL PROGRAMMING*

A major restriction on the use of decision analysis in practice is the frequent difficulty of determining a decision maker's multiattribute utility function. The assessment process can be complex and tedious and generally involves: (1) identifying relevant independence conditions, (2) assessing conditional utility functions, (3) assessing scaling constants, and (4) checking for consistency. Some of the assessment and modeling complexities encountered include an assessor's inability to respond in a quantitatively meaningful and consistent way to hypothetical gambles and an analyst's problem in selecting an appropriate functional form that accurately characterizes the conditional utility assessments. A simplified procedure that mitigates these difficulties is proposed. This procedure facilitates the determination of scaling constants by obtaining (via mathematical programming) a multiattributed measurable value function which is converted to a multiattributed utility function. The methodology can be developed advantageously to produce an interactive software package for use as an assessment aid.     

The Application of Neural Networks and a Qualitative Response Model to the Auditor's Going Concern Uncertainty Decision*

An auditor gives a going concern uncertainty opinion when the client company is at risk of failure or exhibits other signs of distress that threaten its ability to continue as a going concern. The decision to issue a going concern opinion is an unstructured task that requires the use of the auditor's judgment. In cases where judgment is required, the auditor may benefit from the use of statistical analysis or other forms of decision models to support the final decision. This study uses the generalized reduced gradient (GRG2) optimizer for neural network learning, a backpropagation neural network, and a logit model to predict which firms would receive audit reports reflecting a going concern uncertainty modification. The GRG2 optimizer has previously been used as a more efficient optimizer for solving business problems. The neural network model formulated using GRG2 has the highest prediction accuracy of 95 percent. It performs best when tested with a small number of variables on a group of data sets, each containing 70 observations. While the logit procedure fails to converge when using our eight variable model, the GRG2 based neural network analysis provides consistent results using either eight or four variable models. The GRG2 based neural network is proposed as a robust alternative model for auditors to support their assessment of going concern uncertainty affecting the client company.     

Predicting the Winner's Curse

If quantity uncertainty exists in a first price auction that specifies a fixed bid, a participant must answer two questions when evaluating a candidate bid: “What are my chances of winning?” and “What is the effect of the winner's curse on my quantity estimate?” The winner's curse is the tendency of the winner of a first-price sealed-bid auction to be the bidder that most overvalues the items being offered. When value uncertainty is due to quantity uncertainty, the winner's curse implies that the bidder that most overestimates the quantity tends to win. Thus, if there is quantity uncertainty, a participant must adjust its bid for this tendency to overestimate quantities. This paper presents an empirical method to answer the above questions by estimating a predictive distribution of the highest competing bid and the quantity bias caused by the winner's curse. The method is developed for timber auctions but is general to auctions where a fixed bid is called for and there is uncertainty in the mix and quantities of items being offered. An example that uses data from timber auctions is used to demonstrate the method.     

Strict Uncertainty: A Criterion for Moderately Pessimistic Decision Makers*

This paper proposes a decision rule to rank actions under strict uncertainty, the available information being limited to the states of nature, the set of alternative rows, and the consequence of choosing every row if a given state occurs. This rule is suitable to moderately pessimistic individuals and social groups, these agents being neither maximax nor maximin decision makers but people who assume that the best outcome from the action will not occur. For these decision makers the paper shows the existence of a consistent weight system in which one and only one weight is attached to each state of the world under plausible conditions of domination. Most of the traditional axioms are satisfied by the proposed ranking approach. In the frame of disappointment (measured by ranges of column dispersion), the meaning of some controversial postulates used in the literature is explained. The proposed criterion is a departure from Laplace's (1825) rule and from the remaining standard criteria. Only in the special case of equal column dispersion do both Laplace's rule and the proposed weights lead to the same solution.     

Chainwise Paired Comparisons

The pairwise comparison technique is a building block of the Analytic Hierarchy Process (AHP), which has been popularly used for multicriteria decision analysis. This paper develops a shortcut technique in which only n paired comparisons forming a closed chain are needed for n decision elements. Together with the development of a simple and intuitive measure of (inconsistency, this technique derives the relative weights of decision elements via easy step-by-step calculations on a spreadsheet format. Its performance has been tested on Saaty's wealth of nations example. It is important to notice that ranking and weights yielded from this alternative technique are identical to Harker's incomplete pairwise comparison solution for the same chain orientation for the example tested.     

Understanding the Participation of Critical Task Specialists in Strategic Decision Making*

This paper explores the role of critical task specialists in strategic decision making and presents a theoretical model relating critical task specialist participation in decision making to the organization's overall strategy and the nature of the decision. This exploratory study examines scope and intensity of physician participation in hospital decision making. Intensity of critical task specialist participation is explained by content of the decision and by the organization's strategy, while scope of participation is explained by decision content. The findings suggest the need for more complex models of participation than are normally used in decision-making research. The findings also suggest that executives, in managing strategic decision-making processes, should pay attention to questions of both scope and intensity of participation. The results suggest that critical task specialists play a different role in the decision process, depending on specific decision content and organization strategy.     

Cognitive Limitations and Investment “Myopia”*

Optimization of investment decisions in an uncertain and dynamically evolving environment is difficult due to the limitations of the decision-maker's cognitive capacity. Thus, actual investment decisions may deviate from the dynamically optimal decision rule. This paper investigates how a potential investment rule bias affects the expected payoff from a project that has an uncertain development time and an uncertain completion cost. The result shows that the presence of a potential bias in the adopted decision rule dissipates project value and that the dissipating effect is greater for a longer term project if the completion cost is an increasing function of the time to completion.     

Structuring Conflict in Individual,Face-to-Face,and Computer-Mediated Group Decision Making: Carping Versus Objective Devil's Advocacy*

Researchers and practitioners have long been interested in the effects of cognitive conflict techniques on individual and group decision making. One widely used and studied technique, devil's advocacy (DA), has been found to enhance decision-making performance for both individuals and groups. Devil's advocacy begins with a recommended decision, followed by a critique of the decision that questions its assumptions. Researchers have not yet examined the effects of the objectivity of the devil's advocacy comments in computer-mediated environments. This paper reports the results of a laboratory experiment that focused on this question by comparing the effects of an objective, nonemotional DA to an emotional, “carping” DA within individuals and groups using either computer-mediated or face-to-face communication. In a manner consistent with prior research, both DA treatments were operationalized through the use of paper-based consulting reports. The results suggest that individuals and computer-mediated groups develop and consider more solution alternatives than face-to-face groups, and that subjects given the objective DA treatment produce higher quality decisions than those given the carping DA treatment. Face-to-face groups in the carping DA treatment considered the fewest alternative solutions in their decision-making process, reached the lowest solution quality, yet reached decision consensus in the fewest voting rounds. The practical implications of the results suggest that questioning statements made by a devil's advocate should be objective, regardless of group communication condition. Carping devil's advocacy appears to stifle group decision outcomes when groups are using face-to-face communication.     

The Design of a Knowledge-Based Decision Support System to Support the Information Analyst in Determining Requirements

Decision support system (DSS) researchers and designers continue to look for unstructured organizational tasks where there is a critical need for intelligent computer-based support. One such decision task is information requirements determination. Requirements determination is recognized as the most crucial phase of the systems development life cycle. Unfortunately, most methodologies and CASE tools focus only on how to specify the requirements once they are determined. There is very little computer support for the process of determining requirements. This paper discusses the conceptual design and development of a knowledge-based DSS to support information analysts in the critical decision task of determining requirements for the design of effective information systems. The expert modeling support system has the expertise to assist the analyst in studying the organization as a whole and in modeling the system under study in the context of the overall organization's goals and needs. The focus of the paper is on the problems associated with building the knowledge base component of the intelligent decision support system. A prototype implementation of the system is described.     

The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973 ) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.     

SOME CAUTIONARY NOTES ON THE USE OF CONJOINT MEASUREMENT FOR HUMAN JUDGMENT MODELING*

Conjoint measurement has been suggested as a methodology that might be useful in assisting research concerned with the identification of the structural form of a judge's model. This paper synthesizes the results of some recent research that examined the robustness of this methodology. This research suggests that conjoint measurement has three major weaknesses: (1) certain biases exist when diagnosing model structure, (2) model diagnosis is limited to a small set of potential models, and (3) error substantially compromises conjoint measurement's ability to diagnose model structure. An empirical example that demonstrates some of the difficulties of using this methodology with experimental data is also presented.