An Empirical Study of Equivalence Judgments vs. Ratio Judgments in Decision Analysis*

Two commonly used elicitation modes on strength of preference, equivalence and ratio judgments, were compared in an experiment. The result from the experiment showed that ratio judgments were less effective than equivalence judgments. Based on an iterative design for eliciting multiattribute preference structures, equivalence judgments outperformed ratio judgments in estimating single‐attribute measurable value functions, while being nearly more effective than ratio judgments in assessing multiattribute preference structures. The implications of the results from the experiment are that multiattribute decision‐making techniques should take advantage of the decision maker's inclination of making effective equivalence trade‐off judgments, and that useful techniques should be devised to incorporate different commonly used techniques, such as multiattribute utility theory and the Analytic Hierarchy Process, to elicit and consolidate equivalence trade‐off judgments.     

ASSESSMENT OF MULTIATTRIBUTED MEASURABLE VALUE AND UTILITY FUNCTIONS VIA MATHEMATICAL PROGRAMMING*

A major restriction on the use of decision analysis in practice is the frequent difficulty of determining a decision maker's multiattribute utility function. The assessment process can be complex and tedious and generally involves: (1) identifying relevant independence conditions, (2) assessing conditional utility functions, (3) assessing scaling constants, and (4) checking for consistency. Some of the assessment and modeling complexities encountered include an assessor's inability to respond in a quantitatively meaningful and consistent way to hypothetical gambles and an analyst's problem in selecting an appropriate functional form that accurately characterizes the conditional utility assessments. A simplified procedure that mitigates these difficulties is proposed. This procedure facilitates the determination of scaling constants by obtaining (via mathematical programming) a multiattributed measurable value function which is converted to a multiattributed utility function. The methodology can be developed advantageously to produce an interactive software package for use as an assessment aid.     

A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept

Invasive species risk maps provide broad guidance on where to allocate resources for pest monitoring and regulation, but they often present individual risk components (such as climatic suitability, host abundance, or introduction potential) as independent entities. These independent risk components are integrated using various multicriteria analysis techniques that typically require prior knowledge of the risk components’ importance. Such information is often nonexistent for many invasive pests. This study proposes a new approach for building integrated risk maps using the principle of a multiattribute efficient frontier and analyzing the partial order of elements of a risk map as distributed in multidimensional criteria space. The integrated risks are estimated as subsequent multiattribute frontiers in dimensions of individual risk criteria. We demonstrate the approach with the example of Agrilus biguttatus Fabricius, a high‐risk pest that may threaten North American oak forests in the near future. Drawing on U.S. and Canadian data, we compare the performance of the multiattribute ranking against a multicriteria linear weighted averaging technique in the presence of uncertainties, using the concept of robustness from info‐gap decision theory. The results show major geographic hotspots where the consideration of tradeoffs between multiple risk components changes integrated risk rankings. Both methods delineate similar geographical regions of high and low risks. Overall, aggregation based on a delineation of multiattribute efficient frontiers can be a useful tool to prioritize risks for anticipated invasive pests, which usually have an extremely poor prior knowledge base.     

工程合同冲突协调的经济学计算研究

本文运用已获得的理论研究结果对工程合同冲突问题的协商解决构造了业主和承包商的多属性效用函数,建立交易双方价值最大化的合同谈判模型,并用数字模拟求得合同订立的公平解决方案.基于合同订立状态,对工程合同执行过程中经常出现的变更,索赔和仲裁等问题建立相应的次优化模型,并用数字模拟求得合同变更,索赔和仲裁相应的解决方案.尽管本文的工作是以工程合同为例,并具有一定程度的理想性,但对解决各种合同的实际冲突问题仍是一种有价值的参考方法.     

A Screening Methodology for the Identification and Ranking of Infrastructure Vulnerabilities Due to Terrorism

The extreme importance of critical infrastructures to modern society is widely recognized. These infrastructures are complex and interdependent. Protecting the critical infrastructures from terrorism presents an enormous challenge. Recognizing that society cannot afford the costs associated with absolute protection, it is necessary to identify and prioritize the vulnerabilities in these infrastructures. This article presents a methodology for the identification and prioritization of vulnerabilities in infrastructures. We model the infrastructures as interconnected digraphs and employ graph theory to identify the candidate vulnerable scenarios. These scenarios are screened for the susceptibility of their elements to a terrorist attack, and a prioritized list of vulnerabilities is produced. The prioritization methodology is based on multiattribute utility theory. The impact of losing infrastructure services is evaluated using a value tree that reflects the perceptions and values of the decisionmaker and the relevant stakeholders. These results, which are conditional on a specified threat, are provided to the decisionmaker for use in risk management. The methodology is illustrated through the presentation of a portion of the analysis conducted on the campus of the Massachusetts Institute of Technology.     

Consistency and Accuracy in Decision Aids: Experiments with Four Multiattribute Systems*

There have been a number of multiattribute decision aids developed to aid selection problems. Multiattribute value theory and the analytic hierarchy process are two commonly used techniques. Different systems can result in radically different conclusions if they inaccurately and inconsistently reflect the preference structure of decision makers, or if they are based on inappropriate theoretical models. This study examines the impact of the underlying theoretical model, the method in which preference information is elicited, and the structure of alternatives as influences on the results from using various decision aids. It was found that two systems based on the multiattribute value theory model were just as diverse in their conclusions as were results between AHP and the multiattribute value theory models. Therefore, accuracy of information reflecting decision maker preference is an important consideration. Feedback capable of assuring the decision maker that information provided is consistent is a necessary feature required of decision aids applied to selection problems. The study also found that the way in which information is elicited influenced the result more than did the underlying model. Exact numerical data for complex concepts such as attribute importance and alternative performance on attributes is not necessary, and elicitation procedures that are more natural for the user are likely to be more accurate.     

A Review of the High-Level Nuclear Waste Repository Siting Analysis

We critique two 1986 Department of Energy reports concerning the selection of sites for characterization as the nation's first high-level nuclear waste repository. We find that the multiattribute utility analysis of the five nominated sites was well done, although we express concern about the assessed probabilities, question the construction of two important attribute scales, and disagree with some of the value tradeoffs that were used. In contrast, we find the logic of the recommendations report to be weak and unconvincing.     

Distribution of Aggregate Utility Using Stochastic Elements of Additive Multiattribute Utility Models

Conventionally, elements of a multiattribute utility model characterizing a decision maker's preferences, such as attribute weights and attribute utilities, are treated as deterministic, which may be unrealistic because assessment of such elements can be imprecise and erroneous, or differ among a group of individuals. Moreover, attempting to make precise assessments can be time consuming and cognitively demanding. We propose to treat such elements as stochastic variables to account for inconsistency and imprecision in such assessments. Under these assumptions, we develop procedures for computing the probability distribution of aggregate utility for an additive multiattribute utility function (MAUF), based on the Edgeworth expansion. When the distributions of aggregate utility for all alternatives in a decision problem are known, stochastic dominance can then be invoked to filter inferior alternatives. We show that, under certain mild conditions, the aggregate utility distribution approaches normality as the number of attributes increases. Thus, only a few terms from the Edgeworth expansion with a standard normal density as the base function will be sufficient for approximating an aggregate utility distribution in practice. Moreover, the more symmetric the attribute utility distributions, the fewer the attributes to achieve normality. The Edgeworth expansion thus can provide a basis for a computationally viable approach for representing an aggregate utility distribution with imprecisely specified attribute weights and utilities assessments (or differing weights and utilities across individuals). Practical guidelines for using the Edgeworth approximation are given. The proposed methodology is illustrated using a vendor selection problem.     

Analytical network process for software selection in product development: A case study

Application of software for manufacturing processes is one of the resolutions many enterprises have resorted to in the 21st century. This has been a result of increased complexity of products, globalization, rapid changes in technology and so on. The idea was that application of software especially for product development would increase the competitive advantage of industry nevertheless the irony has been that most of the investment in software has not achieved the expected results. We carry out a case study to introduce a methodology, the analytical network process as a multiattribute strategic decision making approach to help in the selection of appropriate software to suit the product development process of a particular product.     

A general space-time model for combinatorial optimization problems (and not only)

We consider the problem of defining a strategy consisting of a set of facilities taking into account also the location where they have to be assigned and the time in which they have to be activated. The facilities are evaluated with respect to a set of criteria. The plan has to be devised respecting some constraints related to different aspects of the problem such as precedence restrictions due to the nature of the facilities. Among the constraints, there are some related to the available budget. We consider also the uncertainty related to the performances of the facilities with respect to considered criteria and plurality of stakeholders participating to the decision. The considered problem can be seen as the combination of some prototypical operations research problems: knapsack problem, location problem and project scheduling. Indeed, the basic brick of our model is a variable x_ilt which takes value 1 if facility i is activated in location l at time t, and 0 otherwise. Due to the conjoint consideration of a location and a time in the decision variables, what we propose can be seen as a general space-time model for operations research problems. We discuss how such a model permits to handle complex problems using several methodologies including multiple attribute value theory and multiobjective optimization. With respect to the latter point, without any loss of the generality, we consider the compromise programming and an interactive methodology based on the Dominance-based Rough Set Approach. We illustrate the application of our model with a simple didactic example.     

Evaluating airline competitiveness using multiattribute decision making

This paper presents an objective approach to the evaluation of airline competitiveness. The evaluation problem is formulated as a multiattribute decision making model and solved by three widely used methods (the simple additive weighting method, the weighted product method and the technique for order preference by similarity to ideal solution) based on multiattribute value theory. A new empirical validation procedure is developed to deal with the inconsistency problem of evaluation outcomes produced by the three methods. The procedure selects the evaluation outcome which has a minimum expected value loss. An empirical study on Taiwan's five major domestic airlines is conducted to demonstrate the effectiveness of the approach. To measure and compare overall competitiveness of the airlines, five competitiveness dimensions and their associated objective performance measures on both efficiency and effectiveness are identified. The result of empirical validation for the three methods suggests the use of the simple additive weighting method. The evaluation outcome helps an airline identify its competitive advantages relative to its competitors. The objective approach presented is particularly applicable when subjective judgements on performance ratings and attribute weights are not reliable, or suitable decision makers are not available.     

Risk-Adjusted Mission Value: Trading Off Mission Risk for Mission Value

This article develops a decision-theoretic methodology for the risk-adjusted mission value (RAMV) for selecting between alternative missions in the presence of uncertainty in the outcomes of the missions. This methodology permits trading off mission risk for mission value, something that probabilistic risk analysis cannot do unless it explicitly incorporates both mission value and risk aversion of the project management. The methodology, in its complete implementation, is consistent with the decision theory known as expected utility theory, although it differs from conventional decision theory in that the probabilities and all but one of the utilities are not those of the decision maker. The article also introduces a new interpretation of risk aversion. The methodology is consistent with the elementary management concept concerning division of labor. An example is presented for selecting between discrete alternatives-four landing sites on Mars. A second example is presented for selecting among a set of continuous alternatives-a comet flyby distance. The methodology is developed within the context of scientific missions, but the methodology is equally applicable to any situation requiring outcome value judgments, probability judgments, and risk aversion judgments by different constituencies.     

Decision analysis for water resources planning

Quantitative decision analysis techniques were applied to a particular problem of water resources planning: how should the water supply of the metropolitan Boston area be increased to meet the projected demand for 1990? The analytic approach used a multiattribute value model to evaluate several alternatives from the points of view of different interested constituencies. The model was presented to a number of individuals and groups with responsibility for recommending policy, and they indicated an interest in the findings.     

A robust ranking method extending ELECTRE III to hierarchy of interacting criteria,imprecise weights and stochastic analysis

A great majority of methods designed for Multiple Criteria Decision Aiding (MCDA) assume that all assessment criteria are considered at the same level, however, decision problems encountered in practice often impose a hierarchical structure of criteria. The hierarchy helps to decompose complex decision problems into smaller and manageable subtasks, and thus, it is very attractive for computational efficiency and explanatory purposes. To handle the hierarchy of criteria in MCDA, a methodology called Multiple Criteria Hierarchy Process (MCHP), has been recently proposed. MCHP permits to consider preference relations with respect to a subset of criteria at any level of the hierarchy. Here, we propose to apply MCHP to the ELECTRE III ranking method adapted to handle three types of interaction effects between criteria: mutual-weakening, mutual-strengthening and antagonistic effect. We also involve in MCHP an imprecise elicitation of criteria weights, generalizing a technique called the SRF method. In order to explore the plurality of rankings obtained by the ELECTRE III method for possible sets of criteria weights, we apply the Stochastic Multiobjective Acceptability Analysis (SMAA) that permits to draw robust conclusions in terms of rankings and preference relations at each level of the hierarchy of criteria. The novelty of the whole methodology consists of a joint consideration of hierarchical assessments of alternatives performances on interacting criteria, imprecise criteria weights, and robust analysis of ranking recommendations resulting from ELECTRE III. An example regarding the multiple criteria ranking of some European universities will show how to apply the proposed methodology on a decision problem.     

Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression

We consider multiple criteria decision aiding in the case of interaction between criteria. In this case the usual weighted sum cannot be used to aggregate evaluations on different criteria and other value functions with a more complex formulation have to be considered. The Choquet integral is the most used technique and also the most widespread in the literature. However, the application of the Choquet integral presents two main problems being the necessity to determine the capacity, which is the function that assigns a weight not only to all single criteria but also to all subset of criteria, and the necessity to express on the same scale evaluations on different criteria. While with respect to the first problem we adopt the recently introduced Non-Additive Robust Ordinal Regression (NAROR) taking into account all the capacities compatible with the preference information provided by the DM, with respect to the second one we build the common scale for the considered criteria using the Analytic Hierarchy Process (AHP). We propose to use AHP on a set of reference points in the scale of each criterion and to use an interpolation to obtain the other values. This permits to reduce considerably the number of pairwise comparisons usually required by the DM when applying AHP. An illustrative example details the application of the proposed methodology.     

An Integrated Methodology for Assessment and Selection of the Project Risk Response Actions

In a systematic process of project risk management, after risk assessment is implemented, the risk analysts encounter the phase of assessment and selection of the project risk response actions (RA). As indicated by many researchers, there are less systematic and well-developed solutions in the area of risk response assessment and selection. The present article introduces a methodology including a modeling approach with the objective of selecting a set of RA that minimizes the undesirable deviation from achieving the project scope. The developed objective function comprises the three key success criteria of a project, namely, time, quality, and cost. Our model integrates overall project management into the project risk response planning (P2RP). Furthermore, the proposed model stresses on an equivalent importance for both "risk" and "response." We believe that applying the proposed model helps the project risk analyst in most effective and efficient manner dealing with his or her complicated RA selection problems. The application of the proposed model was implemented in projects in the construction industry in which it showed tremendous time, cost, and quality improvements.     

Assigning Students to Groups: A Multi-Criteria Decision Support System Approach*

MCADSS is a multi-criteria allocation decision support system for assisting in the task of allocating students to groups. Based on multiple criteria, MCADSS's goal is to maximize the diversity of members within groups, while minimizing the average differences between groups. The project may be viewed from several perspectives: as a multi-criteria decision-making problem, as a “reverse'’clustering problem, or as a personnel assignment problem. The system is currently being used to allocate M.B.A. students into sections and study teams at The European Institute of Business Administration (INSEAD). This paper describes the rationale for MCADSS, design criteria, system methodology, and application results. It also suggests how this approach could be used for further applications.     

Assessing the Benefits and Costs of Homeland Security Research: A Risk-Informed Methodology with Applications for the U.S. Coast Guard

This article describes a methodology for risk-informed benefit–cost analyses of homeland security research products. The methodology is field-tested with 10 research products developed for the U.S. Coast Guard. Risk-informed benefit–cost analysis is a tool for risk management that integrates elements of risk analysis, decision analysis, and benefit–cost analysis. The cost analysis methodology includes a full-cost accounting of research projects, starting with initial fundamental research costs and extending to the costs of implementation of the research products and, where applicable, training, maintenance, and upgrade costs. The benefits analysis methodology is driven by changes in costs and risks leading to five alternative models: cost savings at the same level of security, increased security at the same cost, signal detection improvements, risk reduction by deterrence, and value of information. The U.S. Coast Guard staff selected 10 research projects to test and generalize the methodology. Examples include tools to improve the detection of explosives, reduce the costs of harbor patrols, and provide better predictions of hurricane wind speeds and floods. Benefits models and estimates varied by research project and many input parameters of the benefit estimates were highly uncertain, so risk analysis for sensitivity testing and simulation was important. Aggregating across the 10 research products, we found an overall median net present value of about $385 million, with a range from $54 million (5th percentile) to $877 million (95th percentile). Lessons learned are provided for future applications.     

Researching the Roles of Internal-change Agents in the Management of Organizational Change

There has been relatively little empirical research on the roles played by internal-change agents in the processes of developing and managing organizational and cultural change, or on their learning needs. There is a particular dearth of research on these issues in the public-service sector. This paper discusses an innovative methodology for studying the work of internal-change agents within local government. It describes an action-research project, the learning laboratory, which the authors piloted with a small group of senior managers involved in developing programmes of corporate organizational and/or cultural change in their own local authorities. Using a variety of action-research and action-learning techniques within the laboratory, together with before and after interviews with the participants and their line managers in their authorities, the project was able to explore the roles, perceptions and learning needs of these internal-change agents. The research makes a contribution to the study of internal-change agents in their organizational context, and draws attention in particular to the implications for change agents of the political context of public-service organizations. The value of the learning-laboratory methodology for assessing the learning needs of internal-change agents is also assessed.     

Multiattribute Risk Analysis in Nuclear Emergency Management

Radiation protection authorities have seen a potential for applying multiattribute risk analysis in nuclear emergency management and planning to deal with conflicting objectives, different parties involved, and uncertainties. This type of approach is expected to help in the following areas: to ensure that all relevant attributes are considered in decision making; to enhance communication between the concerned parties, including the public; and to provide a method for explicitly including risk analysis in the process. A multiattribute utility theory analysis was used to select a strategy for protecting the population after a simulated nuclear accident. The value-focused approach and the use of a neutral facilitator were identified as being useful.