Knowledge Representation and Reasoning in a Real-Time Operational Control System: The Shipboard Piloting Expert System (SPES)*

This paper describes a knowledge representation approach and reasoning implementation in a real-time knowledge-based control system (KBCS) for navigating ships in restricted waters. This shipboard piloting expert system (SPES) is being developed as an intelligent node in Sperry Marine's ExxBridge integrated ship's bridge system (IBS) for Exxon Shipping Company tankers. The SPES is intended to provide decision support to ships' navigation officers while piloting large vessels in restricted waters, and to reduce the information overload under which they labor, by incorporating local, transit-specific, and shiphandling knowledge, and by providing requisite decision support in a timely fashion. As such, the system provides decision support to (1) senior ships' pilots training junior pilots; (2) ships' masters training junior deck officers in the essentials of good piloting and shiphandling; and (3) watchstanding deck officers utilizing the system's on-line reminder and assist capabilities, or off-line simulation and contingency planning functionality.     

The Effects of Hindsight Bias on Jurors' Evaluations of Auditor Decisions*

Hindsight bias refers to the tendency of individuals with outcome knowledge (hindsight) to alter their perception of an event such that, ex-post, one's assumed ability to predict an event is greater than one's ex-ante ability. Auditors must make decisions without knowledge of an eventual outcome, but auditor liability is determined from a perspective that includes outcome knowledge. A behavioral experiment was conducted with 92 prospective jurors. Jurors were presented with a case in which auditors performed an audit of a client company and subsequently issued the standard, favorable audit report. Outcome knowledge was manipulated as: (1) no outcome (control group), (2) negative outcome (bankruptcy and subsequent lawsuit), and (3) negative outcome with a debiasing strategy. Results indicate that outcome knowledge biased jurors' evaluations of the auditor's judgment. Additional analysis revealed that the results are consistent with a cognitive interpretation of hindsight bias. The debiasing strategy was found to be effective in mitigating hindsight bias.     

Production System Development for Expert Systems Using a Recursive Partitioning Induction Approach: An Application to Mortgage,Commercial, and Consumer Lending

The concepts of expert systems and decision support systems have received considerable attention recently. While systems have been proposed for various problem areas in business, difficulties still exist in the knowledge acquisition phase of development. This paper presents a recursive partitioning analysis (RPA) approach to knowledge acquisition. The RPA production system approach was applied to data sets representing the mortgage, commercial, and consumer lending problems. Comparison of the classification rates across these problems to the results of a generalized inductive inference production system (Quinlan's ID3 algorithm) and across the mortgage and commercial lending problems to traditional statistical modeling approaches indicated that the RPA approach provided superior results while using fewer variables.     

Validating Expert Systems: A Demonstration Using Personal Choice Expert,A Flexible Employee Benefit System*

A method for validating expert systems, based on validation approaches from psychology and Turing's “imitation game,” is demonstrated using a flexible employee benefits expert system. Psychometric validation has three aspects: the extent to which the system and expert decisions agree (criterionrelated validity), the inputs and processes used by experts compared to the system (content validity), and differences between expert and novice decisions (construct validity). If these criteria are satisfied, then the system is indistinguishable from experts for its domain and satisfies the Turing Test. Personal Choice Expert (PCE) was designed to help employees of a Fortune 500 firm choose benefits in their flexible benefits system. Its recommendations do not significantly differ from those given by independent experts. Hence, if the system-independent expert agreement (criterion-related validity) were the only standard, PCE could be considered valid. However, construct analysis suggests that re-engineering may be required. High intra-expert agreement exists only for some benefit recommendations (e.g., dental care and long-term disability) and not for others (e.g., short-term disability, accidental death and dismemberment, and life insurance). Insights offered by these methods are illustrated and examined.     

The Application of Neural Networks and a Qualitative Response Model to the Auditor's Going Concern Uncertainty Decision*

An auditor gives a going concern uncertainty opinion when the client company is at risk of failure or exhibits other signs of distress that threaten its ability to continue as a going concern. The decision to issue a going concern opinion is an unstructured task that requires the use of the auditor's judgment. In cases where judgment is required, the auditor may benefit from the use of statistical analysis or other forms of decision models to support the final decision. This study uses the generalized reduced gradient (GRG2) optimizer for neural network learning, a backpropagation neural network, and a logit model to predict which firms would receive audit reports reflecting a going concern uncertainty modification. The GRG2 optimizer has previously been used as a more efficient optimizer for solving business problems. The neural network model formulated using GRG2 has the highest prediction accuracy of 95 percent. It performs best when tested with a small number of variables on a group of data sets, each containing 70 observations. While the logit procedure fails to converge when using our eight variable model, the GRG2 based neural network analysis provides consistent results using either eight or four variable models. The GRG2 based neural network is proposed as a robust alternative model for auditors to support their assessment of going concern uncertainty affecting the client company.     

Automating Knowledge Acquisition and Refinement for Decision Support: A Connectionist Inductive Inference Model*

An important application of expert systems technology is to provide support for nonstructured decision making. Usually, nonstructured decision making is characterized by heavy reliance on heuristic knowledge, which is very difficult to articulate or document, and therefore traditional knowledge acquisition approaches are not very successful. The quality and effectiveness of an expert system supporting unstructured decision making is affected when traditional knowledge acquisition approaches are used. To alleviate this problem a model is proposed that combines inductive inference and neural network computing, and an example is presented that illustrates the potential of this model in unstructured decision support.     

Expert leaders in a fast-moving environment

This longitudinal study explores the influence of leaders on performance in the iconic, high-technology, turbulent industry of Formula One. The evidence is evaluated through the emerging theory of expert leadership which proposes the existence of a first-order requirement: it is that leaders should have expert knowledge in the core-business of the organizations they are to lead (holding constant management and leadership experience). The study's findings provide strong support for the ‘expert leader’ hypothesis. The most successful F1 principals are disproportionately those who started their careers as drivers. Moreover, within the sub-sample of former drivers, it is those who had the longest driving careers who went on to become the most effective leaders. The study's expert-leader findings are consistent with the hypothesis that longitudinal performance improves when a leader's knowledge and expertise correlate with an organization's core-business activity.     

Interface Style and Training Task Difficulty as Determinants of Effective Computer-Assisted Knowledge Transfer*

The transfer of expert knowledge to novices is one means of improving decision quality. Research needs to identify (1) the knowledge to be transferred to novices, and (2) the best method for transferring that knowledge. Studies that compare the judgment behavior of experienced and novice auditors address the first issue. The present study addresses the second issue in the context of using a computer-assisted training (CAT) program. CAT was selected for study because of evidence that it can both improve the effectiveness and reduce the costs of training. An experiment was conducted in which two factors were manipulated: (1) the design of the human-computer interface of the CAT program, and (2) the content of training tasks. The judgment of interest involved causal reasoning about the relationships between various internal control procedures and possible errors. The results indicate that alternative styles of interaction with a CAT program differ in terms of learning effectiveness. In addition, there was also evidence that training task content affected learning.     

SOME CAUTIONARY NOTES ON THE USE OF CONJOINT MEASUREMENT FOR HUMAN JUDGMENT MODELING*

Conjoint measurement has been suggested as a methodology that might be useful in assisting research concerned with the identification of the structural form of a judge's model. This paper synthesizes the results of some recent research that examined the robustness of this methodology. This research suggests that conjoint measurement has three major weaknesses: (1) certain biases exist when diagnosing model structure, (2) model diagnosis is limited to a small set of potential models, and (3) error substantially compromises conjoint measurement's ability to diagnose model structure. An empirical example that demonstrates some of the difficulties of using this methodology with experimental data is also presented.     

The Effects of Process and Outcome Similarity on Users' Evaluations of Decision Aids*

Decision aids (DA) used in online shopping contexts have been shown to improve users' product choices. Given that previous research (e.g., Byrne & Griffitt, 1973 ) has demonstrated the positive effects of perceived similarity on an individual's evaluation of others, this study investigates the effects of users' perceived similarity with a DA on their evaluations of that DA. More specifically, we investigate the effect of users' perceptions of the similarity between their own decision process and that followed by the DA to arrive at a recommendation (decision process similarity), as well as the similarity between the recommendations made by the DA and users' initial choices (outcome similarity), on their evaluations of the DA's usefulness and trustworthiness. The results of this study show that perceived process similarity exerts positive and significant effects on users' perceptions of the DA's usefulness and trustworthiness. However, the effects of perceived outcome similarity on trust are completely mediated by perceived process similarity. It is also observed that the level of the user's domain knowledge moderates the effects of perceived decision process similarity on both perceived usefulness and trustworthiness. These results have implications for DA design. It is important that designers consider the process by which users make decisions for themselves and align the DA's decision process with those of the user's, especially for the novice user. The full mediation of the effect of outcome similarity on trust by process similarity highlights how a similar decision process can mitigate some of the negative effects of outcome dissimilarity.     

A Learning Curve Analysis of Expert System Use*

In this article, we study how an expert system affects novice problem solving in a financial risk analysis domain. We demonstrate that novice performance is improved after exposure to an expert system. Further, we show that novice performance continues to improve when the system is withdrawn. By comparing learning curves for people with exposure to those without, we can assess how much the system has benefitted its users. We demonstrate a quantitative methodology to measure the increment of learning due to the use of an information technology. We also explore the issue of how expertise is transferred from the system to the user.     

Integrating Neural Networks and Semi-Markov Processes for Automated Knowledge Acquisition: An Application to Real-time Scheduling*

Recently, artificial neural networks (ANN) have gained attention as a promising modeling tool for building intelligent systems. A number of applications have been reported in areas varying from pattern recognition to bankruptcy prediction. In this paper, we present a creative methodology that integrates computer simulation, semi-Markov optimization, and ANN techniques for automated knowledge acquisition in real-time scheduling. The integrated approach focuses on the synergy between operations research and ANN in eliciting human knowledge, filtering inconsistent data, and building competent models capable of performing at the expert level. The new approach includes three main components. First, computer simulation is used to collect expert decisions. This step allows expert knowledge to be obtained in a non-intrusive way and minimizes the difficulties involved in interviewing experts, constructing repertory grids, or using other similar structures required for manual knowledge acquisition. The data collected from computer simulation are then optimized using a semi-Markov decision model to remove data redundancies, inconsistencies, and errors. Finally, the optimized data are used to build ANN-based expert systems. The integrated approach is evaluated by comparing it with the human expert and using ANN alone in the domain of real-time scheduling. The results indicate that ANN-based systems perform worse than human experts from whom the data were collected, but the integrated approach outperforms human experts and ANN models alone.     

Rule-Based Expert Systems and Linear Models: An Empirical Comparison of Learning-By-Examples Methods*

Building models of expert decision-making behavior from examples of experts’ decisions continues to receive considerable research attention. In the 1960's and 70's, linear models derived by statistical methods were studied extensively. More recently, rule-based expert systems derived by induction algorithms have been the focus of attention. Few studies compare the two approaches. This paper reports on a study that compared linear models derived by logistic regression with rule-based systems produced by two induction algorithms—ID3 and the genetic algorithm. The techniques performed comparably in modeling the experts at one task, graduate admissions, but differed significantly at a second task, bidder selection.     

Incentive for Peer‐to‐Peer Knowledge Sharing among Farmers in Developing Economies

This study examines the peer‐to‐Peer interactions among farmers when both knowledge learning and sharing are available. We construct a stylized model in which heterogeneous farmers are endowed with their initial production capabilities and can post questions in the platform for help. A representative expert regularly monitors the forum and provides answers to the farmers’ questions, but may be non‐responsive sometimes due to the limited capacity. A knowledgeable core user (farmer) can choose to be silent or responsive, and is allowed to strategically determine the informativeness of her answers. The farmers face the minimum quantity restriction for attracting the buyers, and must make production before the time of sales. We show that in equilibrium the core user never provides answers that are more informative than the expert's, irrespective of her ex ante knowledge level. Redesigning or restructuring the platform does not help eliminate this inefficient knowledge provision. We also find that hiring more staff to frequently monitor the forum turns out to be detrimental for the peer‐to‐peer interactions. Moreover, the competition on knowledge sharing between the platform expert and the core user features strategic complementarity sometimes but strategic substitution at other times. Third, charging for the platform usage may discourage uninformative answers, but it could also discourage the core user from sharing knowledge with other farmers.     

TWO DESIGN PRINCIPLES FOR KNOWLEDGE-BASED SYSTEMS*

This paper discusses two principles that have become increasingly important in the design of knowledge-based systems: domain-specific knowledge used to support opportunistic reasoning and hierarchical organization structure used to control and coordinate problem-solving activity. We propose a design framework that embodies these two principles and describe how this framework has been used to develop a knowledge-based job-shop scheduling system. This system, called OPIS 0, has undergone limited testing in an experimental environment modeled after an actual job shop. Its performance has been very good compared to ISIS and to the more traditional approach of constructing a schedule by dispatching jobs using the COVERT priority rule. The resulting design also shows potential for use in a decision support role.     

The Development Manager's Advisory System: A Knowledge-Based DSS Tool for Project Assessment*

This research investigates whether the knowledge-based decision support system (KBDSS) paradigm provides the necessary supporting structure and developmental framework for product development evaluation. To address the research questions posed in this study, it is necessary to develop and implement KBDSS's at specific decision points along the product development cycle. This paper describes the design, development, and implementation of a KBDSS to support a product development manager's decision concerning full-scale development of a new product. From the systems design perspective, this paper addresses the integration and innovative use of a variety of techniques for knowledge acquisition, modeling, and processing. The approach utilized obtains the benefits of normative modeling as well as the flexibility and developmental advantages of knowledge-based systems. Since its implementation, the system has been successfully used by a development manager to support his recommendation for an ongoing project. His complete satisfaction with this system served as the impetus for the design and development of a multi-expert system which was implemented at the strategic level.     

AN ADAPTIVE DECISION SUPPORT SYSTEM FOR ACADEMIC RESOURCE PLANNING

Institutions of higher learning are growing increasingly interested in the use of model-based approaches to their resource allocation problems. Recent modeling approaches, however, have failed to consider that resource allocation planning is not a well-structured decision process. Additionally, many decision makers are necessarily involved in the academic planning process and may assume dissimilar perspectives on the importance of achieving different goals and objectives. Furthermore, satisfactory allocation solutions can be expected to vary considerably from decision maker to decision maker as the individual's cognitive processes, perceptions, and evaluations are taken into consideration. This paper describes a decision support system (DSS) approach that attempts to adapt to a variety of academic decision makers with differing planning views in an environment of multiple conflicting objectives. This DSS, which was successfully tested on four academic decision makers in a large midwestern university, shows considerable promise for providing decision support to decision makers with varied problem-solving styles.     

Knowledge-Based Risk Assessment Under Uncertainty for Species Invasion

Management of invasive species depends on developing prevention and control strategies through comprehensive risk assessment frameworks that need a thorough analysis of exposure to invasive species. However, accurate exposure analysis of invasive species can be a daunting task because of the inherent uncertainty in invasion processes. Risk assessment of invasive species under uncertainty requires potential integration of expert judgment with empirical information, which often can be incomplete, imprecise, and fragmentary. The representation of knowledge in classical risk models depends on the formulation of a precise probabilistic value or well-defined joint distribution of unknown parameters. However, expert knowledge and judgments are often represented in value-laden terms or preference-ordered criteria. We offer a novel approach to risk assessment by using a dominance-based rough set approach to account for preference order in the domains of attributes in the set of risk classes. The model is illustrated with an example showing how a knowledge-centric risk model can be integrated with the dominance-based principle of rough set to derive minimal covering "if ... , then...," decision rules to reason over a set of possible invasion scenarios. The inconsistency and ambiguity in the data set is modeled using the rough set concept of boundary region adjoining lower and upper approximation of risk classes. Finally, we present an extension of rough set to evidence a theoretic interpretation of risk measures of invasive species in a spatial context. In this approach, the multispecies interactions in an invasion risk are approximated with imprecise probability measures through a combination of spatial neighborhood information of risk estimation in terms of belief and plausibility.     

SMALL PANELS OF EXPERTS IN DICHOTOMOUS CHOICE SITUATIONS*

This paper analyzes an expert resolution problem under an uncertain dichotomous choice situation. The experts share a common system of norms and therefore they all prefer the alternative that best suits their purpose. The selection of such an alternative is referred to as a correct choice. Our analysis of optimal decision rules for panels of independent experts is pursued for n-member decision-making bodies, n≤ 5. The suggested optimality criterion is the maximization of the probability of the panel's making the correct choice. Within our framework, this criterion is equivalent to the more common criterion of expected-utility maximization. For three-member panels of experts, the expert resolution problem is solved and illustrated by means of a medical application. For four-member panels, we list the three relevant decision rules, specify the conditions for all possible rankings of these rules, and, finally, present an extended consulting application. We conclude by listing seven relevant decision rules in the case of five-member decision-making bodies.     

An Application of the AXIS Solution Framework to Multiple Objective Aggregate Production Planning

This paper provides data on the first application of a prototype of the AXIS solution framework. AXIS (algorithms combined with knowledge systems in an interactive sequence) is a framework for interactively combining structured algorithms that seek a best solution with knowledge-based expert systems that seek expert heuristic solutions. This paper tests the framework using an interactive multiple objective integer programming algorithm combined with heuristics taken from the domain of aggregate production planning. The results indicate the AXIS framework can be successful in generating high quality solutions, in vastly reduced solution times compared to the structured algorithms, at much lower costs compared to the expert heuristics working alone.