Expert Knowledge Elicitation: Subjective but Scientific

ABSTRACT

Expert opinion and judgment enter into the practice of statistical inference and decision-making in numerous ways. Indeed, there is essentially no aspect of scientific investigation in which judgment is not required. Judgment is necessarily subjective, but should be made as carefully, as objectively, and as scientifically as possible.

Elicitation of expert knowledge concerning an uncertain quantity expresses that knowledge in the form of a (subjective) probability distribution for the quantity. Such distributions play an important role in statistical inference (for example as prior distributions in a Bayesian analysis) and in evidence-based decision-making (for example as expressions of uncertainty regarding inputs to a decision model). This article sets out a number of practices through which elicitation can be made as rigorous and scientific as possible.

One such practice is to follow a recognized protocol that is designed to address and minimize the cognitive biases that experts are prone to when making probabilistic judgments. We review the leading protocols in the field, and contrast their different approaches to dealing with these biases through the medium of a detailed case study employing the SHELF protocol.

The article ends with discussion of how to elicit a joint probability distribution for multiple uncertain quantities, which is a challenge for all the leading protocols. Supplementary materials for this article are available online.     

Elicitation of multivariate prior distributions: A nonparametric Bayesian approach

In the context of Bayesian statistical analysis, elicitation is the process of formulating a prior density f(·)$f(·)$ about one or more uncertain quantities to represent a person's knowledge and beliefs. Several different methods of eliciting prior distributions for one unknown parameter have been proposed. However, there are relatively few methods for specifying a multivariate prior distribution and most are just applicable to specific classes of problems and/or based on restrictive conditions, such as independence of variables. Besides, many of these procedures require the elicitation of variances and correlations, and sometimes elicitation of hyperparameters which are difficult for experts to specify in practice. Garthwaite et al. (2005) discuss the different methods proposed in the literature and the difficulties of eliciting multivariate prior distributions. We describe a flexible method of eliciting multivariate prior distributions applicable to a wide class of practical problems. Our approach does not assume a parametric form for the unknown prior density f(·)$f(·)$, instead we use nonparametric Bayesian inference, modelling f(·)$f(·)$ by a Gaussian process prior distribution. The expert is then asked to specify certain summaries of his/her distribution, such as the mean, mode, marginal quantiles and a small number of joint probabilities. The analyst receives that information, treating it as a data set D   with which to update his/her prior beliefs to obtain the posterior distribution for f(·)$f(·)$. Theoretical properties of joint and marginal priors are derived and numerical illustrations to demonstrate our approach are given.     

房地产业与国民经济协调发展的国际经验及启示

一、引言近年来,随着中国城市化进程的加快和城镇住房制度改革的不断深入,政府出台了多项支持房地产发展的产业政策和信贷政策,促使房地产业快速增长,2004年,建筑和房地产业增加值占GDP的比例接近10%。房地产业的发展给居民提供了新的资产持有形式和投资渠道,房产已成为城镇居民最主要的家庭财产,李扬等人(2004)的研究显示,在城镇居民的家庭财产构成中,房产的比重为48%,远高于金融资产(比重为35%)。房地产业对中国调整经济结构、促进经济增长发挥了重要作用。当一国或地区经济发展水平达到一定高度后,人们对房地产的需求将日益增长,由此带…     

发达国家服务业需求结构的变动对中国的启示——一项基于投入产出表的比较分析

20世纪 60年代以来 ,服务业异军突起 ,在世界经济中的作用日趋重要。目前 ,无论从就业比重还是产值比重来看 ,服务业在世界经济中总体上都已超过工农业之和。服务业的发展已成为影响一国经济增长、吸纳就业和提高国际竞争力的决定因素。与此同时 ,经济学对服务业的关注也与日俱增 ,其中对影响服务业迅速崛起原因的探讨是理论研究的焦点之一。从需求角度解释服务业崛起的原因主要有两种观点 ,一种观点认为最终消费需求增长是服务业崛起的主要因素 ,这一观点源自克拉克。克拉克认为服务业比重的上升主要是由于人们的消费需求引起的 ,因为相对…