Using Expert Judgments to Explore Robust Alternatives for Forest Management under Climate Change

We develop and apply a judgment‐based approach to selecting robust alternatives, which are defined here as reasonably likely to achieve objectives, over a range of uncertainties. The intent is to develop an approach that is more practical in terms of data and analysis requirements than current approaches, informed by the literature and experience with probability elicitation and judgmental forecasting. The context involves decisions about managing forest lands that have been severely affected by mountain pine beetles in British Columbia, a pest infestation that is climate‐exacerbated. A forest management decision was developed as the basis for the context, objectives, and alternatives for land management actions, to frame and condition the judgments. A wide range of climate forecasts, taken to represent the 10–90% levels on cumulative distributions for future climate, were developed to condition judgments. An elicitation instrument was developed, tested, and revised to serve as the basis for eliciting probabilistic three‐point distributions regarding the performance of selected alternatives, over a set of relevant objectives, in the short and long term. The elicitations were conducted in a workshop comprising 14 regional forest management specialists. We employed the concept of stochastic dominance to help identify robust alternatives. We used extensive sensitivity analysis to explore the patterns in the judgments, and also considered the preferred alternatives for each individual expert. The results show that two alternatives that are more flexible than the current policies are judged more likely to perform better than the current alternatives on average in terms of stochastic dominance. The results suggest judgmental approaches to robust decision making deserve greater attention and testing.     

Classification of Listeria monocytogenes Persistence in Retail Delicatessen Environments Using Expert Elicitation and Machine Learning

Increasing evidence suggests that persistence of Listeria monocytogenes in food processing plants has been the underlying cause of a number of human listeriosis outbreaks. This study extracts criteria used by food safety experts in determining bacterial persistence in the environment, using retail delicatessen operations as a model. Using the Delphi method, we conducted an expert elicitation with 10 food safety experts from academia, industry, and government to classify L. monocytogenes persistence based on environmental sampling results collected over six months for 30 retail delicatessen stores. The results were modeled using variations of random forest, support vector machine, logistic regression, and linear regression; variable importance values of random forest and support vector machine models were consolidated to rank important variables in the experts’ classifications. The duration of subtype isolation ranked most important across all expert categories. Sampling site category also ranked high in importance and validation errors doubled when this covariate was removed. Support vector machine and random forest models successfully classified the data with average validation errors of 3.1% and 2.2% (n = 144), respectively. Our findings indicate that (i) the frequency of isolations over time and sampling site information are critical factors for experts determining subtype persistence, (ii) food safety experts from different sectors may not use the same criteria in determining persistence, and (iii) machine learning models have potential for future use in environmental surveillance and risk management programs. Future work is necessary to validate the accuracy of expert and machine classification against biological measurement of L. monocytogenes persistence.     

Biases in bias elicitation

Abstract

We consider the biases that can arise in bias elicitation when expert assessors make random errors. After presenting a general framework of the phenomenon, we illustrate it for two examples: the case of omitting variables bias and that of the bias arising in adjusting relative risks. Results show that, even when assessors’ elicitations of bias have desirable properties, the nonlinear nature of biases can lead to elicitations of bias that are, themselves, biased. We show the corrections which can be made to remove this bias and discuss the implications for the applied literature which employs these methods.     

Visualising everyday ethnicity: moving beyond stereotypes of Roma minorities

ABSTRACT

The visual image of Roma people in the media is mired in racialised notions of ‘the other’. Whilst we know what Roma stereotypes look like, there is little clarity as to how a ‘non-stereotypical’ image might be constructed. In order to examine the non-stereotypical, two sources of images are analysed: (1) entrants from an anti-stereotype Roma photography competition and (2) self-representations produced by Roma participants during ethnographic research. The findings show that if ‘Roma’ is foregrounded as the subject, even a non-stereotypical approach can reproduce ‘difference’ (from a supposed ‘norm’). ‘Roma’ is thus, at the moment, still strongly linked to a notion of ethnicity that is seen as different and racialised. However, when ethnicity is not emphasised, but rather self-representations and the ‘everyday’, such orthodoxies are challenged. These sources provide a unique opportunity to create a deeper understanding of ‘non-stereotypical’ images in order to challenge misrepresentations and racism.     

Identifying beliefs behind boys’ use of mobile phones to monitor girlfriends and girls’ acceptance: a reasoned-action approach

Monitoring/controlling behaviours can be present in the early stages of an abusive relationship. Because of the need for evidence-based interventions grounded on behavioural models that identify the determinants of abusive behaviours, we applied the formative research of the reasoned action approach to: (1) conduct an elicitation study on the behavioural and normative beliefs that explain why boys use mobile phones to monitor their girlfriends and why these accept it, (2) analyse the items designed to assess the different constructs in the model and (3) carry out a preliminary exploration of the relationship between constructs. The sample was composed of 119 adolescent girls and boys between 14 and 18 years of age. Boys and girls seem to hold complementary beliefs that could produce a feedback loop that maintains the abusive behaviour. Parents are a protective factor against the behaviour whereas peers are not. Results on the item analysis and reliability of the scales were good. Intention seems an important predictor of the performance (51%) and acceptance (60%) of the behaviour and attitudes and perceived social norms of the intention (boys: 67%; girls: 65%), which suggests the appropriateness of the model for the prediction of the behaviour.     

Calibrated Bayes factors for model comparison

A Bayes factor between two models can be greatly affected by the prior distributions on the model parameters. When prior information is weak, very dispersed proper prior distributions are known to create a problem for the Bayes factor when competing models differ in dimension, and it is of even greater concern when one of the models is of infinite dimension. Therefore, we propose an innovative method which uses training samples to calibrate the prior distributions so that they achieve a reasonable level of ‘information’. Then the calibrated Bayes factor can be computed over the remaining data. This method makes no assumption on model forms (parametric or nonparametric) and can be used with both proper and improper priors. We illustrate, through simulation studies and a real data example, that the calibrated Bayes factor yields robust and reliable model preferences under various situations.     

谈篮球课中启发式教学方法的运用

在篮球课教学中,教学方法运用的好坏,不仅关系到教学任务的完成和教学目的的实现,而且对学生智力水平的提高和基本教学能力的培养产生一定影响,文章阐述的是启发式教学方法在篮球课教学中的运用。     

如何在教学中提高大学生的数学素质

论述了提高大学生数学素质的重要性,指出了当前教学中不利于提高大学生数学素质的一些问题,并提供了解决问题的对策。     

A Methodology for Assessing the Probability of Occurrence of Undesired Events in the Tietê–Paraná Inland Waterway Based on Expert Opinion

The market share of Tietê–Paraná inland waterway (TPIW) in the transport matrix of the São Paulo state, Brazil, is currently only 0.6%, but it is expected to increase to 6% over the next 20 years. In this scenario, to identify and explore potential undesired events a risk assessment is necessary. Part of this involves assigning the probability of occurrence of events, which usually is accomplished by a frequentist approach. However, in many cases, this approach is not possible due to unavailable or nonrepresentative data. This is the case of the TPIW that even though an expressive accident history is available, a frequentist approach is not suitable due to differences between current operational conditions and those met in the past. Therefore, a subjective assessment is an option as allows for working independently of the historical data, thus delivering more reliable results. In this context, this article proposes a methodology for assessing the probability of occurrence of undesired events based on expert opinion combined with fuzzy analysis. This methodology defines a criterion to weighting the experts and, using the fuzzy logic, evaluates the similarities among the experts’ beliefs to be used in the aggregation process before the defuzzification that quantifies the probability of occurrence of the events based on the experts’ opinion. Moreover, the proposed methodology is applied to the real case of the TPIW and the results obtained from the elicited experts are compared with a frequentist approach evidencing the impact on the results when considering different interpretations of the probability.     

Structured expert elicitation about Listeria monocytogenes cross-contamination in the environment of retail deli operations in the United States

Listeria monocytogenes is among the foodborne pathogens with the highest death toll in the United States. Ready‐to‐eat foods contaminated at retail are an important source of infection. Environmental sites in retail deli operations can be contaminated. However, commonly contaminated sites are unlikely to come into direct contact with food and the public health relevance of environmental contamination has remained unclear. To identify environmental sites that may pose a considerable cross‐contamination risk, to elucidate potential transmission pathways, and to identify knowledge gaps, we performed a structured expert elicitation of 41 experts from state regulatory agencies and the food retail industry with practical experience in retail deli operations. Following the “Delphi” method, the elicitation was performed in three consecutive steps: questionnaire, review and discussion of results, second questionnaire. Hands and gloves were identified as important potential contamination sources. However, bacterial transfers to and from hands or gloves represented a major data gap. Experts agreed about transfer probabilities from cutting boards, scales, deli cases, and deli preparation sinks to product, and about transfer probabilities from floor drains, walk‐in cooler floors, and knife racks to food contact surfaces. Comparison of experts' opinions to observational data revealed a tendency among experts with certain demographic characteristics and professional opinions to overestimate prevalence. Experts’ votes clearly clustered into separate groups not defined by place of employment, even though industry experts may have been somewhat overrepresented in one cluster. Overall, our study demonstrates the value and caveats of expert elicitation to identify data gaps and prioritize research efforts.