Institutionalising the evaluation function: A South African study of impartiality,use and cost

PurposeThis article explores the implications of outsourcing the evaluation function in South Africa, a context where there is a mismatch between evaluation supply and demand. It unpacks the tradeoffs between internal and external evaluation, and challenges some commonly held assumptions about both.ApproachBased on experiences as an internal evaluator, external evaluator, evaluation manager, and building evaluation capacity, the author explores how each role changes when evaluation is a scarce skill, and looks at implications outsourcing has for both the organization, and the evaluation.FindingsThe purpose of the evaluation must drive the decision to outsource. However, with changing models of collaboration, there may be hybrid options that allow organizations to build evaluation capacity.Practical implicationsOrganisations are faced with a trade-off between commissioning an evaluation, and building internal evaluation capacity. To better understand each approach, it is important to consider the purpose and context of the evaluation. This shifts some commonly held assumptions about internal and external evaluations. Re-examining these assumptions will help organizations make a more informed decision about an evaluation approach.Originality/valueThe field of evaluation is particularly concerned with evaluation use. Most of the literature on this has focused on the approach of individual evaluators, and insufficient attention has been paid to the institutional architecture of the evaluation. This article considers how some of the organisational structures around an evaluation contribute to evidence use, and the case study of South Africa also shifts the focus to the central but overlooked role of context in the debate.     

Assumptions,conjectures, and other miracles: The application of evaluative thinking to theory of change models in community development

Unexamined and unjustified assumptions are the Achilles’ heel of development programs. In this paper, we describe an evaluation capacity building (ECB) approach designed to help community development practitioners work more effectively with assumptions through the intentional infusion of evaluative thinking (ET) into the program planning, monitoring, and evaluation process. We focus specifically on one component of our ET promotion approach involving the creation and analysis of theory of change (ToC) models. We describe our recent efforts to pilot this ET ECB approach with Catholic Relief Services (CRS) in Ethiopia and Zambia. The use of ToC models, plus the addition of ET, is a way to encourage individual and organizational learning and adaptive management that supports more reflective and responsive programming.     

基于神经网络的测井评价油层污染研究

利用测井资料,在剖析传统的测井评价油(气)层污染方法的基础上,介绍了利用BP神经网络这一现代数理统计新技术来实现测井多参数评定油气层污染程度的方法和技巧;以华北二连油田实际资料为例,建立了测井判释油气层污染的数学物理模型,并进行了模拟预测。结果表明:该法简便可行,对污染评价参数预测精度较高,对污染程度评价合理准确,可作为油(气)层污     

Multiple imputation for missing edge data: A predictive evaluation method with application to Add Health

Recent developments have made model-based imputation of network data feasible in principle, but the extant literature provides few practical examples of its use. In this paper, we consider 14 schools from the widely used In-School Survey of Add Health (Harris et al., 2009), applying an ERGM-based estimation and simulation approach to impute the network missing data for each school. Add Health's complex study design leads to multiple types of missingness, and we introduce practical techniques for handing each. We also develop a cross-validation based method – Held-Out Predictive Evaluation (HOPE) – for assessing this approach. Our results suggest that ERGM-based imputation of edge variables is a viable approach to the analysis of complex studies such as Add Health, provided that care is used in understanding and accounting for the study design.     

Experiences with systematic triangulation at the Global Environment Facility

Systematic triangulation may address common challenges in evaluation, such as the scarcity or unreliability of data, or the complexities of comparing and cross-checking evidence from diverse disciplines. Used to identify key evaluation findings, its application has proven to be effective in addressing the limitations encountered in country-level evaluation analysis conducted by the Independent Evaluation Office of the Global Environment Facility (GEF). These include the scarcity or unreliability of national statistics on environmental indicators and data series, especially in Least Developed Countries; challenges in evaluating the impacts of GEF projects; and inherent difficulties in defining the GEF portfolio of projects prior to the undertaking of the evaluation. In addition to responding to the need for further developing triangulation protocols, procedures and/or methodologies advocated by some authors, the approach offers a contribution to evaluation practice. This applies particularly to those evaluation units tasked with country-level evaluations in international organizations, facing similar constraints.     

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering¹ Research Experiences for Undergraduates² (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts.     

The Construction of College Students＇ Employment Competitiveness Evaluation Index System

随着大学生就业呈现竞争化、多元化趋势，对高校就业情况的衡量标准也应由“就业率”评价向“就业竞争力”评价转变。大学生就业竞争力评价指标体系主要包括主观就业竞争力与客观就业竞争力。硬实力和软实力构成主观就业竞争力，其中软实力包括基本职业人格、学习创新能力、团队组织能力、职业知识结构四方面，客观就业竞争力包含就业机会、就业成本、就业效率和就业质量等方面。     

Deactivating the Buttons: Integrating Radical Exposure Tapping with a Family Therapy Framework

The purpose of this paper is to describe and illustrate with case examples a brief intervention termed Radical Exposure Tapping (RET). RET can be integrated with family therapy to address stuck points where the therapy is hindered by a family member's affective block, an intense and unchangeable emotional reactivity to a specific trigger. RET draws from the methodology of Eye Movement Desensitization and Reprocessing (EMDR) and combines it with the tapping sequence of the Emotional Freedom Technique (EFT) to produce an intervention that is more flexible than EMDR, provides greater rigor than using the EFT technique alone and can be effective in a single session within the context of family therapy. The paper puts this work into context by first over viewing definitions of trauma and Post‐Traumatic Stress Disorder, arguing that family members' emotional reactivity may be a symptom of PTSD even when they would not qualify for the diagnosis because they had not experienced a life threatening event.     

环境信息披露的污染减排效应评估

本文利用我国2008年正式实施环境信息披露制度这一外生冲击构造准自然实验,基于2004-2017年我国285个城市的面板数据,通过双重差分法系统评估环境信息披露对工业污染物排放的影响。克服环境信息披露的测量困难与内生性问题,首次考察环境信息披露的污染减排效果,并借助数理模型对其影响机制进行规范阐释。研究发现,环境信息披露能够显著降低工业污染物排放水平,且该影响具有一定的时滞性和长期性;同时,减排作用会随地区环境污染程度和环境规制力度的增强而呈现递增规律;此外,机制分析的结果表明,其传导机制主要来自于产业结构转型和减排技术进步。为验证研究结论的稳健性,本文提供了平行趋势、工具变量、安慰剂等多种方法的检验结果。本文的研究在经验上丰富了环境信息披露与环境污染治理之间关系的相关讨论,为提升我国环境污染治理水平、打赢污染防治攻坚战提供有益的政策启示。     

《后出师表》真伪考释

有学者对诸葛亮《后出师表》提出置疑。笔者提出几点意见：一、《后表》虽不载于《诸葛亮传》,但见于《诸葛恪传》;二、《后表》不是张俨、诸葛恪伪造;三、《后表》用语与诸葛亮习惯用语符合;四、《后表》立意与诸葛亮行为一致。由此可知,《后表》是诸葛亮的作品。