Assumptions,conjectures, and other miracles: The application of evaluative thinking to theory of change models in community development

Unexamined and unjustified assumptions are the Achilles’ heel of development programs. In this paper, we describe an evaluation capacity building (ECB) approach designed to help community development practitioners work more effectively with assumptions through the intentional infusion of evaluative thinking (ET) into the program planning, monitoring, and evaluation process. We focus specifically on one component of our ET promotion approach involving the creation and analysis of theory of change (ToC) models. We describe our recent efforts to pilot this ET ECB approach with Catholic Relief Services (CRS) in Ethiopia and Zambia. The use of ToC models, plus the addition of ET, is a way to encourage individual and organizational learning and adaptive management that supports more reflective and responsive programming.     

基于神经网络的测井评价油层污染研究

利用测井资料,在剖析传统的测井评价油(气)层污染方法的基础上,介绍了利用BP神经网络这一现代数理统计新技术来实现测井多参数评定油气层污染程度的方法和技巧;以华北二连油田实际资料为例,建立了测井判释油气层污染的数学物理模型,并进行了模拟预测。结果表明:该法简便可行,对污染评价参数预测精度较高,对污染程度评价合理准确,可作为油(气)层污     

Multiple imputation for missing edge data: A predictive evaluation method with application to Add Health

Recent developments have made model-based imputation of network data feasible in principle, but the extant literature provides few practical examples of its use. In this paper, we consider 14 schools from the widely used In-School Survey of Add Health (Harris et al., 2009), applying an ERGM-based estimation and simulation approach to impute the network missing data for each school. Add Health's complex study design leads to multiple types of missingness, and we introduce practical techniques for handing each. We also develop a cross-validation based method – Held-Out Predictive Evaluation (HOPE) – for assessing this approach. Our results suggest that ERGM-based imputation of edge variables is a viable approach to the analysis of complex studies such as Add Health, provided that care is used in understanding and accounting for the study design.     

Experiences with systematic triangulation at the Global Environment Facility

Systematic triangulation may address common challenges in evaluation, such as the scarcity or unreliability of data, or the complexities of comparing and cross-checking evidence from diverse disciplines. Used to identify key evaluation findings, its application has proven to be effective in addressing the limitations encountered in country-level evaluation analysis conducted by the Independent Evaluation Office of the Global Environment Facility (GEF). These include the scarcity or unreliability of national statistics on environmental indicators and data series, especially in Least Developed Countries; challenges in evaluating the impacts of GEF projects; and inherent difficulties in defining the GEF portfolio of projects prior to the undertaking of the evaluation. In addition to responding to the need for further developing triangulation protocols, procedures and/or methodologies advocated by some authors, the approach offers a contribution to evaluation practice. This applies particularly to those evaluation units tasked with country-level evaluations in international organizations, facing similar constraints.     

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering¹ Research Experiences for Undergraduates² (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts.     

The Construction of College Students＇ Employment Competitiveness Evaluation Index System

随着大学生就业呈现竞争化、多元化趋势，对高校就业情况的衡量标准也应由“就业率”评价向“就业竞争力”评价转变。大学生就业竞争力评价指标体系主要包括主观就业竞争力与客观就业竞争力。硬实力和软实力构成主观就业竞争力，其中软实力包括基本职业人格、学习创新能力、团队组织能力、职业知识结构四方面，客观就业竞争力包含就业机会、就业成本、就业效率和就业质量等方面。     

环境信息披露的污染减排效应评估

本文利用我国2008年正式实施环境信息披露制度这一外生冲击构造准自然实验,基于2004-2017年我国285个城市的面板数据,通过双重差分法系统评估环境信息披露对工业污染物排放的影响。克服环境信息披露的测量困难与内生性问题,首次考察环境信息披露的污染减排效果,并借助数理模型对其影响机制进行规范阐释。研究发现,环境信息披露能够显著降低工业污染物排放水平,且该影响具有一定的时滞性和长期性;同时,减排作用会随地区环境污染程度和环境规制力度的增强而呈现递增规律;此外,机制分析的结果表明,其传导机制主要来自于产业结构转型和减排技术进步。为验证研究结论的稳健性,本文提供了平行趋势、工具变量、安慰剂等多种方法的检验结果。本文的研究在经验上丰富了环境信息披露与环境污染治理之间关系的相关讨论,为提升我国环境污染治理水平、打赢污染防治攻坚战提供有益的政策启示。     

AD HOC MODEL BUILDING USING TIME-VARYING PARAMETER MODELS*

Decision support for managers and policy makers, such as required in planning and evaluation efforts, often requires ad hoc behavioral modeling to account for context-specific phenomena and to handle data limitations. This paper introduces a systematic approach useful for meeting these requirements in which time-varying parameter estimation plays an important role. A case study evaluating the impacts of public policy actions on residential natural gas conservation illustrates the approach.     

基于层次分析的广东区域竞争力评价

选取国内八省市为比较对象,运用层次分析法对广东区域竞争力表现及竞争力潜力进行评价,得出了广东在国内八省市中的竞争力排位,分析了广东在区域竞争力方面的优劣势,并就提升广东整体区域竞争力提出了相应建议。     

Using a community-created multisite evaluation to promote evaluation use across a sector

Multisite evaluation has been cited as a strategy for building knowledge about a program's success and enhancing evaluation capacity and evaluation use. Even so, the extent to which data from these efforts are made available to individual project participants varies. This article describes a community-created multisite evaluation that was designed to overcome this limitation. Based on the negotiated centralized evaluation model and implemented within the context of a community of practice, the EvalFest community-created multisite evaluation has used shared measures to collect data from 30,000 participants from partner sites across the community over three years. This article describes the design characteristics of the community-created multisite approach, and presents results related to partners’ evaluation use that demonstrate the early success of this method. We conclude by considering how this strategy might be applied to other sectors.