Using a participatory evaluation design to create an online data collection and monitoring system for New Mexico's Community Health Councils

We present the collaborative development of a web-based data collection and monitoring plan for thirty-two county councils within New Mexico's health council system. The monitoring plan, a key component in our multiyear participatory statewide evaluation process, was co-developed with the end users: representatives of the health councils. Guided by the Institute of Medicine's Community, Health Improvement Process framework, we first developed a logic model that delineated processes and intermediate systems-level outcomes in council development, planning, and community action. Through the online system, health councils reported data on intermediate outcomes, including policy changes and funds leveraged. The system captured data that were common across the health council system, yet was also flexible so that councils could report their unique accomplishments at the county level. A main benefit of the online system was that it provided the ability to assess intermediate, outcomes across the health council system. Developing the system was not without challenges, including creating processes to ensure participation across a large rural state; creating shared understanding of intermediate outcomes and indicators; and overcoming technological issues. Even through the challenges, however, the benefits of committing to using participatory processes far outweighed the challenges.     

Improving Weight of Evidence Approaches to Chemical Evaluations

Federal and other regulatory agencies often use or claim to use a weight of evidence (WoE) approach in chemical evaluation. Their approaches to the use of WoE, however, differ significantly, rely heavily on subjective professional judgment, and merit improvement. We review uses of WoE approaches in key articles in the peer‐reviewed scientific literature, and find significant variations. We find that a hypothesis‐based WoE approach, developed by Lorenz Rhomberg et al., can provide a stronger scientific basis for chemical assessment while improving transparency and preserving the appropriate scope of professional judgment. Their approach, while still evolving, relies on the explicit specification of the hypothesized basis for using the information at hand to infer the ability of an agent to cause human health impacts or, more broadly, affect other endpoints of concern. We describe and endorse such a hypothesis‐based WoE approach to chemical evaluation.     

幼儿园游戏与教学融合的审思——基于幼儿游戏本质的视角

幼儿园游戏与教学在学前教育研究中一直隶属于两个领域，尽管有学者提出了一些融合设想，但仍难脱二元论范畴。本研究立足于幼儿游戏本质追寻，并把游戏本质作为幼儿园教学的基本内核，游戏内部的自我控制感和教学外部目的性的平衡与结合，正是幼儿园教学的核心特质。这种思路既理清了幼儿园教学特殊性，又有利于打破目前学界对于二者关系的形形色色的二元论认识，有利于促进二者从对立走向统一。     

Explaining how unexploded ordnance clearance enhances livelihoods in the Lao PDR

BackgroundFollowing violent conflict, the continued presence of landmines and unexploded ordnance pose a barrier to rebuilding livelihoods. Mine action removes these explosive remnants of conflict to enable communities to safely return contaminated land to productive use. There is limited understanding, however, of how, why, in what context and in what respects mine action contributes to livelihoods. Yet, such information is required for effective resource allocation, checking underlying program assumptions, understanding benefits and potential harms.MethodsThe evaluation was undertaken in the Lao People's Democratic Republic. It used an interpretive case study design and applied the principles of realist evaluation. Program staff and local government authorities were interviewed (N = 37) and program beneficiaries. In total, 38 individual interviews with program beneficiaries were conducted and eighteen focus group interviews (9 with males, 9 with females), each with 6–9 participants.ResultsThe evaluation identified two main mechanisms through which the program ‘worked’: (1) communication pre- and post-clearance and (2) the delivery of the product (cleared land).ConclusionThe realist approach helped to refine the program theory, highlighted the role of self- and task-efficacy and community communication, assisted in identifying contextual factors that influence outcomes and suggested a revision of expected outcomes.     

‘It's afforded us a huge flexibility’: the impact of ‘Disabled Children's Access to Childcare Pilots’ on families with a disabled child in England

For many parents of disabled children, finding affordable and suitable childcare that meets their needs is very challenging. Research in the UK has shown that parents with disabled children experience barriers not just with cost, but also accessibility, the attitudes of childcare providers and in getting good information about sources of childcare. The Disabled Children's Access to Childcare (DCATCH) pilots was an initiative designed to improve access to childcare for disabled children in England. As part of an evaluation of DCATCH, qualitative interviews were carried out with 38 members of 22 families who had received support from the initiative. All of the families reported positive outcomes and highlighted: a beneficial impact on the parents' capacity to work; enjoyable experiences for the disabled child; increased confidence and independence for both parents and children; and the creation of time for parents to pursue other activities. The results of the DCATCH initiative support other research which argues that whilst cost is a significant factor around childcare choices for families with a disabled child, having confidence in the childcare provider's ability to meet specific needs (including complex health care needs) and providing positive experiences for the disabled child are also key, determining factors.     

基于层次分析法的多媒体教学评价研究综述

从基于层次分析法的多媒体教学评价角度,对教学条件、教学课件、课堂教学效果及实验教学等领域的多媒体教学评价进行了综述研究,就目前这些研究方向存在的问题及其发展趋势进行了点评概括.     

Assumption-aware tools and agency; an interrogation of the primary artifacts of the program evaluation and design profession in working with complex evaluands and complex contexts

Like artisans in a professional guild, we evaluators create tools to suit our ever evolving practice. The tools we use as evaluators are the primary artifacts of our profession, reflect our practice and embody an amalgamation of paradigms and assumptions. With the increasing shifts in evaluation purposes from judging program worth to understanding how programs work, the evaluator’s role is changing to that of facilitating stakeholders in a learning process. This involves clarifying purposes and choices, as well as unearthing critical assumptions. In such a role, evaluators become major tool-users and begin to innovate with small refinements or produce completely new tools to fit a specific challenge or context.We interrogate the form and function of 12 tools used by evaluators when working with complex evaluands and complex contexts. The form is described in terms of traditional qualitative techniques and particular characteristics of the elements, use and presentation of each tool. Then the function of each tool is analyzed with respect to articulating assumptions and affecting the agency of evaluators and stakeholders in complex contexts.     

中国商品流通现代化的模糊综合评价研究

完善了商品流通现代化指标体系,并运用模糊综合法将商品流通现代化指标转换成了指数。研究发现商品流通现代化水平与其区域位置、总体经济实力密切相关,且受到产业结构的影响。同时,通过基于指数的聚类分析得到如下结论:"率先发展型区域"要抓住历史机遇,培养创新型人才,保持领先地位;"积极追赶型区域"要发挥地理优势,打破省之间、行业和部门之间、所有制之间的界限,积极参与各种区域经济合作;"流通欠发达型区域"要进一步推进和实施西部大开发战略,推进物流现代化。     

A monte carlo evaluation of response surface analysis based on paired-comparison data

The use of the logit transformation on paired-comparison data in the weighted least squares analysis of response surfaces for aesthetic qualities of products is discussed. Monte Carlo simulations are employed to investigate the small sample properties of the estimators and test statistics. A secondary objective of the Monte Carlo simulations is the comparison of two transformation procedures. The simulations are of standard-item paired-compar-ison experiments in which ties are not allowed.     

从态度系统探讨英语学术书评的评价策略

以评价理论为框架,选取权威的语言学杂志学术5篇书评为语料,从态度系统的视角对英语学术书评的评价策略进行分析。经统计发现学术书评中蕴含了大量表态度意义资源,但其子系统分布不均匀,其中表情感、判定和鉴别意义的语言资源占表态度意义总资源的比例。因此,学术书评作者通过使用较多的鉴赏资源,判定资源来实现其评论客观公正的意图。