Challenges and successes to the implementation of a zoo conservation-education program

Zoo conservation-education programs have potential to address biodiversity loss, although evidence of their effectiveness to encourage social change is in its infancy. Moreover, how a program is implemented may influence program efficacy, yet there is little evidence of the factors that shape this process in zoos. Accordingly, through a process evaluation of Zoos Victoria’s ‘When Balloons Fly” (WBF) conservation-education program against marine debris, we identified barriers and enablers to the implementation of the program which can be addressed to improve future initiatives. Between April-May 2018, 24 Zoos Victoria professionals completed an online survey focussed on identifying challenges and successes in implementing WBF. Four participants additionally completed a follow-up telephone interview. Themes were identified and organised according to the model of diffusion in service organisations (Greenhalgh, Robert, Macfarlane, Bate, & Kyriakidou, 2004). Our results illuminate that features of the organisation (e.g., structure, culture) rather than features of individuals (e.g., skills, motivation) or characteristics of the conservation-education program itself (e.g., messaging), were most influential to implementation success. Based on these findings, attention to the organisational context is critical for promoting and evaluating the success of conservation-education programs and must be given significant attention alongside program characteristics and staff capability to deliver them.     

Evaluating the impact of a healthy corner store initiative on food access domains

Healthy Corner Store Initiatives (HCSIs) are one food access strategy that aims to improve food environments by supporting local food stores in expanding their healthy offerings. This study presents the evaluation results from one such HCSI. Fresh Foods Here evaluated its network of eight stores in Columbus, Ohio between November 2013 and August 2014. Data from invoices, inventories, rapid market assessments, and customers surveys were analyzed for evidence of impact on the service delivery and personal domains of food access. For some indicators, initial gains were concentrated between pre- and interim evaluation periods, followed by either a leveling off or decline between interim and post. However, overall results were promising, with increases noted in the number of healthy items ordered by store owners, in daily foot traffic and transactions, and in consumer confidence for certain healthy behaviors. Lessons learned concerning the operation and evaluation of HCSIs are shared.     

Evaluability assessment of a community development leisure program in Spain

This paper presents the results of an evaluability assessment (EA) conducted in Spain. EAs are assessments that minimize the uncertainty and risk inherent in a subsequent evaluation (e.g. an impact or results assessment) that may require excessive resources. We designed our own EA model by combining three theoretical approaches, with a holistic and pedagogic vision of the process and a flexible methodology to enable adaptation to different programs and contexts, thus fostering transferability. The EA was carried using a qualitative methodology: documentary analysis, seven semi-structured interviews with stakeholders, eight direct observation sessions and a check-list for politicians and experts. The outcome report helped promote organizational learning, provided the program with a logical and assessable theoretical model, detected its strengths and helped overcome the barriers to efficient assessment. Based on these achievements, an evaluation of the results was recommended, with repeated pretest-posttest measurements and an equivalent control group.     

On Deriving a Complete Sufficient Statistic

A practical computer program is described for Fisher's randomization one-sample and two-sample tests of location. Two heuristics permit most of the permutations to be counted implicitly rather than explicitly. The heuristics, together with careful program organization, yield a very efficient program.     

Flood Risk Management: Exploring the Impacts of the Community Rating System Program on Poverty and Income Inequality

Flooding remains a major problem for the United States, causing numerous deaths and damaging countless properties. To reduce the impact of flooding on communities, the U.S. government established the Community Rating System (CRS) in 1990 to reduce flood damages by incentivizing communities to engage in flood risk management initiatives that surpass those required by the National Flood Insurance Program. In return, communities enjoy discounted flood insurance premiums. Despite the fact that the CRS raises concerns about the potential for unevenly distributed impacts across different income groups, no study has examined the equity implications of the CRS. This study thus investigates the possibility of unintended consequences of the CRS by answering the question: What is the effect of the CRS on poverty and income inequality? Understanding the impacts of the CRS on poverty and income inequality is useful in fully assessing the unintended consequences of the CRS. The study estimates four fixed‐effects regression models using a panel data set of neighborhood‐level observations from 1970 to 2010. The results indicate that median incomes are lower in CRS communities, but rise in floodplains. Also, the CRS attracts poor residents, but relocates them away from floodplains. Additionally, the CRS attracts top earners, including in floodplains. Finally, the CRS encourages income inequality, but discourages income inequality in floodplains. A better understanding of these unintended consequences of the CRS on poverty and income inequality can help to improve the design and performance of the CRS and, ultimately, increase community resilience to flood disasters.     

Evaluating innovation development among Brazilian micro and small businesses in view of management level: Insights from the local innovation agents program

This research aims to analyze management and innovation patterns among micro and small businesses (MSBs) that participated during 2015–2016 in the Local Innovation Agents (LIA) Program from the Brazilian Micro and Small Business Support Service (SEBRAE). Complemented by factor analyses, two-step cluster analysis was applied on 6674 MSBs’ management dimensions to identify group patterns and statistical tests explored further cluster differences regarding management and innovation dimensions, besides innovation improvement throughout the program. Results were multifaceted. First, complementary factor analyses showed that management dimensions compose one factor with similar loadings, thus in accordance with their predictive importance found in the cluster analysis. Second, two main clusters were identified in terms of management level, which also presented significant differences regarding innovation levels. Third, considering a before-and-after self-comparison, by and large, innovation was significantly improved by both clusters. Fourth, the highest developed cluster presented higher improvement rates in most innovation dimensions, thus benefiting more from the program, except for two marketing-related innovations, which improved similarly by both clusters. Overall, even though the LIA Program was effective to leverage MSBs innovation, higher efficiency rates would be bounded to fewer participating MSBs, and hence policy planners should be aware of this tradeoff.     

Coincidence of role expectations between staff and volunteer members of drug free community coalitions

Community coalitions have proliferated as a means of addressing a range of complex community problems. Such coalitions often consist of a small paid staff and volunteer members. The present study examines one likely contributor to coalition effectiveness: the degree of agreement on role expectations between paid staff and volunteer members. Role confusion occurs when paid staff and volunteers differ in their expectations of who is responsible for accomplishing specific tasks. Staff and volunteer members from 69 randomly selected Drug Free Coalitions in the United States as well as 21 Drug Free Coalitions in Connecticut were asked to respond to an online survey asking about 37 specific coalition tasks critical for effective coalition functioning and the degree to which paid staff and/or voluntary members should be responsible for accomplishing each. Our final sample consisted of 476 individuals from 35 coalitions. Using coalitions as the unit of analysis, we found significant differences between paid staff and volunteer coalition members on nine tasks reflecting four domains: meeting leadership and participation, (2) planning and implementation leadership, (3) publicity/media relations, and (4) logistical functions. Implications of these differences and ways that evaluators could help coalitions deal with differing role expectations were discussed.     

Narrative review of strategies by organizations for building evaluation capacity

Program evaluation is an important source of information to assist organizations to make “evidence-informed” decisions about program planning and development. The objectives of this study were to identify evaluated strategies used by organizations and program developers to build the program evaluation capacity of their workforce, and to describe success factors and lessons learned. Common elements for successful evaluation capacity building (ECB) include: a tailored strategy based on needs assessment, an organizational commitment to evaluation and ECB, experiential learning, training with a practical element, and some form of ongoing technical support within the workplace. ECB is a relatively new field of endeavor, and, while existing studies in ECB are characterized by lower levels of evidence, they suggest the most successful approaches to ECB are likely to be multifaceted. To build the level of evidence in this field, more rigorous study designs need to be implemented in the future.     

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities.This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed.     

Finding the sweet spot: Developing,implementing and evaluating a burn out and compassion fatigue intervention for third year medical trainees

Medical trainees are at high risk for developing burnout. Introducing trainees to the risks of burnout and supporting identification and proactive responses to their ‘warning’ signs of compassion fatigue (CF) is critical in building resiliency. The authors developed and evaluated a burnout and CF program for third year trainees at a Canadian Medical School. Of 165 medical trainees who participated in the burnout and CF program, 59 (36%) provided evaluation and feedback of the program and its impact throughout their year. Participation included self-utilization of a validated CF and burnout tool (ProQOL) across three time-points, workshop feedback, and focus group participation. Results highlighted the importance of 1) Recognizing Individual Signs & Symptoms of Stress, CF and Burnout; 2) Normalizing Stress, CF and Burnout for Students and Physicians; 3) Learning to Manage One’s Own Stress. A decrease in compassion satisfaction and increase in burnout between beginning and end of third year were found. Further outcomes highlighted the importance of learning, living and surviving CF and burnout in clerkship. Emergent theory reveals the important responsibility educators have to integrate CF and burnout programs into ‘the sweet spot’ that third year offers, as trainees shift from theoretical to experiential practice as future clinicians.