Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use

In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed.     

Process evaluation of “Girls on the Run”: Exploring implementation in a physical activity-based positive youth development program

Many positive youth development programs rely on physical activity as a primary program component. Referred to as physical activity-based youth development programs, these program designs have great potential for promoting healthy youth development. This study examined how one such physical activity-based positive youth development program was implemented in order to identify design features critical to maximizing positive youth outcomes. This mixed method, multi-site process evaluation of Girls on the Run (GOTR) utilized focus groups, site visits, and self-report implementation checklists. Implementation scores were calculated to assess implementation fidelity across twenty-nine sites, and qualitative data were inductively analyzed to identify factors influential for implementation. Results reveal variability in how GOTR was implemented. Five themes emerged from the data that represented factors serving as facilitators or barriers to programmatic implementation. These included contextual/environmental factors (e.g., parental involvement, relationships with school personnel), organizational factors (e.g., implementation support and responsiveness of staff), program-specific factors (e.g., curriculum design), coach factors (e.g., existing relationships with participants, responsiveness to participant's needs), and youth factors (e.g., behavioral and discipline issues). Study findings have implications for improving the design of physical activity-based and other positive youth development programs, with relevance to evaluators, program planners, youth development leaders, and others working with children and youth.     

The Peru Urban Management Education Programme (PEGUP) — linking capacity building with local realities

The development of initiatives for Local Agenda 21 for the cities of Peru, their documentation for the “best practices” programme of HABITAT II, and the demand for a formalized programme of support, capacity building and technical assistance has stimulated the establishment of the Peru Urban Management Education Programme (PEGUP). The PEGUP represents an innovative approach to capacity building, working through different mechanisms of education and training, technical assistance to municipal development of Local Agenda 21 and the promotion of networking and experience exchange. The experiences to date indicate that the set of support mechanisms is in line with the requirements of local governments which need a variety of support on the long road to develop urban management capacities that allow the solution of their urban and environmental problems. PEGUP offers a variety of services which are part of the development strategy of “Forum of Cities for Life” network.     

How Kids Learn to Say the Darnedest Things: The Effect of Multiple Exemplar Instruction on the Emergence of Novel Verb Usage

We report experiments using time-lagged pre- and postintervention designs with (a) 4 first graders with learning delays, and (b) a systematic replication with 3 preschoolers with learning delays. Both experiments tested the effects of multiple exemplar instructional procedures (MEI) on the emergence of untaught past tense emission of novel regular verbs (e.g., jumped derived from jump) and grammatically inaccurate but experimentally correct usage of irregular verbs (e.g., singed derived from sing). Prior to the MEI, none of the children could produce regular or irregular past tense forms to pictures that provided simulated contexts (pictures with backgrounds for past and present tense). MEI provided across the picture contexts for past and present tense used separate training sets of verbs to teach children to form regular past tense. After either 1 or 2 MEI training sets, the children emitted accurate past tense forms of the untaught regular and inaccurate, but experimentally correct irregular verbs. These findings provided an instructional history that resulted in the children''s acquisition of past tense for untaught regular past tense verbs and “creative” errors with irregular tenses. Results are discussed in terms of the research on experimentally induced sources for novel verbal behavior and related interpretations.     

Disclosure of Child Sexual Abuse Among Adult Male Survivors

Men who were sexually abused during childhood are a stigmatized, under-studied, and marginalized population that is at risk for long-term mental health problems. However, many mental health practitioners feel under-prepared and ill-equipped to effectively treat male survivors of child sexual abuse. Furthermore, little is known about factors that may impact the mental health of male survivors such as disclosure of the sexual abuse. The purpose of this study was to (a) describe the disclosure process of male survivors using a lifespan approach, (b) identify disclosure differences based on age and type of abuser, and (c) explore relationships between disclosure attributes and current mental health. Using a large, purposive sample of male survivors (N = 487), the study found that, on average, men delayed telling (M = 21.38 years) and discussing the abuse (M = 28.23 years) for many years. Older age and being abused by a family member (i.e., incest) were both related to delays in disclosure. Most participants who told someone during childhood did not receive emotionally supportive or protective responses and the helpfulness of responses across the lifespan was mixed. Several variables (e.g., timing of disclosure, discussing with a spouse, response to disclosure) were related to current mental health problems. These findings are helpful for clinical social workers who practice with clients from this population. Specific suggestions for improving clinical practice (e.g., assessment, treatment, professional training) are discussed.     

Narrative review of strategies by organizations for building evaluation capacity

Program evaluation is an important source of information to assist organizations to make “evidence-informed” decisions about program planning and development. The objectives of this study were to identify evaluated strategies used by organizations and program developers to build the program evaluation capacity of their workforce, and to describe success factors and lessons learned. Common elements for successful evaluation capacity building (ECB) include: a tailored strategy based on needs assessment, an organizational commitment to evaluation and ECB, experiential learning, training with a practical element, and some form of ongoing technical support within the workplace. ECB is a relatively new field of endeavor, and, while existing studies in ECB are characterized by lower levels of evidence, they suggest the most successful approaches to ECB are likely to be multifaceted. To build the level of evidence in this field, more rigorous study designs need to be implemented in the future.     

A National Survey of Child Advocacy Center Directors Regarding Knowledge of Assessment,Treatment Referral,and Training Needs in Physical and Sexual Abuse

Mental health services are a core component of child advocacy centers in the United States. Child advocacy center directors were surveyed about (a) trauma and posttraumatic stress disorder; (b) referral criteria for treatment of abuse victims; (c) evidence-based treatments for abused children; (d) reliable, valid, and normed measures helpful in assessment; and (e) training needs. Directors accurately identified posttraumatic stress disorder symptoms, but additional symptoms were misidentified. Directors identified best practices for assessment and treatment, but they misidentified non-evidence-based practices. Primary reasons for referral for services included severity of abuse and emotional response of the child. However, referrals based on assessment findings were not a high priority. Directors expressed some training needs for staff consistent with issues identified in the study.     

Capacity-building needs of minority health nonprofits

This article reports on the results of a statewide assessment of the capacity-building needs of organizations that provide health services to ethnic minority groups in Ohio. The research addressed gaps in knowledge about the specific needs of these organizations for improved effectiveness and long-term sustainability. A telephone survey of 659 organizations, supplemented by focus groups with 37 participants in the state's largest cities, indicated substantial need and interest in capacity-building technical assistance in areas such as revenue-generating activities, marketing and public relations, information technology training, program evaluation, and board leadership development. The limited ability of these organizations to pay for the needed assistance creates challenges for planning approaches to meet these vital needs.     

Case study of a health optimizing physical education-based comprehensive school physical activity program

In this article, we report a qualitative case study, in which we examined enablers and barriers related to the development, implementation, and sustainability of a comprehensive school physical activity program (CSPAP) aligned with the Health Optimizing Physical Education (HOPE) curriculum model at a middle school. Literature on program-diffusion and school-university partnerships guided data collection and analysis. Data sources included semi-structured interviews with the program implementation team (n = 9) and the school’s health and physical education teachers (n = 7); a focus group interview with students; documents (e.g., lesson plans), and observations. Constant comparison techniques were used to code and draw out themes from the data. Findings revealed the extensive effort needed for program implementation and highlighted the importance of strong external support mechanisms, conducting needs assessments, and training teachers to market physical activity programming. Partnerships may provide critical support for schools in their efforts to generate and sustain CSPAPs.     

Training child welfare citizen review panel members: A promising approach?

Citizen Review Panels (CRPS) are groups of volunteers mandated by United States federal law to examine policies, procedures, and practices of public (e.g., state) child welfare agencies, and make recommendations for systemic improvements. To date, several researchers have made clarion calls for training frameworks and approaches for CRP members. Despite the federal mandate, millions of dollars in resources allocated to these panels, and the potential to positively impact the child welfare system, no published training frameworks exist. This brief documents the evaluation of an online training for CRP members (N = 21) in one southeastern state. The training was developed based on needs identified in existing CRP literature, and delivered via an online learning platform. A pre-experimental (pre/post) approach was used to evaluate the training. Results indicate a significant improvement in knowledge associated with serving on the CRP, and overall, participants viewed the training as being positively impactful to their work as a CRP member. The brief will provide an overview of the training, evaluation approach, and briefly discuss salient implications derived from the results.     

An Adult Protective Services' View of Collaboration With Mental Health Services

Mental Health Services (MHS) meet mental health needs of older adults through active, outpatient, community-based care. Adult Protective Services (APS) are involved with needs of older adults who have mental disability and mental illness. Adult Protective Services and MHS staff may to work together when they respond to the needs of victims and adults at risk for abuse, neglect, self-neglect, and exploitation. The purpose of this study was to understand effective APS–MHS collaborations (e.g., leadership, organizational culture, administration, and resources in predicting success). A survey that was sent to members of the National Adult Protective Services Association (NAPSA) revealed that both APS and MHS have strong commitments to protecting clients' rights and autonomy, but there appear to be differences between the two with regard to implementation, apparent in cases involving clients with diminished mental capacity who are at imminent risk, but who refuse help. Strengths of APS–MHS collaborations included improved communication and better service for at-risk clients.     

Time preference before and after a risky activity – A field experiment

This paper examines how a risky activity (e.g., skydiving) affects an individual’s time preference related to financial decisions (i.e., wanting to get paid before or after the activity). We found that prior to a risky activity, inexperienced people were more present-oriented, than they were afterwards. Interestingly, the more experienced individuals were, the less likely they were to demonstrate a preference for the present. Our findings suggest that engaging in activities that individuals might find frightening or thrilling (e.g., skydiving; driving faster than the speed limit; going to a mall) could make less experienced actors shortsighted when processing information (considering the present rather than the future), and lead to shortsighted financial decisions. We suggest that the attempt to regulate concerns associated with activities individuals might find frightening affects unrelated, important daily decisions due to a shift in their time preference.     

Collaborative Partnership in Age-Friendly Cities: Two Case Studies From Quebec,Canada

This article aims to explain the collaborative partnership conditions and factors that foster implementation effectiveness within the age-friendly cities (AFC) in Quebec (AFC-QC), Canada. Based on a community-building approach that emphasizes collaborative partnership, the AFC-QC implementation process is divided into three steps: (1) social diagnostic of older adults' needs; (2) an action plan based on a logic model; and (3) implementation through collaborations. AFC-QC promotes direct involvement of older adults and seniors' associations at each of the three steps of the implementation process, as well as other stakeholders in the community. Based on two contrasting case studies, this article illustrates the importance of collaborative partnership for the success of AFC implementation. Results show that stakeholders, agencies, and organizations are exposed to a new form of governance where coordination and collaborative partnership among members of the steering committee are essential. Furthermore, despite the importance of the senior associations' participation in the process, they encountered significant limits in the capacity of implementing age-friendly environments solely by themselves. In conclusion, we identify the main collaborative partnership conditions and factors in AFC-QC.     

Migration,Religion, and Residential Segregation at the Urban Level: The Case of Muslim Migrants in Rome and Milan

This article investigates residential segregation at the intraurban level of migrants in two Italian cities, Rome and Milan, considering religion as a point of reference in light of its pivotal role in terms of identity references for many migrants. The article focuses in particular on Muslim migrants—due to both the magnitude of their presence and complex issues related to their settlement in Italian cities. The analysis shows a low level of intraurban residential segregation of Muslim migrants in both cities, with some relevant differences related to national subgroups (e.g., a higher concentration for people coming from Bangladesh and Pakistan), so that religion seems not yet to be a main driver of residential choice for Muslim migrants. In light of both the low level of segregation of Muslim migrants and some features of Italian urban policies on migration and religion, we argue that residential concentration can currently play a beneficial role in terms of the insertion of migrants in Italian cities and fulfillment of some of their needs (e.g., availability of minority places of worship).     

Equity versus equality: Spectators,stakeholders and groups

Justice figures prominently in a wide variety of economically important contexts that involve both third parties and involved parties, e.g., in environmental regulation, international trade, and legal proceedings. The primary rivals for fairness rules over the distribution of a fixed good are equality and equity (i.e., allocations that are proportional to contributions). This paper reports the results of a dictator experiment in relation to a large variety of factors that might affect these rules, including performance on a real effort task, in-group identity, subject pools, allocative power, cultural orientation and demographic variables. We find impersonal third parties (i.e., Spectators) allocating anonymously for others favor equity. Subjects who share personal stakes anonymously with recipients (i.e., Stakeholders) allocate amounts between equity and equality. Stakeholders, who meet and communicate with their recipients (i.e., In-groups), allocate even more equally than anonymous stakeholders to their own recipients and behave more selfishly toward other subjects (i.e., Out-groups). These findings are robust with respect to subject pool, a measure of culture, and demographic variables, which seldom matter. We conclude that there is considerable agreement about these fairness rules, when parties are well informed, although there remain important differences across subject pools in the willingness to act on those rules.     

Training effects on motor–cognitive dual-task performance in older adults

This systematic review investigated whether healthy older adults benefit from training interventions in motor–cognitive dual-task (DT) situations and which specific aspects of the intervention and/or task selection contribute to training benefits. Training effects were analysed with regard to the training programme (e.g., general ST or DT training) and task conditions (e.g., standing or walking, complexity of secondary cognitive task). Literature was searched via OVIDsp (Medline, EMBASE, PsycINFO). DT studies were included by the following criteria: (1) investigation of at least one motor task, (2) assessment of DT performance outcomes on standing or walking, (3) conduction of an intervention, and (4) investigation of older adults in an experimental–control group design or an old–young comparison. Thirteen studies met all inclusion criteria. Four types of interventions were identified: (1) general single-task (ST) motor training, (2) specific ST motor training, (3) general DT training, and (4) task-related (specific) DT training. For DT standing conditions only DT interventions improved motor performance, whereas DT walking also benefits by ST training. Most benefits on motor and cognitive performance seem to be reached by DT training interventions whereas a GST produced lowest effects. Thus, balance orientated motor and cognitive DT performance in healthy older adults can be improved by performance related exercises. Furthermore, to reach beneficial effects, it seems necessary that the training intervention includes a certain level of exercise load such as rising difficulties, appropriate intensity and duration, a certain level of task specificity, and variable task prioritization. The transfer of training effects into everyday situations needs to be further investigated.     

Dissemination of an evidence-based parenting program: Clinician perspectives on training and implementation

The present study used a qualitative approach to examine clinicians' experiences as trainees of an evidence-based parenting program, parent–Child interaction therapy (PCIT). In order to explore factors related to successful implementation and maintenance of the PCIT program in a community setting, twenty-nine community clinicians completed phone interviews six months to four years after an initial forty-hour PCIT training workshop. Clinicians reported positive experiences with the training, but also described barriers related to agency, client, program, and training factors. Findings suggest that (1) trainees view the core components of PCIT as acceptable and valuable, (2) training costs and problems with third-party reimbursement can impede implementation, (3) clinicians may benefit from training that includes skills in motivation enhancement, and (4) ongoing consultation is valuable to clinicians, although trainees differ in their preferences regarding the manner of delivery (e.g., teleconference, live). This study brings clinicians into the conversation regarding barriers to and facilitators of evidence-based training and implementation.     

Field Note—Developing Suicide Risk Assessment Training for Hospital Social Workers: An Academic–Community Partnership

This article describes 1 large urban pediatric hospital's partnership with a university to provide suicide assessment and management training within its social work department. Social work administrators conducted a department-wide needs assessment and implemented a 2-session suicide assessment training program and evaluation. Respondents (97.8%) indicated that the training was either helpful or very helpful in 8 suicide assessment skill-based domains. All attendees reported positive changes in perceived competence in 6 of 8 skill-based domains. A brief and time-efficient in-service training can be instrumental in augmenting hospital social worker competence in suicide risk assessment practice. This model of training program development, implementation, and evaluation is feasible, evidence-informed, and may be replicated.