Child sexual abuse programs: Recommendation for refinement and study

Child assault prevention programs have increasingly been instituted in school systems throughout the country. this paper reviews and summarizes research findings on child abuse, child abuse prevention programs, and evaluations of child abuse prevention programs. In addition, the author presents issues for program developers to consider as they re-examine and refine existing child abuse prevention programs.     

The devil is in the details: examining the evidence for "proven" school-based drug abuse prevention programs

In an effort to promote evidence-based practice, government officials, researchers, and program developers have developed lists of model programs in the prevention field. This article reviews the evidence used by seven best-practice lists to select five model prevention programs. The authors' examination of this research raises questions about the process used to identify and publicize programs as successful. They found limited evidence showing substantial impact on drug use behavior at posttest, with very few studies showing substantial impact at longer follow-ups. The authors advocate additional long-term follow-up studies and conclude by suggesting changes in the procedures for developing best-practice lists.     

The complexity of roles in community action projects: The example of the evaluation of ‘alternatives’

Evaluation of community interventions is a special form of evaluation involving many roles that are key to accomplishing both the intervention and the accompanying research. The present paper describes the roles involved in the evaluation of a community intervention (‘Alternatives’) aimed at safer use of alcohol and depressant medications by seniors.The three core roles were the community developer who provided leadership in the implementation of the project, the researcher/evaluator, and the community committee that sanctioned and facilitated the project. Other roles on the project included: the project coordinator, the nurse-interviewers who collected the survey data for the evaluation, volunteers from seniors groups, local health service providers, the media, the funders, and others on the project team who provided specific technical expertise.The paper describes the competing interests among these roles as well as conflicts that arose and how these conflicts were handled. Although specific roles are described, the types of roles and the potential for competing interests and conflict are generally relevant to community level evaluations.     

The myths and politics of housing in Hong Kong: The controversy over the demolition of the Hunghom Estate

This paper explores the post-handover surge of civic activism in Hong Kong by examining the controversy over the demolition of the Hunghom Estate—a government subsidized housing project that was sold to private developers during a recession in early 2004. In a departure from “business as usual,” the high-profile demolition was stopped 10 months later after a series of protests mobilized by environmental activists. This result was widely hailed as a triumph of corporate responsibility and environmental consciousness. By tracing the competing narratives over the course of the controversy, this paper attempts to elucidate this “success” story by revealing the inherent conflicts between different stakeholders, and how these narratives nevertheless share and sustain a number of long-held myths about Hong Kong's economy and housing market. It argues that these myths obscure the ongoing political choices of an interventionist administration, which maintains legitimacy by tightly controlling urban development and securing support from powerful economic actors. By connecting the various claims of the present case with historic discourses of the territory, the paper aims to shed light on the power relations embedded in the development policies that characterized Hong Kong over the colonial period, and which continues to shape the practices of housing in the present.     

A Review of Multicomponent Interventions to Prevent and Control Tobacco Use Among College Students

Abstract

Objective: Multicomponent tobacco control programs have been implemented at the state and community levels and have led to a reduction in tobacco use. The purpose was to review the public health research literature on tobacco prevention and control programs on college campuses and derive evidence-based implications for comprehensive program implementation. Methods: MEDLINE, PsycINFO, ERIC, and PubMed databases were used to search the research literature concerning tobacco prevention and control programs conducted on college campuses published between 2000 and 2009. Results: No studies were found that implemented all 5 recommended components of a comprehensive program. Tobacco control programs containing policy and prevention education were used the most and promotion of tobacco-free environments and banning sales of tobacco products were used the least. Conclusion: The review suggests that despite the recommendation of comprehensive tobacco control programs to reduce tobacco use on college campuses, few institutions have implemented and evaluated programs consisting of multiple components.     

Systematic review of primary prevention human papillomavirus interventions targeting college students

ABSTRACT. Objectives: The purpose of this research was to systematically analyze human papillomavirus (HPV) interventions targeting college students. Methods: Completed interventions targeting general HPV prevention, HPV vaccine uptake, or antecedents of HPV vaccination uptake that used any quantitative design, published from January 2000 to January 2014 in the English language, were reviewed. Results: Twelve interventions met the criteria. Ten interventions produced 1 or more significant outcomes on primary or secondary variables of interest. Conclusions: Efficacy of interventions can be enhanced through tailoring materials and pretesting by sex, operationalizing theories, incorporating process evaluations, employing HPV vaccine uptake outcome measures, and utilizing Web-based delivery of programs.     

Are cost-inclusive evaluations worth the effort?

Relative costs are as important as relative effectiveness when choosing between program alternatives or among a set of programs competing for scarce funds. Nevertheless, the number of cost-inclusive evaluations remains comparatively small. This article presents the results of three first-time cost-inclusive evaluations each performed by an experienced evaluator. Each evaluator performed a different type of cost-inclusive evaluation using different tobacco control programs as examples: "standard" cost-effectiveness analysis, threshold or break-even analysis, and a simulation model. Results are presented in terms of the challenges faced, and informational and insight benefits gained, as well as in terms of program cost-effectiveness. All three evaluators agreed that the benefits from performing cost-inclusive evaluations are well worth time and effort involved. They also found that this type of evaluation provides abundant information that can be used to improve program effectiveness and cost-effectiveness.     

Non-formal educator use of evaluation results

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use.Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study.Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs.     

Program decisions : Evaluating a bird in the hand versus two in the bush

In new programs that have not reached full effectiveness, or in programs that are designed to produce future benefits (i.e., become “institutionalized”), evaluations that fail properly to assess future performance may bias decisions against the programs. For such programs, consideration of future benefits may significantly enhance the assessment of their cost-effectiveness. This paper describes an evaluation methodology based on decision theory that can take future benefits into account in evaluating a program. The methodology was applied to the Metropolitan Atlanta Crime Commission (MACC) Community Anti-Crime Project and indicated the potential for substantial future benefits subsequent to cessation of federal funding. The implications of use of this methodology and the MACC results for the overall Community Anti-Crime Program are also discussed.     

Challenges in evaluating programs serving homeless families

Homeless families, usually headed by single mothers, are the fastest growing segment of the homeless population. Although families with children make up a large percentage of those experiencing homelessness, there have been few studies on the effectiveness of services for homeless families offered by shelters transitional housing programs, and other agencies. This article summarizes the research that has been conducted on families that are homeless and the limitations of this research for program evaluation. Challenges to program evaluation are identified: the lack of published studies in the area; the fact that program evaluation is rarely built into programs or funded; the methodological issues in tracking families; the difficulty in assessing the impact on families; implementation issues; the range of barriers to housing stability faced by homeless families; and changes in society at large that influence the results of evaluation. Six recommendations are made for meeting these challenges: evaluation from a coherent theory of change; setting reasonable and differential expectations for clients; strengthening linkages with other agencies that serve the same client population; increasing the emphasis on follow-up; utilizing prevention efforts to reduce the number of families that become homeless; and working for expanded low-income housing and expanded subsidies.     

Therapeutically Managing Reunification After Abuse Allegations

School-based programs have been the central strategy to educate children about the serious nature of child sexual abuse in the hope of prevention or early intervention. Virtually all evaluations have been quantitative, seldom allowing children to directly comment on their experiences. This article presents the results of qualitative research with 116 students (51 boys and 65 girls) ranging from age 6 to 12 who had participated in the Who Do You Tell child sexual abuse education program. Ten focus groups were conducted with students in separate grades, from kindergarten through sixth grade, two to three months after program participation. The core themes that emerged from the focus group interviews are presented, as are implications for child sexual abuse prevention programs.     

A content analysis of sexual health and substance use information presented on study abroad websites: Findings and recommendations

Abstract

Objective: Despite study abroad students frequently engaging in risky behaviors, there is a dearth of research exploring prevention efforts taken by study abroad programs. The goal of this project was to examine information presented on study abroad program websites regarding sexual assault, alcohol use, drug use, and risky sexual behavior. Participants: A total of 753 universities in the US were selected from the Carnegie Classification of Institutes database. Method: Coders evaluated the website of each institution’s study abroad program for the presence of information about the four factors of interest. Results: Sixty-seven percent of the websites provided no information on any of these risk behaviors. Chi-square analyses revealed institutional demographic differences in the presentation of prevention information. We also identified three emerging themes about avenues for modifying website content. Conclusion: Study abroad programs can provide more detail and action oriented information on their websites for students.     

The Effectiveness of Educational Programs to Improve Recognition and Reporting of Elder Abuse and Neglect: A Systematic Review of the Literature

Health professionals often lack adequate protocols or knowledge to detect, manage, and prevent elder maltreatment. This systematic review describes and evaluates existing literature on the effectiveness of educational interventions to improve health professionals' recognition and reporting of elder abuse and neglect. Fourteen articles described 22 programs ranging from brief didactics to experiential learning and targeted a variety of health and social service audiences. Most evaluations were limited to satisfaction measures. These programs may result in increased awareness, collaboration, and improved case finding. However, using the published literature to guide new program planning is constrained by lack of details and limited evaluations.     

Program evaluation of services for the homeless : Challenges and strategies

The rapid growth of the homeless population in North America has given rise to a sharp increase in the number of task forces and studies aimed at setting up either programs for the homeless, or policies for controlling the phenomenon. Whenever there is a need for program evaluations in this process, numerous methodological and strategic challenges have to be faced. Due to the characteristics of the clientele, evaluation studies of services for the homeless call for innovative approaches. This paper reviews the research strategies (types of evaluations, designs, and indicators) that have been developed to assess programs for chronic inebriates and mentally ill homeless. The findings from previous evaluations are then summarized and their consequences for evaluation practice are considered.     

Decision-making in Social Work Field Education: A “Good Enough” Framework

This qualitative study was designed to explore decision-making processes used by directors of field education in social work programs in the USA. It is a follow-up to previous research showing the dilemmas that field directors face [specifics deleted to maintain the integrity of the review process]. We asked 22 field directors to explain how they would handle different dilemmas designed to simulate the kinds of issues that typically arise in field education. Analyses revealed that field directors use a four-dimensional decision-making process to address competing demands, employing a ‘good enough’ framework. The four dimensions include student learning, professional ethics, agency relationships, and administrative expectations.     

A multi-level examination of how the organizational context relates to readiness to implement prevention and evidence-based programming in community settings

Prior theoretical and empirical research suggests that multiple aspects of an organization's context are likely related to a number of factors, from their interest and ability to adopt new programming, to client outcomes. A limited amount of the prior research has taken a more community-wide perspective by examining factors that associate with community readiness for change, leaving how these findings generalize to community organizations that conduct prevention or positive youth development programs unknown.Thus for the current study, we examined how the organizational context of the Cooperative Extension System (CES) associates with current attitudes and practices regarding prevention and evidence-based programming. Attitudes and practices have been found in the empirical literature to be key indicators of an organization's readiness to adopt prevention and evidence-based programming. Based on multi-level mixed models, results indicate that organizational management practices distinct from program delivery may affect an organization's readiness to adopt and implement new prevention and evidence-based youth programs, thereby limiting the potential public health impact of evidence-based programs. Openness to change, openness of leadership, and communication were the strongest predictors identified within this study. An organization's morale was also found to be a strong predictor of an organization's readiness. The findings of the current study are discussed in terms of implications for prevention and intervention.     

The unique character of involvement in multi-site evaluation settings

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site program evaluations, traditional notions of participatory evaluation do not apply. The purpose of this research is to determine the ways in which stakeholders are involved in large-scale, multi-site STEM evaluations. This article describes the findings from a survey of 313 program leaders and evaluators and from follow-up interviews with 12 of these individuals.Findings from this study indicate that attendance at meetings and conferences, planning discussions within the project related to use of the program evaluation, and participation in data collection should be added to the list of activities that foster feelings of evaluation involvement among stakeholders. In addition, perceptions of involvement may vary according to breadth or depth of evaluation activities, but not always both. Overall, this study suggests that despite the contextual challenges of large, multi-site evaluations, it is feasible to build feelings of involvement among stakeholders.     

Political and organizational preconditions for application of the standards for educational evaluation : The standards for educational evaluation seen in a wider perspective in relation to policy making and organization

Some of the standards for educational evaluation refer to the political and organizational context in which evaluation projects take place: “conflicting interests,” “political viability,” and various standards which have to do with the identification of the evaluation object and of the most important groups and persons involved. Whereas the Joint Committee on Standards for Educational Evaluation seems to focus on the level of the individual research project, the present authors feel that in addition, contextual influences on evaluations should be analyzed at a higher level of aggregation. Political and organizational factors at the macro level can even be seen as preconditions for the application of the standards at project level. This point of view is illustrated by referring to a study of the functioning of evaluation research within some innovative programs in Dutch education.     

The quality of evaluations of foster parent training: An empirical review

A comprehensive literature review was undertaken to identify published evaluations of foster parent training programs (pre-service, in-service single session, and in-service multi-session). Results of the review of the literature revealed that few evaluations have been conducted on the preservice training programs most widely used and the results are mixed at best in the evaluations conducted. Moreover, the best evaluations of in-service training were for the programs least likely to be offered to foster parents: multi-session programs. Taken together, the results point to gaps in the knowledge base and directions for future research.