Drug abuse prevention evaluation methodology: a bright future

Drug abuse prevention research findings have been inconsistent. These inconsistencies can be related to several issues including study design and methodology. This article presents consensus recommendations developed to enhance drug abuse prevention evaluation research by a group of prevention researchers and practitioners who met at the National Institute on Drug Abuse in Rockville, Maryland during May 1989. As noted by the number of consensus statements, there was a high level of agreement. After exploring various aspects of evaluating prevention interventions, that agreement was reflected in specific recommendations which are directed to modifying prevention approaches; integrating epidemiologic, etiologic and intervention research methods; and expanding prevention research utilization.     

Using benefit-cost analysis to assess child abuse prevention and intervention programs.

Benefits and costs are discussed when child abuse prevention and intervention programs are proposed and evaluated, but systemic benefit-cost analysis as developed by economists has not been applied to such programs. This article presents the case for using benefit-cost analysis to structure evaluations of child abuse prevention and intervention programs. It presents the basic concept of benefit-cost analysis, its application in the context of assessing these types of child welfare programs, and limitations on its application to social service programs.     

Therapeutically Managing Reunification After Abuse Allegations

School-based programs have been the central strategy to educate children about the serious nature of child sexual abuse in the hope of prevention or early intervention. Virtually all evaluations have been quantitative, seldom allowing children to directly comment on their experiences. This article presents the results of qualitative research with 116 students (51 boys and 65 girls) ranging from age 6 to 12 who had participated in the Who Do You Tell child sexual abuse education program. Ten focus groups were conducted with students in separate grades, from kindergarten through sixth grade, two to three months after program participation. The core themes that emerged from the focus group interviews are presented, as are implications for child sexual abuse prevention programs.     

Psychological Abuse in Family Studies

Abstract

One of the first documented psychoeducational programs to educate college students about the perils of psychological abuse is described. The intervention was designed to help students examine their personal experiences of psychological abuse and consider how the information could be used in their careers. The process of creating the intervention and publicizing it to the campus community is discussed. The content of the intervention, participants, implementation, and evaluation processes are described. Operational definitions and dramatic skits of psychological abuse are described along with historical context and current research findings. Ways of working through psychological abuse, and services available to recover from it, are presented. Evaluation data, immediately after workshop completion and one week later, indicated that participants positively evaluated this intervention and reported both positive attitudinal and behavioral outcomes. Limitations and implications of this psychoeducational program for the prevention of interpersonal violence are discussed.     

The History of Child Sexual Abuse Prevention: A Practitioner's Perspective

ABSTRACT

This article examines the history and current condition of child sexual abuse prevention efforts in the United States, emphasizing the perspective of those engaged in developing and working in such programs. The author argues that child sexual abuse prevention programs had built-in challenges given the topical area as well as the rapid growth of such programs combined with a paucity of resources and, initially, research, to support and inform its growth. Common criticisms of child sexual abuse prevention programs are examined and alternative explanations are postulated to explain certain weaknesses of programs. Finally, the author challenges researchers to broaden their research of sexual abuse prevention efforts beyond single population, single variable (such as knowledge gain) designs to understand more fully what is currently being done nationally to prevent the sexual abuse of children. Additionally, clear broad-based support for prevention in the wider field of child abuse is encouraged to build on the successes of prevention efforts.     

A qualitative exploratory study of substance abuse prevention outcomes in a heterogeneous prevention system

The prevention of abuse of alcohol and other drugs is a concern for parents, policy-makers, educators, and social service professionals. Prevention programs are sponsored by many different types of social and educational agencies using a variety of intervention strategies. This article reports a study of a sample of such programs in the state of Nevada. The overall prevention system in the state espouses a "risk and resiliency" approach to prevention. Focus group methodology was used to study perception of outcomes of these programs from the viewpoints of various program stakeholders (youth participating in the programs, parents of participants and program staff). Analysis of the qualitative data yielded findings about potential outcomes as well as implicit program theories. Implications for future planning efforts as well as further evaluation efforts are discussed.     

CMHS/CSAT Collaborative Demonstration Program for Homeless Individuals

The Collaborative Demonstration Program for Homeless Individuals is providing an opportunity for several community agencies in the United States to explore innovative intervention and treatment strategies to address the needs of homeless people with co-occurring (mental illness and substance abuse) disorders. This cooperative agreement, funded jointly by the Center for Mental Health Services (CMHS) and the Center for Substance Abuse Treatment (CSAT), is a $3 million project supporting programs in various community agencies to develop, document, and evaluate programs for persons who are homeless with co-occurring disorders to be used as models in other communities. The program models include: Assertive Community Treatment, Psychosocial Rehabilitation, Therapeutic Community, and an integrated treatment model. The first phase of the two-phase project funded 16 programs in the U.S. to develop manuals within their primary treatment modalities for homeless people with co-occurring disorders. For Phase II of the project, six of the 16 model programs were competitively selected to demonstrate program impact through formal program evaluation efforts. The data derived from the various projects will be compiled into a compendium of information for state agencies and community service providers throughout the U.S.     

A critical and comparative review of the prevention of drug and alcohol abuse in Israel

The article reviews the various programs and intervention strategies of substance abuse prevention in Israel. It concentrates mainly on the stages of primary and secondary prevention among youth. School-based prevention programs, those designated for detached youth as well as community-based programs, are presented and analyzed. The prevention efforts in Israel are also compared to those in other Western countries. The discussion includes recommendations for future developments in this domain.     

Child sexual abuse programs: Recommendation for refinement and study

Child assault prevention programs have increasingly been instituted in school systems throughout the country. this paper reviews and summarizes research findings on child abuse, child abuse prevention programs, and evaluations of child abuse prevention programs. In addition, the author presents issues for program developers to consider as they re-examine and refine existing child abuse prevention programs.     

Constructing a consensus-based prevention outcome measurement instrument

This article describes Ohio's Prevention Evaluation Project (PEP). The purpose of the project was to develop a process and instrument to assess behavioral and attitudinal outcomes in primary drug abuse prevention programs targeting young people aged twelve to seventeen. One of PEP's principal achievements was the inclusion of community prevention program providers from throughout the state in the evaluation instrument development. The effort produced a self-administered questionnaire to capture data on young peoples' drug use practices, attitudes toward drugs, and problematic behaviors. Most significantly, the product produced was the acceptance and endorsement of community-based programs. The forty-one-item questionnaire has good to excellent reliability for virtually all measures, as assessed by the test-retest method. The instrument is a product of a process that brought together a university-based research team, state alcohol and drug abuse prevention administrators, and representatives of public programs. PEP demonstrates how to productively link service providers, administrators, and evaluators to develop a process for assessing the effectiveness of prevention programs. The process and tools described serve as a model for other communities wanting to evaluate their prevention programming.     

Mentoring as a Bridge to Positive Outcomes for Teen Mothers and Their Children

This paper compares historical and psychosocial realities of teenage parenting to prevailing contemporary myths. The authors explore the negative consequences of current remedies based on these myths. Community volunteer mentoring programs are suggested as a cost-effective intervention that can benefit communities and promote positive outcomes for at-risk pregnant teenagers. The authors suggest strategies for implementation of a community volunteer mentoring program based on an existing program in an urban community health center. Detailed information for social workers in community agencies is provided with regard to community education, recruitment, training, and ongoing support and supervision of mentors; funding requirements; and program evaluation.     

“I didn't know you could just ask:” Empowering underrepresented college-bound students to recruit academic and career mentors

This study investigates a new approach to cultivating mentoring relationships in which adolescents participate in workshops to develop their capacity to recruit mentors and other supportive adults who can help advance their academic and career goals. Drawing on in-depth pre- and post- interviews, research observations, and participant feedback and workshop materials from a pilot intervention conducted with 12 ethnic minority students in their senior year of high school, this study explores whether and how the intervention influenced participants, as well as mechanisms of change. Results suggested that the intervention increased the value students placed on social capital and mentoring relationships, developed their knowledge, skills, and self-efficacy in how to develop such connections, and influenced their interactions with potential academic and career mentors. Although additional research is needed, this study highlights the potential of a relatively low-cost intervention to support underrepresented college-bound students in developing relationships that are crucial to college and career success.     

CMHS/CSAT Collaborative Demonstration Program for Homeless Individuals1

The Collaborative Demonstration Program for Homeless Individuals is providing an opportunity for several community agencies in the United States to explore innovative intervention and treatment strategies to address the needs of homeless people with co-occurring (mental illness and substance abuse) disorders. This cooperative agreement, funded jointly by the Center for Mental Health Services (CMHS) and the Center for Substance Abuse Treatment (CSAT), is a $3 million project supporting programs in various community     

Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use

In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed.     

Strengthening child and youth programs: A look at inter-organizational mentoring strategies

Community-based non-profit organizations rarely have access to research or evaluation evidence to inform their programs and often lack the capacity to gather or use this information independently. In 2016, Wisdom2Action—a network of knowledge mobilization (KMb) experts, policy makers and service providers across Canada—launched an inter-organizational mentorship program to facilitate the implementation and sharing of best and promising practices within community-based programs for young people. This article outlines the findings from a developmental evaluation of eight mentoring relationships. Drawing on the Promoting Action on Research in Health Sciences (PARiHS) model of KMb, we look at mentoring as a type of facilitation that supports the increased use of evidence and evaluation information by non-profit organizations and identify key themes that support effective organizational mentorship in this sector. Findings reinforce the importance of establishing connected relationships and understanding context in mentoring relationships, creating adaptive and responsive work plans, ensuring consistent communication, and maintaining a focus on capacity-building if knowledge mobilization is to occur.     

The unique character of involvement in multi-site evaluation settings

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site program evaluations, traditional notions of participatory evaluation do not apply. The purpose of this research is to determine the ways in which stakeholders are involved in large-scale, multi-site STEM evaluations. This article describes the findings from a survey of 313 program leaders and evaluators and from follow-up interviews with 12 of these individuals.Findings from this study indicate that attendance at meetings and conferences, planning discussions within the project related to use of the program evaluation, and participation in data collection should be added to the list of activities that foster feelings of evaluation involvement among stakeholders. In addition, perceptions of involvement may vary according to breadth or depth of evaluation activities, but not always both. Overall, this study suggests that despite the contextual challenges of large, multi-site evaluations, it is feasible to build feelings of involvement among stakeholders.     

Fostering Higher Education: A postsecondary access and retention intervention for youth with foster care experience

Most youth in foster care aspire to obtain higher education, but face daunting obstacles in doing so. While societal interest and effort to support foster youth in achieving higher education has grown, very few supports have evidence to show that they are effective at improving postsecondary outcomes. In an effort to address the dearth of clearly articulated, evidence-based postsecondary support approaches for foster youth, we have developed Fostering Higher Education (FHE), a comprehensive, structured, and evaluable postsecondary access and retention intervention composed of elements (professional educational advocacy, substance abuse prevention, mentoring) that are either evidence based or promising based on the scientific literature and their ability to address the outcomes of interest. This paper describes the development and youth usability and practitioner feasibility testing of the FHE intervention approach, which was developed through funding from the National Institute on Drug Abuse. Youth usability feedback was primarily positive, with the majority of participants indicating they found the FHE activities interesting and useful, and were comfortable participating in them. Practitioner feasibility feedback was also primarily positive, with almost unanimous ratings of the FHE intervention components as very important to provide to youth and that all would be feasible for an organization to implement, though the mentoring components were seen as slightly less feasible than other components. Next steps and implications of this intervention development process are discussed.     

Cultural Variants and Social Work Practice in India

In social work field education, mentoring is underused and lacks research data. There is a paucity of research that examines the effect mentoring has on social work field directors who administer field programs at the undergraduate and/or graduate level. This exploratory study fills this void by examining the mentoring opportunities and experiences of field directors. The results show that there is a desire by field directors to receive assistance and collaborate with mentors on scholarly activities. The most helpful aspects of mentoring include having a mentor who acted as a sounding board, gave advice on administering the field program, and provided strategies for success. Suggestions for future research on mentoring field directors are presented.     

Feasibility and acceptability of a child sexual abuse prevention program for childcare professionals: comparison of a web-based and in-person training

Recent prevention research has established the efficacy of some child sexual abuse prevention programs targeting adults; however, less is known about the feasibility of implementing such programs. The current study examines the feasibility and acceptability of a child sexual abuse prevention program for child care professionals provided in two different formats: in person and Web based. The sample consisted of 188 child care professionals from a large-scale, multisite, randomized controlled trial. Findings indicate that both in-person and online training formats are feasible to implement and acceptable to professionals. When comparing formats, the in-person format was favored in terms of comfort level and likelihood of sharing information with others. These findings have significant implications for dissemination of child sexual abuse prevention programs for child care professionals.     

A systematic review on community-based interventions for elder abuse and neglect

Elder abuse and neglect is a societal issue that requires prevention and intervention strategies at the practice and policy level. A systematic review on the efficacy of community-based elder abuse interventions was undertaken to advance the state of knowledge in the field. The peer-reviewed literature between 2009 and December 2015 were searched across four databases. Two raters independently reviewed all articles, assessed their methodological quality, and used a modified Sackett Scale to assign levels of evidence. Four thousand nine hundred and five articles were identified; nine were selected for inclusion. Although there was Level-1 evidence for psychological interventions (n = 2), only one study on strategies for relatives (START) led to a reported decrease in elder abuse. There was Level-4 evidence for conservatorship, an elder abuse intervention/prevention program (ECARE), and a multidisciplinary intervention (n = 4), in which one study yielded significant decreases in elder abuse and/or neglect. The remaining three were classified as Level-5 evidence (n = 3) for elder mediation and multidisciplinary interventions. There are limited studies with high levels of evidence for interventions that decrease elder abuse and neglect. The scarcity of community-based interventions for older adults and caregivers highlights the need for further work to elevate the quality of studies.