Implementation and process evaluation of a school-based drug abuse prevention program: Project Towards No Drug Abuse

The present study provides an implementation, process, and immediate outcomes evaluation of the classroom component of Project Towards No Drug Abuse (TND). This project involves development and evaluation of a school-based drug abuse prevention curriculum for continuation high school youth, who are at relatively high risk for drug abuse. Three randomized conditions were evaluated: a standard care, classroom only, and classroom plus school-as-community. The latter condition was an enhanced school-based condition which involved outside-of-classroom meetings and activities. Implementation was high in both program conditions even though this was a higher risk context. Process evaluation data were favorable and did not vary between the two program conditions. Immediate outcomes data (knowledge) was higher in the two program conditions than in the standard care condition. Regarding the classroom program, addition of extra-classroom activities does not appear to alter the quality of delivery of the program.     

Teachers' delivery skills and substance use prevention program outcomes: the moderating role of students' need for cognition and impulse decision making

The purpose of this study was to extend the literature in both substance use implementation and persuasive health communication by examining the extent to which students' need for cognition and impulsive decision-making moderated the relationship between teachers' classroom communication behavior and program outcomes in an evidence-based middle school substance use prevention curriculum. Participants included 48 teachers and their respective 7th grade students who participated in a randomized trial testing the effectiveness of personal coaching as a means to improve the quality with which teachers implemented the All Stars curriculum. Need for cognition and impulse decision-making were both associated with positive changes in lifestyle incongruence and commitments to not use substances for students whose teachers displayed greater interactive teaching. Further, need for cognition was associated with lower alcohol use rates while impulse decision making related to lower rates of marijuana use in classes with interactive teaching.     

Evaluation of the All Stars Program: student and teacher factors that influence mediators of substance use

The authors examined the relationship between students' perceptions of a problem behavior prevention program, All Stars, and changes in the program variables. Three factors--Program Enjoyment, Student Engagement, and Teacher Relationship--were used to predict changes in the four variables targeted by the All Stars program. Student Engagement was related to greater changes in student idealism, commitment, and bonding. Program Enjoyment was related to positive changes in student idealism and normative beliefs. Teacher Relationship had little impact on the program variables. Students who were taught All Stars by regular classroom teachers reported greater Program Enjoyment and Student Engagement than students taught by health education specialists.     

Impact of an Intergenerational Program on 4th Graders' Attitudes Toward Elders and School Behaviors

Abstract

The rapid growth of the elderly population coupled with research demonstrating the existence of ageist stereotypes even among very young children have led to the rise of intergenerational programs. Very limited research has been conducted, however, to demonstrate the effectiveness of these programs in producing attitudinal change or other beneficial outcomes for at-risk children. This study examined the impact of an intergenerational program on children's attitudes toward elders and on their school-based behaviors. Eighty-one 4th grade children enrolled in an inner-city school participated in the study. Forty-one children, with matched seniors partners, engaged in activities based on the 4th grade core curriculum within an outdoor classroom environment while the remaining 40 children participated in usual core curriculum activities. At the conclusion of the program those children who participated in the program had significantly more positive attitudes towards the elderly and significantly better school behavioral grades than did non-participating students. Implications and recommendations for intergenerational programming are discussed.     

Impact of an Intergenerational Program on 4th Graders' Attitudes Toward Elders andSchool Behaviors

Abstract

The rapid growth of the elderly population coupled with research demonstrating the existence of ageist stereotypes even among very young children have led to the rise of intergenerational programs. Very limited research has been conducted, however, to demonstrate the effectiveness of these programs in producing attitudinal change or other beneficial outcomes for at-risk children. This study examined the impact of an intergenerational program on children's attitudes toward elders and on their school-based behaviors. Eighty-one 4th grade children enrolled in an inner-city school participated in the study. Forty-one children, with matched seniors partners, engaged in activities based on the 4th grade core curriculum within an outdoor classroom environment, while the remaining 40 children participated in usual core curriculum activities. At the conclusion of the program those children who participated in the program had significantly more positive attitudes towards the elderly and significantly better school behavioral grades than did non-participating students. Impli-     

Time-on-task, technology and mathematics achievement

Information and communication technologies hold much promise for use in education in developing countries. This study reports on an evaluation conducted on the introduction of computers in the delivery of the mathematics curriculum in one of the provinces of South Africa. Although the request was for an outcome evaluation very early in the implementation of the program, it was tailored in such a way as to fulfill a more formative role. Despite substantial variability in implementation, and in most cases with very weak exposure of the learners to the intervention, sufficient evidence emerged to indicate that this mode of curriculum delivery may be effective. Improvement in mathematics performance was related to a range of variables: some concerned classroom teaching practices, some referred to social differences between the learners, and some to the specific intervention. The strongest of these predictors in the sample was the strength of the intervention: the more time learners spent on using the software to study mathematics, the more improvement they showed from 1 year to the next in their performance in the subject.     

The Effect of Teacher's Feedback in EFL Teaching

Teacher feedback is a very common phenomenon in classroom teaching.Teacher feedback is an important part for classroom communication.It is an essential link to optimize the teaching and learning to achieve a harmony and unity.It is necessary to study.This paper mainly analyses the definition of teacher feedback and the effect of teacher feedback.     

Process evaluation of “Girls on the Run”: Exploring implementation in a physical activity-based positive youth development program

Many positive youth development programs rely on physical activity as a primary program component. Referred to as physical activity-based youth development programs, these program designs have great potential for promoting healthy youth development. This study examined how one such physical activity-based positive youth development program was implemented in order to identify design features critical to maximizing positive youth outcomes. This mixed method, multi-site process evaluation of Girls on the Run (GOTR) utilized focus groups, site visits, and self-report implementation checklists. Implementation scores were calculated to assess implementation fidelity across twenty-nine sites, and qualitative data were inductively analyzed to identify factors influential for implementation. Results reveal variability in how GOTR was implemented. Five themes emerged from the data that represented factors serving as facilitators or barriers to programmatic implementation. These included contextual/environmental factors (e.g., parental involvement, relationships with school personnel), organizational factors (e.g., implementation support and responsiveness of staff), program-specific factors (e.g., curriculum design), coach factors (e.g., existing relationships with participants, responsiveness to participant's needs), and youth factors (e.g., behavioral and discipline issues). Study findings have implications for improving the design of physical activity-based and other positive youth development programs, with relevance to evaluators, program planners, youth development leaders, and others working with children and youth.     

An evaluation of immediate outcomes and fidelity of a drug abuse prevention program in continuation high schools: project towards no drug abuse (TND)

The present study provides an implementation fidelity, process, and immediate outcomes evaluation of Project Towards No Drug Abuse (TND), a drug prevention program targeting continuation high school youth (n=1426) at risk for drug abuse. A total of 24 schools participated in three randomized conditions: TND Only, TND and motivational interviewing follow-up, and no treatment control. Fidelity was high: across program schools the curriculum was implemented as intended and was received favorably by students. Relative to controls, intervention conditions produced effects on hypothesized mediators, including greater gains in program related knowledge, greater reductions in drug use intentions, and positive changes in motivation. However, few generalizations to attitudes and intentions regarding risky sexual behavior were found. The pattern of results suggests that the experimental manipulations worked as intended.     

The relationship between implementation fidelity and educational outcomes in a school-based family support program: development of a model for evaluating multidimensional full-service programs

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of multi-component family support programs for improving educational outcomes for at risk youth, and to assess the relationship between program implementation and outcomes. The qualitative evaluation involved prolonged engagement to identify common program domains or mediators. Using a method called Innovation Configuration Analysis, levels of implementation of program domains were explicated as well as an overall Implementation Fidelity Index. Strong positive relationships were found between overall program implementation and program-level outcomes achieved by student participants.     

Looking Inside the “Black Box”

Abstract

The continued devolution of social welfare systems and services in the U.S. resultsin high stakes program evaluations in the field of family support and early intervention. Programs are expected to utilize evidence-based interventions and to demonstrate effectiveness. A look at implementation helps to differentiate between theories that do not work and programs that are not effective. Methods for identifying program implementation are needed. In a 17-site program evaluation, the author and her colleagues developed a methodology for measuring implementation and demonstrated the effects of differential implementation in understanding program outcomes.     

An evaluation of the fidelity of implementation of a school-based drug abuse prevention program: project toward no drug abuse (TND)

This article provides an implementation fidelity evaluation of the fourth experimental trial of Project Towards No Drug Abuse (TND). Two theoretical content components of the curriculum were examined to increase our understanding of the active ingredients of successful drug abuse prevention programs. A total of 18 senior high schools were randomly assigned by block to receive one of three conditions: cognitive perception information curriculum, cognitive perception information + behavioral skills curriculum, or standard care (control). These curricula were delivered to both regular and continuation high schools students (n=2331) by trained project health educators and regular classroom teachers. Across all program schools, the two different curricula were implemented as intended, were received favorably by students, and showed significant improvements in knowledge specific to the theoretical content being delivered. This pattern of results suggests that the experimental manipulations worked as intended, and thus, permit the attribution of future behavioral outcome differences between conditions to differences in content of Project TND material provided rather than to differences in the fidelity of delivery. Further, our findings indicate that Project TND can be implemented effectively with low and high risk youth in a general environment as well as with high risk youth in a more specialized environment.     

Using Active Learning Projects to Teach Research Skills Throughout the Sociology Curriculum

A core element of the sociology curriculum is the methods course, intended to teach students the value of systematic observation and analysis of the social world. However, this one-shot approach to teaching methodological skills is ineffective and not well liked by students or faculty. A more effective approach is the integration of active learning assignments and projects that teach and reinforce these skills throughout the curriculum, from the introductory course to the substantive content courses. This paper describes my experiences with this approach, outlining various activities and research projects used to teach methodological skills. Also highlighted are the outcomes reported by students and the benefits for teaching sociology courses. A discussion of the possibilities for disseminating and using the research beyond the classroom and the strengths and weaknesses of integrating research across the curriculum, as well as several teaching tips are also included.     

Evaluating multicultural curricula in the community college: A sociocultural framework

This paper addresses the need for models for assessing multicultural programs in the community college, the most culturally and socioeconomically diverse educational institutions in the country. A three-dimensional framework presents faculty, student, and curriculum variables critical to the implementation and outcomes of multicultural programs. The framework emerged from the formative evaluation of a new interdisciplinary social science curriculum and guided the design of the national field test of that curriculum in 30 community college classrooms. Three kinds of results are reported: implementation patterns; appropriateness to faculty members' teaching goals; and impact on reading behavior, interest, overall learning, and political efficacy of students with diverse ages, ethnic and sociocultural backgrounds, and political positions. Political efficacy gains of older students and students with lower socioeconomic backgrounds are discussed. The importance of such a framework in documenting the interaction between a curriculum and its sociocultural context is stressed.     

Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention

The well-documented disparities in availability, accessibility, and quality of behavioral health services suggest the need for innovative programs to address the needs of ethnic minority youth. The current study aimed to conduct a participatory, formative evaluation of “Working on Womanhood” (WOW), a community-developed, multifaceted, school-based intervention serving primarily ethnic minority girls living in underserved urban communities. Specifically, the current study aimed to examine the feasibility, acceptability, and initial promise of WOW using community-based participatory research (CBPR) and represented the third phase of a community-academic partnership. Qualitative and quantitative data were collected from 960 WOW participants in 21 urban public schools, as well as WOW counselors, parents, and school staff over the course of one academic year. Results demonstrated evidence of acceptability of WOW and noteworthy improvements for WOW participants in targeted outcomes, including mental health, emotion regulation, and academic engagement. Findings also indicated several challenges to implementation feasibility and acceptability, including screening and enrollment processes and curriculum length. Additionally, we discuss how, consistent with participatory and formative research, findings were used by program implementers to inform program improvements, including modifications to screening processes, timelines, curriculum, and trainings – all in preparation for a rigorous effectiveness evaluation.     

Tobacco prevention education in schools for the deaf: the faculty perspective

We report results of a survey of tobacco education practices and perspectives among faculty at four Schools for the Deaf participating in the trial of a tailored tobacco prevention curriculum. Few faculty (20.4%) included tobacco use among the three most important health problems facing their students, although 88.8% considered tobacco education to be worthwhile. Despite perceived unmet needs among their students, classroom or school-wide attention to tobacco prevention was limited. Only 13.9% reported delivering tobacco programming in the prior year, most often reporting lack of deaf-friendly curriculum and materials (60.9%), time (47.8%), and training (43.5%) as barriers to program delivery. Perceptions, attitudes, and institutional issues, including lack of tailored curriculum, were seen as contributing to the limited focus on this important health problem.     

‘Tell Me and I Forget,Teach Me and I May Remember,Involve Me and I Learn. And That's What It's About.’ How a Co‐design Methodology is Used in the Delivery of Parents Building Solutions: A Qualitative Study

There are many parenting programs delivered in Australia and Parents Building Solutions (PBS) is one of these. Collaboratively designed by Parentzone staff of Anglicare Victoria, it has a twenty year history of building the evidence base. PBS stands apart from other programs because parents actively co‐design the sessions and content with skilled facilitators. Understanding the drivers, processes and practices that make the co‐design methodology work, is fundamental to the implementation science that underpins the program.This study aimed to examine the way co‐design was used in the delivery of PBS, specifically looking at program implementation and outcomes. Focus groups and interviews were conducted with Parentzone staff (team leaders and facilitators) and parents who had recently completed a program. Ethics approval was provided and analysis was conducted using NVivo software with co‐design as the unit of analysis. Three major themes about co‐design were present across team leaders, facilitators and parents: 1) responsiveness and flexibility are central to the functionality of co‐design within PBS; 2) facilitators implement the co‐design methodology using a suite of knowledge and skills; and 3) parents report tangible results from participating in a co‐designed parenting program. There was an overwhelming appreciation from both facilitators and parents about the co‐designed implementation style. Facilitators and team leaders highly valued the flexibility of the program which enabled their ability to respond to parent's needs. Furthermore, parents believed they achieved tangible outcomes derived from strategies and support delivered in the program. The co‐design methodology used in PBS was evident for all stakeholders and was a driver of program implementation and its outcomes. The methodology described in this has practice implications for family therapists and others who work directly parents and families.     

Response to Dean Bardill

Increasing demands for the accountability of social work education necessitate better methods of program assessment. In the technique described here, tested by a BSW program in 1992 and 1993, a Program Assessment Committee was formed to evaluate the collective work of randomly chosen seniors on three assignments. The results revealed strengths and weaknesses of the program and led to a reexamination of the assignments, the statements of desired program outcomes, and the curriculum itself.