The efficacy of a high school rape prevention program in Israel

Sexual violence against women and girls in Israel is rather prevalent. To address this problem, the Association of Rape Crisis Centers in Israel (ARCCI) provides rape prevention programs for middle to high school teens. These programs have been in place for several decades, but their effectiveness has not been evaluated empirically to date. This study seeks to fill this gap by performing an evaluation of one such preventive program. Three hundred and ninety-four 11th graders completed a preintervention and postintervention questionnaire, assessing their rape-related attitudes and behaviors. Results indicate a significant improvement following the workshop in the understanding of what distinguishes rape from mutually consensual relations, along with a substantial shift in many rape-supportive attitudes. At the same time, some victim blaming still remained. Likewise, self-reported behavioral changes were minimal, possibly because of a ceiling effect. Implications for future rape prevention programs in Israel are discussed.     

Applying utilization-focused evaluation to high school hazing prevention: A pilot intervention

Researchers argue that hazing can contribute to an abusive school climate and interfere with a positive learning environment for students. National efforts exist for establishing policies, protocols, evaluation, and education for students, administrators, and staff to prevent hazing at the college level, but this work has yet to be applied broadly in a high school context. In response to this gap, researchers implemented a pilot project at two high schools in Maine that consisted of hazing prevention training and assessment. This paper discusses the design, methods, and lessons learned through this collaborative, utilization-focused, and mixed-method training and evaluation with school personnel and high school student participants.     

Effects on high school students of teaching a cross-age alcohol prevention program

This study examined the impact on high school students who taught elementary students MADD's Protecting You/Protecting Me (PY/PM), an alcohol use prevention and vehicle safety program. High school students (N = 188) enrolled in a peer helping course completed surveys before and after teaching PY/PM, and a comparison group of peer helper students (N = 141) from matched schools completed surveys at the same times. Results indicated that, relative to the comparison group, those exposed to PY/PM gained knowledge of alcohol's effects, increased their perceptions of the risks of high levels of alcohol use, gained teaching skills, and showed less frequent episodes of binge drinking. No effects were found for attitudes toward future drinking, perceptions of the risk of low levels of alcohol use, alcohol use, or vehicle safety. This cross-age prevention program may be successful in changing high school students' knowledge, attitudes, and behaviors regarding high levels, but not low levels, of alcohol use.     

Efficacy of a brief intervention on attitudes to reduce school violence: A randomized clinical trial

There is growing interest in the phenomenon of school violence, which has been associated in diverse works with youth's attitudes towards violence, and it has been the focus of many intervention programs. However, the high human and economic cost entailed can impede its administration in some school centers. Therefore, the goal of the present study is to assess the efficacy of a brief intervention aimed at modifying attitudes towards violence to reduce the phenomenon of school bullying. The sample was obtained from a Secondary Education Institute during the 2010–2011 school term, and was made up of 252 students aged between 12 and 15 years. A controlled and randomized design was used in order to assess the effects of the program “Count on Me.” Ten classrooms were randomly assigned either to the intervention or to a waiting-list. Results show a significant reduction of playground violence perceived by the students, especially among the girls. Implications for the development of future brief programs for the prevention of school violence are discussed.     

Home-based, family-centered intervention: evaluation of a foster care prevention program

A family service agency contributes to the growing literature on a new service area through an analysis of closed cases in its own home-based service program, and compares its findings with other published reports.     

A method to obtain a randomized control group where it seems impossible. A case study in program evaluation

Randomization of program participants into control and experimental groups is often not feasible in field settings. The researcher's desire to evaluate a program with a rigorous experimental design is often incompatible with the objective of serving the expressed needs of the program participants. However, opportunities do arise when a randomized control group can be constructed without disregarding the participants' wish to be included in the treatment group. This article describes a method that uses the participants' compliance to program instructions as a means of classifying participants and, thereby, obtains a randomized control group for a subset of participants. A large smoking intervention project is used to illustrate two variations of this method.     

Portfolio assessment in a collaborative program evaluation: the reliability and validity of a family literacy portfolio

Evaluations increasingly use open-ended assessments, such as portfolios, to gather information about program impact. Portfolios, however, present challenges in achieving acceptable levels of reliability and often lack evidence to support validity. This article describes the components of a portfolio assessment system developed in a collaborative evaluation of a family literacy program. Staff of a family literacy program and two evaluators collaborated to develop the assessment and the tools that frame the review of the portfolios. Rubrics, exemplar portfolios, portfolio logs, and lists of ‘look-fors’ were developed to guide raters in the scoring and to improve the reliability of scores and validity of decisions about the program. Inter-rater reliability for the portfolio assessment was 0.79 for holistic scores and 0.74 for analytic scores. With respect to validity, holistic and analytic scores correlated with criterion measures from 0.50 to 0.59, providing initial evidence of a common construct.     

Effectiveness of a group-based academic tutoring program for children in foster care: A randomized controlled trial

The consistently poor educational achievement of children in foster care has been associated with many negative outcomes including long term poor adult adjustment (e.g., higher rates of suicide, criminality, and substance abuse). The current study was undertaken to improve foster children's academic skills through academic remediation. Across this two year randomized study, 91 children in out of home foster or kinship care, between grades 1 and 8 inclusive, completed the study. One-half were randomly assigned to the 30-week direct-instruction small group tutoring condition, while the other half served as wait-list controls. A statistically significant increase in standard scores was found on reading decoding, spelling and mathematic skills for the children who received tutoring, but no differences were obtained on sentence comprehension. Significant effect sizes, in the small to moderate range, were also found in support of the tutoring condition across these three domains. The implications of these positive findings as they relate to improving educational achievement among children in foster care are discussed.     

The effects of a pedometer-based intervention on first-year university students: A randomized control trial

ABSTRACT

Objectives: To assess the effects of a 12-week pedometer-based intervention on the physical activity behavior, health-related quality of life (HRQOL), and psychological well-being of first-year university students. Participants: First-year university students (N = 184) were recruited during September 2012 and randomly assigned to an intervention or a control group. Methods: Intervention participants were provided with a pedometer, monthly tracking logs, and follow-up e-mails. Control participants received no intervention. Physical activity, HRQOL, and psychological well-being were measured at baseline and post intervention. Data were analyzed using multivariate/univariate analysis of variance (MANOVA/ANOVA). Results: All participants experienced an increase in mild physical activity (p < .01) from baseline to follow-up. The intervention failed to produce significant differences between groups for physical activity (p = .28), HRQOL (p = .80), or psychological well-being (p = .72). Psychological well-being (p < .001), vigorous physical activity (p = .04), and mental health status (p < .001) decreased across the duration of the study. Conclusions: More intensive interventions may be required to elicit physical activity behavior change.     

Implementation and process evaluation of a school-based drug abuse prevention program: Project Towards No Drug Abuse

The present study provides an implementation, process, and immediate outcomes evaluation of the classroom component of Project Towards No Drug Abuse (TND). This project involves development and evaluation of a school-based drug abuse prevention curriculum for continuation high school youth, who are at relatively high risk for drug abuse. Three randomized conditions were evaluated: a standard care, classroom only, and classroom plus school-as-community. The latter condition was an enhanced school-based condition which involved outside-of-classroom meetings and activities. Implementation was high in both program conditions even though this was a higher risk context. Process evaluation data were favorable and did not vary between the two program conditions. Immediate outcomes data (knowledge) was higher in the two program conditions than in the standard care condition. Regarding the classroom program, addition of extra-classroom activities does not appear to alter the quality of delivery of the program.     

Evaluating the effectiveness of a school drug and alcohol prevention curriculum: a new look at "Here's Looking at You, Two"

The article reports on the results of an evaluation of a school drug and alcohol prevention curriculum marketed under the title, "Here's Looking at You, Two." Previous evaluations, unreported in the literature and having unresolved methodological problems, have found that while the program appears effective at transmitting information regarding drug and alcohol abuse, it has not been effective at changing the underlying attitudes and behaviors that, in part, explain substance abuse. Employing a more rigorous methodology, our examination of a relatively large sample across five school districts provides support for previous findings. Over the short-term of one year, the program was particularly effective at transmitting substance information to primary and middle school students. The program, however, produced very little of the expected effect on the underlying attitudes that are critical to changing substance abuse behaviors.     

Influence of a home-based exercise program on the urine pH in elderly female subjects: a secondary analysis of a randomized controlled trial

Background

A low urine pH is a characteristic metabolic feature of metabolic syndrome and type 2 diabetes. The purpose of the current study was to investigate the effects of a 12-week home-based bench step exercise on the urine pH status of elderly female subjects.

Methods

The current study is a secondary analysis of a randomized controlled trial (RCT) in which 59 postmenopausal female subjects were randomized to either the exercise group (n?=?29) or the control group (n?=?30). The subjects in the exercise group were instructed to perform home-based exercises using a bench step at the anaerobic threshold (AT), with a goal of performing ≥140 min/week at home for 12 weeks. The subjects in the control group were instructed to not change their normal lifestyle. Urine was collected after overnight fasting, and the urine pH was measured using a urinary test strip. The inter-group-differences at baseline and the pre-post changes within groups were assessed using the Mann-Whitney U test and Wilcoxon’s signed-rank test, respectively. Additionally, the difference in the post-intervention urine pH levels of the two groups, adjusted for the pre-intervention values (the estimated effect size) and the precision (95% confidence intervals) were investigated using an analysis of covariance.

Results

The pre-post comparison of the urine pH data using Wilcoxon’s signed-rank test showed a significant increase in the urine pH levels of the exercise group (p?<?0.05); there was no significant change in the urine pH levels of the control group. However, the estimated effect size (0.15) was small and the confidence interval straddled 0 (?0.25–0.55).

Conclusions

Based on the results of the current secondary analysis of an RCT, we could not clearly conclude that exercise has a beneficial effect on the urine pH. Further well-designed RCTs should be conducted to determine whether aerobic exercise is truly able to ameliorate urine acidification.

Trial registration

The study was retrospectively registered in the University Hospital Medical Information Network (UMIN) as “Effect of step exercise on aerobic fitness and progression of atherosclerosis in the elderly” under the registration number UMIN 000026743 (the date of registration: March 28, 2017).

     

An evaluation of immediate outcomes and fidelity of a drug abuse prevention program in continuation high schools: project towards no drug abuse (TND)

The present study provides an implementation fidelity, process, and immediate outcomes evaluation of Project Towards No Drug Abuse (TND), a drug prevention program targeting continuation high school youth (n=1426) at risk for drug abuse. A total of 24 schools participated in three randomized conditions: TND Only, TND and motivational interviewing follow-up, and no treatment control. Fidelity was high: across program schools the curriculum was implemented as intended and was received favorably by students. Relative to controls, intervention conditions produced effects on hypothesized mediators, including greater gains in program related knowledge, greater reductions in drug use intentions, and positive changes in motivation. However, few generalizations to attitudes and intentions regarding risky sexual behavior were found. The pattern of results suggests that the experimental manipulations worked as intended.     

An evaluation of retail outlets as part of a community prevention trial to reduce sales of harmful legal products to youth

Communities across the nation have become increasingly concerned about inhalant use and use of harmful legal products among youth because of increasing prevalence rates and deleterious health consequences from abusing these products. The increasing concern of communities about inhaling and ingesting legal products has been coupled with increasing awareness and concern about ability of youth to access and abuse a variety of other legal retail products. There are few examples of scientifically designed community prevention projects that seek to reduce youth abuse of such legal products. This article describes a community prevention trial that is designed to reduce sales of inhalants and other harmful legal products to youth and demonstrates how the retailer component of the trial can be rigorously evaluated. It also shows how data from youth purchase attempts can complement survey data from retailers.     

The priority of justice: a framework approach to ethics in program evaluation

The situations of evaluation are inevitably complex and various, often involving conflicts between ethical principles as well as among aims or stakeholders. To meet this challenge, evaluators and stakeholders need an interpretive framework to clarify the issues at hand and open the way to workable solutions. This paper provides a three-part framework of justice to guide practitioners in this interpretive task.First, evaluation is instituted to serve the public with fidelity to the values, standards, and ideals that characterize it as a profession and as an office deserving the public trust, here called public justice. Second, these requirements evoke and entail the more general demands of fair process, mutual respect, and right action known as procedural justice. Third, the operations of office and just process must serve the public good, meeting the demands of distributive justice that govern the allocation of goods and benefits.This framework takes as a starting point the priority of justice as articulated by John Rawls: “Justice is the first virtue of social institutions, as truth is to thought. A theory however elegant and economical must be rejected or revised if it is untrue; likewise laws and institutions no matter how efficient and well-arranged must be reformed or abolished if they are unjust” (1971, p. 3).     

A short-term outcome evaluation of the "I'm Special" drug abuse prevention program: a revisit using SCAT inventory

In the previous evaluation of "I'm Special" (ISP) drug abuse prevention/education program, the long-term impact was reported. The current study examines the short-term outcome of the ISP to establish a conceptual link between what has been observed longitudinally to the short-term outcome. The evaluation instrument used is children's Self-Concept Attitudinal (SCAT) Inventory. Subjects are the third grade students in the Charlotte-Mecklenburg public schools located in Charlotte, North Carolina. The evaluation design employed is before and after-measurement without a control group. In the absence of a control group, the treatment effect of the ISP is estimated on the basis of individual growth curve models. Through the study, it has been learned that the ISP was able to generate positive changes along six attitudinal dimensions included in the SCAT Inventory. The six scales have shown close relationships to student performance at school: student-teacher relationship; self-esteem, attitude toward school, basic social values, advanced social values, and the perception of family cohesiveness. Of these, the first four scales have shown statistical significance at the .05 level. It is estimated that the ISP is capable of generating a significant amount of positive attitudinal changes on a short-term basis with a time span of about four months between pre- and posttests. These findings are consistent with the conclusions obtained from the longitudinal study where student alcohol and other drug using behavior and other related student problem behaviors were significantly lower among the ISP recipients than non-recipients of the program.     

Increasing college access for youth aging out of foster care: Evaluation of a summer camp program for foster youth transitioning from high school to college

Young people who transition from the foster care system face many challenges including lack of support and other educational barriers. They are less likely to graduate from high school than their counterparts and go on to college yet despite challenges, many succeed and take advantage of higher education programs.In Michigan, a state with one of the highest percentage of youth in foster care, Michigan State University developed a small scale, targeted intervention to help transitioning foster youth achieve their goals of pursuing higher education. Led by the School of Social Work in collaboration with other colleges and disciplines, it was demonstrated that a campus based learning program for transitioning foster youth can help contribute toward a perceived increase in knowledge and information about college life, funding and admissions procedures. The educational process involved peer support, role modeling, mentoring and active learning sessions led by the faculty and students who were often foster care alumni themselves. Leaders and speakers came from a range of disciplines, institutions and organizations. This approach and curriculum contributed to perceptions of the camp as enhancing life skills, self-concept, empowerment and sense of purpose. Consequently, this program contributed to the resilience of those who attended and potentially helped build steps from care to higher education.     

Medical students' and tutors' experiences of directed and self-directed learning programs in evidence-based medicine: a qualitative evaluation accompanying a randomized controlled trial

This qualitative study aims to interpret the results of a randomized controlled trial comparing two educational programs (directed learning and self-directed learning) in evidence-based medicine (EBM) for medical students at the University of Oslo from 2002 to 2003. There is currently very little comparative educational research in this field. In the trial, no statistically significant differences between the study groups were shown for any outcomes considered (EBM knowledge, skills, and attitudes). Further analysis suggests that main reason for the negative trial results was that the majority of students learned equally effectively, whichever program they received, although implementation of the educational programs was not complete because of varying attendance. This study illustrates a stepwise evaluation model that might be useful in evaluating other socially complex interventions.