Evaluation of children's stay in institutions: what is working?

This article presents a double approach: quantitative (about 653 older boys and girls who left special education centers less than 10 years ago) and qualitative (talks with 38 of them). The quantitative study, researching factors of success in special education centers, shows the importance of placement for 3 or 4 years, a later exit between 19 and 21 years, the harm done by many placements, and the importance of collaboration between parents and youth workers. The qualitative study shows the influence on boarders of various types of education adopted in special education centers: the need of adolescents for a normative structure, identification patterns, and progressive responsibility, as well as emotional needs expressed through a quest for parental substitutes. It appears that very heterogeneous groups are anxiogenous for fragile youngsters who are searching for their own identities. Coming in and leaving an institution are particularly delicate and often painful moments, and they must be prepared by the youth workers with very special care.     

The Oral History Rating Scale–Revised: Preliminary Evaluation of a Clinician-Rated Measure of Divorce Potential

ABSTRACT

This study was a preliminary psychometric investigation of the Oral History Rating Scale–Revised (OHRS–R), a therapist-rated measure of married couples' divorce potential based a 90-min oral history interview. Findings suggest the OHRS–R shows promise as a clinical tool. Therapist and observing raters' total OHRS–R scores demonstrated high interrater reliability and discriminated from client reports of psychological functioning (Outcome Questionnaire-45.2) and marital satisfaction (Revised Dyadic Adjustment Scale). Therapist OHRS–R ratings showed evidence of construct validity. Convergence between therapist OHRS–R ratings and a client-reported measure of divorce risk (Marital Status Inventory) was relatively low. Longitudinal research is needed to confirm predictive validity.     

Program Evaluation of “Young at Heart”

Abstract

We conducted a program evaluation study of “Young at Heart,” a Texas (United States) program that places elderly volunteers in childcare settings. The main constructs evaluated in this research-based article are Erikson's generativity (a motivation to guide younger generations) and life satisfaction. We compared four groups of elderly persons on these constructs: Young at Heart volunteers, Meals on Wheels volunteers (who deliver food to other elderly persons and thus gain volunteer experience, but not with children), non-volunteers drawn from the general population of one Texas community, and individuals in the same community who volunteered in a variety of activities (“miscellaneous volunteers”). Our guiding assumption was that volunteering with children would appear to be a clear expression of generativity; we thus hypothesized that YAH volunteers would score highest in it. Contrary to prediction, the miscellaneous volunteers averaged the highest generativity, followed by YAH volunteers. Philosophical and conceptual issues are identified with regard to research on generativity and intergenerational programming.     

Mixed‐Method Evaluation of Continuing Professional Development: Applications in Cultural Competence Training

Continuing professional development has been identified as an important tool for advancing the competence of social workers, yet outcomes of professional development are conventionally evaluated using methods that cannot provide trustworthy information about program effectiveness. This paper suggests that innovations in social research can be applied to strengthen the evaluation of educational outcomes from continuing professional development. The benefits of designing a mixed‐method evaluation of educational interventions are explored by reviewing the experience of implementing a cultural competence continuing professional development workshop series in Toronto, Canada. Review of the process demonstrates that the combination of methods results in a richer data set that can answer questions about both the process of the learning experience, and the effect that training has on professional practice.     

Teaching Note—A Call for Including Theories of Evaluation in Program Evaluation Courses Taught in Schools of Social Work

ABSTRACT

Many schools of social work offer courses on program evaluation. However, one component of program evaluation—theories of evaluation—may all too often be left out of the curriculum. This Teaching Note defines and describes evaluation theory and the benefits of including it in a program evaluation curriculum in schools of social work. Specific ideas for incorporating this content into MSW and doctoral courses in schools of social work are provided.     

The Impact of Using Personal Learning Audits as a Means of Preparing Students for Practice: A Small‐Scale Evaluation

This paper examines the ‘effectiveness’ of a tool used by students to enable them to reflect upon their skill, knowledge and abilities in order that they can prepare for direct practice. The evaluation of the Personal Learning Audit (PLA) was carried out with a cohort of students on the part‐time BA/DipSW programme at Glasgow Caledonian University and was based on a direct practice placement undertaken between April and August 2005. The research was based on a range of methods that considered both the participants' perception of the PLA and its impact on their written work on placement. The intention of this mixed method approach was to obtain outcomes at a number of levels in relation to the efficacy of the tool. While the findings have to be considered in the context of the small‐scale nature of the research, the evidence of this study suggests that the PLA process is at its most effective when fully integrated into the students' learning structures both within the placement and the university setting.     

Exploring the Potential of Shadow Controls in the Evaluation of Children’s Services

This article describes and presents a framework for an under‐used evaluation technique in the context of an evaluation of a programme for disaffected young people. Shadow controls—the use of expert judgement to estimate the success of a programme—are often dismissed in research design as an unreliable form of comparison, but can be useful in situations where there is limited scope for a control group or to enhance the causal inference attributable to non‐experimental evaluations. The exercise described uses a practice tool as a structure for making predictions about the situations of the young people on the programme, assuming they do not receive an intervention. These predictions (shadow controls) are then compared to outcome data for the young people at the end of the programme. The results of the exercise provide some important messages about the programme’s effectiveness and the potential for strengthening non‐experimental evaluation methods. The article also discusses how the method can usefully inform evaluations of social programmes and encourage agency and user collaboration.     

Knowledge and Behavioral Impact of Adult Participation in Child Sexual Abuse Prevention: Evaluation of the Protecting God’s Children Program

ABSTRACT

This article presents findings from an evaluation of a popular adult training program (Protecting God’s Children) used in Catholic institutions, including schools, churches, and social service agencies. The study explores knowledge and behavior change based on pretest/posttest questionnaires administered to over 500 adults and follow-up questionnaires sent six months after the training. The participants in the training were compared to a control group of adults who did not participate in the program. The results indicate that participants arrive at the training with fairly high rates of preexisting knowledge but that the program increases knowledge across demographic groups. Follow-up surveys suggest that the new knowledge is retained over six months. The study indicates that the program is associated with an increase in participants talking to their own children about child sexual abuse. Participants also report sharing information with other adults and monitoring behavior around children more closely.     

Evaluation of school‐based AIDS education curricula in San Francisco

Students in 3 middle (n=385) and 3 high schools (n=254) in the San Francisco Unified School District participated in the evaluation of an AIDS education curriculum. Classes within‐schools were designated as either intervention classes or nonintervention classes. Students in intervention classes received 3 class periods of AIDS instruction with a newly developed curriculum. Students in nonintervention classes did not receive any special AIDS instruction. All students completed a pretest and posttest AIDS knowledge and attitude survey. The results indicated that AIDS instruction classes demonstrated a significant knowledge‐advantage, as well as change in attitudes (e.g., reflecting greater tolerance for attending class with students who may have AIDS or HIV infection).     

Fathers’ Perspectives on Strengthening Military Families: A Mixed Method Evaluation of a 10-Week Resiliency Building Program

A recent Institute of Medicine report on “The Assessment or Readjustment Needs of Veterans, Service Members, and Their Families” http://nationalacademies.org/hmd/Reports/2013/Returning-Home-from-Iraq-and-Afghanistan.aspx, (2013) underscored the need for effective support for military families with young children, and that effective engagement into existing services remains a challenge. This mixed-method study involved 14 fathers (previously deployed military) who engaged in the Strong Military Families Program, a resiliency-building group for families with young children. The purpose of this paper was twofold: first, to identify the efficacy of this brief intervention for reducing mental health symptomatology among previously deployed military fathers who completed the group, and second to better understand the perceptions and reflections of fathers who completed an effective symptom management program in order to fill the literature gap around this issue and guide future efforts at increasing engagement of this population. Pre- and post-group assessments were administered including depression and posttraumatic stress symptom ratings. Assessments also included interviews designed to elicit fathers’ expectations before the program and to capture their reflections after completion. Quantitative analyses examined changes in symptoms pre- to post-group, and qualitative analyses aimed to better understand fathers’ experiences and help guide future efforts to increase engagement of this population. A grounded theory approach was employed to analyze interview content, and two themes were identified reflecting a desire for (1) connection and (2) learning. The prominence of these themes both before and after group underscored the value of connection to others who shared experience and opportunity for learning effective parenting strategies. Corresponding quantitative analyses indicated a significant decrease in self-reported posttraumatic stress (p?<?.05) and trend level reduction in depression (p?<?.10), suggesting participation may contribute to more effective symptom management. Subgroup analyses contrasting the pre-group interviews of fathers who endorsed higher (n?=?9) versus lower (n?=?5) levels of symptoms revealed that those with greater symptomatology expressed more themes related to fear of committing to the program. Discussion will focus on effective outreach and engagement, and the need to align programs to the interests of previously deployed fathers of young children.     

Evaluation of a School—Juvenile Court team approach to delinquency prevention

The School-Juvenile Court Liaison Project was designed to assist schools and courts in working cooperatively to intervene in and prevent delinquency. Results of the evaluation indicate increased communication and joint service planning between the systems. School and court personnel are talking to each other more often about students who are involved with the court, as well as about general issues of school-court cooperation, and school and court staff are working together more frequently to develop treatment plans for such students. School-court teams have also been successful in developing interagency case staffing councils and prevention-oriented projects in their communities. Factors contributing to the project's success are discussed.     

Evaluation of the health risks to garment workers in the city of Xambrê-PR, Brazil

This study evaluated the risks for cardiovascular disease and the life habits of garment industry workers in northwestern Paraná state, Brazil. The following parameters were assessed: body composition, cardiorespiratory fitness, eating habits and physical activities by garment industry workers. Cardiovascular risk was observed in some of the studied subjects, in the form of high BMI and reduced maximal oxygen uptake. The development of a workplace quality-of-life program is suggested, aiming to stimulate the development of physical activities to improve the cardiovascular conditioning of workers.     

Schema via Structure? Personal Network Density and the Moral Evaluation of Infidelity

This article considers whether the density of a person's social network is related to his/her moral attitudes toward infidelity. Integrating recent sociological thinking on moral schemas with network theory's insights about deviance and structural independence, I employ data from a representative sample of American men aged 57–85. Findings indicate that men with the densest personal networks are least likely to condone infidelity. This association, moreover, was independent of men's education, their beliefs about religion and sex, and attitudes about their partners, among other factors. The findings imply an affinity between micro‐social structure and moral judgment, suggesting that network density can help constrain even the expression of moral attitudes.     

Does it make a difference? Evaluation of a Canadian poverty reduction initiative

Program evaluation is an important aspect of any organization. The ability to reflect on past performance and plan for the future is essential to an organization’s health and future growth. This exploratory study is part of a larger program evaluation initiative that examined the efficacy of a regionally based organization that provided funding to community groups to alleviate poverty. The purpose of the study was to explore testimonials provided by participants of the organization’s funded programs, to determine if the participants were satisfied with the programs and the extent to which participants’ perceptions are congruent with the goals of the organization. Content analysis was used to examine 3494 testimonials from 77 different agencies. Three overall themes were determined from the analysis: 1 Developing Social Networks, 2 Learning Comes in Various Forms, and 3 Developing Self-Efficacy. Findings from the testimonials suggest that the benefits of the programs are highly social and that connections with others are important, but also provide rich opportunities for learning new skills and knowledge, as well as gaining confidence and a sense of control. The findings from this analysis support one goal of the organization which is to engage people living in poverty in meaningful ways.     

Teaching Note—Evaluation of an Avoiding Plagiarism Workshop for Social Work Students

A 1-hour workshop on how to avoid plagiarizing when writing academic papers was developed and delivered at an orientation session for BSW and MSW students at a university in the northeast United States. Six social work instructors led the workshops at the university’s main campus and two extension centers. Before and after the workshop, students read an original passage from a social work text and were asked if the material were paraphrased in four different ways would it constitute plagiarism. Pre- and posttest results indicated that the workshop increased the percentage of students who could correctly identify examples of plagiarism versus ethical writing. Implications for social work education are discussed.     

Helping Dual-Earner Couples Manage Work–Partner Interferences: A Program Evaluation

This study explored the effectiveness and informed further development of a brief intervention designed to teach couples strategies for managing interferences from work to their romantic relationship. A pretest/posttest design with a control group measured the impact of the intervention on married couples’ work–partner balance skills and strategies and their relationship satisfaction. Couples in the intervention group improved in areas of work–partner balance compared with the control group, but there was no difference in relationship satisfaction between groups. The program was most effective for women. Based on these findings, we discuss program strengths, areas for improvement, and future directions for work–partner management programming.     

‘I Hate It,But It Still Sounds Good’: Collective Identity and the Evaluation of Oppositional Frame Resonance

While activists often respond to claims advanced by their opposition, little is known about how oppositional rhetoric is evaluated. This study focuses on the evaluation process, examining how movement actors assess the resonant appeal of oppositional frames. I analyze how activists in the American pro-choice movement respond to a faction of the pro-life movement that primarily frames abortion as harmful to women. Drawing on focus group conversations with pro-choice activists, I find feminist collective identity and their own experience advancing gendered frames influence which oppositional frames pro-choice actors consider most likely to resonate with a non-activist audience. These judgments subsequently guide decisions about how to respond to oppositional frames and construct of counterframes. I find activists to use collective identity to rule out potential strategies and tactics they feel are in conflict with what the group represents. I argue that in cases where similarities exist between frames and counterframes, experience advancing rhetoric superficially similar to that of the opposing movement provides strategic insight. Movement actors draw on lessons learned from their own collective framing experiences to evaluate how audiences will respond to oppositional frames with comparable cultural themes. These experiences serve as a guide, informing activists' perceptions of the frames a non-activist audience will be most likely to embrace, which frames must be addressed, and which can be safely ignored. This study emphasizes movement actors' agency and strategic decision-making processes, demonstrates how collective identity influences the framing process, and contributes to knowledge of how group experiences and identity affect perception and strategy.     

Evaluation of job satisfaction in a sample of Spanish social workers through the ‘Job Satisfaction Survey’ scale

The objective of this study is to determine the level of job satisfaction experienced by social workers and to establish whether there are significant differences between the various levels of job satisfaction and a series of personal features and job characteristics. The participants were 947 social workers (861 women and 86 men) belonging to 35 of the 36 Professional Associations existing in Spain. The measurement tool used is the Job Satisfaction Survey scale, designed by Spector [2002. Psicología Industrial y Organizacional: Investigación y Práctica [Industrial and organizational psychology: Research and practice]. México: Manual Moderno]. The results show that the social workers surveyed experience moderate levels of job satisfaction (M?=?115.8; SD?=?21.4). The intrinsic factor that seems to have the greatest positive influence on job satisfaction is the nature of the job, while the extrinsic factors of pay, fringe benefits, and operating conditions are the ones that contribute most to job dissatisfaction, and social workers have no control over any of them.