Mentoring At-Risk Latino Children and Their Parents: Impact on Social Skills and Problem Behaviors

The Family Mentoring Project, which provided approximately one year of mentoring for at-risk 10-year old Latino children and their parents, aimed to provide not only service but empirical evaluation of the program's impact. This University-community partnership offered individual mentoring, a group educational component for children and parents, and group social/recreational activities. A pre- and post-test analysis of 11 non-mentored and 20 mentored youth revealed positive gains on social skills for mentored children as reflected in self-ratings and mothers' ratings on the Social Skills Rating Scale (SSRS). Also based on the SSRS, mothers reported decreases in three problem behaviors for mentored children. In addition, by post-testing, the mentored children and their mothers compared very favorably with the SSRS standardized samples on both skills and problem behaviors. The findings suggest that bicultural competence may be fostered by programs that provide consistent and long-term mentoring, involve the children's families, include group educational components, and bring families and mentors together for social/recreational events.     

Quality and effectiveness of PHC level class room training under MPW scheme

Government of India have prescribed duration, curriculum and trainers for training of PHC field staff under multipurpose workers' scheme. The extent of implementation was studied in three States. Quality of training was also observed and its impact on knowledge and understanding was determined by comparing pre- and post-test scores on different subject areas. Centralised strategy for class room training with HFWTC as the venue was found to offer several advantages. By and large, Government of India's prescribed curriculum had been followed. Deviation had taken place mostly in the type of trainers. Topics and their sequence were well covered. There was, however, little use of training techniques to promote understanding and participation. In particular, there was lack of teaching aids at PHC level class room. Male field staff showed greatest need and profitted most from the training. Knowledge of maternal and child health and family welfare was least in both male and female staff before and after the training. Administrative factors affecting MO of PHCs as trainers were also determined. This is second in the series of papers based on the project findings.     

Establishing Positive Youth Development Approaches in Group Home Settings: Training Implementation and Evaluation

This article reports on a training program for group home supervisors that was designed to utilize positive youth development principles in work with youth transitioning from care to independent living. Over a period of 5 months, eight one-day training sessions took place across one state in the U.S. (Massachusetts) with a total of 186 group care staff in attendance. The evaluation consisted of three components: observation of participant feedback during training, training day post-test, and follow-up with participants 2–3 months after training. Implications of the data, particularly barriers to implementation of training programs, are discussed.     

To Live More Comfortably with Difference An Interview with Peter Churven

Peter Churven's name has been associated with family therapy in Australia since the early days. He is remembered as the original Director of Redbank House (which pioneered whole family admissions), and for his forceful presence as the Foundation President of the N.S.W. Family Therapy Association. He was recently elected as a member of the Board for this journal. As you read his words, imagine him now and then pausing to think, swivelling in his chair, so that the creaking acts as punctuation.     

Mental health acuity system. The measure of nursing practice

As the mental health unit continues working with the acuity system, areas within the system can be improved, such as simplifying the number of behavioral emergencies and decreasing any overlap of behavioral categories. As the supervisor anticipates "fine-tuning" the system, the process of obtaining feedback from the majority of nursing staff on the unit and involving the senior staff nurses as a group in any revisions will be repeated. The sense of the mental health acuity system at St. Francis Hospital is that it reflects all the intricacies of the work that the mental health staff perform. This validity needs to be maintained throughout any revisions because it is integral to continuing the excellence of the system. The mental health staff knows best the work that they perform daily and this acuity system validates the quality and quantity of the care.     

Single-case Design: The Neglected Alternative for the Evaluation of Family Therapy*

Family therapy (as with other treatment forms) needs to demonstrate its efficacy, but a major obstacle to the development and evaluation of therapeutic techniques in family therapy in particular, has been the almost total reliance on what is called classical group comparisons (e.g., treatment versus no-treatment groups). The focus on group comparisons, however, has meant a complete disregard for a methodology that is also highly appropriate; single-case design (or intrasubject replication) where the sample size is N = 1. In recent times, there has been an increasing disenchantment with classical group design for a number of reasons. For example, group comparisons are not always feasible in many clinical settings and tend to lack relevance for the practitioner's daily functioning. This paper elaborates these kinds of reasons and outlines the major advantages of using single-case design. There is little doubt that single-case methodology is becoming increasingly popular as an important research tool that can no longer be disregarded. Its specific applicability to evaluative research in family therapy is particularly appealing.     

Impact of Social Work Spirituality Courses on Student Attitudes,Values, and Spiritual Wellness

Abstract

This paper describes the development and evaluation of two courses in spirituality offered at the graduate and undergraduate levels. The courses have been offered for the last three years and an evaluative instrument, the Spiritual Wellness Inventory (SWI), was utilized as a pre- and post-test for each class. Results showed a significant increase in five dimensions of spiritual wellness and will be described in detail.     

Analysing domestic activity to reduce household energy consumption

This paper presents our reflections on the issue of behavioral change according to energy conservation constraints and on the status of sustainability in the design of ambient interactive systems at home. We point out how ergonomics contributes to the study of human factors underlying energy consumption. Relating to situated cognition and human computer interaction, our approach relies both on the ergonomic evaluation of feedback consumption displays and on the modeling of domestic activities in order to identify household concerns in real settings. We present empirical results to illustrate this global approach. The results of those studies allow the design of interactive systems: informative and pedagogical systems as well as pervasive and adaptive ambient systems. In our approach, sustainability is taken into account as a design criterion, as security could be, whereas the main design purpose is to aid households in their daily life in order to build a "sustainable situation".     

Pre-, post-, and longitudinal evaluation of juvenile justice education

This article describes two stages of the Juvenile Justice Educational Enhancement Program's pre-, post-, and longitudinal evaluation research. Pilot studies were used to explore how to design statewide research of pre- and postassessment scores and community reintegration outcomes. Preliminary findings suggest that higher performing educational programs produce greater educational gains as measured by academic achievement tests, credits earned, and pupil progression rates. The findings also indicate that these programs have more students returning to school and lower recidivism rates. Building on the pilot studies, refinements were made to the research designs to enable more comprehensive statewide evaluation. Current research includes collection of pre- and postassessment scores from official sources on approximately 16,000 juvenile justice youths. In addition, a research design has been developed to examine program effectiveness by measuring community reintegration variables. Multiple data sources, including official and self-reported data on family, school, employment, and subsequent crime involvement, will be used in the longitudinal study.     

A New Kind of AIDS: Adapting to the Success of Protease Inhibitors in an AIDS Care Organization

Using a case study analysis of Heath House, a Santa Barbara residential care facility for People Living With HIV/AIDS, this paper examines the effects of protease inhibitors on the life of an AIDS care organization. The case of Heath House reveals that when care providers are committed to static conceptualizations of an epidemic and its victims, and have defined the value of their work in relationship to these conceptualizations, new technologies threaten organizational identity and stability. While prior research on goal displacement has emphasized the process by which an organization's members lose sight of their original goals to achieve greater efficiency or legitimacy, this study offers an example of the process by which members adhere to original goals and ideologies, even when change becomes necessary for organizational survival. This article examines tensions between residents and staff at Heath House that occurred when the very institutional culture that allowed it to thrive became anachronistic as AIDS changed. I explore problems of internal dissent and external problems of legitimacy.     

Variation in White House Polling Operations: Carter to Clinton

Using an entirely new data source, this article presents evidencethat significant variation exists in how much different presidentialadministrations use private White House polls. Federal ElectionCommission (FEC) disclosure records reveal the amount of moneythat presidents since Jimmy Carter paid (through their respectiveparty organizations) to the designated White House pollsters.These financial figures, in turn, roughly correlate with theestimated number of polls commissioned for the White House,as determined through archival research and information providedby the pollsters themselves. Two patterns emerge: some presidentspoll heavily from the start of their administrations (RonaldReagan and Bill Clinton); others poll only lightly during thefirst 3 years in office (Jimmy Carter and George Bush). Thesefindings reinforce scholarly assessments of Reagan and Clintonas pursuing a "permanent campaign" approach to leadership, whereasCarter and Bush lacked much interest in public relations techniques.Our evidence suggests a need for a refinement of the institutionalizationconcept as found in the academic literature on White House polling.We agree that all modern presidents inherit sophisticated toolsfor understanding public opinion, but we demonstrate that theydo not use these tools with equal attention or regularity. Putdifferently, a polling capability has been institutionalizedwithin the White house, but substantial variation still existsin how much a given administration uses that capability.     

The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts

This article contributes to the growing literature on evaluation and implementation science by examining the interaction between staff perceptions of organizational strength with perceptions and indicators of program fidelity. As part of a pilot project related to the evaluation of the Family to Family initiative, a survey was distributed to employees within two urban child welfare agencies with a total of 410 respondents across both sites, for a combined response rate of 72.2%. Survey results were analyzed both in terms or respondents' perception of their agency as well as in relation to measures of program performance and workload. Multivariate models show that organizational indicators are the most significant and positive predictors of perceived program implementation. Specifically, staff who positively perceived the availability of information within their agency also believed that the programs were well implemented in their agency. These findings suggest that as the value of program changes are articulated within an organization, the implementation of the initiative is perceived to improve.     

The teaching-family model: Research and dissemination in a service program

The Teaching-Family Model serves as an example of how research can be used as feedback to change a residential treatment program for youths. Further, research can serve to modify training and evaluation of the program as well. The feedback loop established by continual research and evaluation serves to improve program quality, thus facilitating dissemination as the model is adopted by more agencies.From 1967 to 1980, the Teaching-Family Model expanded from one group home in Kansas to more than 150 homes across the United States. Through both successes and failures, proponents of the Teaching-Family Model learned that research and evaluation can and must be a part of the treatment delivery system rather than an occasional adjunct.     

Using an action research approach to involving service users in the assessment of professional competence

This paper reports on a piece of action research that has involved people who use mental health services in systematically providing feedback from a user perspective on participants’ assessed work completed for one module of a masters’ training programme in mental health. In an attempt to improve professional practice and include people who were accessing mental health services in so doing, it outlines how users were trained to provide feedback and the training methods employed. The findings summarise the kind of issues users raised in their feedback to participants about the evidence professionals provided to demonstrate their learning from the training programme. A focus group interview with professionals provides a contrasting insight into the participants’ experience of having their work commented upon from a user perspective. The paper draws on the experience of a five-year external evaluation of an interdisciplinary programme in community mental health at Birmingham University in the UK which has highlighted the involvement of people who use mental health services as a particular innovation in the design, delivery and evaluation of the curriculum.     

An application of the Impact Evaluation Process for designing a performance measurement and evaluation framework in K-12 environments

This article illustrates the application of the Impact Evaluation Process for the design of a performance measurement and evaluation framework for an urban high school. One of the key aims of this framework is to enhance decision-making by providing timely feedback about the effectiveness of various performance improvement interventions. The framework design process is guided by the Impact Evaluation Process, and included the participation of key stakeholders including administrative and teaching staff who all contributed to the performance measurement and evaluation framework design process. Key performance indicators at the strategic, tactical, and operational levels were derived from the school vision, and linked to specific interventions to facilitate the continuous evaluation and improvement process.     

Maisons Familiales -- Senegal

The local associations of Maisons Familiales (MF) in Senegal periodically conduct participatory evaluations of community projects. 2 evaluations often used include internal exercises by and for the staff, such as a written questionnaire, and an assisted self evaluation. An assisted self evaluation often involves participant subgroups discussing problems and possible solutions with each subgroup later sharing items with a national and/or a foreign evaluation facilitator. The facilitator(s) meets with all the subgroups and brings out important issues in the subgroups, then all the subgroups discuss the issues and form a consensus on what actions should be taken. The training staff at an MF center thought the program was fine based on what a few people said, but, after looking at statistics on the number of trainees over a couple of years, the staff learned that the numbers have declined. The staff then discussed the situation and learned that a barrier had developed between the training staff and villagers. As in any evaluation, one must distinguish between the subjective view (what people say) and objective reality (the actual situation using data). In another type of self evaluation, a group discussed dynamism in a village and came up with 4 different points of view. After visiting a "dynamic" and a "nondynamic" village using the 4 points as measurements, the group learned that its previous impressions of the 2 villages were not completely borne out. This evaluation helped the staff to see villagers' priorities and to listen better. Despite wanting to conduct a real impact evaluation, workers have not yet done so because they do not have time to schedule evaluations, do not have enough base line data, and do not know how to account for influences on changes in the villages other than the MF training programs.     

An application of the Impact Evaluation Process for designing a performance measurement and evaluation framework in K-12 environments

This article illustrates the application of the Impact Evaluation Process for the design of a performance measurement and evaluation framework for an urban high school. One of the key aims of this framework is to enhance decision-making by providing timely feedback about the effectiveness of various performance improvement interventions. The framework design process is guided by the Impact Evaluation Process, and included the participation of key stakeholders including administrative and teaching staff who all contributed to the performance measurement and evaluation framework design process. Key performance indicators at the strategic, tactical, and operational levels were derived from the school vision, and linked to specific interventions to facilitate the continuous evaluation and improvement process.     

Prevention of family maltreatment in the U.S. Air Force: A systematic review of research on active-duty military personnel

ABSTRACT

Systematic review procedures are used to empirically evaluate the “implicit” logic model that guides the Air Force Family Advocacy Program’s secondary prevention efforts of family maltreatment among active-duty Air Force members. Searches of seven electronic databases and manual searches of 10 journals yielded 586 peer-reviewed articles published in 2000 or later. This review synthesizes the findings of 23 quantitative studies meeting inclusion criteria, including the prediction of some form of family maltreatment among U.S. active-duty military members. Based on review results, we identify critical success variables that function as family protective factors to decrease the likelihood of family maltreatment. These modifiable variables include formal supports, such as ecosystem supports from installation and unit leaders; informal supports, such as the social support of fellow service members and their families; and safe, stable, and nurturing family processes. The results generally align with the implicit logic model but suggest the model should be extended to include intrapersonal vulnerabilities and assets as well as contextual risks and assets. In addition to informing secondary prevention efforts in the Air Force, this novel use of systematic review procedures offers a strategy for evaluating logic models in other areas of prevention research, practice, or policy.