Towards a faith-based program theory: a reconceptualization of program theory

A meta-program theory is proposed to overcome the limitations and improve the use of program theory as an approach to faith-based program evaluation. The essentials for understanding religious organizations, their various programs, and faith and spirituality are discussed to support a rationale for developing a faith-based program theory that captures the complex nature of religious program phenomena. Implications for public policy are examined. New concepts based on structural approach and four program theories are formulated for program analysis. Several theoretical concepts for faith-based program evaluation to guide methods for describing patterns that reflect the religious beliefs and values are suggested.     

Community-Based Program Research

ABSTRACT

At first glance, the worlds of program professionals and evaluators may seem quite separate. However, there are common issues whose resolution will enhance both program development and research on programs. Program professionals and evaluators have a great deal to learn from each other. As that learning occurs, both program delivery and evaluation research will benefit. Both are concerned about matters of validity, whether it pertains to the nature of the program intervention itself or to the nature of the assessment of the program intervention. To reinforce the development of program evaluation in partnership, this paper discusses key points about evaluation research relevant to both program professionals and researchers. These include the contextual influences on a program, the “readiness” of a program for evaluation, and whether the evaluation research “works” for the program. Underlying our discussion is a call for the development of partnerships around research on programs. In that light, this article elaborates the process steps that should be taken to build program evaluation partnerships, including a discussion of what evaluators and program professionals need to know about each other, and their respective values, interests, and professional perspectives.     

The State of Our Art

Abstract

In this two-part paper, the author examines inter-generational program research and evaluation based on a framework derived from a collaborative UNESCO (2000)-sponsored review of the intergenerational program field. In Part One, conceptual foundations for intergenerational programming are considered, taking into account theories that focus on individuals and groups within interactive contexts, those that focus primarily on individual development, and conceptually based program evaluations. In Part Two, appearing in the next issue of this journal, effects of intergenerational program participation are described, with emphasis on program activities and various program contexts. Challenges and questions emerging from the literature are presented, identifying the need for a greater use of theory in research, more cross cultural research, expanded outcomes, and solutions to some of the methodological challenges in intergenerational program research and evaluation.     

The State of Our Art

Abstract

In the second part of this two-part paper, the author examines intergenerational program research and evaluation based on a framework derived from a collaborative UNESCO (2000)-sponsored review of the intergenerational program field. In Part One, which appeared in the previous issue, conceptual foundations for intergenerational programming were considered, taking into account theories that focus on individuals and groups within interactive contexts, those that focus primarily on individual development, and conceptually based program evaluations. In Part Two, effects of intergenerational program participation are described, with emphasis on program activities and various program contexts. Challenges and questions emerging from the literature are presented, identifying the need for a greater use of theory in research, more cross-cultural research, expanded outcomes, and solutions to some of the methodological challenges in intergenerational program research and evaluation.     

Building Community Capacity to Help Persons with Mental Illness

Abstract

In a time of crisis, persons with mental illness who encounter the police are often sent to jail or are involuntarily committed for psychiatric evaluation when mental health services are not readily available. To better serve these persons and the community, law enforcement and mental health professionals in one Iowa county joined together to ensure these individuals received the assessment and treatment needed. The results of a mixed methods program evaluation are detailed and suggest that the process to develop the program was as critical as the conduct of the program itself. Implications for program development are discussed.     

An evaluation of substance abuse aftercare program for homeless women with children using confounding variable-control design

An outcome evaluation of a substance abuse aftercare program for homeless women with children was conducted using confounding variable-control evaluation design. The confounding variables are chosen from pre-treatment and other contextual variables of the clients that are known to have significant influence on the program outcome, but those that could not have been influenced a priori by the client involvement in in-treatment program activity at Transition House (TH). The latter is the independent variable of this evaluation design. The pre-treatment variables are measured by severity of alcohol and other drug (AOD) problems of the clients, their mental health status, age, and their job status before enrollment in the program. The contextual confounding variables are composed of family and social support available to the clients before and during recovery. While applying multiple regression analysis, we were able to explain 50.8% of the total variance in program outcome by four pre-treatment variables. By adding two contextual variables of family and social support, the total variance in program outcome explained is increased to 64.1%. Finally, by adding the degree of client involvement in in-treatment program activity, we were able to augment the total variance of the program outcome to 69.7%. By estimating the changed variance of program outcome by the in-treatment program activity during the final step, controlling for all other variables previously entered, we were able to establish that client involvement in in-treatment program had unique and positive impact on the program outcome distinct from those explained by the confounding variables. The additional variance uniquely added by in-treatment program activity is 5.6% (p < .001). It has been determined that the degree of client involvement in in-treatment program had positive and systematic impact on the program outcome.     

ViSC Social Competence Program

The ViSC Social Competence Program has been implemented in Austrian schools within the scope of a national strategy plan, Together Against Violence. The program is a primary preventive program designed for grades 5 to 8. The prevention of aggression and bullying is defined as a school development task, and the initial implementation of the program lasts one school year. The program consists of universal and specific actions that are implemented through in-school teacher training and a class project for students. The program was evaluated with a randomized intervention control group design. Data were collected from teachers and students. Results suggest that the program reduces aggression in schools.     

Efficacy of Work-Based Training for Direct Care Workers in Assisted Living

This article reports on the efficacy of a work-based learning program for direct care workers in assisted living. The program goal was to improve skills and facilitate career development. The training program had positive impacts at both individual and organizational levels. Survey data found that workers felt more competent and self-confident about their abilities to work with residents. Furthermore, increasing satisfaction with the training program over time led to greater job satisfaction and a desire for additional education. Organizations have better outcomes when workers are well trained, feel empowered, and are satisfied with their work. Policy implications for assisted living settings and meeting the growing demand for a competent direct care workforce are discussed.     

The Role of Maintaining Telephone Contact with Parents During the Teaching of a Personal Safety Program

Although recent evidence suggests that parents can be effective instructors of a personal safety program, the extent to which these results depend on maintaining contact with parents during program implementation has yet to be determined. This study examined the effectiveness of a program when taught by parents who either were or were not contacted during the teaching of the program. Preschool-aged children in both groups demonstrated enhanced knowledge and skill gains relative to children assigend to a delayed treatment control group. Low-income preschoolers learned prevention concepts and skills without being upset by the program, and their parents also appeared to benefit from teaching the program. However, the probability of completing the program was higher for parents who were contacted throughout program implementation, suggesting that personal contact may enhance motivation for some parents. Implications of the study for the child sexual abuse prevention field are discussed.     

Using macro variables in program evaluation

This paper discusses the importance of using macro-level variables for program analysis. It is argued that three types of macro variables--cultural, economic, and demographic--provide a context for evaluation, and offer alternative explanations for the success or failure of a program. The problems of causality and availability of data are discussed. Macro variables are seen to be especially useful in "meta evaluation," and in integrating the results of specific program evaluations into general conclusions.     

Implementing integrated pest management in professional lawn care: a case study

Human choices regarding land cover management practices may influence ecosystem services provided by urban green spaces. We conducted a 2-year study to compare biological (weed, insect, and disease), aesthetic (lawn quality), and economic (lawn care program cost) attributes of an integrated pest management (IPM) program, in which pesticides are applied on the basis of treatment thresholds, with a standard program, in which pesticides are applied on a calendar basis without pest monitoring. Both programs were managed by a professional lawn care operator. Although weed incidence was low, the IPM program had significantly more lawns with weed presence than the standard program during 2005 and 2006. However, only 21% of the IPM lawns required herbicide applications in 2005, and none exceeded the treatment threshold (5% weed cover) in 2006 as compared to 100% of the standard program lawns being treated for weeds in both years. The IPM program also had significantly more lawns with insect damage than the standard program during June 2005 and August 2005, but not September 2005 and throughout 2006. Only 28% of the IPM lawns required insecticide applications in 2005 and none exceeded the threshold (5% insect damage) in 2006 whereas all of the lawns in the standard program received insecticide treatments in both years. Rhizoctonia blight was present on some of the lawns, but was not a common problem. Although lawn quality was high for both programs (>8, on a scale of 1–9), it was significantly higher for standard than for IPM program lawns during 2005, and June 2006 and September 2006, but not August 2006. The annual lawn management costs were lower for the IPM (281.50) than the standard program (281.50) than the standard program (458.06). Thirty one percent of the IPM program customers who continued with the study in 2006 did so because they were satisfied with the IPM program. Among those who did not continue with the program, 33% cited weed or insect problems, while 33% expected better results. The implications of these findings for implementation of IPM in professional lawn care are further discussed.     

Looking Inside the “Black Box”

Abstract

The continued devolution of social welfare systems and services in the U.S. resultsin high stakes program evaluations in the field of family support and early intervention. Programs are expected to utilize evidence-based interventions and to demonstrate effectiveness. A look at implementation helps to differentiate between theories that do not work and programs that are not effective. Methods for identifying program implementation are needed. In a 17-site program evaluation, the author and her colleagues developed a methodology for measuring implementation and demonstrated the effects of differential implementation in understanding program outcomes.     

Evaluation of the RAINN National Sexual Assault Online Hotline

ABSTRACT

This article describes the evaluation of rainn National Sexual Assault Online Hotline, a new model for delivery of rape and sexual assault crisis services through a secure, confidential chat-based online hotline. Outcome data from 623 visitors and 54 volunteers for the first 11 months of the program are presented. The results indicate that the model is viable and useful for approximately 80 percent of visitors, and volunteers are satisfied with the program. Recommendations for program development and further research are presented.     

The problem of replicability in program evaluation. The component solution using the example of case management

Specificity and replicability of a program are crucial in order to rigorously evaluate the program's effectiveness. However, the traditional approaches to evaluation have ignored the problem that most social and mental health programs consist of vaguely specified interventions and cannot meet minimal standards of replicability. Consequently, the results of effectiveness evaluations of poorly defined programs have little general generalizability. Nevertheless, effectiveness information concerning su ch programs is much needed. One solution to this problem is to focus on program components, examining interventions at a level where operational definitions can be employed and replicability is possible. In this paper, this approach is expanded using the example of case management programs. A component-oriented approach ensures a systematic evaluation of program effectiveness for which the first question for evaluators is whether a program consists of interventions that reliably produce specific immediate outcomes. Then, and only then, is it possible to address questions concerning whether a program will reliably produce those outcomes that are the overall objectives of the program.     

Chapter 11: Motorola Drives Strategic Initiatives Through Collaboration and Interdependence

Abstract

This article describes an integrated approach to implementing a wellness program in a corporate setting. Motorola's wellness program is reviewed, including its history, rationale and strategic focus. Successful integration partners are identified, and strategies for integrated programs are outlined. Education, communication and prevention initiatives and program components are discussed, including recommendations and shared learnings for both small and large-scale wellness programs.     

Pilot Evaluation of a Sexual Abuse Prevention Program for Taiwanese Children

The purpose of the current study was to develop and evaluate the efficacy of a school-based child sexual abuse prevention program for Taiwanese children. Forty-six Taiwanese children age 6 to 13 were divided into one of two groups based on their school grade and then randomly assigned to a skills-based child sexual abuse prevention program who received training immediately or a waiting-list control condition who received the training after a delay. Children's self-protection skills improved regardless of age after participation in the program. The program, however, did not successfully improve children's knowledge of sexuality and safety. Although future studies should modify the program content to better target knowledge of sexuality and safety, these results are promising for a pilot of this skills-based CSA prevention program in Taiwan.     

The Interrelationship Between Program Development Capacity and Readiness for Change Among Small to Mid-Sized Nonprofits

ABSTRACT

Based on survey data from 396 small to mid-sized nonprofit organizations operating within Southeast lower Michigan, this article examines the relationship between program development capacity and readiness for change and the predictors of these two components of capacity building among small to mid-sized nonprofits. It uses a simultaneous equation approach as the basis for examining the relationship between program development capacity and readiness for change. The findings indicate that program development capacity and readiness for change are mutually enforcing processes and that the levels of program development capacity and readiness for change are predicted by two distinct sets of predictors.     

Evaluating program effects: Conceptualizing and demonstrating a typology

Outcome evaluation is very important for program evaluation and has been becoming increasingly so in the age of accountability. Typically, outcome evaluation is conducted for a single program from a single perspective. However, in a real-life situation, many programs exist in a system, and the effects could be viewed from various perspectives. The authors illustrate a typology of program effects in a system. It moves from the paradigm of a single program’s single effect to that of a set of programs’ multiple effects. Methodological implications are discussed.     

Empowering Lesbian and Gay Foster Adolescents Through Mentoring Relationships

This article discusses a mentoring model as a resource for lesbian and gay adolescents in foster care. Interview data collected in a national study of foster adolescent mentoring programs led to the identification of elements of succesful programs. The authors apply these elements to the design of a model mentoring program for lesbian and gay adolescents. Such a model program would help to alleviate problems that are related to isolation, stigmatization, and lack of positive lesbian and gay role models. Selected lesbian and gay youth vignettes are described and implications drawn for program development.